MyCity Business Chatbot — New York City's AI Assistant Told Business Owners to Break the Law
United States of America
NYC's MyCity Business chatbot, launched October 2023 on Microsoft Azure AI, was found in March 2024 to routinely give illegal …
United Kingdom · London · See the United Kingdom profile · See the London profile
Top 65% 53/100 · Ask Evidence Copilot about this practice
Piloted May-December 2024, the Home Office's ACS and APS tools cut asylum casework time by up to an hour per case, but its own evaluation found 9% of AI summaries too flawed to use and almost a quarter of caseworkers lacked confidence in the outputs, ahead of a January 2026 wider
Facing an asylum backlog of more than 62,000 applications awaiting an initial decision as of September 2025, the UK Home Office piloted two generative-AI tools between May and December 2024: Asylum Case Summarisation (ACS), built on ChatGPT-4 to condense asylum interview transcripts, and Asylum Policy Search (APS), which retrieves and summarises country-of-origin policy guidance for caseworkers.
A Home Office research note reported that ACS saved decision-makers an average of 23 minutes per case and APS saved 37 minutes searching policy material — up to an hour combined — with neither tool appearing to change the quality of the final decisions in these small-scale pilots.
The same evaluation reported that 9% of ACS-generated summaries were flawed enough to be removed from the pilot, and that 23% of caseworkers lacked full confidence in the tools' outputs; civil-society reviewers separately noted the Home Office declined to disclose the prompts behind the tools or whether errors correlated with applicants' nationality or case complexity, and that asylum seekers are not told when AI is used in their case.
Both tools were designed to require a human decision-maker to review any AI output before a decision is made, and the Home Office's own research note recommends larger-scale evaluation before full rollout; ACS nonetheless proceeded toward a wider rollout in January 2026.
Read the full analysis: https://www.openrightsgroup.org/blog/saving-time-risking-lives-government-uses-ai-tools-to-inform-asylum-decisions/
Read the full analysis: https://www.ein.org.uk/news/home-office-expand-ai-use-asylum-decision-making-after-promising-pilot-results
Implementation detail (cost, timeline, staffing, conditions for success) is not yet available for this practice.
Do you run this practice? Claim it — verified implementers get a public contact pathway and can propose corrections.
Where this practice's information was retrieved from, and when.
United States of America
NYC's MyCity Business chatbot, launched October 2023 on Microsoft Azure AI, was found in March 2024 to routinely give illegal …
Australia
Australia's DTA ran the world's largest whole-of-government Copilot trial — 5,000+ staff, almost 60 agencies — with an independent Nous …
United States of America
New Jersey built its own secure generative-AI assistant for state workers, now used by 20,000+ of its 70,000 employees for …
Belgium
Since 2014, Belgium's federal social security service has used the MiningWatch data-mining tool to rank construction, cleaning and hospitality employers …
Open full copilot Grounded in cited practices — always check the sources.