SyRI — the Dutch welfare-fraud system struck down by the courts
Netherlands
SyRI linked citizens' data to flag welfare-fraud risk in poorer neighbourhoods. In 2020 a Dutch court halted it for violating …
Australia · Canberra · See the Australia profile
Services Australia's 2016–2020 income-averaging algorithm wrongly raised AU$1.75 billion in welfare debts against ~470,000 recipients. A 2023 Royal Commission ruled the scheme unlawful, triggering a AU$1.2 billion settlement and 57 governance recommendations.
The Robodebt scheme (July 2016 – May 2020) was operated by Services Australia (then the Department of Human Services) to automatically detect alleged overpayments of social security benefits. It cross-referenced Centrelink beneficiary records with averaged annual income data from the Australian Taxation Office, dividing a recipient's annual declared income into fortnightly estimates to infer undeclared earnings — a methodology valid for only about 7% of welfare recipients but applied universally without human review.
The scheme's stated purpose was to automatically detect and recover alleged welfare overpayments at scale, replacing case-by-case human review with an averaging algorithm applied across the entire caseload.
The algorithm issued approximately 470,000 automated debt notices totalling AU$1.75 billion. Recipients — many unemployed, disabled or experiencing financial hardship — bore the burden of proving the debts were wrong, often without access to the original income data used to calculate them.
A Federal Court approved an AU$1.2 billion class-action settlement in November 2020 (AU$1.872 billion in total including legal costs); the government simultaneously wrote off AU$1.75 billion in debts. The Royal Commission into the Robodebt Scheme (August 2022 – July 2023) concluded the scheme was 'a costly failure of public administration in both human and economic terms', describing the automated mechanism as 'crude, cruel and neither fair nor legal'. Commissioners documented 663 welfare recipients who died in the period shortly after receiving automated debt notices, and made 57 recommendations on human oversight, automated decision-making law, inter-agency data governance and accountability.
The scheme was discontinued in May 2020 after the government conceded in court it was unlawful. Amnesty International cited Robodebt in a 2023 report on automated risk-profiling systems as a case study of harm at scale caused by removing human oversight, and the case is now widely used in AI ethics and public administration curricula as a cautionary lesson on opaque, human-free algorithmic enforcement.
Where this practice's information was retrieved from, and when.
Netherlands
SyRI linked citizens' data to flag welfare-fraud risk in poorer neighbourhoods. In 2020 a Dutch court halted it for violating …
Malaysia
Bank Negara Malaysia (BNM) and PayNet's National Fraud Portal (April 2024) links 53 institutions via FNA graph analytics to trace …
Ireland
Since 2011, Ireland's Revenue Commissioners have used AI risk scoring (REAP) to target tax-compliance interventions; 290,000 data-analytics-driven interventions in 2023 …
Canada
Canada's IRCC uses an AI eligibility model to triage and auto-approve routine IEC work permits. Launched Nov 2023 with a …
Open full copilot Grounded in cited practices — always check the sources.