Australia's Robodebt AI Scheme Wrongly Demanded $1.7 Billion from Citizens

The Australian Government's Online Compliance Intervention (OCI) system, commonly known as 'Robodebt', operated from July 2016 to November 2019 as an automated debt recovery scheme targeting welfare recipients. The system used income averaging algorithms to identify potential overpayments by comparing welfare recipient declarations with Australian Taxation Office data. The fatal flaw was that the algorithm averaged annual income across 26 fortnightly periods, assuming steady employment, when most welfare recipients had irregular, casual work patterns with periods of unemployment between jobs. The automated system generated over 526,000 debt notices totaling approximately $1.7 billion AUD without human verification. Recipients received letters demanding repayment of alleged overpayments, with the burden of proof reversed - citizens had to prove they didn't owe money rather than the government proving they did. Many recipients faced demands for documentation going back years, which employers were not required to retain. The system particularly targeted vulnerable populations including single mothers, students, and people with mental health conditions. The human impact was devastating. The Royal Commission documented cases of recipients becoming homeless, suffering severe mental health deterioration, and in some cases, taking their own lives. Notable cases included Rhys Cauzzo, whose family attributed his suicide partially to Robodebt stress, and Jennifer Miller, who faced a $4,800 debt notice shortly before her death. The scheme caused widespread anxiety, financial hardship, and destroyed trust in government institutions among Australia's most vulnerable citizens. Legal challenges intensified as the scheme's fundamental illegality became apparent. In 2019, the Federal Court ruled in Amato v Commonwealth that the income averaging method was unlawful because it relied on assumptions rather than actual facts about employment periods. This led to the scheme's suspension and eventual abandonment. A class action lawsuit was filed, resulting in a $1.8 billion AUD settlement in 2020 - one of the largest government settlements in Australian history. The Royal Commission into the Robodebt Scheme, established in 2022, conducted a comprehensive investigation finding the scheme was 'crude and cruel' and implemented despite clear legal advice that it was unlawful. Commissioner Catherine Holmes found that senior public servants and ministers knew or should have known the scheme was illegal but proceeded anyway. The Commission made 56 recommendations for reform and referred several individuals for potential criminal prosecution. The Robodebt scandal fundamentally changed Australia's approach to automated government decision-making. It demonstrated the catastrophic consequences of implementing algorithmic systems without proper safeguards, human oversight, or consideration of vulnerable populations. The incident led to new requirements for algorithmic transparency in government and highlighted the critical importance of maintaining human judgment in systems affecting citizens' fundamental rights and welfare.