AI Incident Database

Serbian schools deployed AI facial recognition surveillance systems in 2022 without proper consent from students or parents. The deployment affected thousands of students and drew criticism from privacy advocates, leading to regulatory investigations.

The FTC ordered Weight Watchers to delete AI models trained on children's data collected through its Kurbo app without proper parental consent, marking the first 'algorithmic disgorgement' order requiring destruction of AI systems built with illegally obtained data.

Amazon Ring's AI-powered doorbell network shared user footage with over 2,000 police departments without warrants or user consent from 2019-2022, affecting millions of users before policy changes ended the practice.

DHS's HART biometric database, containing data from 260+ million people, failed privacy assessments and raised accuracy concerns. The GAO found inadequate oversight and civil liberties groups challenged the system's deployment.

Saudi Arabia's Neom megacity project includes comprehensive AI surveillance systems for facial recognition and behavioral tracking of residents. Leaked documents in 2022 revealed the extensive scope, drawing international human rights criticism.

Multiple EU data protection authorities fined Clearview AI approximately €60M total for collecting billions of facial images without consent, violating GDPR biometric data protections across Italy, France, UK, and Greece.

AI proctoring software used during COVID-19 remote learning recorded students in bedrooms and private spaces, leading to privacy lawsuits and many universities discontinuing the technology.

Clearview AI scraped 40+ billion facial images without consent to build a comprehensive surveillance database, resulting in $50+ million in fines and settlements across multiple jurisdictions for privacy violations.

Apple's Siri assistant inadvertently recorded private conversations due to false wake word triggers, with contractors regularly hearing confidential medical information and intimate moments, leading to a $95M settlement.

Bloomberg revealed Amazon employed thousands of contractors worldwide to listen to Alexa recordings from users' homes for speech training, exposing private conversations without adequate user consent and leading to privacy lawsuits.

Amazon Alexa recorded a Portland couple's private conversation about hardwood floors and sent the audio file to a random business contact due to a series of voice recognition errors and lack of user confirmation for sensitive actions.

Grammarly's browser extension contained a critical vulnerability that exposed all 22 million users' documents to any website they visited, discovered by Google Project Zero researcher Tavis Ormandy.

Target's pregnancy prediction algorithm correctly identified a teenage customer's pregnancy through purchase patterns and sent baby product coupons to her home, inadvertently revealing her condition to her father before she had disclosed it.