AI Incident Database

Volkswagen's IDA voice assistant system incorrectly activated and made unintended emergency calls, causing false alarms to emergency services and operational disruption.

An AI triage system at a Dutch hospital incorrectly classified emergency patients, sending high-acuity cases to lower priority queues. The incident highlights risks of automated medical decision-making without adequate human oversight.

Throughout 2024, federal judges sanctioned multiple attorneys across the US for filing legal briefs containing AI-hallucinated case citations. The pattern of fake precedents undermined court proceedings and prompted new disclosure requirements.

Multiple peer-reviewed journals discovered hundreds of AI-generated papers containing telltale phrases like 'As an AI language model,' leading to mass retractions by Wiley and other publishers in 2024.

AI-powered homework tools including PhotoMath and Chegg AI provided incorrect mathematical solutions to students, causing wrong submissions and misinformed learning processes.

Research revealed that AI essay grading systems systematically gave lower scores to essays when student names suggested African American identity, demonstrating concerning racial bias in educational AI tools.

Criminals used AI-generated deepfake audio impersonating a Fortune 500 CEO to manipulate stock prices, causing $25 million in investor losses before detection. The scheme highlights vulnerabilities in financial market authentication systems.

DoNotPay's AI chatbot marketed as 'robot lawyer' provided inaccurate legal advice, leading to FTC settlement of $193K for unauthorized practice of law.

Google's Gemini AI image generator exhibited severe bias by refusing to create images of white people and generating historically inaccurate depictions. Google paused the feature after widespread criticism.

AI-powered traffic enforcement cameras systematically issued false tickets to vehicle shadows, reflections, and cars in wrong lanes due to computer vision failures. Hundreds of drivers affected across multiple jurisdictions with ongoing litigation challenging automated enforcement accuracy.

Microsoft Copilot generated inappropriate sexual and violent content about real public figures in early 2024, exposing weaknesses in content filtering systems despite existing safety measures.

Air Canada's customer service chatbot told passenger Jake Moffatt he could book a full-price ticket and retroactively claim a bereavement discount within 90 days. This policy did not exist. When Moffatt tried to claim the discount, Air Canada refused, arguing the chatbot was wrong. A tribunal ruled Air Canada must honor the chatbot's promise.

Microsoft Copilot for 365 exposed confidential documents by leveraging overpermissioned SharePoint and OneDrive access, allowing users to discover sensitive information through AI-powered search that they shouldn't have been able to access.

JPMorgan Chase's AI financial insights tool incorrectly categorized customer transactions and provided flawed budget recommendations, affecting 45,000 customers and leading to poor financial decisions.

Hong Kong employee lost $25.6 million after being deceived by deepfake video call impersonating company CFO. Police investigating this sophisticated AI-enabled fraud targeting corporate finance operations.

A finance worker at UK engineering firm Arup (known for designing the Sydney Opera House) was tricked into transferring $25.6 million to fraudsters who used deepfake technology to impersonate the company's CFO and other colleagues during a video conference call. Every other participant on the call was a deepfake.

AI-generated explicit images of Taylor Swift went viral on X in January 2024, accumulating tens of millions of views before removal and prompting congressional action on deepfake regulation.

AI-generated explicit images of Taylor Swift spread across X/Twitter, reaching millions of views before removal. The incident prompted congressional action on deepfake legislation and platform policy changes.

AI-generated robocalls mimicking President Biden's voice were sent to New Hampshire voters before the 2024 primary, discouraging voting participation and prompting FCC enforcement action.

Political consultant used AI voice cloning to create robocalls impersonating President Biden, telling New Hampshire voters not to participate in the 2024 Democratic primary. The FCC imposed a $6 million fine and declared AI-generated voice robocalls illegal.