AI Incident Database

Volkswagen's IDA voice assistant system incorrectly activated and made unintended emergency calls, causing false alarms to emergency services and operational disruption.

Multiple peer-reviewed journals discovered hundreds of AI-generated papers containing telltale phrases like 'As an AI language model,' leading to mass retractions by Wiley and other publishers in 2024.

Multiple hospitals experienced critical failures of AI-powered medical imaging and diagnostic systems during ransomware attacks in 2023-2024, causing diagnostic delays and forcing emergency reversion to manual processes.

AI-powered homework tools including PhotoMath and Chegg AI provided incorrect mathematical solutions to students, causing wrong submissions and misinformed learning processes.

Research revealed that AI essay grading systems systematically gave lower scores to essays when student names suggested African American identity, demonstrating concerning racial bias in educational AI tools.

The EU AI Act became the world's first comprehensive AI regulation in March 2024, establishing risk-based classification system and strict requirements for foundation models and high-risk AI systems.

Deepfake audio technology was used to create fake CEO statements for stock manipulation. The SEC investigation highlighted vulnerabilities in financial information verification systems and the growing threat of AI-generated fraud in capital markets.

Criminals used AI-generated deepfake audio impersonating a Fortune 500 CEO to manipulate stock prices, causing $25 million in investor losses before detection. The scheme highlights vulnerabilities in financial market authentication systems.

DoNotPay's AI chatbot marketed as 'robot lawyer' provided inaccurate legal advice, leading to FTC settlement of $193K for unauthorized practice of law.

Google's Gemini AI refused to state that Hitler had a more negative impact than Elon Musk, citing policies against making comparisons between people. The incident highlighted problems with overly cautious AI safety guardrails that prevented reasonable moral judgments about historical figures.

Google's Gemini AI image generator refused to create images of white people and produced historically inaccurate diverse images due to overcorrected diversity guidelines, forcing Google to pause the feature amid widespread criticism.

Google's Gemini AI image generator exhibited severe bias by refusing to create images of white people and generating historically inaccurate depictions. Google paused the feature after widespread criticism.

ChatGPT experienced a widespread technical glitch on February 20, 2024, producing hours of gibberish and incoherent responses due to a token generation issue. OpenAI quickly acknowledged and resolved the incident affecting millions of users globally.

Wendy's February 2024 announcement of AI-powered dynamic pricing sparked massive consumer backlash, forcing the company to clarify and partially walk back the initiative.

Air Canada's customer service chatbot told passenger Jake Moffatt he could book a full-price ticket and retroactively claim a bereavement discount within 90 days. This policy did not exist. When Moffatt tried to claim the discount, Air Canada refused, arguing the chatbot was wrong. A tribunal ruled Air Canada must honor the chatbot's promise.

Microsoft Copilot generated inappropriate sexual and violent content about real public figures in early 2024, exposing weaknesses in content filtering systems despite existing safety measures.

AI-powered traffic enforcement cameras systematically issued false tickets to vehicle shadows, reflections, and cars in wrong lanes due to computer vision failures. Hundreds of drivers affected across multiple jurisdictions with ongoing litigation challenging automated enforcement accuracy.

A Waymo autonomous vehicle in San Francisco struck a cyclist who had already been knocked down by another vehicle, raising concerns about AV response to complex emergency scenarios.

Microsoft Copilot for 365 exposed confidential documents by leveraging overpermissioned SharePoint and OneDrive access, allowing users to discover sensitive information through AI-powered search that they shouldn't have been able to access.

JPMorgan Chase's AI financial insights tool incorrectly categorized customer transactions and provided flawed budget recommendations, affecting 45,000 customers and leading to poor financial decisions.