AI Incident Database

JPMorgan Chase's AI financial insights tool incorrectly categorized customer transactions and provided flawed budget recommendations, affecting 45,000 customers and leading to poor financial decisions.

A finance worker at Arup was tricked into transferring $25 million after attending a video call where all other participants were deepfake recreations of real colleagues, including the CFO.

Hong Kong employee lost $25.6 million after being deceived by deepfake video call impersonating company CFO. Police investigating this sophisticated AI-enabled fraud targeting corporate finance operations.

A finance worker at UK engineering firm Arup (known for designing the Sydney Opera House) was tricked into transferring $25.6 million to fraudsters who used deepfake technology to impersonate the company's CFO and other colleagues during a video conference call. Every other participant on the call was a deepfake.

AI-generated explicit images of Taylor Swift went viral on X in January 2024, accumulating tens of millions of views before removal and prompting congressional action on deepfake regulation.

AI-generated explicit images of Taylor Swift spread across X/Twitter, reaching millions of views before removal. The incident prompted congressional action on deepfake legislation and platform policy changes.

AI-generated robocalls mimicking President Biden's voice were sent to New Hampshire voters before the 2024 primary, discouraging voting participation and prompting FCC enforcement action.

Political consultant used AI voice cloning to create robocalls impersonating President Biden, telling New Hampshire voters not to participate in the 2024 Democratic primary. The FCC imposed a $6 million fine and declared AI-generated voice robocalls illegal.

AI-generated robocalls mimicking President Biden's voice targeted 5,000 elderly New Hampshire voters with false election information. The FCC responded by banning AI voices in robocalls and fining perpetrators $6 million.

DPD's customer service chatbot was manipulated into swearing at a customer and calling the company 'the worst delivery firm in the world' through prompt injection techniques. The incident went viral on social media, causing significant reputational damage.

DPD's customer service chatbot was manipulated into swearing at customers and writing derogatory content about the company. The incident went viral on social media, forcing DPD to disable the AI system.

Samsung's Galaxy S24 AI photo enhancement feature was discovered to artificially generate lunar surface details in moon photographs, adding fabricated content rather than enhancing existing image data, raising concerns about photographic authenticity.

Scientific journals experienced a massive influx of AI-generated fake research papers in 2023-2024, leading Wiley to close 19 journals and widespread concerns about research integrity.

OpenAI's GPT Store launched in January 2024 with numerous problematic custom GPTs that facilitated academic dishonesty and copyright infringement. Investigations revealed inadequate content moderation and policy enforcement during the initial rollout.

Randal Reid was wrongfully arrested in Louisiana and spent nearly a week in jail based on a false facial recognition match for a theft in a city he had never visited, highlighting racial bias in facial recognition technology.

Michael Cohen used Google Bard to generate legal citations for a court filing, but the AI fabricated non-existent cases. The fake citations were submitted to court, resulting in sanctions.

The New York Times filed a landmark federal lawsuit against OpenAI and Microsoft in December 2023, alleging copyright infringement for using millions of NYT articles to train GPT models without permission, potentially setting precedent for AI training data rights.

A Chevrolet dealership's AI chatbot was manipulated into agreeing to sell a $70,000 Tahoe for $1 and recommending Tesla and Ford vehicles, causing viral embarrassment and highlighting risks of unguarded commercial AI systems.

The FTC banned Rite Aid from using facial recognition for 5 years after the technology falsely identified customers as shoplifters, disproportionately harming Black, Latino, and Asian customers through wrongful detentions and searches.

FTC banned Rite Aid from using facial recognition for 5 years after the technology falsely identified customers as shoplifters, with disproportionate impact on minority customers.