AI Incident Database

Political consultant used AI voice cloning to create robocalls impersonating President Biden, telling New Hampshire voters not to participate in the 2024 Democratic primary. The FCC imposed a $6 million fine and declared AI-generated voice robocalls illegal.

AI-generated robocalls mimicking President Biden's voice were sent to New Hampshire voters before the 2024 primary, discouraging voting participation and prompting FCC enforcement action.

AI-generated robocalls mimicking President Biden's voice targeted 5,000 elderly New Hampshire voters with false election information. The FCC responded by banning AI voices in robocalls and fining perpetrators $6 million.

Female politicians worldwide have been systematically targeted with AI-generated deepfake pornography, causing psychological harm and deterring political participation. Cases documented across Italy, UK, US, India with limited legal recourse available.

Two days before Slovakia's 2023 parliamentary election, an AI-generated audio deepfake falsely showed opposition leader Michal Simecka discussing vote rigging with a journalist, spreading widely during the pre-election media moratorium.

Lawyers and litigants used AI image generators like DALL-E and Midjourney to create fabricated photos of injuries and property damage, submitting them as evidence in court cases before detection.

An AI-generated fake image showing an explosion at the Pentagon went viral on social media in May 2023, causing temporary stock market volatility and public concern before being debunked by authorities.

Synthesia AI video platform was exploited to create fake news anchors delivering disinformation in multiple languages. Research by Graphika and Atlantic Council documented the campaign's international scope and impact on information integrity.

AI voice cloning technology enabled a massive surge in grandparent scams throughout 2023-2024, with criminals using synthetic voices to impersonate family members and defraud elderly victims of millions of dollars.

ElevenLabs voice cloning technology was misused to create non-consensual synthetic audio of celebrities and public figures, prompting the company to implement stricter usage restrictions and verification requirements.

Arizona mother received convincing AI voice clone of her daughter claiming kidnapping and demanding ransom in 2023. The synthetic voice caused severe emotional distress before the scam was discovered.

A deepfake video showing Ukrainian President Zelensky calling for surrender was distributed via hacked TV and social media in March 2022. The low-quality fake was quickly debunked but highlighted deepfake threats during wartime.

Belgian VFX artist Chris Ume created hyperrealistic Tom Cruise deepfakes that garnered over 11 million views on TikTok, fooling experts and demonstrating the impossibility of detecting advanced deepfakes with current technology.

Criminals used AI voice cloning technology to impersonate a parent company CEO, successfully deceiving a UK energy firm executive into authorizing a $243,000 wire transfer in one of the first documented deepfake fraud cases.

China's Xinhua News Agency launched AI-generated news anchors in 2018, raising international concerns about state media using synthetic presenters for potential propaganda purposes without adequate disclosure.