AI Incident Database

AI-generated deepfake videos and audio of political candidates spread across social media during 2025 European elections, prompting EU regulatory action and platform content policies. The incident affected millions of voters and resulted in significant fines under the Digital Services Act.

AI-powered robocall campaign used voice cloning to impersonate Social Security Administration officials, defrauding 8,500 elderly Americans of $12.5 million through convincing synthetic voice calls demanding immediate payments.

Midjourney V7's photorealistic capabilities fooled professional fact-checkers at major news outlets, leading to widespread publication of AI-generated images as authentic photos. The incident highlighted critical gaps in media verification processes and sparked regulatory investigations into synthetic media disclosure requirements.

AI voice cloning technology enabled a 700% surge in fraud scams during 2024-2025, causing $25 billion in global losses. Criminals used brief voice samples to create convincing deepfakes of family members and business associates to deceive victims into transferring money.

Deepfake video technology was used to create false CEO statements that manipulated stock prices, causing millions in investor losses and prompting SEC investigation into AI-enabled market manipulation schemes.

Criminals used AI voice cloning technology to impersonate children in fake kidnapping calls to parents nationwide in 2025, resulting in estimated tens of millions in losses and prompting FBI warnings about deepfake fraud schemes.

OpenAI's Sora video generator was misused to create non-consensual explicit deepfake videos shortly after its public launch, highlighting content moderation challenges in AI video generation tools.

AI-generated political ads, including deepfake videos and synthetic voice calls, proliferated during the 2024 US election without disclosure requirements, exposing regulatory gaps in election integrity protections.

In 2024, South Korea faced a nationwide crisis as AI-generated deepfake pornography targeting female students spread through Telegram channels, affecting over 500 schools and prompting emergency legislation and law enforcement investigations.

A massive deepfake pornography crisis affecting over 30,000 South Korean students prompted emergency legislation in 2025 with up to 7-year prison sentences for creating non-consensual deepfakes.

Meta's AI Studio allowed users to create Instagram chatbots impersonating real people without consent. The platform launched without adequate safeguards against identity fraud, affecting hundreds of individuals before Meta implemented restrictions.

In 2024, scammers used AI voice cloning technology to impersonate IRS agents, Medicare representatives, and law enforcement officials in sophisticated phone fraud campaigns. The FTC reported significant increases in government impersonation scams, with estimated losses in the tens of millions affecting thousands of victims nationwide.

During India's 2024 general elections, political parties extensively used AI deepfakes including videos of deceased politicians and fake opponent content, affecting nearly one billion eligible voters and prompting regulatory intervention by election authorities.

A Baltimore County high school student used AI to create a fake audio recording of their principal making racist remarks, leading to the administrator's temporary removal before forensic analysis revealed the deepfake.

Deepfake audio technology was used to create fake CEO statements for stock manipulation. The SEC investigation highlighted vulnerabilities in financial information verification systems and the growing threat of AI-generated fraud in capital markets.

Criminals used AI-generated deepfake audio impersonating a Fortune 500 CEO to manipulate stock prices, causing $25 million in investor losses before detection. The scheme highlights vulnerabilities in financial market authentication systems.

Fraudsters used AI deepfake technology to impersonate a company's CFO and other executives on a video call, convincing a finance worker to authorize a $25 million wire transfer to criminal accounts.

Hong Kong employee lost $25.6 million after being deceived by deepfake video call impersonating company CFO. Police investigating this sophisticated AI-enabled fraud targeting corporate finance operations.

A finance worker at UK engineering firm Arup (known for designing the Sydney Opera House) was tricked into transferring $25.6 million to fraudsters who used deepfake technology to impersonate the company's CFO and other colleagues during a video conference call. Every other participant on the call was a deepfake.

A finance worker at Arup was tricked into transferring $25 million after attending a video call where all other participants were deepfake recreations of real colleagues, including the CFO.