← Back to incidents

South Korean Deepfake Porn Crisis Targeting Schoolgirls via Telegram Channels

Critical

In 2024, South Korea faced a nationwide crisis as AI-generated deepfake pornography targeting female students spread through Telegram channels, affecting over 500 schools and prompting emergency legislation and law enforcement investigations.

Category
Deepfake / Fraud
Industry
Education
Status
Ongoing
Date Occurred
Aug 1, 2024
Date Reported
Aug 29, 2024
Jurisdiction
South Korea
AI Provider
Other/Unknown
Application Type
other
Harm Type
reputational
People Affected
30,000
Human Review in Place
No
Litigation Filed
No
Regulatory Body
National Assembly of South Korea
deepfakenon-consensualminorstelegramsouth-koreaschoolsdigital-abuseAI-governance

Full Description

In August 2024, South Korea experienced an unprecedented digital sex crime crisis when AI-generated deepfake pornographic images of female students began circulating widely through Telegram messaging channels. The scandal erupted when reports emerged that hundreds of schools across the country were affected by these non-consensual sexually explicit images, with perpetrators primarily targeting female classmates, including minors as young as elementary school age. The deepfake content was systematically created and distributed through numerous Telegram channels, with some groups containing thousands of members. Perpetrators would collect photos of female students from social media platforms, school websites, and personal accounts, then use readily available AI tools to generate pornographic images. These channels were organized by school districts and individual institutions, creating a nationwide network for sharing this illegal content. The scale of the operation was staggering, with police identifying over 220 suspects by September 2024, including 171 teenagers. The revelation caused widespread panic among students, parents, and educators. Many female students reported severe psychological distress, with some refusing to attend school or participate in social media. The Korea Women's Hotline reported a surge in calls related to digital sex crimes. Parents organized protests demanding stronger action from authorities and schools. The crisis highlighted the vulnerability of young people in the digital age and the ease with which AI tools could be weaponized for abuse. Law enforcement agencies responded with unprecedented urgency, establishing specialized investigation units and conducting raids on suspects' homes and schools. The National Police Agency created a dedicated task force to combat deepfake crimes, while prosecutors began pursuing maximum penalties under existing laws. However, investigations were complicated by Telegram's encryption and the cross-border nature of the platform. Many channels quickly moved to private settings or migrated to other platforms when public attention intensified. The South Korean government moved swiftly to address the crisis through legislative action. In September 2024, the National Assembly fast-tracked amendments to strengthen penalties for creating, distributing, or possessing deepfake pornography, with specific provisions for cases involving minors. The legislation increased maximum sentences and eliminated statute of limitations for certain offenses. Additionally, the government announced plans to work with international partners to improve cooperation in cross-border digital crime investigations. The incident exposed significant gaps in platform accountability and content moderation systems. Telegram's limited cooperation with law enforcement and weak content detection systems enabled the crisis to reach such massive scale before intervention. The case became a defining moment for South Korea's approach to AI governance and digital rights protection, influencing policy discussions across the region about the need for stronger safeguards against AI-enabled abuse.

Root Cause

Accessible deepfake generation tools combined with unmoderated Telegram channels enabled mass production and distribution of non-consensual sexually explicit imagery targeting specific individuals, particularly minors in school environments.

Mitigation Analysis

This crisis highlights critical gaps in platform content moderation, particularly on encrypted messaging services like Telegram. Enhanced detection systems for synthetic media, mandatory human review for sexually explicit content, age verification systems, and robust reporting mechanisms could have prevented the widespread distribution. Additionally, proactive monitoring of school-specific channels and rapid response protocols for removing non-consensual content are essential controls that were absent.

Lessons Learned

The South Korean deepfake crisis demonstrates that AI-generated content can cause mass harm when combined with social dynamics and insufficient platform safeguards. It highlights the critical need for proactive detection systems, international cooperation on digital crimes, and age-appropriate protections in AI governance frameworks.
South Korean Deepfake Porn Crisis Targeting Schoolgirls via Telegram Channels | Provyn Index