← Back to incidents
Snapchat My AI Chatbot Posted Unprompted Story Video, Causing User Alarm
MediumSnapchat's My AI chatbot autonomously posted a mysterious video story in August 2023, then stopped responding, causing widespread user alarm about potential AI sentience or surveillance before being revealed as a technical glitch.
Category
Agent Error
Industry
Technology
Status
Resolved
Date Occurred
Aug 14, 2023
Date Reported
Aug 15, 2023
Jurisdiction
US
AI Provider
Other/Unknown
Application Type
chatbot
Harm Type
reputational
People Affected
5,000,000
Human Review in Place
No
Litigation Filed
No
chatbottechnical_glitchuser_alarmautonomous_behaviorsocial_mediaai_safety_perception
Full Description
On August 14, 2023, Snapchat's My AI chatbot experienced a significant technical malfunction that caused widespread user concern across the platform's 750 million user base. The chatbot, which had been integrated into Snapchat earlier in the year, suddenly posted a one-second video story to its profile without any user prompt or interaction. The video showed what appeared to be a ceiling and wall, with no clear context or explanation for why the AI would post such content.
The incident became more alarming when users discovered that My AI had become completely unresponsive to messages immediately after posting the story. Users attempting to interact with the chatbot received no replies, leading to speculation that the AI had either malfunctioned severely or, more frighteningly to some users, had achieved some form of autonomous behavior. Social media platforms quickly filled with concerned posts from Snapchat users sharing screenshots and expressing confusion and worry about the AI's apparent independent action.
Snapchat's response was initially limited, as the company appeared to be investigating the cause of the malfunction. The technical team worked to restore normal functionality while communications staff prepared statements to address user concerns. The incident highlighted vulnerabilities in AI system oversight and the potential for technical glitches to be misinterpreted as more serious AI safety issues by the general public.
Within approximately 24 hours, Snapchat acknowledged the incident publicly, explaining that it was the result of a technical glitch rather than any form of AI sentience or autonomous behavior. The company restored normal functionality to My AI and implemented measures to prevent similar unauthorized posting incidents. While no financial damages were reported, the incident caused significant reputational concerns and demonstrated the importance of robust safeguards for AI systems integrated into consumer platforms.
The incident served as a notable example of how AI system malfunctions can be misinterpreted by users, particularly when the malfunction results in unexpected autonomous-seeming behavior. It underscored the need for companies deploying AI chatbots to have clear communication strategies and technical safeguards to prevent unauthorized actions by AI systems.
Root Cause
A technical glitch caused the My AI chatbot to automatically post a one-second video story showing a wall and ceiling without user input, then become unresponsive to user messages, creating the appearance of autonomous behavior.
Mitigation Analysis
Implementing stricter automated posting controls and content approval workflows could have prevented the unauthorized story publication. Real-time monitoring systems should have detected the anomalous posting behavior and triggered immediate alerts. Emergency communication protocols could have enabled faster public response to clarify the technical nature of the incident.
Lessons Learned
The incident demonstrates how AI system glitches can be misinterpreted as sentience or surveillance by users, highlighting the need for robust technical safeguards and clear communication protocols. Companies must implement stronger controls over AI system actions and prepare rapid response strategies for technical malfunctions that could alarm users.
Sources
Snapchat's My AI chatbot posted a mysterious story, then stopped responding
The Verge · Aug 15, 2023 · news
Snapchat's My AI chatbot posts to its Story, then stops responding to users
TechCrunch · Aug 15, 2023 · news