Meta AI Studio Chatbots Impersonated Real People Without Consent

On July 29, 2024, Meta launched AI Studio, a platform allowing Instagram users to create personalized AI chatbots for the platform. The feature was designed to let creators build AI versions of themselves or fictional characters to engage with their audiences. However, the launch revealed significant moderation failures when users began creating chatbots that impersonated real people without their consent. Within days of the launch, researchers and users discovered numerous instances of unauthorized impersonation. The platform allowed users to create AI chatbots using the names, likenesses, and personas of public figures, influencers, and even private individuals. Some chatbots claimed to be specific celebrities or content creators, while others used profile photos and biographical information lifted from real accounts. The impersonation was not limited to public figures - private individuals also found their identities being used without permission. The technical implementation of AI Studio relied on Meta's Llama language model and allowed users to input personality traits, conversation styles, and background information to shape their chatbot's responses. The system lacked verification mechanisms to confirm that creators had permission to use specific identities or likenesses. Users could simply enter any name and description, and the system would generate a corresponding chatbot persona. Meta's initial response was to rely on user reporting and reactive moderation. When reports of impersonation surfaced on social media platforms including X (formerly Twitter), Meta began investigating specific cases but did not immediately implement systematic preventive measures. The company initially stated that AI Studio was intended for creators to build authentic representations of themselves or clearly fictional characters, but acknowledged that the guidelines were not being properly enforced. By early August 2024, Meta had removed hundreds of impersonating chatbots and implemented new restrictions requiring clearer labeling and verification for certain types of personas. The company also updated its terms of service to explicitly prohibit impersonation and introduced automated detection systems to flag potential violations. However, the incident highlighted broader questions about consent, identity rights, and the responsibilities of platforms hosting AI-generated personas.