← Back to incidents

AI Image Generators Used to Create Fake Product Review Images on E-commerce Platforms

Medium

Bad actors used DALL-E, Midjourney and other AI image generators to create fake product review photos on Amazon and other e-commerce platforms. The FTC updated guidelines while platforms struggle with detection at scale.

Category
Other
Industry
Technology
Status
Ongoing
Date Occurred
Jan 1, 2023
Date Reported
Jun 15, 2023
Jurisdiction
US
AI Provider
OpenAI
Model
DALL-E 2
Application Type
api integration
Harm Type
reputational
Human Review in Place
No
Litigation Filed
No
Regulatory Body
Federal Trade Commission
fake_reviewse-commerceconsumer_fraudsynthetic_mediamarketplace_integrityFTC_guidelinesdetection_evasion

Full Description

Throughout 2023 and into 2024, researchers and platform investigators documented widespread use of AI image generation tools to create fraudulent product review content across major e-commerce platforms including Amazon, eBay, and others. The practice involved using tools like OpenAI's DALL-E 2, Midjourney, and Stable Diffusion to generate convincing product photos that appeared to show real customer experiences with purchased items. These AI-generated images were often paired with fake review text to create comprehensive fraudulent endorsements. The sophistication of these fake reviews evolved rapidly as AI image quality improved. Early detection efforts focused on identifying telltale signs of AI generation such as inconsistent lighting, unnatural textures, or anatomical irregularities in generated people. However, as the technology advanced, these indicators became less obvious to both automated detection systems and human moderators. Fraudulent sellers particularly targeted high-value categories like electronics, beauty products, and home goods where visual evidence of product quality significantly influences purchasing decisions. Research conducted by academic institutions and cybersecurity firms revealed patterns in the fake review campaigns. Many operations used template-based approaches, generating multiple variations of similar product scenarios across different listings. The images often depicted idealized use cases or exaggerated positive outcomes that real customers would be unlikely to photograph or experience. Some campaigns coordinated timing to post multiple fake reviews with AI-generated images within short timeframes to boost products rapidly in search rankings. In response to growing evidence of AI-generated fake reviews, the Federal Trade Commission updated its endorsement guidelines in 2023 to explicitly address AI-generated content in commercial contexts. The FTC clarified that businesses are responsible for ensuring the authenticity of all endorsement content, including images, regardless of the method used to create them. Amazon, eBay, and other platforms began investing in detection technologies, including partnerships with AI companies to develop classifiers specifically designed to identify synthetic review content. However, the arms race between fraudsters and detection systems continues, with new AI tools and techniques emerging faster than countermeasures can be deployed.

Root Cause

AI image generation tools like DALL-E and Midjourney were exploited by bad actors to create convincing but fake product review images, circumventing platform detection systems that primarily focused on text-based fake reviews.

Mitigation Analysis

Enhanced detection systems using reverse image searches, AI-generated content classifiers, and metadata analysis could identify synthetic images. Requiring image provenance verification, implementing stricter reviewer verification processes, and developing AI watermarking standards would help authenticate genuine review content.

Lessons Learned

The incident highlights how rapidly advancing AI capabilities can outpace existing fraud detection systems and regulatory frameworks. E-commerce platforms must proactively adapt their review authenticity verification processes to address synthetic content rather than reactively responding to new AI tools.

Sources

AI Enforcement Actions: What to Expect
Federal Trade Commission · Aug 28, 2023 · regulatory action
AI Image Generators Used to Create Fake Product Review Images on E-commerce Platforms | Provyn Index