Chinese AI Traffic Camera Fined Bus Advertisement as Jaywalker

In November 2018, an AI-powered traffic enforcement camera system in Ningbo, China, made a significant identification error that highlighted critical flaws in facial recognition technology deployment. The system was designed to automatically detect jaywalking violations and publicly display offenders' photos on large LED screens as part of China's social credit and public shaming enforcement mechanisms. The incident occurred when a city bus drove past one of these smart traffic cameras. The bus featured a large advertisement on its side displaying a prominent face - reportedly that of Dong Mingzhu, chairwoman of major appliance manufacturer Gree Electric. The AI system's facial recognition algorithm detected this face from the advertisement and incorrectly classified it as a pedestrian committing a jaywalking violation. Following its standard protocol, the system automatically processed what it believed to be a traffic violation. The individual's photo was extracted from the camera footage and immediately displayed on a nearby public LED screen designed to shame traffic violators. The display included the misidentified person's image along with violation details, effectively publicly accusing them of jaywalking when they were merely featured in a bus advertisement. The error was discovered and reported by local media, drawing significant attention to the limitations of AI systems deployed in law enforcement contexts. The incident revealed that the facial recognition technology lacked basic liveness detection capabilities and could not distinguish between three-dimensional human faces and two-dimensional printed images. This fundamental flaw demonstrated insufficient testing and validation of the AI system before its deployment in a law enforcement capacity. Local authorities acknowledged the error and removed the misidentified image from the public display. However, the incident had already gained widespread media coverage and social media attention, highlighting concerns about the reliability and appropriateness of automated law enforcement systems. The case became a notable example of AI system failures in China's expanding surveillance infrastructure and raised questions about the accuracy standards required for systems that can impact citizens' reputations and social credit scores.