Amazon Rekognition Facial Recognition System Sold to Police Despite Known Racial Bias

Amazon Web Services began marketing its Rekognition facial recognition service to law enforcement agencies in 2016, positioning it as a cost-effective solution for identifying suspects and monitoring public spaces. The service was adopted by multiple police departments including Orlando Police Department and Washington County Sheriff's Office in Oregon, with Amazon actively promoting its law enforcement applications at conferences and through direct sales efforts. In July 2018, the American Civil Liberties Union conducted a test that exposed significant racial bias in Amazon Rekognition. The ACLU used the system to compare photos of all 535 members of Congress against a database of 25,000 publicly available arrest photos. The system incorrectly matched 28 members of Congress to criminal mugshots, with 39% of the false positives being people of color despite them comprising only 20% of Congress. The bias was particularly pronounced for darker-skinned women, who were misidentified at much higher rates. Despite this public demonstration of bias and subsequent criticism from civil rights groups, Amazon continued to defend and sell Rekognition to law enforcement. Company executives argued that the ACLU's test used inappropriate confidence thresholds and that the technology was accurate when properly configured. However, internal Amazon documents later revealed that the company was aware of accuracy issues, particularly regarding racial bias, before the ACLU study. Amazon employees began organizing internally, with over 450 employees signing letters calling for the company to stop selling facial recognition to law enforcement. The controversy intensified in 2020 following nationwide protests over police brutality and racial injustice after George Floyd's death. Amazon faced mounting pressure from employees, investors, and civil rights organizations. On June 10, 2020, Amazon announced a one-year moratorium on police use of Rekognition, stating it hoped Congress would implement appropriate rules for facial recognition technology. The company extended this moratorium indefinitely in May 2021, though it continues to allow use by organizations working to find missing children and combat human trafficking. The incident highlighted broader concerns about algorithmic bias in law enforcement technology and contributed to legislative efforts to regulate facial recognition systems.