← Back to incidents

Serbian Schools Deploy AI Facial Recognition Surveillance Without Student Consent

High

Serbian schools deployed AI facial recognition surveillance systems in 2022 without proper consent from students or parents. The deployment affected thousands of students and drew criticism from privacy advocates, leading to regulatory investigations.

Category
Privacy Leak
Industry
Education
Status
Under Investigation
Date Occurred
Jan 1, 2022
Date Reported
Oct 15, 2022
Jurisdiction
Serbia
AI Provider
Other/Unknown
Application Type
embedded
Harm Type
privacy
People Affected
50,000
Human Review in Place
No
Litigation Filed
Yes
Litigation Status
pending
Regulatory Body
Commissioner for Information of Public Importance and Personal Data Protection of Serbia
facial_recognitionschoolsminorsconsentsurveillancebiometric_dataserbiaprivacy_violationeducation_technology

Full Description

In 2022, multiple Serbian educational institutions implemented AI-powered facial recognition surveillance systems designed to monitor student attendance, behavior, and movement within school premises. The systems used computer vision technology to automatically identify and track individual students throughout the school day, creating detailed profiles of student activities and whereabouts. The deployment occurred without obtaining proper informed consent from students or their parents, violating fundamental data protection principles for processing biometric data of minors. Schools failed to conduct required data protection impact assessments or establish legal bases for processing sensitive personal data under Serbian and EU data protection frameworks. The Big Brother Awards, an international privacy advocacy organization, publicly criticized the deployment as part of their 2022 awards ceremony highlighting the most egregious privacy violations. The organization noted that the surveillance systems represented a significant escalation in educational monitoring that normalized mass surveillance of children without adequate safeguards or oversight. Following public criticism and privacy complaints, the Serbian Commissioner for Information of Public Importance and Personal Data Protection launched formal investigations into the school deployments. The regulatory authority examined whether schools had proper legal authorization for biometric data processing and whether students' fundamental rights to privacy and data protection were adequately protected. The incident reflects broader concerns about AI surveillance expansion in educational settings across Eastern Europe, where schools increasingly adopt facial recognition and behavioral monitoring technologies without comprehensive privacy frameworks. Educational privacy advocates have raised concerns that such systems create environments of constant surveillance that may negatively impact student development and learning. The case highlights regulatory gaps in oversight of AI deployment in sensitive sectors like education, where power imbalances between institutions and individuals require enhanced protection measures for personal data processing.

Root Cause

Educational institutions deployed AI-powered facial recognition systems for student monitoring without obtaining proper legal consent from minors and their guardians, and without conducting required data protection impact assessments.

Mitigation Analysis

This incident could have been prevented through mandatory privacy impact assessments before AI deployment, clear consent mechanisms for processing minors' biometric data, and regulatory oversight of AI systems in educational settings. Stronger data protection enforcement and specific guidelines for AI use in schools would have identified legal violations before deployment.

Lessons Learned

Educational AI deployments require specialized privacy frameworks that account for the vulnerability of minors and power dynamics in schools. Regulatory authorities must establish clear guidelines for AI surveillance in educational settings before widespread adoption occurs.

Sources

Big Brother Awards 2022 - Serbia School Surveillance
Big Brother Awards · Oct 15, 2022 · advocacy organization
Serbian Schools Face Criticism Over Facial Recognition Systems
Radio Television of Serbia · Oct 20, 2022 · news