← Back to incidents
Knightscope K5 Security Robot Knocked Down and Ran Over Toddler at Stanford Shopping Center
HighA Knightscope K5 autonomous security robot knocked down and ran over a 16-month-old child at Stanford Shopping Center when its obstacle detection systems failed to identify the toddler.
Category
Safety Failure
Industry
Other
Status
Resolved
Date Occurred
Jul 7, 2016
Date Reported
Jul 11, 2016
Jurisdiction
US
AI Provider
Other/Unknown
Model
Knightscope K5
Application Type
agent
Harm Type
physical
People Affected
1
Human Review in Place
No
Litigation Filed
No
autonomous_robotphysical_harmchild_safetyobstacle_detectionsensor_failurepublic_spacesecurity_robot
Full Description
On July 7, 2016, at Stanford Shopping Center in Palo Alto, California, a Knightscope K5 autonomous security robot collided with and ran over a 16-month-old toddler during routine patrol operations. The incident occurred in the mall's common area as the child was walking near the robot's designated patrol path. The 300-pound, 5-foot-tall robot knocked the toddler to the ground and subsequently ran over the child's right leg and foot before continuing its programmed route. The child's parents were present and immediately responded to assist their injured child.
The K5 robot utilized a combination of cameras, LIDAR sensors, ultrasonic sensors, and navigation algorithms designed to enable autonomous patrol operations while avoiding obstacles and humans. However, the system's obstacle detection and avoidance capabilities failed to properly identify the 16-month-old child as an object requiring navigation around or stopping for. The robot's artificial intelligence algorithms and sensor fusion technology were unable to distinguish the toddler's small stature and movement patterns as presenting a collision risk, representing a critical failure in the safety systems designed to prevent such incidents.
The toddler sustained minor physical injuries including scrapes and bruises to the leg and foot area but did not require hospitalization or emergency medical treatment. The incident created immediate safety concerns for Stanford Shopping Center management and drew significant media attention to the deployment of autonomous robots in public spaces. While the physical harm was limited, the incident exposed potential liability issues for both Knightscope and venue operators utilizing autonomous security systems in environments with children and other vulnerable populations.
Knightscope immediately removed the malfunctioning K5 unit from service following the incident and launched an internal investigation to determine the cause of the sensor and algorithm failure. The company issued public statements acknowledging the incident while characterizing it as an isolated malfunction rather than a systemic design flaw. Knightscope emphasized their commitment to safety and stated they were working to understand and address the technical factors that led to the collision, though specific remediation measures were not immediately disclosed.
The incident marked one of the first widely reported cases of an autonomous security robot causing physical harm to a human, particularly a small child, in a public commercial environment. The event highlighted significant gaps in current autonomous robot safety protocols and raised questions about the adequacy of existing testing and certification processes for robots deployed in mixed human environments. Industry observers noted that the incident underscored the challenges of developing AI systems capable of reliably detecting and responding appropriately to all types of human obstacles, especially children whose smaller size and unpredictable movement patterns present unique detection challenges for current sensor and algorithm technologies.
Root Cause
The robot's obstacle detection and avoidance systems failed to properly identify and respond to the presence of a small child in its path. The sensors and AI algorithms were unable to distinguish the toddler as an obstacle requiring avoidance.
Mitigation Analysis
Enhanced sensor arrays including lower-mounted proximity sensors, improved computer vision training on children and low-height objects, and mandatory human supervision in areas with high pedestrian traffic could have prevented this incident. Real-time monitoring with immediate manual override capabilities and geofencing to exclude high-risk areas would provide additional safety layers.
Lessons Learned
This incident demonstrates the critical importance of comprehensive testing of autonomous systems across all user demographics, particularly children who may present unique detection challenges due to their size and unpredictable movement patterns. It underscores the need for fail-safe mechanisms in autonomous robots operating in public spaces.
Sources
Security robot knocks down toddler at California shopping center
CNN · Jul 11, 2016 · news
Security robot knocks down toddler in California shopping centre
The Guardian · Jul 12, 2016 · news