← Back to incidents

Tesla Autopilot Failed to Detect Barrier, Killing Apple Engineer Walter Huang

Critical

Tesla Autopilot failed to detect a concrete barrier on Highway 101, killing Apple engineer Walter Huang in March 2018. NTSB found the system misclassified the barrier and accelerated into it.

Category
Safety Failure
Industry
Technology
Status
Resolved
Date Occurred
Mar 23, 2018
Date Reported
Mar 23, 2018
Jurisdiction
US
AI Provider
Other/Unknown
Model
Autopilot
Application Type
embedded
Harm Type
physical
Estimated Cost
$15,000,000
People Affected
1
Human Review in Place
No
Litigation Filed
Yes
Litigation Status
settled
Regulatory Body
National Transportation Safety Board
autopilotfatal_crashcomputer_vision_failureteslantsb_investigationwrongful_deathregulatory_oversightautonomous_vehicles

Full Description

On March 23, 2018, at approximately 9:27 AM, Walter Huang, a 38-year-old Apple software engineer, was driving his Tesla Model X on US Highway 101 in Mountain View, California, when the vehicle's Autopilot system engaged and ultimately failed catastrophically. Huang was traveling northbound in the carpool lane when his vehicle, operating under Autopilot control, struck a concrete lane divider at the junction where Highway 101 splits toward Highway 85. The impact was severe, with the vehicle's front end being completely destroyed and the car subsequently catching fire. The National Transportation Safety Board's comprehensive investigation revealed critical failures in Tesla's Autopilot system. The NTSB determined that the Autopilot's computer vision system misidentified the concrete barrier, failing to classify it as an obstacle that required avoidance. Instead of braking or steering away from the barrier, the system actually accelerated the vehicle from 62 mph to 70 mph in the final seconds before impact. Data logs showed that Huang had been using his smartphone and playing a game for approximately 18 minutes of the 19-minute trip, with his hands off the steering wheel for the final 6 seconds before the crash. Investigators discovered that this was not an isolated incident at this specific location. The same concrete barrier had been struck by another vehicle just 11 days prior to Huang's crash, and the protective crash attenuator that normally cushioned the barrier had not yet been repaired by Caltrans. The NTSB found that the damaged or missing crash attenuator contributed to the severity of Huang's injuries, but emphasized that the primary cause was the Autopilot system's failure to detect and respond to the barrier. Tesla's response to the incident drew sharp criticism from the NTSB. The company initially blamed the driver for not paying attention and suggested that the crash was unavoidable. Tesla also publicly released selective crash data before the NTSB investigation was complete, which the safety board characterized as premature and potentially prejudicial to the investigation. The NTSB ultimately concluded that Tesla's Autopilot design permitted driver disengagement and failed to provide adequate safeguards against foreseeable misuse. The Huang family filed a wrongful death lawsuit against Tesla in 2019, alleging that the company knew its Autopilot system was defective and dangerous. The lawsuit claimed that Tesla misrepresented the capabilities of Autopilot and failed to warn users of its limitations. After years of litigation, Tesla settled with the Huang family in 2022 for an undisclosed amount, avoiding a public trial that could have revealed additional internal documents about Autopilot's development and known limitations. This incident became a landmark case in the discussion of autonomous vehicle safety and manufacturer responsibility. The NTSB's final report, released in February 2020, included recommendations for improved human-machine interface design, better driver monitoring systems, and enhanced regulatory oversight of partially automated driving systems. The case highlighted the critical gap between public perception of 'autopilot' capabilities and the actual limitations of Level 2 driver assistance systems.

Root Cause

Tesla Autopilot's computer vision system failed to properly classify the concrete lane divider as an obstacle, instead treating it as part of the roadway. The system also accelerated the vehicle from 62 to 70 mph in the seconds before impact, indicating a complete failure of obstacle detection and emergency braking systems.

Mitigation Analysis

Enhanced sensor fusion combining cameras, radar, and lidar could have provided redundant obstacle detection. Mandatory human attention monitoring systems and automatic disengagement in construction zones would have required driver intervention. Real-time telemetry monitoring and immediate software updates after the first barrier strike at this location could have prevented the fatal second incident.

Litigation Outcome

Tesla settled wrongful death lawsuit with Huang family in 2022 for undisclosed amount

Lessons Learned

The incident demonstrated that current computer vision systems can fail catastrophically in edge cases involving infrastructure damage or unusual road configurations. It highlighted the need for robust human monitoring systems and the dangers of misleading marketing terminology for semi-autonomous features.