“The importance of this research goes well beyond the specific issues addressed in our statistical analyses,” said QCSC. “The larger question is whether the field experience of autonomous vehicles and advanced driver-assistance systems will be fairly and transparently assessed by public officials.”
When QCSC, which specialises in data analysis as a business tool, approached NHTSA for access to the publically-funded research, they were refused. The log-jam took two years to break, only after QCSC threatened court procedings to obtain the data via a freedom of information request.
In response to a request for a comment from Autocar, the Washington-based NHTSA released a limited statement: “The agency is reviewing the report released by Quality Control Systems Corp. with interest and will provide comment as appropriate.”
QCSC’s report is titled “NHTSA’s Implausible Safety Claim For Tesla’s Autosteer Driver Assistance System” and looked at data for airbag deployments of MY2014 – 2016 Model S and MY2016 Model X models equipped with Tesla’s Autopilot.
QCSC’s analysis of the data, contained in a 24-page report, found that airbag deployments actually increased from 0.76 million to 1.21 million, a 59% rise, rather than decreased.
“Before and after comparisons of the resulting crash rates are unbiased by missing data for exposure mileage because there are no missing data in this subset of the data,” said QCSC in its report.
When NHTSA analysed airbag deployment and mileage travelled data supplied by Tesla, NHTSA came to the conclusion that there were 1.3 deployments per million miles before Autosteer and 0.8 million after – a 40% reduction.
NHTSA’s findings were widely reported in January 2017, partly because of the fatal accident in Florida six months earlier when a Model S operating with Autopilot ploughed into a truck, having failed to detect the vehicle making a turn across the car’s path.
Autopilot is a Level 2 advanced cruise-control self-driving system that allows the driver to temporarily relax their grip on the steering wheel. Autosteer is the lane-keeping part of the Autopilot system, which also facilitates lane changes when the indicator is operated.
Introduced in 2014, Autosteer was enhanced in 2016 with an upgrade. Significantly, it means a lane change can be executed with less oversight by the driver. Ultimately Tesla aims for automatic lane-changing manoeuvres in Level 3 or 4 autonomy.
In response to the report, a Tesla statement read: "QCS’ analysis dismissed the data from all but 5714 vehicles of the total 43,781 vehicles in the data set we provided to NHTSA back in 2016. And given the dramatic increase in the number of Tesla vehicles on the road, their analysis today represents about 0.5% of the total mileage that Tesla vehicles have traveled to date, and about 1% of the total mileage that Tesla vehicles have traveled to date with Autopilot engaged.