AV Disengagement Reports May Be Misleading
Aug. 6, 2020—Complaints pile up at the end of each year from autonomous vehicle companies about allegedly inaccurate data. According to the California Department of Motor Vehicles, every autonomous vehicle company is required to submit a report at the end of the year detailing how often the operator had to disengage the vehicle's autonomous functions.
Waymo went as far as to tweet that the metric "does not provide relevant insights" nor does it "distinguish performance from others in the self-driving space," reports Tech Crunch.
The primary argument is that the metric is misleading without more context due to AV companies having varied testing processes. Another fear of AV companies is that the regulations could discourage more complex tests that come from virtual testing while incentivizing less difficult circumstances.