Why truly autonomous cars without the human touch seem impossible

Autonomous vehicle start-ups have raised tens of billions of dollars based on promises to develop truly self-driving cars but industry executives and experts say remote human supervisors may be needed permanently to help robot drivers in trouble. The central premise of autonomous vehicles — that computers and artificial intelligence will dramatically reduce accidents caused by human error — has driven much of the research and investment. But there is a catch: making robot cars that can drive more safely than people is immensely tough because self-driving software systems simply lack humans' ability to predict and assess dangers quickly, especially when encountering unexpected incidents or "edge cases." "Well, my question would be, 'Why?'" said Kyle Vogt, chief executive of Cruise, a unit of General Motors, when asked if he could see a point where remote human overseers should be removed from operations. "I can provide my customers peace of mind knowing there is always a human there to help if needed," he said. "I don't know why I'd ever want to get rid of that." This is the first time Cruise has acknowledged the long-term need for remote human operators. Like air-traffic controllers, such human supervisors could be sitting thousands of miles away monitoring video feeds from multiple AVs, sometimes with a steering wheel, ready to step in and get stuck robot drivers moving again — AVs invariably stop when they cannot figure out what to do. Alphabet Inc's Waymo and Argo, which is backed by Ford Motor Co and Volkswagen AG, declined to comment when asked the same question. GM recalled and updated software in 80 Cruise self-driving vehicles this month after two people were injured in a crash in San Francisco in June. US safety regulators said the recalled software could "incorrectly predict" an oncoming vehicle's path and Cruise said the unusual scenario would not recur after the update. For some, the idea that human supervisors could be here to stay raises more doubts about the technology. Truly autonomous vehicles are far behind the optimistic rollout schedules predicted only a few years ago. In 2018, GM sought US government approval for a fully autonomous car without a steering wheel, brake or accelerator pedals that would enter its commercial ride-sharing fleet in 2019. That vehicle, the Cruise Origin, now is scheduled to begin production in spring 2023, Mr Vogt said. In 2019, Tesla Inc chief executive Elon Musk promised 1 million robotaxis "next year for sure" — though his company's "full self-driving" offering has been criticised because its cars are not capable of driving themselves without a human behind the wheel and ready to take manual control in an emergency. In an interview on YouTube in June, Mr Musk said developing self-driving cars was "way harder than I originally thought, by far". But when asked for a timetable, he said "this year". Tesla did not respond to a request for comment for this story. The undelivered promise of true autonomy has raised the stakes for the AV industry. "If these companies don't succeed over the next two years, they're not going to exist any more," said Mike Wagner, chief executive of Edge Case Research, which helps AV companies assess, manage and insure risk. "It's a case of put up or shut up at this point." Many AV start-ups today use humans as remote supervisors, alongside safety drivers sitting behind the wheel. Those remote humans are an additional expense, but help self-driving cars handle edge cases. These could include something as basic as an unfamiliar set of lane closures during road construction, or erratic, unpredictable behaviour by pedestrians or human drivers. When a robot driver encounters an edge case, "it puts its hands up and says, 'I don't know what's going on'," said Koosha Kaveh, chief executive of Imperium Drive, which is using humans as remote operators for cars in the English city of Milton Keynes. Over time, those people will act as "air-traffic controllers", supervising a growing number of autonomous cars. Mr Vogt says the company's AVs on the roads in San Francisco currently rely on humans less than 1 per cent of the time. But across hundreds, thousands or even millions of AVs, that would add up to a significant amount of time stopped on the road waiting for human guidance. Mr Kaveh said as more self-driving cars — which are more predictable than humans — hit the roads, the number of edge cases will drop, "but you will never get to zero edge cases". "Even decades from now you will not get to 100 per cent truly autonomous vehicles," he said. Nevertheless, competition is rising. Some Chinese cities are pushing to allow active AV testing more quickly. Doubt has crept in as investors are puzzled over how soon autonomous business will turn profitable. Overall investment in future mobility start-ups has slowed, with AV-focused companies hit especially hard, representing less than 10 per cent of venture investment in the second quarter, according to investor website PitchBook. Investment in AV start-ups in the quarter dropped to $958 million. Only two years ago, AV investment was booming, as Alphabet's Waymo raised $3 billion, Didi's AV unit raised $500m and Amazon.com Inc acquired Zoox for $1.3bn, PitchBook said. Autonomous systems are not as capable as people because their "perception and prediction algorithms are not as good as how a human brain processes and decides", said Chris Borroni-Bird, an independent consultant who previously led advanced-vehicle programmes at GM and Waymo. For instance, a human when seeing a ball roll into the road — harmless by itself — will assume it could be followed by a child and hit the brakes far quicker than an AV, he said. "I am concerned that AV companies will rush to market without proving the safety is better than human-driven vehicles." The problem is there are "tens of billions of potential edge cases" that AVs could encounter, said James Routh, chief executive of AB Dynamics, which conducts tests and runs simulations on cars, including on the advanced driver-assistance systems that are the foundation of autonomous driving features. Auto data start-up Wejo Group Ltd receives 18 billion data points daily from millions of connected cars and is helping with simulations for AVs, said Sarah Larner, executive vice president for strategy and innovation. "But there are so many variables such as weather, you can take an edge case and then have to layer in all the different variants," she said. "It's truly millions of outputs." In its track tests for cars, AB Dynamics employs a robot arm that it plans to retrofit on slow-moving mining and agricultural lorries to make them largely autonomous. Mr Routh envisages a remote team of humans supervising fleets of, for instance, self-driving mining lorries operating in closed environments. He does not see that scenario working for vehicles in faster, more open environments because it could be difficult for remote human supervisors to react quickly enough to dangers.

Why truly autonomous cars without the human touch seem impossible

Industry executives and experts say remote human supervisors may be needed permanently to help robot drivers