Scoring My 2018 Self-Driving Car Predictions

One year ago, I laid out a number of predictions for the self-driving car world in 2018, along with associated percentages (I lifted the percentages idea from Scott Alexander).

Here are my predictions from one year ago, scored.

100% Certain

✓ No Level 5 self-driving cars will be deployed anywhere in the world.
✓ No GPS or DGPS system will reliably exceed 10cm localization accuracy on all public roads in the US.

90% Certain

✓ Level 4 self-driving cars will be available to the general public, on public roads, somewhere in the world. [Explainer: I count the ongoing Lyft-Aptiv trials in Las Vegas as fulfilling this prediction, even though they include a safety operator. Also, supposedly Drive.AI is operating in Texas, although that’s been surprisingly quiet.]
✓ Deep learning will remain the dominant tool for image classification.
✓ No US road will have a speed limit for autonomous vehicles that is faster than the speed limit for human-driven vehicles.

80% Certain

✓ All Level 4 vehicles available to the general public will use lidar.
✓ Somebody will die in a crash due to a failure of Tesla Autopilot. [Explainer: Mountain View, California, in March.]
✓ Waymo will still have driven more autonomous miles than any other company.
✓ Level 4 self-driving cars will be available to the general public somewhere other than Pittsburgh.
A company will be acquired primarily for its autonomous vehicle capabilities with a valuation above $100M USD. [Explainer: Maybe I’m missing something, but no obvious acquisition jumps out at me. Either the Ford/Autonomic deal or the Hexagon/AutonomouStuff deal might qualify, but neither reported a price. Cruise took some pretty significant minority investment, but was not acquired.]
✓ No dominant technique will emerge for urban motion planning.

70% Certain

Level 4 self-driving cars will be available to the general public in Pittsburgh.
✓ Level 4 self-driving cars will be available to the general public somewhere in China. [Explainer: Pony.AI, although the lack of corroboration makes me suspicious.]
✓ Tesla will sell the most advanced self-driving system available to the general public. [Explainer: IIHS report.]
✓ Deep learning will not be the dominant tool for object classification from point clouds. [Explainer: I don’t have a smoking gun, but my observations indicate that deep learning is still making headway for point clouds, but has not yet taken over.]

60% Certain

✓ 2,000 students will have graduated the Udacity Self-Driving Car Engineer Nanodegree Program.
Level 4 self-driving cars will be available to the general public somewhere in Europe.
✓ Waymo will have exceeded 10 million miles driven. [Explainer: October, 2018.]
✓ Tesla will produce 5,000 Model 3 vehicles in a single calendar week. [Explainer: July, 2018.]
✓ No member of the general public will die in a Level 4 autonomous vehicle. [Explainer: I should have worded this differently, as it fails to capture the Elaine Herzberg fatality, which was probably the most important self-driving car incident of the year. But, as written, this prediction was correct.]

50% Certain

Cruise Automation will open its Level 4 fleet to the general public.
Level 3 self-driving cars will be available for purchase by the general public.
A company will be acquired primarily for its autonomous vehicle capabilities with a valuation above $1B USD.
1,000 Udacity students will have jobs in the autonomous vehicle industry. [Explainer: I’m not going to count this one either way. One thing Udacity has discovered over the last year is how hard it is for us to track students in jobs.]
✓ Self-driving cars will be legal for public use somewhere in India. [Explainer: Startups in India.]

Conclusion

100% of my 100% predictions were correct.

100% of my 90% predictions were correct.

83% of my 80% predictions were correct.

75% of my 70% predictions were correct.

80% of my 60% predictions were correct.

25% of my 50% predictions were correct.

It seems like I did pretty well this year. That I can see I was neither systematically over-confident nor under-confident.

For 2019, I’d like to do a better job identifying issues that are 50/50 uncertainties.

Congratulations on putting 2018 in the books. Here’s looking forward to 2019!

Visiting NIO in Hangzhou

Last week NIO invited me to Hangzhou, China, to speak with NIO owners and team members about self-driving cars. It was awesome!

NIO is one of China’s most advanced electric car companies. The NIO ES8 SUV and EP9 race cars are already on the market. Next summer the ES6 SUV will launch in China with a breath-taking 500km (300mi) of range.

NIO owners have access to special facilities, or NIO Houses, throughout China. The NIO House at which I spoke in Hangzhou is located right on West Lake, one of China’s most beautiful areas.

What really impressed me were the quality of the questions from the audience of NIO owners and employees. People knew all about the different types of sensors on self-driving cars, but they wanted to know about redunancy, and how different car manufacturers were preparing for failure scenarios. They also wanted to learn about how US manufacturers were thinking about Level 3 and Level 4 autonomy. What are the advantages and disadvantages of high-precision GPS, specifically in China? This is a group of people who know their stuff!

Everyone was unfailingly polite and generous, and every visit to China is a reminder of how fast this country moves. Chinese companies have only recently begun working on autonomous vehicles in earnest, having ceded US companies a 5–10 year headstart. But it’s easier to move fast when somebody else has already blazed a path, and Chinese companies like NIO are making tremendous progress.

Check out this video the self-driving NIO EP9 — the world’s fastest autonomous vehicle!

Uber Resumes Testing Self-Driving Cars

Uber ATG announced in a blog post last week that it is restarting its self-driving car tests in Pittsburgh, along with manual driving tests in San Francisco and Toronto.

Uber has been telegraphing this return for weeks, and it’s good to see the changes the company has made since one of its autonomous vehicles fatally collided with an Arizona pedestrian last spring.

The trigger for returning vehicles to the road appears to have been approval from the Pennsylvania Department of Transportation. This approval was not required — Pennsylvania law places no restrictions on self-driving cars — but Uber solicited the approval nonetheless. Presumably the company plans to work more closely with regulators than it has in the past.

When Uber shut down self-driving operations last spring, it had recorded approximately 2 million autonomously-driven miles. That put it solidly in second place, behind Waymo’s then-8 million miles and ahead of the 500,000 or so miles driven by Cruise.

Since then, everyone else has kept testing while Uber has been on pause. The latest numbers aren’t publicly available, but Waymo announced 12 million autonomous miles a few months ago, and Cruise may well have passed Uber’s 2 million miles by this point.

It’s still early days, but it will be interesting to see how long it takes Uber to get back into the full swing of testing and development.

Zoox Receives California Permit

A bit out of the blue, the California Public Utilities Commission (CPUC) announced that Zoox has received the first permit to transport passengers in self-driving cars in California.

This was a surprise because, until the announcement, CPUC hadn’t even come up in any discussion of self-driving cars, at least as far as I can remember.

CPUC did announce a twin pair of self-driving car pilot programs — one program for vehicles with safety operators (“back up drivers”) and one program for fully driverless vehicles. Zoox’s permit requires safety operators. That said, CPUC pilot program applies to “companies using autonomous vehicles that…are under the CPUC’s jurisdiction…”

http://docs.cpuc.ca.gov/PublishedDocs/Published/G000/M212/K893/212893443.PDF

Which companies are under CPUC jurisdiction is not obvious. The CPUC website states:

“The essential services regulated include electric, natural gas, telecommunications, water, railroad, rail transit, and passenger transportation companies.”

I imagine “passenger transportation companies” as something akin to a limited entry, licensed, monopoly-like services. Bascially, taxi companies. There appears to be an ongoing back-and-forth between Uber and CPUC over jurisdiction for regulating human-driven ridesharing services.

Mainly this seems like a reminder of how new self-driving cars are everywhere. Presumably, the self-driving ride-sharing services will be regulated by some government entity. Whether that entity is local or state or federal, and whether it is the Department of Transportation or the Public Utilities Commission or something else, most of that is yet to be determined.

The answers may come down to who steps forward and claims authority.

Ford’s Self-Driving Moves

In the last few weeks, Ford’s self-driving car program has made a number of exciting announcements. First, they announced a pilot self-driving car program throughout the entire city of Washington, D.C., to launch in 2019.

Shortly thereafter, Ford announced its purchase of electric scooter startup Spin. This appears to be another step in the direction of Ford as a mobility solutions provider, following its acquisition of the Chariot shuttle service and the launch of Ford GoBike bicycle rentals.

Next came an impressive series of self-driving car demos for journalists in Miami, Florida. Ford is currently testing self-driving cars in a six square-mile section of the city.

Most recently, Ford announced a partnership with Walmart and other retailers to deliver merchandise using self-driving cars.

In addition to its strategic moves, Ford seems to be improving its ability to communicate its vision for autonomous vehicles. Ford posts on Medium.com appear from Sherif Markaby, CEO of Ford Autonomous Vehicles, LLC, but also from team members in business development, marketing, and engineering.

Markaby recently posted a helpful infographic outlining the different components of the Ford autonomous vehicle ecosystem.

As former Ford engineer Sam Abuelsamid wrote for Forbes.com:

Ford will not be first to the party. We all know that. But in cooperation with Argo, it is well on its way to creating what seems to be as good an AV system as any out there with smoother operation than much of what I’ve felt from several of its top competitors.”

EB Tech Day San Jose

This Thursday I’ll be moderating a panel on self-driving cars at EB Tech Day San Jose. The event is hosted by Elektrobit, a Udacity partner and a leading supplier of automotive software, particularly safety-critical software.

On the panel will be a number of self-driving car engineers and experts from Elektrobit and their partner company, iSystem:

  • Chris Schlink, Sr. Application Support Engineer, iSystem
  • Hurley Davis, Director of Engineering, U.S., EB
  • Volker Springer, Sr. Project Manager, EB
  • Chris Thibeault, Head of U.S. Product Expert Group, EB

My panel goes on-stage at 1pm, but the event goes all day, from breakfast to happy hour. A full day of autonomous vehicle technology 🚗

Register to attend and say hello!

Waymo’s Early Days

The early days of the Google Self-Driving Car Project were not that long ago — only 7 years ago, at the beginning of the decade. But that was before the self-driving car goldrush, back when Uber was only operating a limousine service, and before Lyft even existed. A lot can change in 7 years.

The New Yorker goes back to the early days to investigate, in particular, Anthony Levandowski’s days at Google. Levandowski earned $120 million from his time at Uber, but The New Yorker reports that his time was replete with controversy.

“Hiring could take months,” Levandowski told me. “There was a program called WorkforceLogic, and just getting people into the system was super-complicated. And so, one day, I put ads on Craigslist looking for drivers, and basically hired anyone who seemed competent, and then paid them out of my own pocket. It became known as AnthonyforceLogic.” Around this time, Levandowski went to an auto dealership and bought more than a hundred cars. One of his managers from that period told me, “When we got his expense report, it was equal to something like all the travel expenses of every other Google employee in his division combined. The accountants were, like, ‘What the hell?’ But Larry said, ‘Pay it,’ and so we did. Larry wanted people who could ignore obstacles and could show everyone that you could do something that seemed impossible if you looked for work-arounds.”

Worth a read.

Uber To Resume Testing Self-Driving Cars on Public Roads

Uber has requested permission to resume testing self-driving cars on public roads in Pittsburgh, Pennsylvania. As I write on Forbes.com:

“In conjunction with Uber’s request to resume testing autonomous vehicles on public roads, Uber also published a safety report, a letter on safety from CEO Dara Khosrowshahi, and a summary of internal and external safety reviews. Uber also linked to the full 56-page external safety review completed by the law firm LeClairRyan.

Read the post to learn about the many improvements Uber has made and is making to its safety procedures.

KPIT Sponsors 500 Self-Driving Car Scholarships For India

Aspiring Self-Driving Car Engineers in India, apply today for the opportunity to work on autonomous vehicles, regardless of your financial situation!

KPIT, one of India’s leading automotive software suppliers, just announced they are sponsoring 500 scholarships for Indian students to take Udacity’s Self-Driving Car Engineer Nanodegree program!

Apply now for the scholarship!

Since we launched the Nanodegree program two years ago, we have seen tremendous interest from students in India who want to learn about autonomous vehicles. Many of the Indian students who have enrolled in the Nanodegree program now work on autonomous vehicles at great Indian companies like KPIT, Ola, and Hi-Tech Robotics.

The KPIT Scholarships will provide the opportunity for any student in India to work on self-driving cars, regardless of their financial situation.

KPIT is making a tremendous investment in Indian software engineers. We are delighted to be able to work with Kishor Patil and the KPIT team to make this possible!

Ford and Volkswagen Take Self-Driving International

My latest post on Forbes.com discusses recent announcements from both Ford and Volkswagen to take their self-driving cars abroad.

“In recent days both Ford and Volkswagen have announced plans to work on self-driving vehicles outside of their home markets. In Ford’s case, the target market is Beijing, whereas the Volkswagen effort will take place in Israel.”

The ventures are different, and offer distinct insights into each company’s approach to autonomous vehicles. But the move to new markets may have a common inspiration.

“By launching self-driving cars in other markets, automotive companies might be able to stand out and gain local advantages, instead of racing to catch up to Waymo in the US market.”

Much more on Forbes.com.