Startup Watch: Blackmore

A startup called Blackmore just raised a few million dollars to miniaturize sensors for autonomous vehicles.

A few interesting points about Blackmore:

  1. They want to embed lidar in the grill of a car. This seems like a difficult vantage point, since the sensor won’t have a 360-degree view of the environment.
  2. They plan to deliver prototypes next summer.
  3. Based on their website, they seem to target two markets: autonomous vehicles and the military.
  4. They’re based in Bozeman, Montana, which is a great town, but hardly a tech hub. Given the cost of housing in Silicon Valley, though, I’m tempted to apply for a job there right now.

Autonomous World

Business Insider recently launched a special series called ā€œAutonomous Worldā€ that covers self-driving cars. It’s thorough!

Articles (I have not read all of them yet) include:

Is Deep Learning Overhyped?

One of the questions I get every now and again is whether self-driving cars are a solved problem. Is there any work left to be done in this field?

The answer is that there is so much work left to be done! It only seems like a solved problem from the outsideĀ šŸ™‚

So I was interested to read Francois Chollet’s answer to ā€œIs Deep Learning Overhyped?ā€ on Quora.

Chollet is the author of Keras, which is a deep learning library we use in the Udacity Self-Driving Car Program. He explains at length why artificial intelligence generally, much like autonomous driving specifically, is not a solved problem.

Overall: deep learning has made us really good at turning large datasets of perceptual inputs (images, sounds, videos) and simple human-annotated targets (e.g. the list of objects present in a picture) into models that can automatically map the inputs to the targets. That’s great, and it has a ton a transformative practical applications. But it’s still the only thing we can do really well. Let’s not mistake this fairly narrow success in supervised learning for having ā€œsolvedā€ machine perception, or machine intelligence in general. The things about intelligence that we don’t understand still massively outnumber the things that we do understand, and while we are standing one step closer to general AI than we did ten years ago, it’s only by a small increment.

There’s still a lot of work left to do!

Auro’s Santa Clara Shuttle

Udacity’s partner, Auro Robotics, has been testing it’s self-driving shuttle on the campus of Santa Clara University for a year. In November they turned it loose on the public for the first time.

IEEE Spectrum says it’s getting a good reception!

During my rides, it was clear that the students are used to the Aeroā€Šā€”ā€Šso used to it that they don’t even think about getting out of its way. That can lead to a somewhat frustrating ride as the vehicle patiently trails a slow-walking student; it has a horn, but is too polite to beep. Visitors to campus, however, are at first puzzled, then thrilled, to learn that they are being chauffeured in a car that is driving itself. (See video, above.) And if you’re in the area, and have never had a ride in an autonomous vehicle, just stand in front of the parking garage for a whileā€Šā€”ā€Šthe shuttle won’t ask to see your ID.

Audi Demos Vehicle to Infrastructure

Ars Tecnica has a pretty cool story about Audi demonstrating Vehicle-to-Infrastucture (V2I) communnication in Las Vegas.

Or, really, Infrastructure-to-Vehicle:

Audi’s new Traffic Light Information feature can be found on 2017 A4s, Q7s, and allroad vehicles that have Audi’s Connect Prime packageā€Šā€”ā€Šwhich puts customers out $10 to $30 monthly, depending on the length of the subscription.

As an Audi driver, you experience this feature as a small icon that tells you how much time is left until the next green light as you come to a stop. If you come to a protected left turn and put your left blinker on, the car will give you a countdown unique to that light as well.

This is pretty basic V2I, but so far V2I has mostly been talk and no action, so it’s awesome to see Audi pushing this live.

It’s also interesting to me that Audi charges a fee for this. That suggests there aren’t really network effects to this effort, otherwise they’d want as many people on the system as possible, even if Audi had to subsidize it.

CarND: Experiences and Lessons Learned

A few days ago George Sung, who is in the first cohort of students of the Udacity Self-Driving Car Nanodegree Program, gave a presentation about his experience in the program to the Boston Self-Driving Cars Meetup.

It’s a thorough overview of the program so far. If you’re interested in signing up for the Nanodegree program, or if you’re already a student and interested in how another student has experienced it, it’s worth a watch.

George’s presentation starts at about 18:40 on the video.

Driving Outside the Lines

Last week my colleague Lisbeth organized a really fun event for Udacity Self-Driving Car Students.

We rented out an auditorium at the Computer History Museum in Mountain View, and had several amazing engineers talk about their work on autonomous vehicles.

The opening act was a tag-team of my colleagues Mac and Eric, talking about their work on Udacity’s own open-source self-driving car:

The main event was Sebastian Thrun interviewing Axel Gern, Head of Autonomous Driving at Mercedes-Benz North America:

And the encore was the ever-exciting George Hotz announcing Comma.ai’s new strategy:

Fun factā€Šā€”ā€Šat the beginning of George’s presentation, you’ll see him gesturing off-stage to some anonymous person to advance his slides. That was me. Working at a startup means wearing a lot of hatsĀ šŸ˜‰

Delphi and Mobileye Roll Together

The San Francisco Chronicle got an up-close and personal look at Delphi’s partnership with Mobileye, and the self-driving cars that partnership has produced:

With the race to develop self-driving cars now at an all-out sprint, Delphi and Mobileye believe they possess an edge.

They have developed a system for crowdsourcing the hyper-detailed 3-D maps upon which autonomous vehicles rely. Millions of non-autonomous cars that use Mobileye cameras for lane keeping or collision prevention will create a constant stream of data to map roads and potential obstacles, even temporary ones such as road repair crews or double-parked cars.

Also, this:

ā€œYou can’t develop autonomous cars that just follow all the rules, because they’ll just clog cities,ā€ [Mobileye executive Dan] Galves said. ā€œThe point is really providing the intelligence and the rules of breaking the rules, if you willā€Šā€”ā€Šproviding some human intuition into the vehicles.ā€

Self-Driving Cars and Regulators

Business Insider has a great inside-baseball story on the early days of Otto, particularly the negotiations and maneuvering that took place in running their first self-driving truck tests in Nevada.

The Nevada regulatory bureaucracy is generally very amenable toward autonomous vehicles, but there’s still a certain amount of required testing and licensing.

According to the BI article, Otto had to figure out a way around that in order to keep up their frantic development pace:

Before an autonomous vehicle can be operated on the state’s roads, it must be issued a testing license and special red license plates. It has to be able to capture driving data in case of crashes, have switches to engage and disengage the autonomous systems, and have a way to alert the human operator if it fails.

To obtain a license, Otto would have had to produce evidence of 10,000 miles of previous autonomous operation and submit a truck for a self-driving test, such as the one completed by Google in 2012. It would also need to post a $5 million bond and file reams of paperwork. Even with all those requirements fulfilled, Otto’s demo would need two people seated up front, one of them poised to take over in the event of a failure.

…

Otto’s founders were faced with a stark choice. They could submit to the DMV and undertake the laborious process of modifying, testing, and licensing their truck. This would likely take a month or more, and could risk their first-mover advantage in driverless trucking. Or the engineers could continue with their test as planned.

Nissan’s Autonomous Towing System

Logistics is one of the industries most ripe for autonomous vehicles. A lot of logistics involves traversing the same areas over and over again. And the vehicles are in use more or less constantly, as opposed to personal vehicles, which are parked 95% of the time.

In that vein, Nissan has just announced an autonomous towing system they’ve put into use at one of their plants in Japan.

And the video continues in the vein of autonomous vehicle videos with rather whimsical musical selections: