
Waymo has expanded their Open Dataset to include prediction data, and they’ve posed a new set of challenges for the public to tackle.
Motion prediction challenge: Given agents’ tracks for the past 1 second on a corresponding map, predict the positions of up to 8 agents for 8 seconds into the future.
Interaction prediction challenge: Given agents’ tracks for the past 1 second on a corresponding map, predict the joint future positions of 2 interacting agents for 8 seconds into the future.
Real-time 3D detection: Given lidar range images and their associated camera images, produce a set of 3D upright boxes for the objects in the scene, with a latency requirement.
Real-time 2D detection: Given a set of camera images, produce a set of 2D boxes for the objects in the scene, with a latency requirement.
What’s more, they published an academic paper describing how they automated the labeling of the data.
Submissions to the challenges are due on May 31.