Today we're unveiling something truly extraordinary—one of the coolest and most transformative technologies: Mixed Reality Testing (MRT). Since launching Waabi World four years ago, we've been building towards this pivotal moment - bringing our virtual testing capabilities into the physical world to fundamentally transform what's possible in autonomous vehicle development.
For over 100 years, closed-course testing has been the staple of vehicle safety testing. But creating scenarios on a physical test track resembles elaborate movie-stunts—it’s difficult to reproduce tests consistently, those tests do not capture the diversity of the real-world, and the range of safety-critical scenarios we can test is very limited because of the risk of damaging equipment or, worse, endangering lives.
MRT changes everything! In the same way that augmented reality goggles blend the physical world with a virtual world, MRT enables the Waabi Driver to drive autonomously down a physical test track while simultaneously experiencing numerous intelligent, simulated actors that coexist in this hybrid reality and react to each other and to the physical world in naturalistic ways. All this is possible by leveraging Onboard Waabi World, a version of Waabi's neural simulator that runs in a few milliseconds on the onboard compute. As Onboard Waabi World generates new scenarios, the real physical sensor readings are modified instantaneously so the Waabi Driver can react to the blend of real and virtual elements while driving in the physical world. This fusion creates a first-of-its-kind reality that unlocks unlimited testing possibilities previously impossible to achieve safely or practically.
Traffic jams can materialize instantly, motorcycles can weave between lanes, crowds of pedestrians can jaywalk unpredictably, children can dart into the street from behind parked cars, animals can wander across the road, debris can appear in lanes creating hazardous obstacles. The possibilities are endless.
This breakthrough eliminates all traditional constraints of closed-course testing. We can do exponentially more tests than ever before and in a continuous fashion, with extraordinary levels of diversity and realism. Most importantly, we can push the boundaries of safety testing without real-world consequences.
MRT represents the culmination of years of work toward safe, scalable autonomous deployment. It's been central to our testing approach for over two years and fundamental to achieving feature-complete autonomous driving capabilities earlier this year.
But this is just the beginning. MRT’s impact extends beyond self-driving trucks – we’re laying the foundation for a future where any physical AI system can be tested and validated safely - from robotaxis to humanoid robots, manufacturing automation to healthcare robotics.
Learn about Mixed Reality Testing: https://lnkd.in/gQ_qMVbn