Real2Sim from nuScenes, Waymo dataset to Simulation

Autonomous vehicle dataset such as nuScenes, Waymo Motion, or your own collected one, is known valuable for algorithm development and testing. What's more?

You can also make the digital twin version of those scenarios, allowing engineers to easily modify, parametrize scenarios, inject algorithms like AI drivers, optimal controllers,…. In addition, once can lifting the dataset into higher dimensions, imagine like replacing the car model with realistic vehicle dynamics or diving simulator, allowing advanced testing such as human in the loop inside the logged scenario… and more.

We have been working on these topics, focusing on Simcenter Prescan traffic scenario simulation. The software provides intuitive and common model APIs to interface with most common real dataset types.

This interesting topic come from various Siemens ADAS colleagues, also some smart Master thesis students contribution (like Jasper van Leuven :)