Valeo Racer is the first extended reality (XR) video game to combine live video and world perception of the real environment with digital gaming elements. Valeo Racer brings ADAS sensors and in-vehicle entertainment to the next level. It immerses the vehicle passenger in an XR  infinite runner-style game, in which the object is to collect coins and avoid obstacles. To do so, Valeo cameras, ADAS sensors, and machine learning algorithms stream real-time video and real-world perception data to the game. The game can be played on a mobile device, like a cell phone or a tablet, using the video as the background and incorporating real-world objects as part of the gameplay.

Multiple passengers inside the vehicle can play the game simultaneously, and the players can compete against each other. In addition to the entertainment benefits of the system, studies have shown that an XR in-vehicle game can cause much less motion sickness than games that are not related to vehicle movements and speed changes, thanks to the use of real-time visuals from the vehicle’s surround view cameras. Valeo Racer utilizes Valeo ADAS sensors and perception algorithms and does not require additional hardware, making it an ideal add-on to existing ADAS-enabled vehicles.