Aware Multimodal Interaction and Extended Reality for Cars and Mobile Work Machines

The recent technological advances in electrification, automation, and connectivity have drastically changed the automotive industry and mobile industrial machinery. The use of heavy machinery and passenger vehicles on the road has increased exponentially, leading to a higher demand for safe and efficient operations.

The field of user interfaces for industrial heavy machinery and passenger vehicles is rapidly evolving, with new advancements and innovations emerging every year. As technologies such as AI, AR, and autonomous systems continue to mature, we can expect to see even more sophisticated and user-friendly interfaces in the years to come. 

The aim of the MIXER project is to advance several research and manufacturing areas by creating novel technologies, applications and standards for in-vehicle interaction and remote situational awareness. Key benefit areas will include integrating current and upcoming technologies and tools to creating next-gen Driver and Occupant Management systems, Augmenting content to enhance situational awareness using AR / HUD displays, standardizing processes for advance ADAS systems and SAE levels of autonomy, developing AI voice assistants for in-cabin multimodal interaction, and defining connected vehicle infrastructure to create Vehicular Metaverse.