Partnership between Meta and BMW aims to integrate virtual and augmented reality into smart vehicles

It collaboration, which began in 2021, seeks to revolutionize travel in cars, trains and planes, opening up new possibilities for communication, entertainment and hands-free utility.

The challenge faced by the research team is related to tracking technology in moving environments. Meta already has VR headsets equipped with sensors, but moving vehicles introduces additional complexity.

To overcome this obstacle, they are incorporating real-time data from inertial motion sensors (IMUs) and cameras from BMW vehicles into the Project Aria research glasses tracking system. This will allow precise location of virtual objects in relation to the moving vehicle.

With the improved tracking system, virtual and mixed reality passenger experiences were realized in moving cars, accurately anchoring virtual objects through a digital twin of the vehicle. 

Meta and BMW intend to continue working together to further explore the perception capabilities of modern cars, enabling the development of future augmented reality glasses and personalized AI assistants. This partnership prometransform the travel experience and open up new opportunities for entertainment and interaction within vehicles.

See also:

BMW in the metaverse? German automaker requests trademark registration in the US to explore web3.0

The high-end car manufacturer BMW has just registered a patent for the brand in the digital environment in the United States to enter the metaverse and trade in NFTs. The registration was approved on November 25th, but was only announced last Wednesday (30th).

Apple registers “xrOS” brand indicating possible operating system for virtual reality headset

A Apple, one of the largest technology companies in the world, recently registered a trademark called “xrOS” in New Zealand.