Oculus is rolling out Passthrough API for mixed reality on Quest 2 headsets

Oculus has announced a new API that lets developers use mixed reality visuals in their Oculus Quest 2 games and apps. For this, video images from the Oculus Quest 2 sensors are ‘mixed’ with virtual VR images.

An experimental version of the Passthrough API will be introduced in v31 of the Oculus SDK, the Facebook subsidiary reports in a blog post. The API allows VR developers to process, among other things, the black-and-white images from the four Oculus Quest 2 cameras in their apps and games. These images can then be modified, for example with color overlays.

Oculus lists several use cases for the feature. For example, productivity apps could display Quest 2 users’ physical keyboard in a virtual environment. For example, games could use the feature to place zombies in users’ living rooms, the company writes.

The Oculus Quest headsets and the Rift S already have it some sort of passthrough function, which allows users to view what is happening in the real world while playing a game. Facebook late, however to know about UploadVR that the new Passthrough API will only be available for the Oculus Quest 2 for the time being. The company also says that the video images will be processed by the Quest 2 itself and added to the VR app or game. According to the company, this means that apps and games that use the Passthrough API cannot save or view these camera images themselves.

Among other things, the Passthrough API lets users use their physical keyboard within VR environments. Click for a gif.
Source: oculus