
Start Testing WordPress’ New Interactivity API
Aug 27, 2023Create a Chatbot Trained on Your Own Data via the OpenAI API — SitePoint
Aug 23, 2023World Rhythmic Gymnastics Championships 2023: All final results and medals
Aug 15, 2023Bruins have cap space options with offseason to
Aug 10, 2023Adopting an API Maturity Model to Accelerate Innovation
Jul 26, 2023Quest Passthrough API Imminent, Meta Support Page Suggests
Meta's support website now describes a "headset camera" permission for Quest headsets, suggesting the Passthrough API is launching soon.
While headsets like Quest 3 and Apple Vision Pro use cameras to let you see the real world, today only the system software gets raw access to these cameras. Third-party developers can use passthrough as a background, sure, but they don't actually get access to it. They instead get higher-level data derived by the system, such as hand and body skeletal coordinates, a 3D mesh of your environment with bounding boxes for furniture, and limited object tracking capabilities. That means they can't run their own computer vision models, which severely limits the augmentation capabilities of these headsets.The exception is that on visionOS 2, Apple is now giving enterprise companies raw access to Vision Pro's passthrough cameras for non-public internal apps, but this requires a special licence from Apple and is restricted to "in a business setting only".
Meta announced the Passthrough API at Connect 2024 back in September, saying that it will "enable all kinds of cutting-edge MR experiences".
Now, just over five months later, a Meta support page just went live describing a new "headset camera" permission which "allows an app to access the real-time passthrough camera feed from the front of your headset".
The page was first spotted by VR enthusiast Luna, and gives three examples of how Quest apps could leverage the passthrough view:
Meanwhile, Google confirmed last month that Android XR, its upcoming OS set to debut in Samsung's standalone headset, will let apps access the passthrough camera view at launch.
• Object recognition• Location recognition. • Other machine learning functionality
