Nvidia and Apple are collaborating on the Vision Pro in the most unlikely way

Nvidia revealing support for the Apple Vision Pro.

You don’t normally see tech titans like Nvidia and Apple pair up, but the two companies announced at this week’s Nvidia GTC 2024 that they are coming together around the Vision Pro. Nvidia is bringing its Omniverse Cloud platform to Apple’s headset, allowing users to interact with objects and design directly through the Vision Pro.

The basis of support is a set of Omniverse Cloud APIs that can stream Omniverse assets to Apple’s headset. Omniverse isn’t running on the Vision Pro itself. Instead, designers can stream scenes made with the Universal Scene Description (OpenUSD) in Omniverse to the Vision Pro, and interact with the 3D objects natively.

Nissian demoed this capability in a demo video. Through the Vision Pro, the user is able to swap out paint colors, adjust the trim, and even go inside the car using spatial awareness thanks to the Vision Pro.

Nvidia and Apple team on Vision Pro an in unexpected way | Digital Trends

Get your weekly teardown of the tech behind PC gaming

It’s sure to make a splash in the enterprise sector, but there are some consumer implications here. Nvidia is essentially showing that it can stream interactable 3D applications to the Vision Pro. This is enabled by Nvidia’s Graphics Delivery Network (GDN), which is already being used to stream 3D applications from the cloud. The fact that it can work on the Vision Pro is a big deal.

The linchpin for this are the Omniverse Cloud APIs. Also at GTC, Nvidia revealed five new APIs centered around Omniverse Universal Scene Description (OpenUSD) loud that can be used individually or collectively:

  • USD Render: support for ray-traced renders of OpenUSD data
  • USD Write: support for modifying OpenUSD data
  • USD Query: support for interactive scenes
  • USD Notify: support for tracking USD changes
  • Omniverse Channel: allows users to connect tools and projects across scenes

Right now, Omniverse Cloud on the Vision Pro is focused around enterprise applications, just as Apple’s headset itself is. This is still a critical foundation for streaming interactable 3D applications to Apple’s headset in the future. Even with how powerful the Vision Pro is, it’s not enough to handle aspects like ray tracing in highly detailed 3D scenes. Being able to stream these scenes at the same quality could line up some exciting apps in the future.

Editors’ Recommendations

Jacob Roach

Jacob Roach is a writer covering computing and gaming at Digital Trends. After realizing Crysis wouldn’t run on a laptop, he…

Vision Pro visors are cracking, and no one knows why

cracked vision pros not dropped and the mystery continues inphenite s pro has a long crack running top to bottom

Some Vision Pros have cracks in the middle, at the bottom of the front glass. Wohinbistdu and dornbirn / Reddit

The front glass of Apple’s Vision Pro is cracking down the middle for a small, but growing number of people. The cause is a mystery because the owners say they didn’t drop, mishandle, or abuse the headset in any way. After an outlier 18 days ago, several more owners have reported the same problem occurring in the past 48 hours.

Read more

Don’t believe the reports about people returning Vision Pros

Someone using Vision Pro at a demo in an Apple Store.

We all know that Apple’s Vision Pro is incredibly expensive — $3,499 is a huge amount to pay for a mixed-reality headset, even if it is by far the best on the market. That has apparently led to some high-profile Apple fans returning their Vision Pros, and not just because of the price.

In his latest Power On newsletter, Bloomberg’s Mark Gurman says he spoke to over a dozen prominent Apple users who have recently sent their headsets back for a refund. The reasons they returned their products, Gurman says, fell along a few familiar lines.

Read more

I tried the Apple Vision Pro. Here’s why it won’t replace my iPhone

Christine wearing the Apple Vision Pro demo unit.

The Apple Vision Pro is one of Apple’s most fascinating new product launches. It’s the first new product line from Apple since the Apple Watch, but the hype around it has been more like when Apple first introduced the original iPhone. Of course, Apple was not the first to the market with a VR/AR headset, but it is definitely what would be considered the most “mainstream” option out there, considering the brand name.

When Apple announced the Apple Vision Pro on June 5, 2023, during its WWDC 2023 keynote, I was excited. After years of rumors, it was finally happening. Preorders started on January 19, 2024, and the  Apple Vision Pro launched on February 2, 2024, in the U.S. The problem? It costs at least $3,500, making it a hard sell for many as a first-generation Apple product.

Read more

[ For more curated Computing news, check out the main news page here]

The post Nvidia and Apple team on Vision Pro an in unexpected way | Digital Trends first appeared on

New reasons to get excited everyday.

Get the latest tech news delivered right in your mailbox

You may also like

Notify of
Inline Feedbacks
View all comments

More in computing