NVIDIA Releases Major Omniverse Upgrade With Generative AI and OpenUSD


NVIDIA today announced a major release of its NVIDIA Omniverse™ platform, offering new foundation applications and services for developers and industrial enterprises to optimize and enhance their 3D pipelines with the OpenUSD framework and generative AI.

The update to Omniverse, an OpenUSD-native software platform for connecting, describing and simulating across 3D tools and applications, accelerates the creation of virtual worlds and advanced workflows for industrial digitalization. Cesium, Convai, Move AI, SideFX Houdini and Wonder Dynamics are now connected to Omniverse via OpenUSD.

Key highlights from the platform update include advancements to Omniverse Kit — the engine for developing native OpenUSD applications and extensions — as well as to the NVIDIA Omniverse Audio2Face™ foundation app and spatial-computing capabilities.

“Industrial enterprises are racing to digitalize their workflows, increasing the demand for OpenUSD-enabled, connected, interoperable, 3D software ecosystems,” said Rev Lebaredian, vice president of Omniverse and simulation technology at NVIDIA. “The latest Omniverse update lets developers tap generative AI through OpenUSD to enhance their tools, and it allows enterprises to build larger, more complex world-scale simulations as digital testing grounds for their industrial applications.”

These platform updates are showcased in Omniverse foundation applications, which are fully customizable reference applications that creatorsenterprises and developers can copy, extend or enhance.

OpenUSD Expands Omniverse Ecosystem
NVIDIA also announced a broad range of frameworks, resources and services for developers and companies to accelerate the adoption of Universal Scene Description, known as OpenUSD.

In addition, the company announced new Omniverse Cloud APIs, built by NVIDIA, for developers to more seamlessly implement and deploy OpenUSD pipelines and applications. For example, ChatUSD is a large language model copilot for developers that can answer USD knowledge questions or generate Python-USD code scripts.

New Omniverse connections enabled by OpenUSD are now available, opening more opportunities for industrial enterprises to break data silos in their complex production pipelines.

Expanding their collaboration across Adobe Substance 3D, generative AI and OpenUSD initiatives, Adobe and NVIDIA announced plans to make Adobe Firefly — Adobe’s family of creative generative AI models — available as APIs in Omniverse, enabling developers and creators to enhance their design processes.

Wonder Dynamics is connected to Omniverse with new OpenUSD export support through its AI platform Wonder Studio, which automatically animates, lights and composes computer-generated characters into live-action scenes. New OpenUSD export support will enable artists to generate and export a complete 3D scene — all from a single camera video.

Luma AI’s reality-capture models in USDZ format can be readily imported to Omniverse. Tools from avatar company Convai and character-engine company Inworld AI are connected to Omniverse. With AI tools like Convai, creators can add characters in their digital twin environments that can provide relevant information about the environment and objects, be a tour guide or be a virtual robot. Move AI enables single-camera motion capture with the Move One app, which can be used to generate 3D character animations that can then be exported to OpenUSD and used in Omniverse.

Omniverse users can now build content, experiences and applications that are compatible with other OpenUSD-based spatial computing platforms such as ARKit and RealityKit. Plus, new support for the Khronos Group’s OpenXR open standard expands Omniverse use to more headsets from manufacturers such as HTC VIVEMagic Leap and Varjo.

Users of SideFX Houdini can also now load Houdini Digital Assets directly into the Omniverse viewport, making Houdini-based connected workflows more seamless. The Cesium extension for Omniverse, called Cesium for Omniverse, enables 3D Tiles, an open standard for streaming massive geospatial datasets in virtual worlds, including those supported by OpenUSD. CGI.Backgrounds now has several ultra-high-definition HDRi maps available in USD Composer. The Cadence DataCenter Design Software™, now available via Omniverse, helps users see computational fluid dynamics simulations in the complete context of their digital twin. With the Cadence data center extension, users can plan, test and validate design and operational considerations before implementing them. And the Blackshark.AI world digital twin platform is now connected to Omniverse.

Customers Using Omniverse for Digitalization
Customers are using Omniverse for tasks ranging from simulating robots to training AI models and improving animation.

Boston Dynamics AI Institute is using Omniverse to simulate robots and their interactions to enable the design of novel robotics and control systems. Continental, one of the leading companies in automotive and industrialization of autonomous systems, is using Omniverse in its mobile robots business to generate physically accurate synthetic data at scale to train computer-vision AI models and perform system-integration testing.

Volvo Cars has transitioned its digital twin to be OpenUSD-based, using Omniverse to create immersive visualizations to help customers make online purchasing decisions.

Marks Design, a brand design and experience agency, is using Omniverse and OpenUSD to streamline collaboration and improve its animation, visualization and rendering workflows.

New Omniverse Systems and Partners
NVIDIA is collaborating with global systems manufacturers to bring RTX workstations optimally configured for Omniverse to millions of designers, architects and engineers. The new systems feature up to four NVIDIA RTX 6000 Ada Generation GPUs, bundled with NVIDIA Omniverse Enterprise software, to accelerate OpenUSD world-building, generative AI-enhanced collaborative design and other industrial digitalization applications.

Omniverse users can also take advantage of the new NVIDIA L40S GPU, a powerful, universal data center GPU that accelerates the most graphics-intensive workloads.