With NVIDIA Omniverse, millions of developers worldwide can now take their workflows to the next level. At GTC, we introduced exclusive events, sessions, and other resources to showcase how we extend the Universe, multi-GPU, real-time simulation, and reference development platform to 3D workflows.
Our dedicated Developer Day was an exclusive event that offered the latest tutorials, breakout sessions with engineers and news, and insight into the NVIDIA Omniverse. It highlighted the many ways Omniverse superusers and developers can build, expand, and connect tools and platforms to the Omniverse ecosystem. During the breakout sessions, participants connected with senior developers of Omniverse to learn more about the licensing structure of the platform.
With the growing NVIDIA Developer Program, Omniverse users can access the latest technical resources, tutorials, and more. Developers and software providers are welcome to build custom tools on the Omniverse platform to expand its functionality.
We also announced additions to our Omniverse Connectors program with popular tools such as Esri, Reallusion, Lightmap, RADiCAL, and Replica Studios that developers can use to streamline complex workflows.
NVIDIA Omniverse user group
The next NVIDIA Omniverse User Group is tomorrow, November 11 at. 7.00 PT. All developers, researchers, creators, students, hobbyists and other professionals using Omniverse are welcome to attend this special event, as well as anyone interested in learning more about the platform.
The event will provide a behind – the – scenes look at upcoming NVIDIA Omniverse platform features, connect users and reveal who won the latest Omniverse Create competition.
A new, powerful tool for improving synthetic data generation
NVIDIA announced the new Omniverse Replicator, a synthetic data generation engine that produces physically simulated synthetic data for deep neural network training. Using the Omniverse Replicator, developers can easily create massive and diverse data that is not only physically accurate, but also tailored to their workflows.
NVIDIA introduced two Omniverse Replicator-based applications for generating synthetic data:
- One for NVIDIA DRIVE Sim, a virtual world hosting the digital twin of autonomous vehicles.
- And one for NVIDIA Isaac Sim, a virtual world for the digital twin of manipulation robots.
These applications will help accelerate the development of autonomous vehicles and robots.
A new platform technology to build interactive AI avatars
NVIDIA also announced the Omniverse Avatar, a technology platform that will enable developers to build intelligent “virtual robots”. Omniverse Avatar will connect NVIDIA technologies in speech AI, computer vision, natural language comprehension, recommendation engines and simulation technologies to provide real-time, intelligent assistants for custom support or video conferencing and telepresence use cases.
New Omniverse connections and extensions for developers
Developers can explore how Omniverse Connectors and extensions open portals between apps. NVIDIA is partnering with partners to bring additional 3D tools to Omniverse so more users can simplify complex tasks and accelerate workflows faster.
Some of the latest connections via Connectors or extensions now available in the Omniverse beta launcher include:
- Esri’s ArcGIS CityEngine is an application that helps users create massive cities at once and makes it easy for users to make quick adjustments to the architectural style or other features of their city model. Esri built an Omniverse Connector for CityEngine so design teams can conveniently deliver full 3D urban models and geographic context (GIS) and visualize various aspects of an urban design with real-time photorealism. The Beta Connector was used in the Ericsson demo that was shown during the GTC keynote.
- Lightmaps HDR Light Studio is an application that adds live HDRI map writing and live HDRI textured area lighting to existing 3D software and renderers. This lets creators easily create perfect lighting setups that make 3D content shine. The Omniverse extension to HDR Light Studio enables groundbreaking lighting workflows where lighting can be easily created and art instructed by teams collaborating in real time.
- RADiCAL Live generates real-time 3D skeletal motion data from a single 2D video feed from any consumer device without sensors, markers or special cameras. Users can connect a video livestream to Radical’s platform and receive multiplayer animation data back to apps and games on any device, anywhere in the world, in real time.
- Reallusion enhances animation pipelines with iClone Connector for Omniverse. With iClone, the character animation process is more streamlined, robust and easier than ever – Omniverse users can access a massive library of high-quality assets and create worlds with photorealistic digital people, props, cameras and lights.
- Replica Studios uses AI to help developers produce naturally sounding performances without a voiceover artist or studio. Replica is developing an Omniverse extension so that developers can seamlessly use Replica’s voice library with Omniverse-connected apps.
Additional Omniverse Connectors, extensions and content libraries coming soon include Adobe Substance 3D Material Plugin, Maxon Cinema4D, Clo Virtual Fashion, Daz3D, PlantFactory e-on softwares, PlantCatalog and VUE, Golaem, Notch, Style3D, TwinBru and Wacom pen support .
Help build the foundation of the Omniverse today
Learn more about NVIDIA Omniverse open beta by diving into the Omniverse Resource Center, which describes how developers can use the Omniverse Kit and Omniverse Connect SDKs to build custom applications and extensions for the platform.
With the free open beta license, users can access all platform apps, sync live with their favorite 3D tools using Omniverse Connectors, and collaborate with others. For teams, Omniverse Enterprise offers an annual subscription.
For further support, explore the Omniverse forums and our medium channel, check out the tutorials at Twitter and YouTube, and sign up for our Discord server to chat with the community.
See NVIDIA’s founder and CEO Jensen Huang’s GTC keynote address below: