At SIGGRAPH 2025, NVIDIA revealed its latest leap in simulation and rendering: the Omniverse NuRec 3D Gaussian Splatting libraries. This suite, part of its Omniverse platform, enables ray-traced 3D Gaussian Splatting using NVIDIA’s 3D Gaussian Unscented Transform, letting developers reconstruct and simulate real-world environments from sensor data with unprecedented fidelity. These tools bring neural rendering into Omniverse workflows, effectively merging the physical and virtual realms.
NuRec isn’t just theoretical—it’s already integrated into simulation tools like CARLA, used by more than 150,000 autonomous vehicle developers, and is supported by tools like Voxel51’s FiftyOne, adopted by Ford and Porsche for visual AI data systems.
These developments are a central part of NVIDIA’s broader Physical AI push, interweaving graphics, reinforcement learning, physics, and AI reasoning. As Sanja Fidler, VP of AI Research at NVIDIA, puts it:
“AI is advancing our simulation capabilities, and our simulation capabilities are advancing AI systems.”
Why It Matters for AVGC, XR & AI Communities
| Benefit | Explanation |
|---|---|
| Physically Accurate Reconstruction | NuRec transforms real-world captures into lifelike, ray-traced virtual environments. |
| Seamless Industry Integration | Incorporated into CARLA and FiftyOne, NuRec broadens its impact across autonomous systems and dataset workflows. |
| AI + Graphics Convergence | Reinforces the trend where neural rendering drives new possibilities in realistic simulation, content creation, and AI training. |
| Next-Gen Physical AI | Fuels the creation of digital twins, immersive worlds, and AI agents that “reason” within simulated realities. |
