NVIDIA Isaac Sim
NVIDIA Isaac Sim™ is an open source reference framework built on NVIDIA Omniverse™ libraries for robotics simulation, testing, and synthetic data generation in physically based virtual environments.
Isaac Sim is fully extensible, so developers can build custom OpenUSD-based simulators or integrate framework capabilities into existing testing and validation pipelines.
How Isaac Sim Works
Isaac Sim can ingest data from multiple sources—such as computer-aided design (CAD), Unified Robot Description Format (URDF), or real-world captures via NVIDIA Omniverse NuRec and Isaac TeleOp—and convert it into USD. Developers then assemble simulation scenes by assigning materials, enabling physics, and configuring robot and sensor models. From there, robots can be used with NVIDIA Isaac Lab for robot learning and simulated in Isaac Sim.
Isaac Sim also supports controllable synthetic data generation, letting developers build custom data pipelines that complement their existing data sources. That data can be further augmented with NVIDIA Cosmos™ world foundation models. Finally, developers can train perception and mobility stacks in simulation and evaluate the end-to-end system in Isaac Sim using software-in-the-loop or hardware-in-the-loop testing.
NVIDIA NeMo Retriever 收集的 NIM 微服务用于构建优化后的摄取和检索管道，以实现大规模的高精度信息检索。