Isaac Sim Built on Omniverse

Isaac Sim built on NVIDIA Omniverse™ leverages the NVIDIA Omniverse Kit and has been enhanced with robotics-specific extensions. It provides access to NVIDIA PhysX and RTX ray-tracing technologies for high performance, photo-realistic robotic simulations.

Isaac SDK integrates with Isaac Sim built on Omniverse through the Robot Engine Extension. Sensor data and drive commands are exchanged though TCP. Isaac SDK provides navigation and manipulation sample applications that work with Omniverse.

Getting Started

Download Isaac Sim built on Omniverse from Isaac Sim Downloads and follow instructions there to set up the simulator.

Note

The Isaac SDK 2020.2 release requires the Isaac Sim 2020.2.2 release for simulation. Isaac Sim 2020.2.2 will be available a few weeks after the Isaac SDK 2020.2 release.

Simulator Settings

The physics simulation setting can be access in Physics > Settings. The default physics settings of 60 timesteps per second and maximum 2 steps per frame provide sufficient accuracy for differential base simulation when the simulation framerate is higher than 30Hz. If the framerate drops below 30Hz, increase the max num steps to 3. This setting will persist after restarting Omniverse Kit.

Note

Increasing the maximum number of physics steps per frame will further decrease the framerate.

../../_images/kit-phyx-max-step.png

Camera simulation in Isaac Sim currently only publishes the viewport camera. To provide valid first-person robot camera simulation data to Isaac SDK, switch the viewport camera to the robot camera and change the viewport resolution to 1280x720 to match the expected camera resolution for most Isaac SDK perception modules. This setting will not persist after restarting kit.

../../_images/kit-viewport.png

Manipulation Samples

See Manipulation Sample Applications to learn how to use Isaac SDK manipulation sample applications with Omniverse Isaac Sim.

Jetbot Samples

See Jetbot Sample Applications to learn how to use Isaac SDK Jetbot sample applications with Omniverse Isaac Sim.