The Isaac Software Development Kit (SDK), says the company, accelerates development for manufacturers, researchers, and startups by making it easier to add AI for perception and navigation into next-generation robots. The SDK includes the Isaac Robot Engine, packaged with high-performance robotics algorithms and hardware reference applications.
The Isaac Robot Engine uses computational graphs and an entity component system to enable developers to break down complex robotic tasks into a network of smaller, simpler steps. Developing a complex system is made easy, says the company, using modular capabilities - called 'GEMS' - for sensing, planning, and actuation that can be easily plugged into a robotics application.
For example, developers can add obstacle detection, stereo depth estimation, or human speech recognition to enrich their robot use cases. Robotics applications developed on the Isaac Robot Engine can seamlessly run on edge devices like the company's Jetson Nano and Jetson AGX Xavier system-on-modules, as well as a workstation with a discrete NVIDIA GPU.
Hardware reference applications are provided for everything from learning the basics of robotics to advanced delivery and research robots. Also available is Isaac Sim, a virtual robotics laboratory and a high-fidelity 3D world simulator that allows developers to quickly and easily train and test their robots in detailed, highly realistic scenarios.
Developers can use virtual robots with simulated sensors (i.e., RGB, stereo, depth, segmentation, LIDAR, and IMU) in Isaac Sim to test their applications in a high-fidelity simulation environment. Once tested, applications can be deployed to NVIDIA Jetson AGX Xavier, Jetson TX2, or Jetson Nano running on physical robots.
Robots in Isaac Sim are tightly coupled to the tools and frameworks in the Isaac SDK, enabling easy transfer of algorithms and data between physical and virtual robots. Both the Isaac SDK robotics developer toolbox and Isaac Sim are available now.