NVIDIA is looking to solve the problem of building the future of real-time AI for sensor-driven applications, specifically by extending the Holoscan Platform's capabilities with generative AI and GPU-resident generative methods.
Requirements
- Dynamic programming expertise in C++ (modern standards), plus proven Python skills for prototyping and tooling.
- Deep passion for real-time AI, computer vision, and sensor-driven systems-plus a passion for high-performance visualization and rendering.
- Familiarity with multimodal or vision-language models and an understanding of how to adapt them to streaming or real-time workloads is a strong plus.
- Familiarity with GPU processing and rendering pipelines, synchronization, GPU memory management, and multi-GPU rendering is a plus.
- Experience with CUDA C/C++ and deep knowledge of GPU architecture and parallel programming paradigms.
- Knowledge of Omniverse Kit, or other GPU rendering frameworks for real-time visualization.
- Acute understanding of low-latency streaming pipelines for multimodal sensor fusion
Responsibilities
- Architect the next generation of Holoscan SDK by developing intuitive, scalable APIs for real-time sensor, imaging, and multimodal data processing—balancing developer usability with peak GPU performance.
- Prototype GPU-accelerated algorithms for computer vision, imaging, sensor fusion, and low-latency rendering-translating research into production-grade software.
- Build and optimize core GPU libraries for accelerated I/O, streaming, decoding, and visualization, employing CUDA, Vulkan, and GPU-resident data paths.
- Contribute to real-time visualization frameworks for medical, robotic, or industrial applications-integrating Vulkan, OpenGL, or Omniverse/RTX-based rendering back-ends.
- Benchmark performance rigorously, profiling and optimizing across the full pipeline (Sensor → AI → Render → Display, Sensor → AI → Robotic Control).
- Combine generative models with the Holoscan Sensor Bridge (HSB), Isaac Sim, ISAAC Lab and Omniverse to create real-time “AI-powered virtual sensors” that behave like real hardware—enabling development and testing long before physical sensors exist.
- Prototype and optimize neural field (NeRF/SDF/Gaussian) operators for real-time scene reconstruction, view synthesis, and 3D perception—directly within Holoscan’s streaming architecture.
Other
- A strong communicator and collaborator able to work across multiple domains-from AI and compute to graphics and visualization.
- 8+ years of experience building and shipping complex, high-performance imaging, sensor, or rendering software.
- Master’s/PhD or equivalent experience in Computer Science, Applied Math, Electrical or Computer Engineering, or related fields.
- Ability to work in a diverse environment and commitment to fostering a diverse work environment.
- Travel requirements not specified
