General Motors is seeking to develop scalable, realistic virtual worlds to power the training and validation of robotic foundation models for perception, planning, and manipulation, thereby accelerating model development and deployment for manufacturing technology.
Requirements
- 3+ years of hands-on experience in robotics simulation, synthetic data generation, or virtual environment development
- Proficiency with Isaac Sim, Omniverse, or similar simulation platforms
- Strong programming skills in Python and C++, with experience in simulation APIs and data annotation tools
- Familiarity with 3D vision, sensor modeling, and domain randomization techniques
- Experience integrating simulation outputs into ML pipelines for training and evaluation
- Experience with robotics frameworks (e.g., ROS/ROS2, MoveIt, Nav2)
- Familiarity with CI/CD pipelines and modern software development practices such as Bash, Github, Bazel, Docker
Responsibilities
- Build and customize simulation scenes in Isaac Sim that accurately reflect real-world robotic tasks and factory layouts
- Develop synthetic data generation pipelines, including randomized object placement, sensor simulation, and multi-modal annotations (RGB, depth, segmentation, point clouds)
- Implement and maintain data processing workflows, ensuring data quality, traceability, and compatibility with ML training pipelines
- Optimize simulation performance and realism, tuning physics parameters, asset fidelity, and rendering configurations for scalable experimentation
- Collaborate with robotics engineers and ML scientists to align simulation outputs with model requirements and support sim2real transfer
- Conduct hands-on testing and debugging, iterating on simulation setups and synthetic data strategies to improve model robustness
- Document workflows and contribute to best practices, enabling reproducibility and knowledge sharing across teams
Other
- This role is categorized as onsite. This means the selected candidate is expected to report to a specific location on a full-time basis.
- This job may be eligible for relocation benefits.
- MSc in Robotics, Computer Graphics, Computer Vision, or related field.
- PhD in Robotics, Computer Graphics, Computer Vision, or related field.
- Publications or contributions in simulation, synthetic data, or robotics venues (e.g. ICRA, RSS, CVPR)
