Toyota Research Institute (TRI) is looking to hire a machine learning engineer to develop infrastructure and support researchers in creating foundation models for general-purpose robots capable of performing a wide variety of dexterous tasks. This involves building Large Behavior Models (LBMs) using generative AI techniques to produce robot actions from sensor data and human requests, leveraging a combination of real-world robot demonstrations, internet-scale data, and high-quality simulation.
Requirements
- Hardware experience on robots
- Communication protocol experience (ROS, WebSocket, RPC…)
- Strong software engineering skills in Python, PyTorch, and distributed systems.
- Experience with large-scale data handling, including streaming, preprocessing, and storage of video or sensor data.
- Continuous integration
- Familiarity with modern ML efficiency frameworks (e.g., FSDP, DeepSpeed, XLA, Ray, Hugging Face Accelerate).
- Experience with machine learning and familiarity with large multi-modal datasets and models.
Responsibilities
- Develop our hardware platform, making sure the robots and software stack are state-of-the-art, operational, and continuously improved with new functionalities.
- Build APIs and systems for high-throughput inference and logging in simulation and on real robot platforms.
- Enable low-latency model serving and robust policy–environment communication.
- Design metrics pipelines for quantitative and qualitative evaluation.
- Build tools for experiment tracking, logging, visualization, and leaderboard management using systems like Weights & Biases, MLflow, or ClearML.
- Build scalable pipelines for heterogeneous multimodal data (images, text, video, touch, depth, proprioception).
- Work with data storage, versioning, streaming, and visualization systems optimized for throughput and accessibility.
Other
- A “make it happen” attitude and comfort with fast prototyping.
- A passion for robotics and development grounded in important fundamental problems.
- Experience working in a research environment, published research papers, open-source projects
- The pay range for this position at commencement of employment is expected to be between $176,000 and $264,000/year for California-based roles.
- TRI offers a generous benefits package including medical, dental, and vision insurance, 401(k) eligibility, paid time off benefits (including vacation, sick time, and parental leave), and an annual cash bonus structure.
