xAI is looking to create AI systems that can understand the universe and aid humanity in its pursuit of knowledge. The omni team specifically aims to create AI experiences beyond text, enabling understanding and generation of content across various modalities like image, video, and audio.
Requirements
- Python
- Jax / PyTorch
- Spark / Ray
- Rust
- Has worked on one or more modalities other than text for model training/serving optimization.
- Keeping up with state-of-the-art techniques for preparing multimodal training data.
Responsibilities
- Develop and optimize scalable frameworks and software for large-scale machine-learning tasks, including model training, inference, and large-scale data processing.
- Design, build, and implement large-scale distributed training systems.
- Profiling, debugging, and optimizing GPU utilization for multimodal model training and inference.
- Building scalable infrastructure for multimodal data management and crawling.
- Hardware / Software / Algorithm co-design.
Other
- Strong engineering skills with passion to improve different aspects of data and model.
- Candidates are expected to be located near the Bay Area or open to relocation.
- All employees are expected to be hands-on and to contribute directly to the company’s mission.
- Leadership is given to those who show initiative and consistently deliver excellence.
- Work ethic and strong prioritization skills are important.
- All engineers and researchers are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.
