MongoDB is looking to build the next-generation inference platform to support embedding models for semantic search, retrieval, and AI-native experiences within MongoDB Atlas. This involves creating infrastructure for real-time, low-latency, and high-scale inference integrated with Atlas.
Requirements
- 5+ years of experience building backend or infrastructure systems at scale
- Strong software engineering skills in languages such as Go, Rust, Python, or C++, with an emphasis on performance and reliability
- Experienced in cloud-native architectures, distributed systems, and multi-tenant service design
- Familiar with concepts in ML model serving and inference runtimes
- Knowledge of vector search systems (e.g., Faiss, HNSW, ScaNN) is a plus
- Experience integrating infrastructure with production ML workloads
- Understanding of hybrid retrieval, prompt-driven systems, or retrieval-augmented generation (RAG)
Responsibilities
- Design and build components of a multi-tenant inference platform integrated directly with MongoDB Atlas, supporting semantic search and hybrid retrieval
- Collaborate with AI engineers and researchers to productionize inference for embedding models and rerankers — enabling both batch and real-time use cases
- Contribute to platform capabilities such as latency-aware routing, model versioning, health monitoring, and observability
- Improve performance, autoscaling, GPU utilization, and resource efficiency in a cloud-native environment
- Work across product, infrastructure, and ML teams to ensure the inference platform meets the scale, reliability, and latency demands of Atlas users
- Gain hands-on experience with tools like vLLM and container orchestration with Kubernetes
Other
- We are looking to speak to candidates who are based in Palo Alto, CA for our hybrid working model.
- Comfortable working across functional teams, including ML researchers, backend engineers, and platform teams
- Motivated to work on systems integrated into MongoDB Atlas and used by thousands of developers
- Contributions to open-source infrastructure for ML serving or search
- Be part of building the AI foundation of the world’s most popular developer data platform
- Collaborate with ML researchers from Voyage.ai to bring novel ideas into scalable systems
- Tackle challenging problems in inference, observability, and distributed infrastructure
- Work in a culture that emphasizes mentorship, ownership, and technical excellence
- To drive the personal growth and business impact of our employees, we’re committed to developing a supportive and enriching culture for everyone.
- From employee affinity groups, to fertility assistance and a generous parental leave policy, we value our employees’ wellbeing and want to support them along every step of their professional and personal journeys.
- MongoDB is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process.
- To request an accommodation due to a disability, please inform your recruiter.
- MongoDB, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type and makes all hiring decisions without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
