Otter.ai is looking to build the infrastructure that powers advanced multi-language, automatic speech recognition (ASR) and real-time speaker identification systems, and needs a Software Engineer to design and scale the backend platforms that bring cutting-edge speech AI to life
Requirements
- Has 2+ years of experience designing and building scalable backend systems and distributed infrastructure
- Is fluent in Python (bonus for C++) and familiar with building high-performance services
- Understands data structures, algorithms, distributed systems, and operating systems at a deep level
- Has worked with databases (SQL & NoSQL), queuing systems, and pub/sub solutions, and knows what’s happening “under the hood”
- Has experience with ML infrastructure / MLOps (e.g., model deployment, feature stores, pipelines) or is eager to learn quickly
- Experience with real-time streaming frameworks (Kafka, Pulsar, Flink)
- Hands-on experience with container orchestration (Kubernetes, ECS)
Responsibilities
- Design, build, and operate backend services that power real-time, multi-language, ASR and speaker identification features
- Architect scalable, fault-tolerant infrastructure across databases, queues, and pub/sub systems to support low-latency ML workflows
- Partner with ML teams to productionize models (training pipelines, model deployment, versioning, and monitoring) for real-time and batch inference
- Improve system observability, reliability, and performance for large-scale speech data ingestion and streaming
- Contribute to the evolution of our platform architecture, including microservices, orchestration (Kubernetes), and API integrations
- Collaborate with cross-functional teams to streamline developer experience, CI/CD pipelines, and automated testing for ML-backed services
Other
- 2+ years of experience
- Bachelor's degree or higher
- Ability to work in a fast-paced environment
- Strong collaboration and communication skills
- Commitment to diversity and inclusion
