AssemblyAI is looking for a Senior Research Engineer to diagnose and resolve bottlenecks in large-scale distributed training, data processing, and inference systems, and to drive optimizations for existing high-performance pipelines to ensure customers stay on the cutting edge of Speech AI.
Requirements
- Strong expertise in the Python ecosystem and major ML frameworks (PyTorch, JAX).
- Experience with lower-level programming (C++ or Rust preferred).
- Deep understanding of GPU acceleration (CUDA, profiling, kernel-level optimization); TPU experience is a strong plus.
- Proven ability to accelerate deep learning workloads using compiler frameworks, graph optimizations, and parallelization strategies.
- Solid understanding of the deep learning lifecycle: model design, large-scale training, data processing pipelines, and inference deployment.
- Strong debugging, profiling, and optimization skills in large-scale distributed environments.
Responsibilities
- Investigate and mitigate performance bottlenecks in large-scale distributed training and inference systems.
- Develop and implement both low-level (operator/kernel) and high-level (system/architecture) optimization strategies.
- Translate research models and prototypes into highly optimized, production-ready inference systems.
- Explore and integrate inference compilers such as TensorRT, ONNX Runtime, AWS Neuron and Inferentia, or similar technologies.
- Design, test, and deploy scalable solutions for parallel and distributed workloads on heterogeneous hardware.
- Facilitate knowledge transfer and bidirectional support between Research and Engineering teams, ensuring alignment of priorities and solutions.
Other
- This is a cross-functional role requiring strong technical rigor, attention to detail, intellectual curiosity, and excellent communication skills.
- Excellent communication and collaboration skills, with the ability to clearly prioritize and articulate impact-driven technical solutions.
- ambitious, curious, and lead with integrity.
- We’re looking for teammates who won’t just fit in, but will help us define and build our company culture.
- We’re committed to creating a space where our employees can bring their full selves to work and have equal opportunity to succeed.
