AssemblyAI is looking to solve customer problems and improve their AI and agentic workflows by building and maintaining a unified API platform that connects customers to multiple LLM providers.
Requirements
- Strong proficiency in Go with demonstrated ability to write production-quality code
- Hands-on experience with LLM APIs (OpenAI, Anthropic, etc.) and understanding of prompt engineering concepts
- Experience building or working with API gateways, proxies, and rate limiting systems
- Deep experience with prompt engineering, chain-of-thought, few-shot learning, and other LLM optimization techniques
- Experience building applications with llms or ai agents with cascading architectures
- Solid understanding of software engineering fundamentals: Data structures and algorithms, System design and architectural patterns, Testing strategies (unit, integration, end-to-end), Code review practices and technical collaboration
- Experience with RESTful APIs and distributed systems concepts
Responsibilities
- Partner closely with the customer success team to understand customer use cases, challenges, and integration needs
- Translate customer pain points surfaced by the CS team into technical solutions and product improvements
- Build features and tooling that directly address customer needs and improve their workflows
- Own and deliver complete features and integrations within our LLM gateway service
- Build and maintain integrations with multiple LLM providers and AI services (OpenAI, Anthropic, Google Vertex, AWS Bedrock etc.)
- Write clean, maintainable, well-tested code following best practices
- Design and implement scalable, fault-tolerant solutions with appropriate abstractions
Other
- 5+ years of professional software engineering experience
- Strong communication skills and ability to collaborate effectively with cross-functional teams
- Track record of delivering high-quality, reliable software in a fast-paced, team environment
- Ability to thrive in a startup environment with changing priorities and rapid iteration
- Customer-obsessed - You genuinely care about solving customer problems and making their lives easier
