84.51° is seeking a Lead Software Engineer to help shape the future of AI infrastructure at 84.51° and Kroger by developing and maintaining an enterprise-scale AI Gateway that provides centralized, secure, and scalable access to Large Language Models (LLMs). This is a mission-critical and fast-growing product that handles millions of requests and billions of tokens per week, and is core to the company's AI strategy.
Requirements
- 5+ years of experience with web development technologies, including HTML, CSS, JavaScript and/or Typescript.
- 5+ years of experience developing web applications using frameworks such as Svelte, Angular, or React (we use SvelteKit on this team)
- 5+ years of experience with public cloud technologies (Azure or GCP preferred), including demonstrated application development and hosting focus.
- 5+ years of experience with container technologies (Docker, Kubernetes, Helm)
- 3+ years of experience with cloud infrastructure automation tools (Terraform)
- Experience with AI-related concepts such as LLMs, Agents, Model Context Protocol (MCP), RAG, fine-tuning.
- Experience developing AI-powered features or applications.
Responsibilities
- Lead development of back-end services, primarily in Python
- Lead development of front-end services, primarily with SvelteKit
- Work regularly with AI model APIs (such as the Azure OpenAI API or Google VertexAI API)
- Work daily with Azure and Google Cloud Platform (GCP)
- Project-level development of infrastructure using Terraform
- Project-level development of CI/CD pipelines using GitHub Actions
- Troubleshooting of issues related to API deployments in Kubernetes (Azure Kubernetes Service)
Other
- 4-year degree in a technology related discipline (Computer Science, Computer Engineering, Information Systems, etc.) or equivalent work experience
- 5+ years of experience with SDLC and working with Agile development teams
- Ability to manage large size technical projects, solving related problems and working to tight deadlines while under pressure
- Strong interpersonal and communication skills with demonstrated experience leveraging these skills with technical teams and non-technical business units
- Desire to learn new technology and grow across different areas of technology
