GEICO is seeking an experienced Sr ML engineer to join their AI org to play key roles for the development of Geico’s virtual assistant platform that elevates the productivity for 30K+ internal associates and the customer experience for millions of policyholders. The AI Agent Platform Engineers are responsible for building key multi-tenant services that power the building, testing, simulation, deployment and hosting of LLM-based agents.
Requirements
- 5+ years of professional software development experience with at least two general-purpose programming languages such as Java, C++, Python or C-Sharp.
- 4+ years of experience designing and building AIML platform and systems utilizing open-source/cloud-agnostic components such as search engine (e.g. elastic search, Qdrant), data warehouse (e.g. snowflake), streaming platform (e.g. Kafka), relational database (e.g. postgresql), Nosql (e.g. MongoDB, Cassandra), distributed processing (e.g. Spark, Ray), workflow management (e.g. Airflow, Temporal), memory management (e.g. Redis), etc.
- 3+ years’ experience managing end-to-end software development life cycle (version control, CICD pipelines, Kubernetes clusters, testing, monitoring & alerting, production support etc.)
- 3+ years’ experience building training, finetuning, real-time/batch inferencing and evaluation systems for AIML models and LLMs, esp. utilizing GPU-powered infrastructure
- 3+ years’ experience with cloud providers such as Azure and AWS
- 2+ years’ experience building conversational experiences and agentic workflows, leveraging open source LLMs, e.g. Llama, Mistral, Claude etc.
- Experience with LLM observability software such as Langsmith, Arize Phoenix, etc.
Responsibilities
- Own design, development and maintenance of high-performance, durable and scalable platform components that jointly power large sets of end-to-end GenAI agentic workflows. Examples include AI agent building & deployment, prompt management, workflow orchestration, MCP registry, etc.
- Contribute to the selection, evaluation, and implementation of software platforms, tools, and frameworks, balancing build vs. buy, speed to market, maintainability, etc.
- Collaborate with cross-functional teams, including data scientists, ML engineers, software engineers, product managers, designers to gather requirements, define project scope and prioritize feature backlogs.
- Establish pragmatic technical visions & roadmaps that balance business outcome, product release timelines and engineering excellence.
- Assist in the planning and estimation of software development projects, ensuring the efficient allocation of resources and timely delivery of solutions.
- Mentor and guide junior engineers via code reviews and design sessions, fostering a collaborative and high-performance team culture, elevating AI engineering best practices across the company.
Other
- Collaborate with cross-functional teams, including data scientists, ML engineers, software engineers, product managers, designers to gather requirements, define project scope and prioritize feature backlogs.
- Mentor and guide junior engineers via code reviews and design sessions, fostering a collaborative and high-performance team culture, elevating AI engineering best practices across the company.
- Strong communication and problem-solving skills to excel in dynamic, cross-functional decision-making environments
- GEICO will consider sponsoring a new qualified applicant for employment authorization for this position.
- The equal employment opportunity policy of the GEICO Companies provides for a fair and equal employment opportunity for all associates and job applicants regardless of race, color, religious creed, national origin, ancestry, age, gender, pregnancy, sexual orientation, gender identity, marital status, familial status, disability or genetic information, in compliance with applicable federal, state and local law.
