Upstart's GenAI Core Platform team needs to build foundational infrastructure to democratize access to generative AI across the company, enabling the safe, efficient, and responsible use of LLMs across all business domains and scaling internal GenAI and LLM implementation.
Requirements
- 10+ years of professional software engineering experience, with at least 3 years leading large-scale, cross-team technical initiatives
- Proven track record of delivering complex, distributed systems and platform infrastructure that span multiple teams
- Deep expertise in backend systems and infrastructure technologies such as Kubernetes, Docker, Terraform, and cloud-native architectures
- Experience designing and operationalizing ML/LLM platforms at scale, including optimization for cost, latency, and reliability
- Demonstrated ability to set long-term technical direction and influence organizational strategy
- Full-stack engineering experience (Python, FastAPI, Kotlin, Spring, React/TypeScript, or similar)
- Expertise in LLM-specific infrastructure such as inference optimization (quantization, ONNX, streaming), retrieval-augmented generation, and vector databases
Responsibilities
- Define and drive the multi-year technical roadmap for the Core GenAI Platform, influencing adoption and alignment across several engineering teams
- Lead architecture and design of large-scale, mission-critical systems for model inference, orchestration, and compliance
- Identify and solve systemic technical risks that impact multiple teams and business-critical AI initiatives
- Build high-leverage, generalizable platform components that meaningfully accelerate the productivity of engineers across Upstart
- Establish operational standards for GenAI integrations, ensuring security, fairness, and reliability at scale
- Mentor senior engineers (L5) and shape the growth of future technical leaders, fostering a culture of learning and excellence
- Collaborate with VP-level and above leadership to influence business strategy with technical insight
Other
- Represent Upstart internally and externally as a thought leader in GenAI systems through executive reviews, cross-company forums, and industry venues
- Excellent communication skills with a history of driving alignment across engineering and business stakeholders
- Awareness of industry best practices and risks in GenAI including hallucination mitigation, fairness, explainability, and data privacy
- Experience mentoring senior engineers and shaping organizational standards for operational excellence
- Competitive Compensation (base + bonus & equity)
