Upstart is looking to build a foundational infrastructure for generative AI across the company to enable the safe, efficient, and responsible use of LLMs across all business domains.
Requirements
- 10+ years of professional software engineering experience, with at least 3 years leading large-scale, cross-team technical initiatives
- Proven track record of delivering complex, distributed systems and platform infrastructure that span multiple teams
- Deep expertise in backend systems and infrastructure technologies such as Kubernetes, Docker, Terraform, and cloud-native architectures
- Experience designing and operationalizing ML/LLM platforms at scale, including optimization for cost, latency, and reliability
- Demonstrated ability to set long-term technical direction and influence organizational strategy
- Full-stack engineering experience (Python, FastAPI, Kotlin, Spring, React/TypeScript, or similar)
- Expertise in LLM-specific infrastructure such as inference optimization (quantization, ONNX, streaming), retrieval-augmented generation, and vector databases
Responsibilities
- Define and drive the multi-year technical roadmap for the Core GenAI Platform, influencing adoption and alignment across several engineering teams
- Lead architecture and design of large-scale, mission-critical systems for model inference, orchestration, and compliance
- Identify and solve systemic technical risks that impact multiple teams and business-critical AI initiatives
- Build high-leverage, generalizable platform components that meaningfully accelerate the productivity of engineers across Upstart
- Mentor senior engineers (L5) and shape the growth of future technical leaders, fostering a culture of learning and excellence
- Collaborate with VP-level and above leadership to influence business strategy with technical insight
- Establish operational standards for GenAI integrations, ensuring security, fairness, and reliability at scale
Other
- Provide technical leadership across multiple cross-functional teams
- Work closely with engineering leaders, ML researchers, and product stakeholders
- Represent Upstart internally and externally as a thought leader in GenAI systems through executive reviews, cross-company forums, and industry venues
- Excellent communication skills with a history of driving alignment across engineering and business stakeholders
- Recognized as a technical leader beyond your immediate team, influencing platform strategy across organizations
