Affirm needs to build a reliable, scalable, self-serve and optimized compute solution to enable ML, Product, and Financial Engineering success.
Requirements
- Experience building and owning large-scale, geographically distributed compute, and data processing systems
- Experience building and owning data lake solutions like Iceberg, Hudi, Delta, etc
- Experience building and managing Workflow Orchestration frameworks like Airflow, Flyte, Prefect, Temporal, Luigi, etc
- Experience with or working knowledge for efficiently scaling frameworks like Spark/Flink for extremely large scale datasets on Kubernetes
- Skilled at developing and debugging in Python/Kotlin or the ability to learn them quickly
- Working knowledge of Relational and NoSQL databases
- Experience with AWS and/or other cloud providers
Responsibilities
- Shape the technical direction, strategy, and roadmap for Batch Infra platform
- Design and build data infrastructure systems, services and tools to handle new Affirm products and business requirements
- Build frameworks and services which will be used by other engineering teams at Affirm to manage billions of dollars in loans and power customer experiences
- Improve the reliability and efficiency of the Batch Infrastructure at scale and high reliability
- Engage other teams at Affirm about their use of the Batch platform to ensure we are always building the right thing
- Take an active role in mentoring junior engineers, lead and implement the processes that support team growth and efficiency
Other
- Strong sense of ownership with a proven track record of successfully driving large cross-functional technical programs
- Technical leadership; capable of handling mentorship, cross functional project execution, and solid individual contribution
- Demonstrated ability to deliver on complex technical projects by collaborating closely with stakeholders
- Eager to learn new things and have a growth mindset
- Well-developed interpersonal, written and verbal communication
- This position requires either equivalent practical experience or a Bachelor's degree in a related field
- Remote work arrangement with occasional office visits for proximal roles
