At Apple, the business problem is to ensure the quality of machine learning pipelines, data workflows, and platform services that power AI products at scale, by leading quality efforts across the machine learning platform.
Requirements
- Strong programming experience in Java or Python, with ability to write reusable test frameworks.
- Proven ability to lead testing efforts for large-scale, backend or platform systems (ideally including microservices or cloud-based architectures).
- Deep understanding of test design methodologies, CI/CD practices, and test automation at scale.
- Experience with test frameworks and tools such as PyTest, JUnit, or equivalent.
- Experience with performance testing of large scale systems.
- Experience testing AI/ML systems or platforms that include ML model training or data pipelines.
- Experience working with cloud platforms (AWS/GCP/Azure) and containerized environments (Docker, Kubernetes).
Responsibilities
- Lead Quality Strategy for ML Platform: Own and define the testing strategy for end-to-end ML pipelines, data flows, and AI platform services.
- Tooling & Infrastructure Influence: Guide the selection and integration of tools and platforms that support scalable test automation, data validation, continuous training (CT), and continuous integration/continuous delivery (CI/CD) in ML workflows.
- Collaborate with ML Engineers & Data Scientists: Partner closely with AI/ML engineers, MLOps, and data science teams to ensure testability, model governance, and validation of ML outputs.
- Champion Best Practices: Define and enforce standards for quality in ML systems - including unit, integration, regression, and fairness testing.
- Measure & Improve Quality: Define and track quality metrics such as test coverage for ML pipelines, test flakiness, and pipeline reliability.
- Mentor Engineering Teams: Influence ML Engineering and Platform teams to adopt a quality-driven approach in their design and implementation
- Stay Ahead of AI Testing Trends: Explore new tools and research in AI quality assurance, ML testing frameworks, and integrate them where beneficial.
Other
- B.S. in Computer Science or similar field, M.S. preferred.
- 10+ years in software development and/or test automation, with at least 3 years leading complex, distributed system testing.
- Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition.
- Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs.
- This role might be eligible for discretionary bonuses or commission payments as well as relocation.
