Apple is seeking to build and lead a team responsible for the development and optimization of core data libraries on their data platform. This role is critical to enabling data-driven decision-making across Apple, powering a wide range of applications from product analytics and machine learning to supply chain optimization and fraud detection.
Requirements
- Deep expertise in open source data platform technologies like Apache Spark and Apache Iceberg.
- Proven contributions to open source projects like Spark or Iceberg.
- Experience building and growing teams focusing on open source technologies.
Responsibilities
- Define and execute the technical roadmap for our data processing platform, aligning with Apple's overall data strategy
- Drive innovation in data processing techniques, exploring new technologies and approaches to improve performance, scalability, and efficiency
- Lead the design, development, and deployment of robust and scalable data pipelines using Spark and Iceberg
- Ensure the reliability, availability, and security of our data processing infrastructure.
- Collaborate with other engineering teams to integrate our data processing technologies with other Apple systems and services.
Other
- Build, mentor, and manage a high-performing team of software engineers specializing in Spark, Iceberg, and related technologies
- Foster a culture of collaboration, innovation, and continuous improvement
- Provide technical guidance and mentorship to team members, promoting their professional growth
- Conduct performance reviews, provide feedback, and identify opportunities for training and development
- Manage team workload, prioritize projects, and ensure timely delivery of high-quality solutions.
- Partner with data scientists, data engineers, product managers, and other stakeholders to understand their data processing needs and requirements
- Communicate technical concepts and solutions effectively to both technical and non-technical audiences
