Apple is looking to advance its data infrastructure and drive innovation by implementing cutting-edge capabilities and tools to power Apple Services Engineering, with a focus on scalable streaming processing systems and distributed stateful streaming computing frameworks.
Requirements
- Good knowledge of Apache Iceberg and Apache Kafka.
- Experience working on or building connectors from Spark to any of the data sources.
- Knowledge of Yarn, Kubernetes or other compute substrate.
- Experienced Poweruser (at least 2 years of running production applications) of Apache Spark or Committer to Apache Spark.
- In depth knowledge of systems like Spark, Beam, Kafka, Iceberg and other existing frameworks
Responsibilities
- Develop and deploy new features of Apple’s internal data platform.
- Regularly contribute to open source.
- Collaborate with cross-functional teams to design and implement automation tools that streamline operations and reduce manual intervention.
- Optimize our cloud-based services to ensure they scale effectively, handling increasing loads while maintaining high performance.
- Innovate on API development and integration, enabling seamless communication between our applications and services
Other
- 8+ years of professional experience
- A successful track-record or demonstrated aptitude as an engineer who has worked on distributed systems.
- BS or MS degree in computer science or equivalent
- Passion to push the limits of distributed stateful streaming computing frameworks
- Ability to work reciprocally with other groups internal to Apple and also communities outside Apple
