At Apple, the business problem is to design and build a scalable big-data platform that is used across Apple, handling millions of queries every single day, and developing high-performance systems that are highly scalable, highly available, and fully fault tolerant.
Requirements
- 8+ years experience designing, developing, and deploying large-scale data processing frameworks and applications on cloud-based infrastructure such as AWS, GCP, etc.
- Strong programming expertise in Go, Java, Scala, and scripting languages, preferably with critical, large-scale distributed systems
- Proficiency in Infrastructure as Code (IaC) tools (e.g Pulumi, Crossplane)
- Experience with containerization and orchestration (e.g., Docker, Kubernetes)
- Experience engineering modern Analytics and Data technologies like Spark, Flink, Iceberg, Trino, Jupyter, Druid, etc. at scale
- Experience with contribution to Open Source projects
- Experience with Cloud Technologies, designing and implementing scalable solutions
Responsibilities
- Designing, developing, and deploying high-performance systems that handle millions of online events and queries daily
- Building and supporting critical infrastructure and frameworks that provide and support services like structured and unstructured storage, caching, queueing, searching, and much more
- Collaborating with cross-functional teams to integrate Cloud infrastructure solutions into Data platform products and services
- Designing large-scale, complex applications with excellent run-time characteristics such as low latency, fault-tolerance, and high availability
- Developing products that are highly scalable, highly available, and fully fault tolerant
- Crafting big-data products using creative algorithms to process petabytes of data with very low latency
- Developing and deploying large-scale data processing frameworks and applications on cloud-based infrastructure
Other
- Bachelor’s degree or Masters in Computer Science, Computer Engineering, or equivalent
- Ability to work in a fast-paced environment and learn/leverage new technologies
- A learning attitude to continuously improve the self, team, and the organization
- Deeply concerned about excellence and quality
- Loves fast-paced environment and learning/leveraging new technologies