Apple Services Engineering (ASE) Data Platform team needs to design and build a scalable big-data platform that is used across Apple to handle millions of queries every single day, bringing challenges that require extraordinarily creative problem-solving.
Requirements
- 8+ years experience designing, developing, and deploying large-scale data processing frameworks and applications on cloud-based infrastructure such as AWS, GCP, etc.
- Strong programming expertise in Go, Java, Scala, and scripting languages, preferably with critical, large-scale distributed systems.
- Proficiency in Infrastructure as Code (IaC) tools (e.g Pulumi, Crossplane).
- Experience with containerization and orchestration (e.g., Docker, Kubernetes).
- Ability to design large-scale, complex applications with excellent run-time characteristics such as low latency, fault-tolerance, and high availability
- Experience engineering modern Analytics and Data technologies like Spark, Flink, Iceberg, Trino, Jupyter, Druid, etc. at scale is a plus
- Experience with contribution to Open Source projects is a plus
Responsibilities
- designing, developing, and deploying high-performance systems that handle millions of online events and queries daily
- building and supporting critical infrastructure and frameworks that provide and support services like structured and unstructured storage, caching, queueing, searching, and much more
- designing, developing, and deploying large-scale data processing frameworks and applications on cloud-based infrastructure
- integrating Cloud infrastructure solutions into Data platform products and services
- design large-scale, complex applications with excellent run-time characteristics such as low latency, fault-tolerance, and high availability
- engineering modern Analytics and Data technologies like Spark, Flink, Iceberg, Trino, Jupyter, Druid, etc. at scale
- contribution to Open Source projects
Other
- Are you an inventive self-starter who takes pride in making ideas come to life on a global scale?
- Are you passionate about developing big-data platforms using creative algorithms to process petabytes of data with very low latency?
- Are you passionate about Cloud Technologies, have a proven track record in designing and implementing scalable solutions, love solving complex challenges and thrive in a collaborative team environment?
- Deeply concerned about excellence and quality
- Loves fast-paced environment and learning/leveraging new technologies
