Airbnb is looking to solve the problem of efficiently managing and processing large amounts of data to support various use cases such as offline data analytics, experiments, and AI/ML model developments.
Requirements
- Strong programming skills in one or more of the following languages: Java, Python, or Scala
- Experience building data applications that create and implement higher-level abstractions on top of the lower-level data infrastructure
- Experience working with data storage and distributed processing technologies (i.e. Hive, Spark, Trino, Flink or other SQL databases, etc …)
- Experience with data modeling, database design and various SQL dialects
- Experience with containerization technologies such as Docker and Kubernetes
- Extensive background in workflow orchestration solutions such as Apache Airflow, Luigi, Azkaban, Oozie, Prefect or Kubeflow
Responsibilities
- Design and build frameworks to support data development workflows
- Develop and maintain automation tools to streamline deployment and management of the platform
- Maintain and evolve data engineering tooling to ensure high availability, reliability, usability and performance
- Collaborate with data engineering and analytics teams to understand their needs and requirements
- Design & implement frameworks (applications) for processing data at scale
Other
- Excellent communication skills and the ability to collaborate with cross-functional teams
- Excellent analytical and problem solving skills
- BS/MS/PhD in Computer Science, a related field, or equivalent work experience preferred
- 10+ years of experience in software engineering
- Occasional work at an Airbnb office or attendance at offsites, as agreed to with your manager
