Airbnb is looking to provide a managed, reliable, performant and scalable platform for exporting data out of its online databases for offline processing
Requirements
- 5+ years of experience building and operating large scale core backend distributed systems like storage, data ingestion, backup and restore, streaming
- Ability to own and dive deeply in a complex code base
- Experience maintaining, analyzing, and debugging production systems
- Knack for writing clean, readable, testable, maintainable code
- Experience working in either Java, Scala or Python
- Experience with building large scale data exports/ingestion platforms
- Experience with SPARK, Kafka, Flink, K8s, Airflow, AWS Aurora or TiDB
Responsibilities
- Build and operate data ingestion system that enables various ways of accessing data at Airbnb, including ingest DB data in the warehouse in various formats and frequency, and stream change data capture (CDC) at near real time
- Be hands-on (code, design, test) and collaborate with cross team partners (internal customers, dependencies and leadership) to deliver on multi-month projects in a timely fashion
- Raise operational standards by effectively and proactively identifying, debugging and fixing operational issues
- Be part of the oncall rotation for the DBExports platform
- Mentor junior engineers on the team
- Build and operate two managed solutions - one for near real time access to change logs (CDC) and another to provide periodic mutation and full table snapshots
- Guide and collaborate with internal product teams to effectively use the platform
Other
- Strong collaboration and communication skills in a remote-working environment
- Demonstrate strong ownership and consistently deliver in a timely manner
- Must live in a state where Airbnb, Inc. has a registered entity
- US - Remote Eligible
- Occasional work at an Airbnb office or attendance at offsites, as agreed to with your manager
