Airbnb needs to improve its logging infrastructure to capture, process, and leverage event data at scale.
Requirements
- Deep expertise in backend programming languages (Java, Kotlin, Scala, or Python)
- Proven experience with real-time event processing systems, particularly with large-scale distributed data processing frameworks like Spark or Flink and messaging frameworks like Kafka
- Hands-on experience with modern ETL frameworks like Airflow
- Understanding of data security, privacy principles, and regulatory compliance (GDPR, CCPA)
- Knowledge of observability and monitoring best practices
- Background in data governance and schema management
- Experience with high-throughput data pipelines
Responsibilities
- Designing and implementing next-generation logging systems that process billions of events daily
- Architecting scalable solutions for real-time and batch event processing
- Driving technical discussions and decision-making across teams
- Designing and implementing robust data governance systems ensuring proper event ownership and lineage
- Optimizing event ingestion pipelines handling billions of events per day
- Collaborating with cross-functional teams to gather requirements, assess logging needs, and design efficient solutions that align with business objectives
- Identifying and implementing automation opportunities to improve logging efficiency
Other
- 9+ years of experience with a BS/Masters or 6+ years with a PhD
- Excellent communication skills with ability to influence both technical and business stakeholders
- Experience building trusted partnerships across diverse teams
- Strong mentorship and technical leadership capabilities
- Occasional work at an Airbnb office or attendance at offsites, as agreed to with your manager
- Must live in a state where Airbnb, Inc. has a registered entity
