Uber is looking for a Data Engineer II to solve complex problems and build scalable systems for designing and implementing large-scale data solutions, driving projects from concept to production, and shaping data architecture that supports business goals.
Requirements
- Advanced SQL expertise, including proficiency with: Window functions, Common Table Expressions (CTEs), Dynamic SQL variables, Hierarchical queries, Materialized views
- Hands-on experience with big data and distributed computing technologies, such as: HDFS, Apache Spark, Apache Flink, Hive, Presto
- Strong programming skills in Python, with solid understanding of object-oriented programming principles.
- Experience designing and maintaining large-scale distributed storage and database systems, including both SQL and NoSQL solutions (e.g., Hive, MySQL, Cassandra).
- Deep understanding of data warehousing architecture and data modeling best practices.
- Familiarity with major cloud platforms such as Google Cloud Platform (GCP), AWS, or Azure.
- Advanced experience with SQL, including Spark SQL, Hive, and Presto, with a deep understanding of query optimization and performance tuning.
Responsibilities
- Design and develop scalable data pipelines for real-time and batch processing to extract, clean, enrich, and load data.
- Enhance data quality through monitoring, validation, and alerting mechanisms.
- Continuously evolve our data architecture to support new products, features, and safety initiatives.
- Contribute to building feature pipelines that support data science models for predictions and business decisions.
- Own end-to-end data solutions-from requirements gathering through to production deployment.
- Design and maintain large-scale distributed storage and database systems, including both SQL and NoSQL solutions (e.g., Hive, MySQL, Cassandra).
- Build scalable data pipelines for real-time and batch processing.
Other
- Bring industry experience in data engineering or a related field.
- Partner with cross-functional Safety and Insurance teams across global tech hubs to deliver on Uber's strategic objectives.
- Proven ability to work closely with product managers and business stakeholders to gather requirements and design scalable data infrastructure that supports cross-functional needs.
- Working knowledge of reporting and business intelligence tools, such as Tableau or similar platforms.
- Bachelor's degree in Computer Science, Engineering, or a related technical field-or equivalent practical experience.
