eBay's Cloud Data Technologies (CDT) team is seeking a Software Engineer to enhance its data infrastructure and manage the end-to-end data lifecycle for all eBay data, from onsite to analytics use cases. The role aims to improve scalability, fault tolerance, data semantics, discovery, and pipeline automation.
Requirements
- Experience with Apache Kafka, Apache Flink, or similar streaming technologies
- Experience of designing and developing large-scale software applications using Object-Oriented Design and JVM languages (Java, Scala)
- Basic knowledge of data semantics, discovery processes, and data governance.
- Proficiency in designing and implementing automated data pipelines.
- Proficiency in programming languages such as Java, Scala, or Python.
Responsibilities
- Assist in designing and enhancing data architecture to support real-time and batch processing, focusing on scalability and fault tolerance using technologies like Apache Kafka and Apache Flink.
- Contribute to implementing systems for effective data semantics management, ensuring data is accurately categorized and easily discoverable.
- Support the development and maintenance of automated data pipelines to ensure efficient data flow and processing.
- Help to create strategies for generating materialized views and data subsumption to optimize data architecture performance.
- Collaborate with data scientists, business analysts, and other engineering teams to define and refine data solution requirements.
- Stay updated on industry developments in data engineering and suggest new technologies or methodologies to enhance data infrastructure.
Other
- Join a team of passionate thinkers, innovators, and dreamers — and help us connect people and build communities to create economic opportunity for all.
- Bachelor or MS degree in Computer Science or related field
