The eBay search engine handles 80 billion queries daily on a corpus of 3 billion documents. The indexing team's job is to build the 20 different indexes for the ebay search engine, on a distributed infrastructure for both batch and real-time updates.
Requirements
- Expertise in Scala and familiarity with Java
- Expertise in building scalable, distributed systems
- Experience in big data technologies such as Hadoop, Spark
- Experience in technologies such as docker and Kubernetes
- Experience with Git, Jenkins and Shell Scripts
- Familiarity in the field of Information Retrieval
Responsibilities
- Understand, estimate, design and implement complex software applications, primarily in Scala
- Deliver highly performing, low latency, robust code with high test coverage, continuous integration and production monitoring
- Research and implement indexing techniques for better search engine performance
- Rollout system changes with implications for multi-functional teams
- Monitor and maintain the batch and real-time indexer pipelines
- Lead engineering design and code reviews
- Triage and debug production issues
Other
- Prefer a BS, MS, or Ph. D. in Computer Science with proven relevant industry experience with 5+ years of experience
- Excellent decision-making, communication, collaboration, presentation, interpersonal and analytical skills
- Mentor junior team members and ensure they adhere to determined software quality standards
