WEX is undergoing a data platform transformation and needs to design and build robust, scalable, and extensible pipelines to feed the entire data ecosystem
Requirements
- Solid programming skills in Python, Java, or Scala, with ability to write maintainable, production-ready code
- Hands-on experience with ETL/ELT pipelines, schema management, and data modeling concepts
- Familiarity with streaming (e.g., Kafka, Kinesis, Spark Streaming) or batch frameworks
- Understanding of CI/CD, version control, and testing practices
- Exposure to observability practices such as logging, metrics, and tracing
Responsibilities
- Design and implement moderately complex ingestion pipelines that integrate with internal and external systems
- Develop reusable components for data transformation, validation, and logging
- Contribute to both batch and streaming ingestion flows, ensuring scalability and maintainability
- Support platform observability by enhancing monitoring, alerting, and error-handling features
- Participate in design discussions, code reviews, and incident investigations
- Partner with data consumers to understand requirements and translate them into ingestion solutions
- Improve automation and testing coverage to reduce manual effort and increase pipeline reliability
Other
- B.Sc. in Computer Science, Engineering, or related technical field (M.Sc. preferred)
- 2–4 years of experience as a data or software engineer, ideally working with data pipelines or distributed systems
- Strong sense of accountability and eagerness to take ownership of assigned deliverables
- Equivalent experience considered