WEX is looking to evolve its Data-as-a-Service (DaaS) platform by architecting and leading the next evolution of its data acquisition platform to handle secure, scalable, and reliable ingestion of data from hundreds of internal systems and external sources, powering enterprise-wide analytics, AI, and product experiences.
Requirements
- Deep understanding of data acquisition patterns at scale—including change data capture (CDC), event-driven ingestion, streaming frameworks, and asynchronous integration models.
- Strong architectural experience with large-scale systems—you’ve built or led platforms that handle tens of millions to billions of records per day.
- Experience building internal data platforms or ingestion frameworks that abstract complexity and accelerate domain adoption.
- Strong programming expertise in a systems language (e.g., Python, Java, Scala, or Go).
- Strong appreciation for platform reliability, security, testability, and documentation as part of scalable engineering.
- Experience integrating with a variety of source systems (e.g., CRM, ERP, telemetry, external APIs), and solving for schema evolution, observability, and error recovery.
Responsibilities
- Lead the design and development of scalable, high-throughput data acquisition systems that integrate internal and external data sources across domains.
- Architect core platform components—such as data routing, transformation orchestration, lineage tracking, and schema evolution—using sound software engineering principles.
- Implement a modular ingestion framework capable of supporting streaming and batch pipelines with varying latencies and SLAs.
- Provide technical leadership, mentor engineers, and establish best practices in code quality, performance optimization, testing, and platform observability.
- Collaborate with domain teams to understand data integration needs and accelerate onboarding through reusable patterns and automation.
- Partner closely with the Control Plane and DataOps teams to integrate orchestration, lineage, access control, and validation into the core ingestion process.
Other
- 10+ years of experience in software or platform engineering with a focus on distributed systems, high-volume data processing, or data platform architecture.
- Excellent communication skills and a passion for building platforms that empower others.
