The company is seeking a Senior Software Engineer with deep expertise in data pipeline engineering to design, build, and maintain highly scalable data pipelines that enable secure, reliable, and performant data movement across systems, supporting advanced analytics, business intelligence, and business-critical applications.
Requirements
- 3+ years experience working on data pipelines, data integration, or ETL/ELT systems.
- Strong skills in SQL with the ability to design and optimize complex queries.
- Hands-on experience with data pipeline frameworks (e.g., Apache Airflow, dbt, Dagster).
- Expertise in streaming technologies (e.g., Kafka, Kinesis).
- Deep understanding of databases and data warehouses (e.g., PostgreSQL, Snowflake, Aurora MySQL).
- Strong knowledge of cloud platforms (AWS or Azure), including storage, compute, and serverless data services.
- Proven ability to design for scalability, performance, and reliability in production-grade pipelines.
Responsibilities
- Architect, implement, and optimize batch and streaming data pipelines to move, transform, and process structured and unstructured data at scale.
- Apply software engineering best practices (code reviews, testing, CI/CD, version control) to data pipeline development.
- Ensure pipelines are modular, reusable, and extensible.
- Build monitoring, logging, and alerting frameworks to ensure pipeline reliability and data quality.
- Implement data validation, schema evolution handling, and error recovery mechanisms.
- Troubleshoot production issues and perform root cause analysis.
- Optimize pipelines for high-volume, low-latency data processing.
Other
- Partner with delivery teams to understand requirements and deliver end-to-end solutions.
- Mentor junior engineers, set coding standards, and advocate for best practices in pipeline development.
- Contribute to technical design reviews, architectural decisions, and long-term data platform strategy.
- Ability to travel up to 15% of the time for internal and team meetings or conferences
- Reliable internet access for any period of time working remotely, not in a Workiva office
