Design, build, and scale data pipelines across a variety of source systems and streams to meet data needs and enable self-service solutions.
Requirements
- Experience with data modeling, ETL/ELT development principles, or data warehousing concepts;
- Experience with data management fundamentals and data storage principles;
- Experience with identity data graphs & identity graph modelling;
- Experience building data pipelines using Python/SQL;
- Experience applying CI/CD principles and processes to data engineering solutions;
- Experience with cloud data engineering design patterns and use cases.
- Experience with AWS Data Storage, Data management pipelines;
- Experience with Snowflake;
- Experience with Airflow, focusing on MWAA.
Responsibilities
- Design, build, and scale data pipelines across a variety of source systems and streams (internal, third-party, as well as cloud-based), distributed/elastic environments, and downstream applications and/or self-service solutions.
- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using cloud-native data engineering principles.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Implement the appropriate design patterns while optimizing performance, cost, security, and scale and end user experience.
- Participate and lead in development sprints, demos, and retrospectives, as well as release and deployment.
- Build and manage relationships with supporting IT teams to effectively deliver work products to production.
Other
- Collaborate with business leaders, engineers, and product managers to understand data needs.
- 100% telecommuting is permitted for this role.
- Bachelor’s degree (or foreign degree equivalent) in Computer Science, Data Science, Statistics, Informatics, Information Systems, Mathematics, Computer Engineering, or a related quantitative field, plus three (3) years of experience in the job offered or in a related occupation.
- This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other discounts and perks.
- Full-time: 40 hours/week
