Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you will play a key role in growing and transforming our analytics landscape.
Requirements
- Highly proficient use of tools, techniques, and manipulation including Cloud platforms, programming languages, and a full understanding of modern data engineering practices.
- Experience with ETL development in data lake and data warehouse (preferably Snowflake)
- Exhibited hands-on experience in building data pipelines and reusable components using AWS Services and PySpark over the past three years
- Exposure to Databricks platform, DBT, Fivetran, Airflow is a plus
- Bachelor’s degree or equivalent training with data tools, techniques, and manipulation.
- Four years of data engineering or equivalent experience.
- Demonstrated track record of domain expertise including understanding technical concepts necessary and industry trends, and possess in-depth knowledge of immediate systems worked on and some knowledge of adjacent systems.
Responsibilities
- Build and operationalize complex data solutions, correct problems, apply transformations, and recommending data cleansing/quality solutions.
- Design complex data solutions
- Perform analysis of complex sources to determine value and use and recommend data to include in analytical processes.
- Incorporate core data management competencies including data governance, data security and data quality.
- Collaborate within and across teams to support delivery and educate end users on complex data products/analytic environment.
- Perform data and system analysis, assessment and resolution for complex defects and incidents and correct as appropriate.
- Test data movement, transformation code, and data components.
Other
- Bachelor’s Degree in STEM related field or equivalent
- Eight years of related experience
- Experience in leading and managing a small team of data engineers, including mentoring and developing team members
- The ability to deliver work at a steady, predictable pace to achieve commitments, deliver complete solutions but release them in small batches, and identify and negotiate important tradeoffs.
- Strong problem solver who ensures systems are built with longevity and creates innovate ways to resolve issues.
