Travelers Data Engineering team needs to construct pipelines that contextualize and provide easy access to data by the entire enterprise, and grow and transform the analytics landscape.
Requirements
- 4+ years of professional data engineering experience
- Proficiency in Python programming
- Experience with data transformation processes including ETL methodologies
- Hands-on experience with cloud platforms, specifically AWS
- Experience with PySpark for large-scale data processing
- Proficiency with Databricks platform (4+ years of experience preferred)
- Experience with Ab Initio data integration platform (alternative consideration)
Responsibilities
- Build and operationalize complex data solutions, correct problems, apply transformations, and recommending data cleansing/quality solutions.
- Design complex data solutions
- Perform analysis of complex sources to determine value and use and recommend data to include in analytical processes.
- Incorporate core data management competencies including data governance, data security and data quality.
- Collaborate within and across teams to support delivery and educate end users on complex data products/analytic environment.
- Perform data and system analysis, assessment and resolution for complex defects and incidents and correct as appropriate.
- Test data movement, transformation code, and data components.
Other
- Bachelor’s Degree in STEM related field or equivalent
- Eight years of related experience
- Strong written and verbal communication skills with the ability to work collaborate well with team members and business partners.
- Ability to lead team members and help create a safe environment for others to learn and grow as engineers.
- Demonstrated track record of domain expertise including understanding technical concepts necessary and industry trends
