Genworth is seeking a Principal Data Engineer to lead the design, development, and implementation of a new data architecture and analytical pipelines, replacing a majority of current analytical platforms and data processes to better serve internal and external customer needs.
Requirements
- Designing, building, testing, and production support of analytical pipelines
- Implementing DataBricks streaming and analytical data processes
- Delta tables with streaming pipelines including APIs for UX consumption
- Spark performance optimization including cluster and coding optimization methods
- CI/CD implementation in analytical pipelines
- Capable of performing POCs to demonstrate the utility of new coding, DataBricks or other platform features such as AI programming and testing code generation.
- Capable of performing software engineering disciplines from design, build, testing and production support.
Responsibilities
- Designing, building, testing, and production support of analytical pipelines
- Implementing DataBricks streaming and analytical data processes
- Leading design and coding standards including code reviews
- Building and re-using data tests for subsequent releases
- Delta tables with streaming pipelines including APIs for UX consumption
- Spark performance optimization including cluster and coding optimization methods
- CI/CD implementation in analytical pipelines
Other
- Capable of influencing other technical leaders and teams to align to common practices, frameworks, and tool usage patterns.
- Capable of being proactive with business leadership on solution options and recommendations that address their requirements including how business data self service data processes are integrated into the architecture.
- Experience using Agile methodologies and creating good stories that complete a solution
- Capable of leading technical projects and decomposing work across team members.
- Ability to mentor and develop other data professionals so they can grow and advance.
