Genworth is seeking a Principal Data Engineer to lead the implementation of a new architecture designed to replace the majority of current analytical platforms and data processes for their Life, Annuity and Long Term Care Data solutions team.
Requirements
- Implementing DataBricks streaming and analytical data processes
- Delta tables with streaming pipelines including APIs for UX consumption
- Spark performance optimization including cluster and coding optimization methods
- CI/CD implementation in analytical pipelines
- Capable of performing POCs to demonstrate the utility of new coding, DataBricks or other platform features such as AI programming and testing code generation.
- Experience using Agile methodologies and creating good stories that complete a solution
- Capable of performing software engineering disciplines from design, build, testing and production support.
Responsibilities
- Designing, building, testing, and production support of analytical pipelines
- Implementing DataBricks streaming and analytical data processes
- Leading design and coding standards including code reviews
- Building and re-using data tests for subsequent releases
- Delta tables with streaming pipelines including APIs for UX consumption
- Spark performance optimization including cluster and coding optimization methods
- CI/CD implementation in analytical pipelines
Other
- This role will lead, mentor, and assist team members in the software development lifecycle process from design, build, test, and run responsibilities.
- Capable of influencing other technical leaders and teams to align to common practices, frameworks, and tool usage patterns.
- Capable of being proactive with business leadership on solution options and recommendations that address their requirements including how business data self service data processes are integrated into the architecture.
- Capable of leading technical projects and decomposing work across team members.
- Ability to mentor and develop other data professionals so they can grow and advance.
