Selective Insurance is seeking a Data Engineer Specialist to support the Claims Analytics team within the Information Management group, aiming to enhance data and analytics projects for the Claims business area.
Requirements
- Expert-level proficiency in Python, SQL, and Spark; strong experience with cloud platforms (Azure, AWS, or GCP).
- Expert level experience in Databricks and Delta Lake.
- Proven track record of building enterprise-scale data platforms supporting advanced analytics and machine learning.
- Experience with streaming architectures (Kafka, Kinesis) and event-driven data processing.
- Strong knowledge of data security, encryption, and access control in regulated environments.
- Advanced working knowledge of SQL and optimizing queries and databases for performance.
- Good understanding and hands on experience in developing and managing CI/CD pipelines
Responsibilities
- Hands on development and support of new or existing data applications.
- Works closely with the lead to create/review low level implementation designs, understand high level data flow designs developed by Data Architects.
- Provide technical guidance to the team and work on implementing complex data solutions.
- Provide support in the design, development, code reviews, test deploy and documentation of Data Engineering and Data Integration Applications.
- Scaling and optimizing schema and performance tuning SQL and ETL pipelines in data lake and data warehouse environments.
- Provide technical leadership and mentor junior data engineers.
- Closely monitor the health of data pipelines and develop contingency plans for failures.
Other
- Ability to effectively work well with people in other departments and/or outside of the enterprise.
- Work closely with Product Owners, Product Managers, Program Manager, Scrum Master, and Team Members in a Scaled Agile framework.
- Possesses excellent communication skills.
- P&C Insurance experience is highly desired.
- Certifications in cloud platforms (e.g., AWS Certified Data Analytics, Azure Data Engineer Associate)
