The Hartford insurance company is looking to implement AI data pipelines that bring together structured, semi-structured and unstructured data to support AI and Agentic solutions.
Requirements
- 8+ years of data engineering experience including Data solutions, SQL and NoSQL, Snowflake, ETL/ELT tools, CICD, Bigdata, Cloud Technologies (AWS/Google/AZURE), Python/Spark, Datamesh, Datalake or Data Fabric.
- 3+ years of AI/ML experience, with 1+ years of data engineering experience focused on supporting Generative AI technologies.
- Strong hands-on experience implementing production ready enterprise grade AI data solutions.
- Experience with prompt engineering techniques for large language models.
- Experience in implementing Retrieval-Augmented Generation (RAG) pipelines, integrating retrieval mechanisms with language models.
- Experience of vector databases and graph databases, including implementation and optimization.
- Strong programming skills in Python and familiarity with deep learning frameworks such as PyTorch or TensorFlow.
Responsibilities
- AI Data Engineering lead responsible for Implementing AI data pipelines that bring together structured, semi-structured and unstructured data to support AI and Agentic solutions. This Includes pre-processing with extraction, chunking, embedding and grounding strategies to get the data ready.
- Develop AI-driven systems to improve data capabilities, ensuring compliance with industry best practices.
- Implement efficient Retrieval-Augmented Generation (RAG) architectures and integrate with enterprise data infrastructure.
- Design, build and maintain scalable and robust real-time data streaming pipelines using technologies such as Apache Kafka, AWS Kinesis, Spark streaming, or similar.
- Develop data domains and data products for various consumption archetypes including Reporting, Data Science, AI/ML, Analytics etc.
- Ensure the reliability, availability, and scalability of data pipelines and systems through effective monitoring, alerting, and incident management.
- Implement best practices in reliability engineering, including redundancy, fault tolerance, and disaster recovery strategies.
Other
- Bachelor's or Master's degree in Computer Science, Artificial Intelligence, or a related field.
- Strong written and verbal communication skills and ability to explain technical concepts to various stakeholders.
- Ability to work in an office location (Hartford, CT; Chicago, IL; Columbus, OH; and Charlotte, NC) 3 days a week (Tuesday through Thursday).
- Travel requirements not specified
- Equal Opportunity Employer/Sex/Race/Color/Veterans/Disability/Sexual Orientation/Gender Identity or Expression/Religion/Age
