The Hartford insurance company is looking to develop advanced AI systems that leverage state-of-the-art generative models, implement efficient RAG architectures, and integrate with their data infrastructure.
Requirements
- Experience with ETL tools (Informatica, IDMC, Talend etc.) & awareness of Big data tech stack - Hadoop, EMR & Pyspark
- Advanced knowledge of SQL as it pertains to data & analytics on any relational database Oracle, SQL Server, Snowflake etc.
- Awareness of data engineering, with at least some hands on with generative AI technologies.
- Ability to showcase implementation of production-ready enterprise-grade GenAI pipelines.
- Experience & awareness of prompt engineering techniques for large language models.
- Experience & awareness in implementing Retrieval-Augmented Generation (RAG) pipelines, integrating retrieval mechanisms with language models.
- Knowledge of vector databases and graph databases, including implementation and optimization.
Responsibilities
- Design, develop, and implement complex data pipelines for AI/ML, including those supporting RAG architectures, using technologies such as Python, Snowflake, AWS, GCP, and Vertex AI.
- Implement on end-to-end generative AI pipelines, from data ingestion to pipeline deployment and monitoring.
- Build and maintain data pipelines that ingest, transform, and load data from various sources (structured, unstructured, and semi-structured) into data warehouses, data lakes, vector databases, and graph databases.
- Develop and implement data quality checks, validation processes, and monitoring solutions to ensure data accuracy, consistency, and reliability.
- Implement end-to-end generative AI data pipelines, from data ingestion to pipeline deployment and monitoring.
- Develop complex AI systems, adhering to best practices in software engineering and AI development.
- Implement and optimize RAG architectures and pipelines.
Other
- Candidates must be authorized to work in the US without company sponsorship.
- Bachelor's in Computer Science, Artificial Intelligence, or a related field.
- 2+ years of experience in data engineering
- Ability to work in an office location (Hartford, CT) 3 days a week (Tuesday through Thursday)
- Assist in mentoring junior AI/data engineers in AI development best practices.
