Travelers is looking to build out a centralized platform for ML and GenAI observability across Business Insurance's portfolio of models, ensuring visibility into operational, data quality, and model performance insights.
Requirements
- experience with Machine Learning and Operations.
- experience with ML Monitoring and Observability.
- experience with defining strategy for ML Ops.
- experience with building out dashboards.
- experience with model monitoring.
- experience with GenAI and LLM.
- experience with implementing and deploying models.
- experience with data logging and data capture.
- experience AWS Cloud, Databricks, CloudWatch, and SageMaker.
- Advanced knowledge of data tools, techniques, and manipulation including cloud platforms, programming languages, and technology platforms.
Responsibilities
- Lead development of analytic data products, including pilots and proof of concepts.
- Execute data strategies with an understanding of enterprise architecture, consumption patterns, platforms and application infrastructure.
- Manage the operationalizing and automating of all capabilities to ensure secure, supported and scalable solutions.
- Standardize and consolidate logging, assemble disparate data, automate pipelines, create reports and dashboards, and enable proactive alerting.
- Partner closely with data scientists, decision scientists, actuaries, and other business stakeholders to define a consistent strategy and framework for monitoring models.
- Perform other duties as assigned.
Other
- Five or more years of related experience
- Two or more years of management experience
- strong leadership and management experience.
- Bachelor’s Degree in STEM related field or equivalent
- Bachelor’s degree or equivalent training with data tools, techniques, and manipulation.