Gen AI project involving summarization and chatbot supporting a huge volume of documents from various LOBs and of various types for a high visibility project
Requirements
- 2+ years of professional experience as a data scientist executing end-to-end Gen AI projects using LLM Models (Llama, Mixtral, Mistral)
- Various inferencing mechanisms - transformer/pipeline, vllm
- Agentic framework: langgraph
- Evaluation frameworks: RAGAS, langsmith, phoenix-arize
- Embedding (all-MiniLM-L6-v2, all-mpnet-base-v2)
- Enterprise Redis Database, Qdrant, Cockroach
- Strong programming experience with Python
Responsibilities
- Leads the design, development and implementation of complex data management, storage applications, often using new technologies
- Exercises judgment within broadly defined practices and policies in selecting methods, techniques, and evaluation criterion for obtaining results
- Delivering on a Gen AI project following the model governance guidelines
- Writing a model document
- Building model monitoring capabilities
- Work leadership may be provided by assigning work and resolving problems
- Effectively communicate difficult technical concepts
Other
- Bachelors degree or advanced degree and /or equivalent experience in related IS/IT discipline
- Excellent written and verbal communication skills coupled with ability to translate business strategy into achievable tactics
- Typically over 10 years of related IT experience
- Travel not mentioned
- Must be willing to work 8am to 5pm