Unlock insights, drive innovation, and shape the landscape of the organization's success by leveraging cutting-edge Generative AI technologies and transforming raw data into actionable intelligence
Requirements
- Hands-on experience building and deploying LLM-based agents, RAG pipelines, and multimodal Gen AI systems
- Proficiency in Python and Gen AI frameworks
- Strong understanding of agent orchestration frameworks (LangGraph, LangChain, AutoGPT, or equivalent)
- Demonstrated expertise in benchmarking, A/B testing, and model monitoring for AI systems
- Experience developing and maintaining prompt engineering standards and frameworks
- Ability to evaluate and optimize model performance across different LLMs and architectures
- Familiarity with internal experimentation, observability, or AI governance tools is a plus
Responsibilities
- Design and implement Gen AI–powered agents that solve real business challenges and streamline internal workflows
- Extend and optimize the internal agent evaluation framework to ensure reliable, high-performing, and explainable agents
- Build benchmarking and monitoring systems to assess orchestration strategies and model performance in production
- Conduct experiments to evaluate the impact of model or architecture changes, balancing performance, cost, and scalability
- Build on existing prompt engineering frameworks to standardize best practices and eliminate “prompt debt”
- Move beyond chatbots to create ambient, context-aware agents that boost efficiency and unlock new productivity avenues
- Collaborate with engineering teams to advance the internal agentic platform, focusing on orchestration, observability, and optimization
Other
- Master’s or Ph.D. in Computer Science, Data Science, Machine Learning, or related fields
- 5+ years of experience in applied ML, AI development, or advanced data science roles
- Strong communication and collaboration skills across product, engineering, and business teams
- Proven track record of mentoring team members and driving innovation in AI workflows
- Ability to communicate complex AI concepts effectively to non-technical stakeholders
