Cisco is looking to build an AI Assistant to revolutionize how users interact with their commerce platform, integrating advanced AI capabilities and LLMs/RAG systems to push the boundaries of what's possible and shape the future of their commerce platform.
Requirements
- Strong programming skills in languages such as Python, R, or Java.
- Hands-on experience with LLM frameworks such as LangChain, LlamaIndex, Haystack, or DSPy.
- Familiarity with RAG evaluation frameworks and techniques (e.g., Ragas, DeepEval, TruLens).
- Strong proficiency in Python and relevant ML libraries (e.g., PyTorch, TensorFlow).
- Solid understanding of automated evaluation metrics and strategies for LLMs
- Strong problem-solving skills and the ability to debug complex AI system behaviors.
- Strong understanding of the data science lifecycle, including data collection, cleaning, modeling, and analysis.
Responsibilities
- Assist in the design, development, and optimization of generative AI models.
- Perform exploratory data analysis to uncover insights and inform model development.
- Continuously monitor and refine models to improve their performance and accuracy.
- Establish and manage feedback loops to gather user input and improve the AI Assistant.
- Analyze feedback data to identify areas for improvement and implement necessary changes.
- Develop strategies to enhance model performance based on user feedback and operational metrics.
- Ensure the integrity and security of data used and generated by the AI Assistant.
Other
- Work closely with business stakeholders to understand their needs and translate them into technical requirements.
- Communicate complex technical concepts to non-technical team members and stakeholders.
- Provide insights and recommendations based on data analysis to drive business decisions.
- Collaborate with cross-functional teams, including software engineers, product managers, and domain experts, to ensure seamless integration of the AI Assistant.
- Participate in code reviews and contribute to the overall improvement of the development process.
