Five9 is looking to solve the business and technical problem of enhancing its AI products' performance through advanced data science research, experimentation, data collection, curation, and analysis, ultimately aiming to improve customer experience.
Requirements
- Extensive hands-on experience with LLMs, agentic architectures, retrieval-augmented systems, transformers, and composite model pipelines.
- Strong understanding of commercial and open-source model ecosystems (e.g., OpenAI, Anthropic, Google, Meta, Mistral), including evaluation, benchmarking, and tradeoff analysis.
- Proven ability to perform fine-tuning, supervised/unsupervised training, prompt engineering, prompt optimization, and model orchestration for real-world use cases.
- Experience designing evaluation frameworks, experiment methodologies, and robust model comparison workflows.
- Expertise in large-scale data collection, labeling, cleaning, and curation pipelines, preferably with conversational or unstructured text data.
- Ability to work with engineering teams using modern software practices (Python, data platforms, cloud-native environments, APIs, ML Ops tooling).
- Understanding of production ML systems, deployment patterns, monitoring, and safety/guardrail design.
Responsibilities
- evaluation of and selection of AI agent architectural frameworks
- evaluation and comparison of LLM models across commercial and open source choices
- model fine-tuning for dedicated tasks
- prompt engineering, prompt structure and design
- composite model definitions and evaluations
- directing the team on the methodologies, practices, algorithms, experiments and processes they perform
- be directly responsible for some amount of the technical work in addition to directing the team
Other
- As Vice President of Data Science, you will lead and grow our in-house data science team.
- As lead of this team, you will take complete ownership of the technical and operational direction of the organization, including growing to team to meet increased demand for its capabilities.
- You will be tasked with growing the team, and ensuring we have the right talent to accomplish our goals.
- You will act as an internal and external spokesperson for data science, and collaborate with stakeholders across the company.
- Ability to collaborate effectively with product managers, engineering leaders, UX, and GTM teams to translate business needs into data science strategies.
