Ellipsis Health is creating cutting-edge AI/ML products that solve healthcare staffing issues and administrative burdens using conversational AI and our patented voice biomarker technology in the delivery of better healthcare for everyone.
Requirements
- Proficiency in programming languages such as Python (with libraries like Pandas, NumPy, Scikit-learn, TensorFlow, PyTorch).
- Solid understanding of statistical analysis, experimental design, and A/B testing methodologies.
- Strong problem-solving skills and a proactive approach to identifying and addressing data quality and model performance issues.
- Experience with Natural Language Processing (NLP) techniques and understanding of LLM architectures and their evaluation challenges.
- Experience with Speech Technologies and their evaluation is a significant advantage.
- Experience with MLOps practices and deploying models to production.
- Familiarity with cloud platforms (AWS, Azure, GCP).
Responsibilities
- Create and Manage Datasets: Design and build high-quality datasets for training, testing and evaluating conversational AI system components.
- Develop Evaluation Frameworks: Engineer and implement advanced evaluation methodologies and metrics to accelerate customer onboarding.
- You’ll also establish robust evaluation metrics for our AI systems.
- Analyze and Improve AI Quality: Investigate the intricate relationship between LLM quality and the performance of LLM Judge systems to drive continuous improvement.
- Collaborate and Innovate: Work closely with AI/ML Engineers and Product Managers to integrate your findings into product enhancements.
- You’ll stay current with the latest advancements in AI evaluation, particularly in Large Language Models (LLMs) and speech systems, contributing to our overall technical strategy.
Other
- Bachelor’s or Master’s degree in Computer Science, Data Science, Statistics, Mathematics, or a related quantitative field.
- Excellent communication and interpersonal skills, with the ability to collaborate effectively in a fast-paced environment.
- Experience in a regulated industry (e.g., healthcare, finance). Familiarity with data governance principles, particularly concerning PII/PHI.
- The amount offered will be determined by a variety of factors including but not necessarily limited to your individual skills, qualifications, and past experience relative to the requirements of the role.
- As a health technology company, we reserve the right to run a background check on any applicant to which we extend an offer and to re-perform any such check at any time during the course of employment.
