Healthcare should work for patients, but it doesn’t. In their time of need, they call down outdated insurance directories. Then wait on hold. Then wait weeks for the privilege of a visit. Then wait in a room solely designed for waiting. Then wait for a surprise bill. Zocdoc's mission is to give power to the patient by building the leading healthcare marketplace that makes it easy to find and book in-person or virtual care. The AI Phone Assistant is an initiative to answer inbound calls for hospitals and doctor's offices, redefining how patients and providers connect.
Requirements
- 7+ years of professional software development experience, with at least 2+ years building or integrating AI/ML systems in production environments.
- Strong proficiency in C, and experience with distributed systems and microservices architectures.
- Experience working with large language models (LLMs), prompt engineering, or AI-powered conversational interfaces.
- Proven ability to design, build, and scale complex, reliable, and high-performance systems.
- A deep understanding of data structures, algorithms, and software design principles.
- A track record of technical leadership and ownership over major systems or product areas.
Responsibilities
- Architect, build, and maintain high-quality, scalable software systems that power Zocdoc’s AI Phone Assistant.
- Design and implement AI-driven workflows, integrating large language models (LLMs) and conversational AI into production systems.
- Lead prompt engineering, model integration, and system optimization to improve accuracy, responsiveness, and reliability.
- Collaborate cross-functionally with product, design, and data science teams to deliver production-grade AI capabilities.
- Drive the evolution of our AI platform — from experimentation and rapid prototyping to scalable, reliable systems in production.
- Ensure system scalability, observability, and performance as the product grows rapidly.
- Stay ahead of the curve on emerging GenAI tools and technologies, and apply them to solve real-world user problems.
Other
- Strong collaboration and communication skills — able to partner across disciplines to deliver results.
- A passion for leveraging AI to build products that make a real difference in people’s lives
- Flexible, hybrid work environment
- Unlimited PTO
- 100% paid employee health benefit options
