The company is looking to solve the problem of developing core services that power next-generation intelligent assistant features, and is seeking a talented individual to join a forward-thinking team to drive innovation and enhance user experiences within a dynamic and impactful environment.
Requirements
- Ability to setup synthetic tenant data and data ingestion – test accounts, generate grounding data, configuration as code
- Maintain, validate, and automate the creation of test datasets for an LLM evaluation system
- Integrate evaluation quality checks in our build and deployment pipeline, ensuring performance and scalability
- A solid foundation in computer science, including strong competencies in data structures, algorithms, and software design.
- Experience with large systems software design and development.
- Proven experience performing in-depth troubleshooting and unit testing with both new and legacy production systems.
- Experience in programming and with problem diagnosis and resolution.
Responsibilities
- Design and craft conversational prompts, messages, and responses for AI chatbots and virtual assistants.
- Create prompts that align with organizational objectives, provide a seamless user experience, and ensure effective interactions between users and AI systems.
- Develop a library of pre-defined prompts tailored to various scenarios and user needs.
- Fine-tune and improve a variety of sophisticated software implementation projects.
- Gather and analyze system requirements, document specifications, and develop software solutions to meet diverse needs.
- Analyze and review enhancement requests and specifications.
- Implement system software and customize requirements.
Other
- Bachelor’s degree in a technical field such as computer science, computer engineering, or a related discipline.
- 2-4 years of professional experience.
- Must be able to work onsite in Redmond, WA for 6 months
- Ability to work in a dynamic and impactful environment
- Must be able to collaborate with passionate, diverse teams
