Amazon Devices is looking to advance the state of the art in multimodal language models for various edge applications by developing novel evaluation benchmarks and integrating evaluation methods across the deployment pipeline.
Requirements
- 3+ years of building models for business application experience
- Experience programming in Java, C++, Python or related language
- Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing
- Experience using Unix/Linux
- Experience in professional software development
Responsibilities
- Collaborate with cross-functional engineers and scientists to advance the state of the art in multimodal model evaluations for devices
- Invent and develop novel multimodal evaluation benchmarks against product use cases
- Design and develop tools for human-in-the-loop model evaluation experiments
- Partner with engineering teams to integrate evaluation methods across the deployment pipeline
- Work closely with scientists, compiler engineers, data collection, and product teams to advance evaluation methods
Other
- work safely and cooperatively with other employees, supervisors, and staff
- adhere to standards of excellence despite stressful conditions
- communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service
- follow all federal, state, and local laws and Company policies
- exhibit trustworthiness and professionalism
