EverWatch is looking to solve the problem of ensuring the quality and reliability of AI/ML software developed for national security by hiring an experienced test engineer to evaluate and test the software.
Requirements
Experience with ML Frameworks (e.g., Pytorch, JAX) and compiler tooling (e.g., MLIR) for AI/ML application testing
Experience in Test and Evaluation (T&E) for deep learning software stacks
Experience developing validation plans, benchmarks, and test scripts to evaluate stability, performance, and power consumption of hardware systems
Experience in profiling a diversity of hardware systems such as GPUs, FPGAs, or ASICS for maximizing latency, throughput, and efficiency
Experience with system administration and deploying Machine Learning (ML) or High-Performance Computing (HPC) workloads in production
Experience supporting and debugging AI applications used by internal applied researchers
Experience implementing GPY programming and distributed/parallel computing algorithms
Responsibilities
Create a test plan with test cases based on user stories
Generate data and implement the test cases to observe how the software performs
Document the results and communicate defects to the development team
Automate continuous security and performance testing and monitor the health of AI applications
Write code to test AI/ML applications
Broaden experience in AI/ML application testing and gain skills in new areas such as prototyping emergent techniques in algorithmic and hardware system optimizations
Share testing experience with the team
Other
TS/SCI with a polygraph clearance required
Master's degree in a technical field, physics, or mathematics and 5+ years of experience in test engineering
Bachelor's degree in a technical field, physics, or mathematics and 7+ years of experience in test engineering
Commitment to non-discrimination and equal employment opportunity
Ability to work in a team environment and communicate effectively with developers and researchers
