Emerson is looking to ensure the quality and reliability of AI-driven applications by testing, verifying, and validating the software through automated and manual testing methods.
Requirements
- Strong knowledge of AI technologies, machine learning frameworks, and NLP, RAG, OCR
- Knowledge of ethical AI principles and bias detection in AI models
- Proficiency with automated testing tools e.g., Selenium; AI tools and platforms (such as TensorFlow, PyTorch, OpenAI, GPT, Copilot etc.)
- Experience in writing technical documents
- Understanding of accepted technical writing style conventions
- Curiosity about hands-on installation, configuration and use of the software to further develop product understanding
- Ability to develop product understanding by working closely with product developers in an Agile development environment
Responsibilities
- Design and implement detailed test plans and test cases for AI-based applications to ensure the functionality, performance, and security meet the standards and requirements
- Conduct rigorous tests on AI-based applications, including generative models, AI Assistant/AI agent platforms, and machine learning algorithms, to assess their effectiveness, accuracy, and usability
- Identify, document, and report defects, bugs, and AI behavior anomalies. Test for AI's response consistency, context understanding, and the ability to generate relevant outputs; collaborating with the development team to resolve issues
- Develop and implement automated test scripts for AI models, ensuring scalability and efficiency in testing
- Work with data engineers, data scientists, and development teams to prepare test data for training, validation, and testing of AI models
- Conduct functional testing, regression testing, load testing, and performance testing for AI-powered applications; ensuring no regression issues or performance drops after model retraining or new version releases
- Analyze and validate the performance of machine learning models and AI outputs critically, identify biases, edge cases through testing and ensure that the application meets the encouraged accuracy, precision, and other performance metrics
Other
- Cross-functional teammate
- Detailed, organized, flexible, and proactive teammate
- Willing to accept feedback and implement changes quickly and with a positive attitude
- Comfortable working in an Agile development environment
- Bachelor's degree and 2+ years of relevant experience or a master's degree and 1+ year of relevant experience
