The DLA needs to test and evaluate AI systems, ensuring they are developed in accordance with applicable legal frameworks and ethical principles, and to integrate the AI testing and evaluation program throughout the product lifecycle.
Requirements
- Mathematics, statistics, computer science, data science or field directly related to the position.
- Conducts large, agency wide, research and development reviews of metrics, measurements, and evaluation methods for emerging and existing areas of AI.
- Utilizes data science expertise to develop algorithms and tools to support data manipulation and processing as well as the use of data visualization techniques to articulate high risk findings.
- Ensures the AI systems are designed for auditability to manage AI risk assessment policies and principles which guide automated decisions supporting DLA business operations.
- Assesses data quality and establishes standards to validate quality criteria for data to ensure it meets the necessary requirements for AI testing and evaluation.
- Courses equivalent to a major field of study (30 semester hours) as shown in paragraph A above, plus appropriate experience.
Responsibilities
- Serves as an AI (Artificial Intelligence) Testing and Evaluation Data Scientist providing subject matter AI expertise and execution to test and evaluate AI systems.
- Provides professional and scientific expertise in the application of data science disciplines for complex studies in machine learning and deep learning algorithms, statistical analysis, visualizations, programing and computer science.
- Provides expertise in evaluating and measuring data science and artificial intelligence systems in accordance with data science Lifecyle practices within DoD parameters.
- Ensures AI systems are developed in accordance with applicable legal frameworks such as General Data Protection Regulation (GDPR) and National Institute of Standards and Technology (NIST).
- Incorporates, Office of Management and Budget (OMB) test and evaluation requirements, DOD AI ethical principles into DLA AI test and evaluation framework to generate an RAI test strategy for modeling cases.
- Utilizes expertise to coordinate the integration of the DLA AI testing and evaluation program during the product lifecycle from concept and design inception, as development proceeds, and integrated to ensure effective RAI implementation.
- Utilizes data science expertise to develop algorithms and tools to support data manipulation and processing as well as the use of data visualization techniques to articulate high risk findings.
Other
- Telework Eligible
- Provides expert advice to senior leadership and AI stakeholders to adopt new or revised policy and implementation plans resulting from AI test and evaluation integration.
- One year of specialized experience that equipped you with the particular competencies to successfully perform the duties of the position and is directly in or related to this position.
- To qualify at the GS-14 level, applicants must possess one year of specialized experience equivalent to the GS-13 level or equivalent under other pay systems in the Federal service, military, or private sector.
- Applicants must meet eligibility requirements including time-in-grade (General Schedule (GS) positions only), time-after-competitive appointment, minimum qualifications, and any other regulatory requirements by the cut-off/closing date of the announcement.
