The Defense Logistics Agency (DLA) is looking to solve the problem of testing and evaluating AI systems, ensuring they are developed in accordance with applicable legal frameworks and DOD AI ethical principles.
Requirements
- Degree: Mathematics, statistics, computer science, data science or field directly related to the position.
- Specialized Experience: One year of specialized experience that equipped you with the particular competencies to successfully perform the duties of the position and is directly in or related to this position.
- Conducts large, agency wide, research and development reviews of metrics, measurements, and evaluation methods for emerging and existing areas of AI.
- Utilizes data science expertise to develop algorithms and tools to support data manipulation and processing as well as the use of data visualization techniques to articulate high risk findings.
- Ensures the AI systems are designed for auditability to manage AI risk assessment policies and principles which guide automated decisions supporting DLA business operations.
- Assesses data quality and establishes standards to validate quality criteria for data to ensure it meets the necessary requirements for AI testing and evaluation.
Responsibilities
- Serves as an AI (Artificial Intelligence) Testing and Evaluation Data Scientist providing subject matter AI expertise and execution to test and evaluate AI systems.
- Provides professional and scientific expertise in the application of data science disciplines for complex studies in machine learning and deep learning algorithms, statistical analysis, visualizations, programing and computer science.
- Provides expertise in evaluating and measuring data science and artificial intelligence systems in accordance with data science Lifecyle practices within DoD parameters.
- Ensures AI systems are developed in accordance with applicable legal frameworks such as General Data Protection Regulation (GDPR) and National Institute of Standards and Technology (NIST).
- Incorporates, Office of Management and Budget (OMB) test and evaluation requirements, DOD AI ethical principles into DLA AI test and evaluation framework to generate an RAI test strategy for modeling cases.
- Utilizes expertise to coordinate the integration of the DLA AI testing and evaluation program during the product lifecycle from concept and design inception, as development proceeds, and integrated to ensure effective RAI implementation.
Other
- Must be a U.S. citizen
- Tour of Duty: Set Schedule
- Security Requirements: Non-Critical Sensitive with Secret Access
- Appointment is subject to the completion of a favorable suitability or fitness determination, where reciprocity cannot be applied; unfavorably adjudicated background checks will be grounds for removal.
- Selective Service Requirement: Males born after 12-31-59 must be registered or exempt from Selective Service.
