The Defense Intelligence Agency (DIA) needs a Senior Data Engineer to support multiple initiatives, including the Machine-Assisted Rapid-Repository System (MARS), Object Management Services (OMS), and Object-Based Intelligence (OBI).
Requirements
- Experience with backend database technologies (e.g. SQL, NoSQL, HPC, etc.).
- Experience with data management systems and databases.
- Experience with ETL pipelines using industry-standard tools and frameworks (e.g. Apache NiFi).
- Experience with GraphQL APIs.
- Experience with relational and non-relational database solutions (e.g. PostgreSQL).
- Experience with containerization capabilities (e.g. Docker, Kubernetes) and infrastructure as code tools.
- Experience with data service versioning and data management solutions.
Responsibilities
- Designs, implements, and operates data management systems for intelligence needs.
- Designs how data will be stored, accessed, used, integrated, and managed by different data regimes and digital systems.
- Plans, designs, and optimizes data throughput and query performance.
- Participates in the selection of backend database technologies (e.g. SQL, NoSQL, HPC, etc.), their configuration and utilization, and the optimization of the full data pipeline infrastructure.
- Manages complex, long term projects involving design, development, and installation of new information systems.
- Develops, integrates, and installs data management capabilities and databases.
- Collaborate with team members to develop or refine resilient and scalable extract, transform, load (ETL) pipelines using industry-standard tools and frameworks (e.g. Apache NiFi).
Other
- Minimum 12 years of experience related to the specific labor category with at least a portion of the experience within the last 2 years with a master’s degree.
- Minimum 17 years of experience related to the specific labor category with at least a portion of the experience within the last 2 years with a bachelor’s degree.
- Demonstrates ability to work independently and with minimal oversight.
- Active TS/SCI clearance with a Current CI Poly.
- Ability to prepare and present briefings to senior management.
