The agency is seeking Data Engineers to build, refine, and maintain the core data pipelines that enable enterprise AI, analytics, and mission systems, making data accessible, reliable, and usable across the agency.
Requirements
- Strong proficiency in building data pipelines using tools such as Python, Spark, Databricks, Azure Data Factory, AWS Glue, or similar.
- Experience integrating structured and unstructured data sources.
- Knowledge of SQL, schema design, data modeling, and cloud-based storage patterns.
- Experience supporting AI/ML pipelines, vectorization, or embedding generation.
- Azure, AWS, or multi-cloud data ecosystem familiarity.
- Experience with data governance, access controls, or sensitive data protection.
- Exposure to DevOps/CI-CD patterns for data workflows.
Responsibilities
- Design, build, and maintain scalable data pipelines, ETL/ELT workflows, and integrations across cloud and on-prem systems.
- Prepare and optimize data for AI/ML models, semantic search, analytics, and mission applications.
- Implement data quality checks, validation, lineage tracking, and metadata management.
- Collaborate with AI engineers and analysts to ensure datasets meet requirements.
- Automate ingestion and transformation processes using industry-standard tools and patterns.
- Support API strategy, data modeling, and domain-driven data structures.
- Troubleshoot pipeline issues and optimize for performance and cost.
Other
- 3+ years of hands-on data engineering experience.
- 10+ years of technical professional experience.
- Secret clearance.
- Selected applicant may be subject to a background investigation and/or education verification.
- SMX does not sponsor a new applicant for employment authorization or immigration related support for this position.
