NDi is looking to solve the problem of delivering advanced analytic applications by hiring a Senior Data Engineer to develop data analytics for desktop and web-developed analytic software, facilitate the bulk analysis of relational information, and establish applications that produce manageable, actionable intelligence from streams of structured and semi-structured data across multi-enclave environments.
Requirements
- Python for data processing, automation and ETL workflow orchestration
- SQL (MySQL, PostgreSQL, Microsoft SQL) and query optimization
- Elasticsearch and Apache Solr (design, scaling, query optimization, cluster management)
- Data pipeline technologies (Apache Kafka, Apache Nifi, Cribl)
- Log analytics and observability platforms, particularly Splunk
- Containerization and orchestration technologies (Docker, Kubernetes)
- Cloud platforms (AWS GovCloud, SC2S, C2S)
Responsibilities
- Design and implement data pipelines and ETL processes to support the cyber investigative capabilities
- Develop and maintain data analytics solutions for desktop and web-based visual analytic applications
- Establish applications that produce manageable, actionable intelligence from streams of structured, semi-structured, and data
- Design strategies for enterprise database systems and set standards for operations, programming, and security
- Construct and optimize large relational databases across multi-enclave environments (Unclassified, Secret, and Top Secret)
- Tune performance of large-scale data workflows, ensuring cost efficiency, low latency, and high availability
- Design and manage Elasticsearch/Apache Solr clusters for fast search, indexing, and retrieval of large-scale datasets
Other
- U.S. Citizenship is required
- Must possess an active TS clearance at the time of application, be willing and able to obtain SCI access, and pass a CI polygraph.
- This position is onsite 5/days a week in Chantilly, VA
- Minimum of 8 years of experience in data engineering or related field
- Experience with SAFe Agile framework
