The Digital Modernization and Experience (DMX) Group at ICF is looking to solve the problem of turning complex data into actionable solutions to improve public systems and services for a federal customer, specifically in the emergency management sector.
Requirements
- Databricks Platform Expertise – SME Level Proficiency including Databricks, Delta Lake, and Delta Sharing
- Deep experience with distributed computing using Apache Spark
- Knowledge of Spark runtime internals and optimization
- Ability to design and deploy performant end-to-end data architectures
- 4+ years of ETL Pipeline Development building robust, scalable data pipelines
- Databricks certifications - Professional or specialty certifications
- Hands-on experience with Azure services such as Synapse, Data Factory, or Databricks.
Responsibilities
- Enable secure, scalable, and efficient data exchange between federal client and external data sharing partners using Databricks Delta Sharing.
- Support the design and development of data pipelines and ETL routines in Azure Cloud environment for many source system types including RDBMS, API, and unstructured data using CDC, incremental, and batch loading techniques.
- Conduct data profiling, transformation, and quality assurance on structured, semi-structured, and unstructured data.
- Identify underlying issues and translate them into technical requirements.
- Assist in building and optimizing data lakes, feature stores, and data warehouse structures to support analytics and machine learning.
- Prepare, structure, and validate data for data science and MLOps workflows, ensuring it meets the quality and format requirements for modeling.
- Help monitor and maintain the flow of data across BI dashboards, analytics environments, and machine learning pipelines.
Other
- Bachelor’s degree in computer science, Information Systems, Data Analytics, or a related discipline.
- Minimum 5+ years in data engineering, data security practices, data platforms, and analytics
- Candidate must be able to obtain and maintain a Public Trust
- Candidate must reside in the U.S., be authorized to work in the U.S., and all work must be performed in the U.S.
- Candidate must have lived in the U.S. for three (3) full years out of the last five (5) years
