Excella is looking for a Senior Consultant Data Engineer to design and build modern data solutions, including data lakes and cleansed data repositories, and develop robust, scalable, and sustainable data pipelines using batch and streaming technologies.
Requirements
- Proven ability to build robust, scalable data pipelines and production-grade ETL/ELT systems.
- Strong proficiency in SQL, Python, and orchestration tools like Airflow and dbt.
- Hands-on experience with big data technologies such as Spark, Kafka, and file formats like Parquet, Delta Lake, and Iceberg.
- Deep experience with cloud data platforms (e.g., AWS Glue, S3, Redshift, EMR, BigQuery, or Azure equivalents).
- Solid understanding of data modeling, performance optimization, and designing secure, well-structured data stores.
- Familiarity with data lake and analytical architecture patterns, including Star Schema, schema-on-read, and data quality frameworks.
- Experience with CI/CD, Git, infrastructure-as-code (e.g., Terraform), and NoSQL databases.
Responsibilities
- Develop and manage data processes to ensure availability and usability.
- Create and automate data pipelines and platforms.
- Write clean, efficient, and well-documented code to support data engineering solutions.
- Monitor and ensure data quality through automated testing frameworks.
- Collaborate with Architects, Product Owners, Data Scientists, and DevOps to design, build, and maintain scalable data solutions.
- Research data acquisition sources and evaluate suitability.
- Integrate data management solutions into client environments.
Other
- This role will require an active DHS Public Trust due to the immediate need of the position.
- 3+ years of professional experience in data engineering or related fields.
- Effective communicator with experience working in Agile environments (Scrum/Kanban) and collaborating across technical and non-technical teams.
- Strong problem-solving skills, a growth mindset, and a passion for learning new technologies.
