Dark Wolf Solutions is seeking a Data Engineer to assist with strategic planning and oversee the implementation of a cloud-based data environment, addressing critical intelligence needs through data delivery, methodologies, and visualizations.
Requirements
- Proficient in utilizing AWS cloud services, including long-term storage solutions and cloud-based database services like Databricks and Elastic MapReduce (EMR).
- Experienced in designing and implementing SQL database structures and mappings between databases.
- Knowledgeable in network-attached storage (NAS) systems and their implementation.
- Skilled in creating and maintaining automated deployment scripts for streamlined software releases.
- Expert in managing and executing large-scale data migration projects, ensuring data integrity and minimal disruption.
- Hands-on experience with large-scale data compute and processing clusters such as Hadoop, optimizing performance and scalability.
- Adept at test-driven development within a secure on-premise cluster, selecting and employing the most efficient languages for the task, including Apache NiFi, Java, Python, and SQL.
Responsibilities
- Providing comprehensive support to analysts by delivering large datasets, methodologies, and impactful data visualizations to address critical intelligence needs.
- Aiding in the development and maintenance of a robust cloud-based data environment for efficient data transport, storage, ETL processes, and solution dissemination.
- Assisting in data engineering, cloud architecture design, and application development efforts, contributing to the overall success of projects.
- Assisting with strategic planning and oversee implementation of the cloud-based data environment, to include mapping of data sources and access controls.
- Developing code, data models, and documentation to standards; providing systems administration and programming support for ETL processes and data infrastructure efforts.
- Training and conducting knowledge transfer to team members on issues and technologies related to the ETL process, on premise high capacity compute cluster, and administrative duties.
- Coordinating with external data and platform providers to ensure the smooth functioning of the systems and data flows, and to accomplish any needed changes and coordinate with experts to assist with technical aspects required to acquire new datasets or data management technologies for inclusion in the environment.
Other
- Effectively facilitates communication and collaboration as a technical liaison between system engineers, data engineers, data scientists, analysts, and non-technical managers/personnel.
- US Citizen with an active Top Secret/Sensitive Compartmented Information (TS/SCI) security clearance with polygraph.
- We are proud to be an EEO/AA employer Minorities/Women/Veterans/Disabled and other protected categories.
- In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire.
