SteerBridge Strategies is looking to revolutionize supply chain management in the aerospace industry by applying advanced computational analytics, specifically AI/ML, to increase parts availability, reduce maintenance wait times, and maximize aircraft availability and operational readiness. The Data Engineer will be responsible for enhancing and optimizing data entry, management, and extraction within existing systems of record to support these goals.
Requirements
- Data modeling (conceptual, logical, and physical)
- Database schema design
- ETL (Extract, Transform, Load) processes and tools
- Proficiency in tools like Apache Kafka, Airflow, Spark, Flink, or NiFi
- Experience with cloud-based data services (AWS Glue, Google Cloud Dataflow, Azure Data Factory)
- Expertise in cloud environments (AWS, GCP, Azure)
- Proficiency in Python, Scala, SQL, and Java
Responsibilities
- The DE will be responsible for leading end-to-end data management activities, including but not limited to working with partners to identify fields, data linkage and integration, performing data quality checks, analysis, presenting data and documenting the process.
- Take the lead role in data transfer operations. Actively develop and maintain data pipelines and workflows that are the foundation of our polling and modeling: problem scoping, data cleaning, analysis, and testing.
- Create, Index, Query, and Update SQL tables/servers.
- Use Azure Databricks (Spark) and Data Factory to manage pipelines.
- Run/update Python and/or JavaScript code to parse data.
- Maintain data in S3 buckets and Blob storage.
- Use schedulers and APIs to get near real-time data.
Other
- Must be a U.S. Citizen.
- Active security clearance or the ability to obtain one is required.
- Mentoring and collaborating with Marines at the squadron level, requiring a deep understanding of squadron-specific operations and a commitment to improving data entry and indexing practices.
- The ideal candidate is a quick learner, curious, innovative, results oriented and has strong interpersonal skills.
- Collaborate with and support the work of the data scientists to produce deliverables.