General Motors Manufacturing is looking to improve decisions, plant asset maintenance, safety, and operational performance, as well as Vehicle Build Data by developing new plant data solutions.
Requirements
- 10+ years of experience in data engineering, including Python or Scala, SQL, and relational/non-relational storage (ETL frameworks, big data processing, NoSQL)
- 5+ years of experience in distributed, petabyte-scale data processing with Spark and container orchestration (Kubernetes)
- Hands-on experience with real-time data streaming in Kubernetes and Kafka
- Expertise in performance tuning (partitioning, clustering, caching, serialization techniques)
- Proficiency with SQL, key-value datastores, and document stores
- Strong CI/CD expertise and best practices
- Cloud experience with at least one major platform (Azure preferred; AWS or GCP acceptable)
Responsibilities
- Provide technical leadership for complex data engineering initiatives from concept through production, ensuring solutions are high-quality, efficient, and reliable.
- Assemble large, complex data sets that meet both functional and non-functional business requirements.
- Identify, design, and implement process improvements, including automation, data delivery optimization, and redesign for greater scalability.
- Architect, build, and optimize highly scalable data pipelines that incorporate complex transformations and efficient, maintainable code.
- Design and develop new source system integrations from a variety of formats including files, database extracts, and APIs.
- Lead and deliver data-driven solutions across multiple languages, tools, and technologies, contributing to architecture discussions, solution design, and strategic technology adoption.
- Develop solutions for delivering data that consistently meets SLA requirements and supports operational excellence.
Other
- This role is categorized as hybrid. This means the successful candidate is expected to report to Warren, MI or Austin, TX three times per week, at minimum
- Bachelor’s degree in Computer Science, Software Engineering, or related field
- Strong teamwork and leadership skills to collaborate and influence across product, program, and engineering teams
- Commitment to ensuring data security, privacy, and regulatory compliance
- GM DOES NOT PROVIDE IMMIGRATION-RELATED SPONSORSHIP FOR THIS ROLE.