The EDAI organization needs to develop scalable, reliable, and high-performance data infrastructure to support advanced analytics, experimentation, and machine learning. This involves building and maintaining foundational data platforms for data scientists, analysts, and marketing stakeholders to generate insights, measure performance, and drive data-informed decisions. The role also includes managing on-call rotations and ensuring operational excellence, system reliability, and timely incident response for production data pipelines.
Requirements
- 3+ years of experience managing data engineering or software engineering teams, with a focus on building and maintaining production-grade data infrastructure.
- 7+ years of hands-on experience in data engineering, including designing, developing, and optimizing large-scale data pipelines and ETL/ELT workflows.
- Proficiency in Python, SQL, and distributed data processing frameworks such as PySpark.
- Experience with modern data platforms and tools such as Airflow, dbt, Snowflake, Databricks, Kafka, or similar.
- Experience with cloud architecture systems such as Azure, AWS, GCP, etc.
- Strong understanding of data modeling, data warehousing, and data governance best practices.
Responsibilities
- Lead and mentor a multidisciplinary team of Data Engineers, Scrum Leads, Architects, and Product Managers to build scalable analytic data foundations.
- Architect, design, and implement data ingestion, transformation, and orchestration workflows using modern data engineering tools and cloud-native technologies.
- Ensure high data quality, reliability, and availability across batch and real-time data processing systems.
- Establish and promote best practices in data engineering, including version control, testing, documentation, and CI/CD for data pipelines.
- Contribute to the evolution of the data architecture and help define long-term strategies for data infrastructure and tooling.
Other
- This role is based remotely but if you live within a 50-mile radius of an office [Atlanta, Austin, Detroit, Warren, Milford or Mountain View], you are expected to report to that office three times a week, at minimum.
- Ability to communicate long-term vision and roadmap milestones through compelling storytelling and data-driven insights to influence leadership and ensure strategic alignment.
- Demonstrated success in collaborating with cross-functional teams and translating business requirements into scalable data solutions.
- Strong leadership and mentoring skills, with a track record of developing high-performing engineering teams.
- GM DOES NOT PROVIDE IMMIGRATION-RELATED SPONSORSHIP FOR THIS ROLE.
