The EDAI organization needs to develop scalable, reliable, and high-performance data infrastructure to support advanced analytics, experimentation, and machine learning, enabling data scientists, analysts, and marketing stakeholders to generate insights and drive data-informed decisions.
Requirements
- Proficiency in Python, SQL, and distributed data processing frameworks such as PySpark.
- Experience with modern data platforms and tools such as Airflow, dbt, Snowflake, Databricks, Kafka, or similar.
- Experience with cloud architecture systems such as Azure, AWS, GCP, etc.
- Strong understanding of data modeling, data warehousing, and data governance best practices.
- 7+ years of hands-on experience in data engineering, including designing, developing, and optimizing large-scale data pipelines and ETL/ELT workflows.
- 3+ years of experience managing data engineering or software engineering teams, with a focus on building and maintaining production-grade data infrastructure.
Responsibilities
- Lead the development of scalable, reliable, and high-performance data infrastructure that powers advanced analytics, experimentation, and machine learning.
- Building and maintaining the foundational data platforms that enable data scientists, analysts, and marketing stakeholders to generate insights, measure performance, and drive data-informed decisions.
- Managing on-call rotations and ensuring operational excellence, system reliability, and timely incident response for the production data pipelines.
- Architect, design, and implement data ingestion, transformation, and orchestration workflows using modern data engineering tools and cloud-native technologies.
- Ensure high data quality, reliability, and availability across batch and real-time data processing systems.
- Establish and promote best practices in data engineering, including version control, testing, documentation, and CI/CD for data pipelines.
- Contribute to the evolution of the data architecture and help define long-term strategies for data infrastructure and tooling.
Other
- Lead and mentor a multidisciplinary team of Data Engineers, Scrum Leads, Architects, and Product Managers to build scalable analytic data foundations.
- Ability to communicate long-term vision and roadmap milestones through compelling storytelling and data-driven insights to influence leadership and ensure strategic alignment.
- Demonstrated success in collaborating with cross-functional teams and translating business requirements into scalable data solutions.
- Strong leadership and mentoring skills, with a track record of developing high-performing engineering teams.
- GM DOES NOT PROVIDE IMMIGRATION-RELATED SPONSORSHIP FOR THIS ROLE.
