Disney Entertainment and ESPN Product & Technology is looking to build and advance the technological backbone for Disney’s media business globally, specifically focusing on creating and scaling innovative global advertising solutions by building mission-critical tools and workflows to support digital & linear ad sales, traffic, marketing, and parts of broadcast operations.
Requirements
- 5+ years of data engineering experience developing large data pipelines.
- Strong understanding of data modeling principles including Dimensional modeling & data normalization principles.
- Strong expertise in writing SQL queries and a deep understanding of Kafka, Spark, and Snowflake.
- Familiarity with AWS services, including Lambda, CloudWatch, Step Functions, EC2, CloudFormation, and Jenkins.
- Strong understanding of SQL Engines and able to conduct advanced performance tuning.
- Strong experience programming languages (e.g. Java, Scala, Python, Pyspark)
- Experience with Snowflake/Databricks/EMR/Spark
Responsibilities
- Contribute to the design and growth of our Data Products and Data Warehouses around Ad data.
- Partner with technical and non-technical colleagues to understand data and reporting requirements, and Collaborate with Data Product Managers, Data Architects, and other Data Engineers to design, implement, and deliver successful data solutions
- Contribute to the design of table structures and defining of data pipelines to build performant Data solutions that are reliable and scalable in a fast-growing data ecosystem.
- Develop Data Quality framework and data checks and Build safeguards for pipeline failures and minimize data quality issues.
- Develop and maintain ETL routines using ETL and orchestration tools such as Airflow
- Serve as an advanced resource to other Data Engineers on the team, and mentor and coach more junior members of the team helping to improve their skills, knowledge, and productivity.
- Design and implement the different stages of the Data pipelines, using AWS and Snowflake.
Other
- Strong communication skills – in both written and verbal presentations.
- Familiarity with Agile Scrum principles and ceremonies
- Bachelor’s Degree in Computer Science, Information Systems or related field, or equivalent work experience.
- Masters Degree in a related field, and/or related certification/s
- Experience with AWS, Azure, Kafka or other cloud technologies
