Disney Entertainment and ESPN Product & Technology is looking to build and maintain the Audience Manager Platform (AMP), a centralized Disney audience data platform that captures & processes all Disney consumers cross channel behavior and delivers varying summarizations in a timely manner to multiple endpoints to support all business needs. The role requires expert knowledge of building scalable, fault-tolerant data processing pipelines and backend to ensure the reliable delivery of audience data.
Requirements
- 5+ years of big data engineering experience modeling and developing large data pipelines
- Hands-on experience with distributed systems such as Spark, Hadoop (HDFS, Hive, Presto, PySpark) to query and process data
- Strong Python and SQL skills processing big datasets
- Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, Big Query, Databricks)
- Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices
- API and backend development experience
Responsibilities
- Build and maintain audience platform initiatives to improve and expand audience targeting capabilities.
- Design table structures and define ETL pipelines to build performant and scalable solutions
- Develop Data Quality checks
- Participate in on-call support
- Develop and maintain ETL routines using ETL and orchestration tools such as Airflow
- Perform ad hoc analysis and SQL and ETL tuning as necessary.
- Participate in code reviews and problem-solving.
Other
- Partner with technical and non-technical colleagues to understand audience data and targeting requirements.
- Support Agile methodologies such as Scrum by actively participating in regular ceremonies such as stand-up, retrospectives and sprint planning.
- Bachelor’s degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience.
- The hiring range for this position in San Francisco, CA is $155,400 to $208,400.
- A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.
