Disney Entertainment and ESPN Product & Technology is looking for a Senior Data Engineer to focus on privacy solutions and data subject rights automation, working cross-functionally to build scalable solutions for complex privacy-related challenges within Disney's world-class streaming services.
Requirements
- 5+ years of data engineering experience in software engineering in the data space
- Strong algorithmic problem-solving expertise
- Strong fundamental Scala and Python software programming skills
- Good understanding of AWS or other cloud provider resources (S3)
- Strong SQL skills and ability to creatively problem solve and dive deep into our data and software ecosystem
- Hands-on production environment experience with distributed processing systems such as Apache Spark
- Hands-on production experience with workflow orchestration systems such as Airflow for creating and maintaining data pipelines
Responsibilities
- Be a key player in a cross-functional team of engineers who build software for a large-scale data processing ecosystem, supporting real-time and batch data pipelines for analytics, data science, and operations.
- Maintain data engineering and architecture best practices and standards within the team and wider organization, along with a culture of quality, innovation, and experimentation
- Evangelize and evolve the platform, best-practices, data driven decisions; identify new use cases and features and drive adoption
- Build out a robust observability, alerting, logging, and system control plane that allows easy diagnosis of any issues across all our data pipelines.
- Contribute to maintaining, updating, and expanding existing software deployments while maintaining strict uptime SLAs
- Maintain detailed documentation of your work and changes to support data quality and data governance requirements
- Be an active participant and advocate of agile/scrum ceremonies to collaborate and improve processes for our team
Other
- Willingness and ability to learn and pick up new skillsets
- Self-starting problem solver with an eye for detail and excellent analytical and communication skills
- Master’s Degree in Computer Science, Information Systems preferred
- Familiarity with privacy regulations and/or data subject rights
- Bachelor’s degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience
