Disney Entertainment & ESPN Product & Technology is looking to solve complex privacy related challenges by building scalable solutions for privacy solutions and data subject rights automation.
Requirements
- 7+ years of data engineering experience in software engineering in the data space
- Strong software algorithmic problem-solving expertise
- Strong fundamental Scala and Python software programming skills
- Good understanding of AWS or other cloud provider resources (S3)
- Strong SQL skills and ability to creatively problem solve and dive deep into our data and software ecosystem
- Hands-on production environment experience with distributed processing systems such as Apache Spark
- Hands-on production experience with workflow orchestration systems such as Airflow for creating and maintaining data pipelines
Responsibilities
- Be a key player in a cross-functional team of engineers who build software for a large-scale data processing ecosystem, supporting real-time and batch data pipelines for analytics, data science, and operations.
- Architect, design, and code shared libraries in Scala and Python that abstract complex business logic to allow consistent functionality across all data pipelines across the Data organization
- Work to architect and build world class modularized tooling to understand our very complex environments to come up with plans for simplification, migration, and maintenance.
- Maintain software engineering and architecture best practices and standards within the team and wider organization, along with a culture of quality, innovation, and experimentation
- Evangelize and evolve the platform, best-practices, data driven decisions; identify new use cases and features and drive adoption
- Build out a robust observability, alerting, logging, and system control plane that allows easy diagnosis of any issues across all our data pipelines.
- Contribute to maintaining, updating, and expanding existing software deployments while maintaining strict uptime SLAs
Other
- Be an active participant and advocate of agile/scrum ceremonies to collaborate and improve processes for our team
- Be a part of the magic: Collaborate with product managers, architects, and other engineers to drive the success of the Foundational Platform
- Master’s Degree in Computer Science, Information Systems preferred
- Familiar with Scrum and Agile methodologies
- Familiarity with privacy regulations and/or data subject rights
