The company needs to architect and build end-to-end data products that fuel short-form video generation, recommendations, and executive-grade analytics, while ensuring real-time, reliable, and cost-efficient data systems.
Requirements
- Fluent in SQL and Python
- Confident with Kafka + Flink (or equivalent)
- Expert SQL and strong Python; deep knowledge of incremental processing, partitioning, compaction, and schema design.
- Hands‑on with real‑time systems (Kafka + Flink or similar) and modern ELT in a warehouse (Snowflake preferred).
- Proven reliability practice: contracts, tests, lineage, SLAs/SLOs, and effective incident response.
- Experience modeling complex domains and enabling both BI and ML/feature store use cases.
- Clear, concise design docs
Responsibilities
- Architect and build end-to-end data products—from streaming ingestion and Flink SQL transforms to Snowflake analytical models and SQLmesh validations—that serve both ML/AI and BI needs with clear SLAs.
- Harden contracts, lineage, and data quality; optimize cost and latency; and lead design reviews, mentoring senior engineers while partnering with DS/AI Engineering, BI/Analytics, and brand teams across NFHS Network, GoFan, and MaxPreps.
- Design and own real‑time and batch pipelines (Confluent Cloud/Kafka, Flink SQL, Snowflake, SQLmesh) with reliability and observability built‑in.
- Model domain‑rich schemas for sports/video/ticketing/subscriptions/ads that serve both analytics and ML feature needs.
- Implement data quality, contracts, testing, and lineage (dbt tests, Great Expectations, OpenLineage/Marquez or similar).
- Drive SLOs, alerting, and remediation playbooks to minimize data downtime and MTTR; lead blameless postmortems.
- Scale event ingestion/CDC from sources like GA4/Segment, app stores, payments (Stripe), 3rd‑party sports systems; manage schema evolution.
Other
- Sets the bar for real‑time, reliable, and cost‑efficient data systems
- Lead design reviews, mentoring senior engineers while partnering with DS/AI Engineering, BI/Analytics, and brand teams
- Translate ambiguous business goals into measurable outcomes.
- Ownership over Participation- You take responsibility for achieving holistic outcomes, prioritize key objectives, and adapt quickly when situations require a different approach. You follow through even against the toughest challenges.
- Team over Stars- You are a bridge builder, establishing processes and relationships with teams outside your own. You work to rally around common goals, find win-win solutions, compromise when necessary, and help others succeed.
