Twitch's Video Team is seeking a Data Infrastructure Engineer to design, build, and maintain the systems that power their data-driven organization, ensuring reliable, scalable, and optimized data pipelines, storage, and processing systems for analytics, machine learning, and business intelligence use cases.
Requirements
- Strong hands-on expertise with cloud platforms
- Proficiency in data pipeline tools (e.g., Airflow, dbt, AWS Glue, Flink).
- Experience with data storage technologies (e.g., Redshift, Snowflake, BigQuery, Delta Lake, Iceberg, Parquet).
- Proficiency in GO, SQL, and Python for building and maintaining data systems.
- Solid understanding of distributed systems and performance optimization.
- Experience with real-time data streaming and event-driven architectures.
- Strong hands-on expertise with AWS cloud
Responsibilities
- Design, implement, and maintain scalable data infrastructure in AWS cloud
- Build and optimize data pipelines (batch and streaming) to support analytics, reporting, and ML workloads.
- Ensure data quality, reliability, and observability through monitoring, logging, and automated alerting.
- Work closely with data engineering and analytics teams to understand requirements and deliver high-performance solutions.
- Champion best practices for security, compliance, and governance in data infrastructure.
- Identify opportunities to optimize performance and cost of data platforms.
- Stay current with emerging tools, frameworks, and cloud services in the data infrastructure ecosystem.
Other
- 6+ years of experience in data engineering, DevOps, or infrastructure engineering roles.
- Background in observability and monitoring
- Knowledge of data governance, security, and compliance best practices
- Prior experience supporting machine learning or advanced analytics environments.
- Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
