Underdog is looking to redesign and scale the backbone of their data and machine learning platform to directly shape how data powers products and decisions across the company, while also leading a team in building innovative data systems for a rapidly growing business.
Requirements
- At least 8+ years of experience in data engineering, data infrastructure, and/or machine learning roles with experience architecting near real time big data systems
- Strong familiarity with distributed computing and data storage mechanisms on the cloud environment (e.g. AWS/GCP/Azure) with hands-on experience in managing data infrastructure
- Track record of delivering scalable and innovative solutions, leveraging cutting-edge technologies for data and machine learning technologies such as Spark, Iceberg, Kafka, and SageMaker
- Expert proficiency with Python and SQL
- Expert proficiency with Terraform or other Infrastructure as Code (IAC) tools
- Experience building ML systems like recommendation engines
Responsibilities
- roadmapping and technically architecting a scalable data and machine learning platform
- Establish best practices that achieve operational excellence in data availability, data quality, and data observability
- Manage relevant cloud infrastructure for hosting big data applications and ML workloads such as SageMaker, Kubeflow, or Vertex AI
- Design and implement data pipelines that are optimized for scale and data quality
- Lead, mentor, and scale the data engineering team, cultivating a culture of innovation, learning, and excellence
- Partner with product, engineering, and analytics teams to understand their data needs and translate their business requirements to scalable technical solutions
- Develop and maintain robust governance frameworks, ensuring processes for monitoring, documentation, and testing are in place to safeguard the integrity and availability of data
Other
- 2+ years of experience managing 5+ person teams
- Highly focused on delivering results for internal and external stakeholders in a fast-paced, entrepreneurial environment
- Demonstrates strong ownership and thrives in a fast paced environment, consistently driving initiatives forward and delivering results with urgency
- Excellent leadership and communication skills with ability to influence and collaborate with stakeholders
- Advanced degree in Computer Science, Data Science, or a related field
