The company needs a Senior Data Engineer to develop, maintain, test, and lead data infrastructure projects to support the PrizePicks business across all departments.
Requirements
- 5+ years of experience in a data Engineering, or data-oriented software engineering role
- Extensive experience building and optimizing cloud-based data streaming pipelines and infrastructure
- Experience with SQL/NoSQL databases/warehouses: Postgres, BigQuery, BigTable, Materialize, AlloyDB, etc
- Experience with Replication/ELT services: Data Stream, Hevo, etc
- Experience with Data Transformation services: Spark, Dataproc, etc
- Experience with Scripting languages: SQL, Python, Go
- Experience with Cloud platform services in GCP and analogous systems: Cloud Storage, Cloud Compute Engine, Cloud Functions, Kubernetes Engine etc
- Experience with Data Processing and Messaging Systems: Kafka, Pulsar, Flink
Responsibilities
- Enhance the capabilities of existing Core Data platforms and develop new integrations with both internal and external APIs
- Design and implement both real-time and batch data ingestion frameworks
- Manage Kubernetes-based infrastructure on Google Cloud Platform (GCP)
- Collaborate with Analytics Engineers to enhance data transformation processes
- Architect and implement Infrastructure as Code (IaC) solutions
- Develop and manage CI/CD pipelines
- Design and automate data governance processes and tool integrations
Other
- Provide on-call support as part of a shared rotation between the Data and Analytics Engineering teams
- Serve as a Data Engineering thought leader within the broader PrizePicks technology organization
- Excellent organizational, communication, presentation, and collaboration experience with organizational technical and non-technical teams
- Graduate degree in Computer Science, Mathematics, Informatics, Information Systems or other quantitative field
- Authorized to work for any employer in the U.S
- Must be willing to consider remote candidates, but preference for candidates based in Atlanta
