Kraken is seeking a skilled Data Engineer to join their Data Platform team and help architect the future of Kraken's data ecosystem, building scalable data systems to power one of the fastest-growing companies in cryptocurrency
Requirements
- 5+ years of work experience in relevant field (Data Engineer, DWH Engineer, Software Engineer, etc)
- Experience with data-lake and data-warehousing technologies and relevant data modeling best practices (Presto, Athena, Glue, etc)
- Proficiency in at least one of the main programming languages used: Python and Scala
- Experience building data pipelines/ETL in Airflow, and familiarity with software design principles
- Excellent SQL and data manipulation skills using common frameworks like Spark/PySpark, or similar
- Expertise in Apache Spark, or similar Big Data technologies, with a proven record of processing high volumes and velocity of datasets
- Experience with business requirements gathering for data sourcing
Responsibilities
- Build scalable and reliable data pipelines that collect, transform, load and curate data from internal systems
- Augment data platform with data pipelines from external systems
- Ensure high data quality for pipelines you build and make them auditable
- Drive data systems to be as near real-time as possible
- Support design and deployment of distributed data store that will be central source of truth across the organization
- Build data connections to company's internal IT systems
- Develop, customize, configure self service tools that help our data consumers to extract and analyze data from our massive internal data store
Other
- Full-time employment
- Remote work location
- Must be familiar with the Kraken app and culture
- Must read the Kraken Culture page to learn more about internal culture, values, and mission
- Kraken is an equal opportunity employer and does not tolerate discrimination or harassment of any kind
