Red Ventures is looking to solve the problem of building data products and creating the foundation that powers their machine learning and business analytics efforts by hiring a Data Engineer.
Requirements
- 2+ years of experience performing production data engineering/ETL work
- 2+ years of experience with one of the major cloud providers (AWS, Azure, or GCP)
- 2+ years of experience working on Spark/SparkSQL using Scala/Python to build and maintain complex ETL pipelines
- 2+ years of experience working with SQL
- Experience with GitHub and CI/CD processes
- Experience working on Orchestration (Databricks Workflows / Airflow)
- Experience with one of the major data warehousing solutions (Databricks, BigQuery, Snowflake, Oracle, or Redshift)
Responsibilities
- Design and build data pipelines from various sources to data warehouse using batch or incremental loading strategies utilizing cutting edge cloud technologies.
- Conceptualizing and generating infrastructure that allows data to be accessed and analyzed effectively.
- Transform existing data from diverse enterprise systems into a unified data platform housing robust datasets ready for analytics and reporting.
- Master upstream processes, pipelines, and source systems.
- Collaborate with various functional units to ensure the successful deployment, operation, and maintenance of solutions.
- Provide operational support for the production data pipelines and data triaging.
- Work hand-in-hand with a variety of stakeholders from functional groups across the organization to create end-to-end solutions.
Other
- 2+ years of experience
- Hybrid schedule with work from home options
- Must be based in Fort Mill, SC Headquarters (Tuesday through Thursday) and work fully remotely on Mondays and Fridays
- Not open to visa sponsorship or transfer of visa sponsorship
- Must be eligible to work in the US
