Cumberland Farms is looking to solve complex business challenges by designing and maintaining the pipelines that power their analytics, machine learning, and reporting systems within a modern Azure and Databricks ecosystem.
Requirements
- 3 years in data engineering or a closely related field
- 5 years with hands on experience in Databricks or Spark based systems
- Databricks
- Spark
- SQL
- Snowflake
- Azure
Responsibilities
- Design, build, and optimize scalable data pipelines and architectures using Databricks, Spark, and SQL
- Collaborate with analytics, data science, and business teams to deliver reliable, well-modeled datasets
- Support federated authentication and cross-platform integration (e.g., Snowflake, Azure, Power BI)
- Participate in code reviews, documentation, and knowledge sharing to elevate team capabilities
- Monitor and manage cloud resource usage to ensure performance and cost-efficiency
- Design data workflows with scalability and budget-conscious architecture in mind
- Develop and maintain ELT and medallion architecture pipelines across Azure and Databricks
Other
- Attention to Detail: Recognizes the downstream impact of data quality and pipeline reliability
- Collaboration: Communicates clearly across technical and non-technical teams
- Problem Solving: Navigates ambiguity and resolves performance or integration challenges
- Adaptability: Responds effectively to shifting priorities, tools, and business needs
- Monday – Friday 8-hour day in office setting
