Valvoline Global Operations is seeking a Data Engineer to enhance its data and analytics capabilities by designing and developing scalable data pipelines, integrating complex systems, and optimizing data workflows to support business intelligence and data science initiatives.
Requirements
- Strong knowledge of data engineering principles, data warehousing concepts, and modern data architecture.
- Proficiency in SQL and at least one programming language (e.g., Python, Scala).
- Experience with cloud platforms (e.g., Azure, AWS, or GCP), particularly in data services.
- Familiarity with data orchestration tools (e.g., PySpark, Airflow, Azure Data Factory) and CI/CD pipelines.
- Hands-on experience with Databricks (including Spark/PySpark, Delta Lake, MLflow, Unity Catalog, etc.).
- Practical experience working with SAP Datasphere (or SAP Data Warehouse Cloud) in data modeling and data integration scenarios.
- Experience with BI tools like Power BI or Tableau.
Responsibilities
- Design, build, and maintain robust, scalable, and high-performance data pipelines using Databricks and SAP Datasphere.
- Collaborate with data architects, analysts, data scientists, and business stakeholders to gather requirements and deliver data solutions aligned with stakeholders’ goals.
- Integrate diverse data sources (e.g., SAP, APIs, flat files, cloud storage) into the enterprise data platforms
- Ensure high standards of data quality and implement data governance practices.
- Stay current with emerging trends and technologies in cloud computing, big data, and data engineering.
- Provide ongoing support for the platform, troubleshoot any issues that arise, and ensure high availability and reliability of data infrastructure.
- Create documentation for the platform infrastructure and processes, and train other team members or users in platform effectively.
Other
- Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field.
- 5-7+ years of experience in a data engineering or related role.
- SAP BW or SAP HANA experience is a plus.
- Understanding of data governance frameworks and data security best practices.
- Exposure to data lakehouse architecture and real-time streaming data pipelines.
