H-E-B Digital Technology is investing heavily in customers' digital experience, reinventing how they find inspiration from food, make food decisions, and get food into their homes. The Staff Data Engineer will use an advanced analytical, data-driven approach to drive a deep understanding of the fast-changing business and answer real-world questions, working with stakeholders to develop a clear understanding of data and data infrastructure needs, resolve complex data-related technical issues, and ensure optimal data design and efficiency.
Requirements
- 8+ years of hands-on experience related to data engineering in developing data pipelines and APIs
- Experience with advance SQL, Python and preferred knowledge in Java
- Proven experience with SQL, Spark, Databricks, AWS Lambda, S3, Data lake
- Experience of ingesting data from data lake to Elasticsearch/Opensearch
- Strong knowledge of messaging systems like Kafka, GCP pubsub or Tibco EMS
- Experience in infrastructure as a code using Terraform
- Experience in DevOps tools such as GitLab CI/CD, and Jenkins.
Responsibilities
- Builds / supports more complex data pipelines, application programming interfaces (APIs), data integrations, data streaming solutions
- Designs data patterns that support creation of datasets for analytics; implements calculations, cleanses data, ensures standardization of data, maps / links data from more than one source
- Performs data validation and quality assurance on work of senior peers and write automated tests
- Maintains / streamlines / orchestrates existing data pipelines end to end
- Builds large-scale batch and real-time data pipelines with big data processing frameworks
- Designs / implements monitoring capabilities based on business SLA and data quality
- Designs / develops / maintains large data pipelines; diagnoses / solves production support issues
Other
- Once you’re eligible, you’ll become an Owner in the company, so we’re looking for commitment, hard work, and focus on quality and Customer service.
- HEART FOR PEOPLE… you’re willing to facilitate solutions with multiple engineers, provide upward communication, and mentor others?
- HEAD FOR BUSINESS… you consistently demonstrate and uphold the standards of coding, infrastructure, and process?
- PASSION FOR RESULTS… you’re capable of high-velocity contributions in multiple technical domains?
- You have a related degree or work experience, preferably a Bachelor’s degree in related work stream.
