Michaels Sr Data Engineers develop technologies that change how our customers connect, explore, and interact with information and one another. We are currently looking for Sr Data Engineers who have a passion for designing systems that can collect and integrate data from various sources and create data sets that can be messaged into meaningful insights. In this position you will help drive our data architecture across datasets.
Requirements
- Experience building and maintaining data pipelines (e.g. Airflow, Prefect, Luigi, Kafka)
- Fluency in SQL, Python, Scala
- Experience with project build with CI/CD pipelines through Jenkins
- Experience with Linux, Docker, and Cloud technologies and data systems architecture
- Experience building Data Models from unstructured and semi-structured raw data.
- Build batch and streaming pipelines on GCP using Dataflow.
- Optimize and tune data pipelines for performance and scalability.
Responsibilities
- Design, develop, and maintain batch and streaming ETL/ELT pipelines using Advanced SQL, Python, and Shell scripting.
- Utilize workflow management tools like Airflow and Jenkins to orchestrate and automate data pipelines.
- Experience building Data Models from unstructured and semi-structured raw data.
- Build batch and streaming pipelines on GCP using Dataflow.
- Optimize and tune data pipelines for performance and scalability.
- Implement best practices for data governance, data quality, and data security.
- Collaborate with cross-functional teams to understand data requirements and design efficient data solutions.
Other
- The ideal candidate exudes analytical acumen, possesses strong data engineering skills, has a high degree of customer-obsession, and has a track record for delivering results.
- You will work on projects critical to Michaels needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve.
- We need Engineers who are versatile, display leadership qualities and are enthusiastic to take on new challenges to help move Michaels Technology forward.
- Bachelors Degree or higher in Computer Science or a related technical field
- 5+ years hand on software development experience, preferable in an industry data-oriented role (Data Engineer, Analytics Engineer, etc.)
