Shopmonkey is looking to build, maintain, and improve its data infrastructure to ensure robust, efficient, and high-quality data pipelines for internal and external stakeholders. The role will involve strategic decision-making regarding data tools, organization, and optimization processes to ensure uninterrupted data flow and support analytics needs.
Requirements
- Proven experience with Kubernetes and Cloud infrastructure (GCP preferred)
- Strong proficiency in Python and SQL for data processing and automation.
- Expertise in orchestration tools such as Airflow, Docker, etc..
- Understanding of performance optimization and cost-effectiveness in dataware houses like Snowflake, ClickHouse, etc.
- Experience with additional orchestration tools like Dogster or Meltano.
- Knowledge of DBT, particularly in setting up new projects.
- Demonstrated ability to build and maintain complex data pipelines and data flows.
Responsibilities
- Build, maintain and elevate Shopmonkey's data infrastructure, ensuring peak performance and dependability.
- Drive the decision-making process for the selection and implementation of data tools and technologies.
- Design and refine data pipelines to ensure smooth and efficient data flow.
- Manage the daily operations of the Shopmonkey platform, swiftly identifying and resolving data-related challenges.
- Partner with cross-functional teams to develop new data requirements and refine existing processes.
- Provide mentorship to junior engineers, supporting their growth and assisting with complex projects.
- Monitor and sustain the data infrastructure, covering areas like recalls, message delivery, and reporting functions.
Other
- 5+ years of industry experience and Bachelor's Degree in STEM preferred additional experience is also accepted in lieu of a degree
- Ability to work effectively in a collaborative, cross-functional environment.
- Strong problem-solving skills with a proactive and solution-oriented mindset.
- This is a hybrid role with in-office expectations 2-3 days/week at our Morgan Hill, CA office to collaborate and stay connected.
- Stay informed on industry trends and best practices in data infrastructure and cloud technologies.