Shopmonkey is seeking a Senior Data Engineer to build, maintain and improve their data infrastructure, ensuring that their data pipelines are robust, efficient, and capable of delivering high-quality data to both internal and external stakeholders.
Requirements
- Proven experience with Kubernetes and Cloud infrastructure (GCP preferred)
- Strong proficiency in Python and SQL for data processing and automation.
- Expertise in orchestration tools such as Airflow, Docker, etc..
- Understanding of performance optimization and cost-effectiveness in dataware houses like Snowflake, ClickHouse, etc.
- Experience with additional orchestration tools like Dogster or Meltano.
- Knowledge of DBT, particularly in setting up new projects.
- Demonstrated ability to build and maintain complex data pipelines and data flows.
Responsibilities
- Continuous Enhancement: Build, maintain and elevate Shopmonkey's data infrastructure, ensuring peak performance and dependability.
- Strategic Leadership: Drive the decision-making process for the selection and implementation of data tools and technologies.
- Streamlining: Design and refine data pipelines to ensure smooth and efficient data flow.
- Troubleshooting: Manage the daily operations of the Shopmonkey platform, swiftly identifying and resolving data-related challenges.
- Cross-Functional Synergy: Partner with cross-functional teams to develop new data requirements and refine existing processes.
- Guidance: Provide mentorship to junior engineers, supporting their growth and assisting with complex projects.
- Collaborative Innovation: Contribute to ongoing platform improvements, ensuring a culture of continuous innovation.
Other
- Bachelor's Degree in STEM preferred additional experience is also accepted in lieu of a degree
- Ability to work effectively in a collaborative, cross-functional environment.
- Strong problem-solving skills with a proactive and solution-oriented mindset.
- 2-3 days per week on-site at our Morgan Hill office.
- Flexible time off - take the time off you need!