Daydream is looking to build the data foundations that power their AI Personal Stylist, aiming to revolutionize how people shop online by redefining fashion search and discovery through an advanced AI and natural language understanding platform.
Requirements
- extensive experience building and deploying data solutions on a major cloud platform (preferable Google Cloud Platform)
- highly proficient with distributed data processing frameworks such as Apache Spark, Flink, or Polars.
- exceptional Python coding skills, with a deep understanding of writing efficient, testable, and maintainable code for data applications.
- expert-level SQL skills and deep experience with modern cloud data warehouses like BigQuery, Snowflake, or Redshift.
- hands-on experience with workflow orchestration tools like Airflow, Argo or Kubeflow.
Responsibilities
- Design, build, and optimize scalable, parallel data processing pipelines on Google Cloud to handle massive volumes of offline data.
- Implement and manage large-scale LLM batch inference jobs, processing millions of data points to enrich our product catalog with sophisticated, AI-generated attributes.
- Architect and own the data infrastructure for our Fashion Knowledge Graph, leveraging BigQuery and parallel data processing frameworks.
- Develop and maintain robust feature generation pipelines to craft high-quality signals for both the training and inference of our machine learning models.
- Orchestrate complex workflows of data processing jobs, implementing robust monitoring, alerting, and data quality validation systems to ensure reliability and trust in our data.
- Collaborate closely with data science and machine learning teams to understand data requirements and deliver production-grade data solutions.
- Champion engineering best practices, including writing clean, maintainable Python and SQL, and drive a culture of high-quality data and operational excellence.
Other
- pragmatic and proactive builder who thrives in a fast-paced, autonomous startup environment, capable of driving projects from concept to production.
- empathetic and collaborative teammate, skilled at communicating complex technical ideas and passionate about building the reliable infrastructure that empowers your colleagues.
- natural leader who enjoys mentoring and developing teammates and aligning work to provide growth opportunities while ensuring priorities are aligned with broader company goals
- Flexible vacation and remote working
- Commitment to Diversity: Daydream is proud to be an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees, regardless of race, color, religion, gender, sexual orientation, gender identity, age, national origin, or disability status.
