The Zillow Group’s Housing Trends Data Engineering team is looking to solve the problem of creating, productionalizing, analyzing, and sharing a full collection of housing metrics and analysis for Zillow’s internal and external customers, and to provide insight to everyday consumers and open data to hundreds of researchers and policymakers across the country.
Requirements
- Strong proficiency in Python programming
- Hands-on experience with big data ecosystems, architectures and modern data platforms, including AWS cloud data services and Lakehouse/Lakebase platforms
- Hands-on experience with Databricks is a significant advantage.
- Proven ability to design, build, and orchestrate batch and real-time data pipelines, processing large-scale datasets from diverse sources
- Practical experience with cutting-edge data engineering technologies such as SparkSQL and Spark Streaming, PostgreSQL, EKS, and Kubernetes
- Familiarity with Agile/DevOps software development processes and tools such as GitLab and CI/CD.
- A good understanding of data science concepts, fundamental machine learning algorithms/libraries, and development lifecycle is a must-to-have.
Responsibilities
- Build data systems to link raw data and concrete Housing Trends insights.
- Build and extend our internal forecasting model development framework.
- Develop and maintain scalable data products and deliver pipelines built for speed, accuracy, and consistency that will scale as our stakeholders’ need.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability and performance, etc.
- Collaborate with data scientists to understand their data requirements and build systems/tools that enable efficient model training and experimentation.
- Implement feature stores and ETL pipelines to streamline feature engineering and model development.
- Build and maintain infrastructure for deploying machine learning models into production environments.
Other
- 5+ years of experience in Big Data Engineering or Machine Learning Engineering roles.
- Exceptional communication skills to drive effective customer engagement, collaborate with cross-functional teams, and clearly articulate technical concepts to technical and non-technical stakeholders.
- Strong problem-solving skills and the ability to work in a fast-paced, collaborative environment.
- Ability to work in a remote environment
- Must be located in the United States, with limited exceptions
