Zillow is looking to transform the real estate industry by leveraging AI technologies to create an advanced, multimodal assistant that helps millions of people find their next home, aiming to redefine the home shopping and transaction experience.
Requirements
- Ph.D. or equivalent experience in Computer Vision, NLP, or related fields, with emphasis on multimodal learning
- Deep expertise in developing and scaling perception models that combine imagery, spatial data, and language
- Proven science leadership in defining a science roadmap for a team and mentoring other scientists
- Track record of publishing high-impact research in top venues like CVPR, NeurIPS, ICCV, ACL, and SIGGRAPH
- Experience developing multi-agent dialogue systems with long context multimodal chain of thought reasoning.
- Hands-on experience fine-tuning voice-AI models for automatic speech recognition, turn detection, and speech generation is a bonus
- Experience with geospatial datasets and 3-D vision techniques, like point clouds, Gaussian splatting, or neural radiance fields, is a plus
Responsibilities
- Design, prototype, and develop multi-agent image-forward, voice-assisted experiences.
- Improve real estate shopping experience using computer vision tasks such as VLM captioning, object detection and localization, segmentation, and multimodal semantic retrieval
- Serve as the focal point for developing a science roadmap, driving alignment across stakeholders on technical capabilities, timelines, and prioritization
- Represent the team at conferences, publish in top-tier journals, like CVPR, NeurIPS, ICCV, ACL, and SIGGRAPH, and champion internal best practices
- Build innovative solutions that personalize using user behavior, context signals, and real-time environmental data
- Distill complex research findings and system designs into actionable insights for diverse audiences
Other
- As a Principal Applied Scientist, You Are a Roll-up-the-sleeves And Get-it-done Researcher Who Can Marry Scientific Rigor With Large-scale Engineering.
- This role has been categorized as a Remote position.
- U.S. employees may live in any of the 50 United States, with limited exceptions.
- Applicants who receive job offers from Zillow Group will be asked to sign a Proprietary Rights Agreement which includes confidentiality, intellectual property assignment, customer and employee non-solicitation, and non-competition provisions.
