Databricks is looking to improve the efficiency and performance of its engineering systems and infrastructure by applying machine learning, scheduling, and optimization algorithms.
Requirements
- 2-8 years of machine learning engineering experience in high velocity, high-growth companies
- Strong understanding of both computer systems and statistics
- Large breadth of knowledge or interest in mathematical modeling beyond ML (OR, combinatorial optimization
- Experience developing AI/ML systems at scale in production
- Strong track record of ML modeling that goes beyond using standard libraries.
- Strong coding and software engineering skills, and familiarity with software engineering principles around testing, code reviews and deployment.
- Experience deploying, scaling and monitoring models in production; deep understanding of the unique infrastructure challenges posed by training and serving predictions in Tier 0 environments.
Responsibilities
- Build end-to-end systems from the ground up in a small team of experienced people.
- Shape the direction of our applied ML areas of investment by engaging with engineering and product teams across the company.
- Drive the development and deployment of state-of-the-art AI models and systems that directly impact the capabilities and performance of Databricks' products, infrastructure and services.
- Architect and implement robust, scalable ML infrastructure, including data storage and processing, model training and serving components, and monitoring and reporting systems to support seamless integration of AI/ML models into production environments.
- Work on novel modeling techniques in the field of ML for Systems
- Contribute to the broader AI community by publishing research, presenting at conferences, and actively participating in open-source projects, enhancing Databricks' reputation as an industry leader.
- Deploy, scale and monitor models in production; deep understanding of the unique infrastructure challenges posed by training and serving predictions in Tier 0 environments.
Other
- 2-8 years of experience
- Strong track record of ML modeling
- Ability to work in a team
- Ability to publish research and present at conferences
- Must be willing to work from Mountain View, CA office
