Databricks is looking to solve the problem of maximizing the value that customers derive from their investments in data projects by developing innovative commercialization strategies and cutting-edge engineering for billing and usage data, budgeting, forecasting, and cost optimization tools.
Requirements
- 9+ years of experience building large projects similar to those described, including near real-time large data processing and distributed service infrastructure management.
- Proven track record of building, shipping, and managing reliable, distributed services and data pipelines at scale.
- Experience with Apache Spark, Lakehouse, Delta Lake, and MLflow.
- Experience with cloud providers such as AWS, GCP, and Azure.
- Experience with AI and LLMs for cost insight, prediction, and optimization.
- Experience with CI/CD processes, test frameworks, data quality assurance, end-to-end reconciliation, and anomaly detection.
- Experience with innovative pricing strategies and plans.
Responsibilities
- Design and manage the Money systems and services, commercializing all Databricks products and offerings.
- Develop innovative primitives that enable and support various pricing strategies such as Pay-As-You-Go, commissions, credits, trials, and promotions.
- Enhance engineering and infrastructure efficiency, reliability, accuracy, and response times, including CI/CD processes, test frameworks, data quality assurance, end-to-end reconciliation, and anomaly detection.
- Collaborate with commercialization experts to develop and implement innovative pricing strategies and plans.
- Use AI and LLMs to innovate in cost insight, prediction, and optimization across various cloud providers.
- Provide leadership in long-term vision and requirements development for Databricks products, in partnership with our engineering teams.
- Represent Databricks at academic and industrial conferences & events.
Other
- BS or higher degree in Computer Science or a related field.
- Demonstrated leadership skills and the ability to lead across functional and organizational boundaries.
- A proactive approach and a passion for delivering high-quality solutions.
- Ability to work with commercialization experts to develop and implement innovative pricing strategies and plans.
- Ability to represent Databricks at academic and industrial conferences & events.
