Databricks is looking to solve the problem of guiding customers in building big data solutions on the Databricks platform, spanning a variety of use cases. The role aims to help customers design and implement these solutions while aligning their technical roadmaps for expanding usage of the Databricks Platform.
Requirements
- 5+ years of experience in a technical role with expertise in at least one of the following: Software Engineer/Data Engineer, Data Applications Engineer, or Hands-on Solutions Architect
- Production experience with Apache Spark or Databricks
- Production programming experience in Python or Scala/Java
- Very comfortable with some flavor of SQL, whether SparkSQL, Postgres, or a Data Warehouse
- Familiar with at least one of AWS, Azure, or GCP
- Deep Specialty Expertise in at least one of the following areas: Experience scaling big data workloads that are performant and cost-effective, Experience with Development Tools for CI/CD, Unit and Integration testing, Automation and Orchestration, REST API, BI tools and SQL Interfaces (e.g. Jenkins), Experience designing data solutions on cloud infrastructure and services, such as AWS, Azure, or GCP, using best practices in cloud security and networking, Experience implementing industry-specific data analytics use cases
Responsibilities
- Provide technical leadership to guide strategic customers to successful implementations on big data projects, ranging from architectural design to data engineering to model deployment
- Architect production data pipelines, including end-to-end pipeline performance testing and optimization
- Become a leading technical expert in areas such as data lake technology, big data streaming, or big data ingestion and workflows
- Assist Solution Architects with more advanced aspects of the technical sale including custom proof of concept content, estimating workload sizing, and custom architectures
- Provide tutorials and training to improve community adoption (including hackathons and conference presentations)
- Contribute to the Databricks Community
- Maintain and extend production data systems to evolve with complex needs
Other
- Degree in a quantitative discipline (Computer Science, Applied Mathematics, Operations Research)
- Ability to travel up to 30% when needed
