Databricks is looking to solve the problem of guiding customers in building big data solutions on their platform, spanning a large variety of use cases, and requiring hands-on production experience with Apache Spark and expertise in other data technologies.
Requirements
- 5+ years experience in a technical role with expertise in at least one of the following: Software Engineering/Data Engineering, Data Applications Engineering
- Extensive experience building big data pipelines
- 5 years professional experience with Big Data technologies (Ex: Spark, Hadoop, Kafka) and architectures
- Experience scaling big data workloads (such as ETL) that are performant and cost-effective
- Experience migrating Hadoop workloads to the public cloud - AWS, Azure, or GCP
- Experience with large scale data ingestion pipelines and data migrations - including CDC and streaming ingestion pipelines
- Production programming experience in SQL and Python, Scala, or Java
Responsibilities
- Provide technical leadership to guide strategic customers to successful implementations on big data projects, ranging from architectural design to data engineering to model deployment
- Architect production level data pipelines, including end-to-end pipeline load performance testing and optimization
- Become a technical expert in an area such as data lake technology, big data streaming, or big data ingestion and workflows
- Assist Solution Architects with more advanced aspects of the technical sale including custom proof of concept content, estimating workload sizing, and custom architectures
- Provide tutorials and training to improve community adoption (including hackathons and conference presentations)
- Contribute to the Databricks Community
- Maintain and extend production data systems to evolve with complex needs
Other
- Bachelor's degree in Computer Science, Information Systems, Engineering, or equivalent experience through work experience
- Can meet expectations for technical training and role-specific outcomes within 6 months of hire
- Can travel up to 30% when needed
- 5 years customer-facing experience in a pre-sales or post-sales role in healthcare industry
- Deep Specialty Expertise in at least one of the following areas
