BTI360 is seeking a Databricks Data Engineer to serve as a Resident Solutions Architect (RSA) for national security customers in classified environments, optimizing data pipelines and driving data management & enrichment solutions on the Databricks platform.
Requirements
- Spark & Databricks Expertise: Hands-on experience with Apache Spark and the Databricks platform, including building and scaling data pipelines.
- Data Engineering Experience: 5+ years of experience in data engineering or big data analytics, with strong coding skills in Python and/or Scala/Java for data processing.
- Cloud & CI/CD Proficiency: Experience developing solutions in cloud environments (AWS and/or Azure) and familiarity with CI/CD pipelines and DevOps practices for deploying data workflows.
- Databricks Certified Data Engineer Professional
- Experience with the Databricks platform
Responsibilities
- Design & Optimize Data Pipelines: Build and refine large-scale data pipelines on the Databricks platform to enable data discovery and enrichment for mission-critical applications.
- Technical Leadership & Advisory: Serve as a Databricks subject-matter expert and trusted advisor to customer teams, providing guidance on architecture, Spark best practices, performance tuning, and innovative big data solutions.
- Customer Engagements: Deliver short to medium-term professional services engagements in classified or unclassified environments, adapting quickly to new project domains and requirements while delivering solutions on time and to specification.
- Solution Implementation: Integrate Databricks solutions with complex client systems and workflows, collaborating with BTI360 and customer engineering teams to ensure successful deployment and adoption of new data capabilities.
- Enablement & Support: Provide hands-on support and training to customer engineers and data teams, helping them maximize platform value (including creating how-to guides, reference architectures, and troubleshooting as needed)
Other
- Active Secret clearance or above, with the ability to be cleared at the TS/SCI with Polygraph level
- Client-facing communication and problem-solving skills, with the ability to translate complex data challenges into actionable solutions and effectively guide customer teams
- Adaptability: Proven ability to thrive in a dynamic environment, capable of juggling multiple projects and quickly learning new datasets, tools, and mission domains as engagements rotate
- Active TS/SCI with Polygraph
- Ability to work on-site in Northern Virginia for classified projects
