DriveWealth is looking for a Senior Data Engineer to help evolve their data platform to the next stage of scale and maturity, addressing complex data problems and delivering trusted, high-impact data solutions.
Requirements
- Strong proficiency in Python and SQL
- Hands-on experience with Spark (PySpark and SparkSQL) and distributed data processing
- Expertise with orchestration and transformation tools (e.g. Airflow, DBT)
- Proficiency with Databricks and cloud platforms (AWS preferred)
- Familiarity with infrastructure as code (e.g.Terraform or equivalent)
- Fluent in shell scripting and command line tooling (e.g. Databricks CLI)
- Experience working in teams with CI/CD pipelines, Git-based workflows and Agile methodologies
Responsibilities
- Design, build and maintain robust data pipelines (batch, streaming and replication) that power analytics, reporting and compliance use-cases
- Translate business needs into data solutions partnering with product managers, engineering teams and business stakeholders
- Proactively identify challenges and opportunities, anticipate scaling, performance and quality needs before they become blockers
- Establish and champion best practices, including documentation, code reviews and standards for data modelling, orchestration and tooling
- Mentor and support other engineers, raising the bar for data engineering craft and helping grow team capabilities
- Contribute to self-service data products, enabling data consumers with curated datasets, semantic layers and tools that accelerate insight generation
Other
- 5+ years of professional experience in data engineering or related fields, with a track record of building and scaling data pipelines and platforms
- Proven ability to work independently and cross-functionally with product, engineering and business teams
- Curiosity, accountability and a drive to improve data quality, scalability and usability across the company
- BS in Computer Science or equivalent
- Applicants must be authorized to work for any employer in the U.S. DriveWealth is unable to sponsor or take over sponsorship of an employment Visa at this time.
