Demandbase is looking to build a pipeline for future Senior Data Engineer, Intent opportunities to support their Intent product by improving core pipelines and designing new processes for ML/AI model deployment, ultimately enhancing their account intelligence platform.
Requirements
- 7+ years of experience in software/data engineering roles, with deep expertise in building and maintaining large-scale distributed data systems.
- Scala experience required
- Strong CS fundamentals, including algorithms, data structures, and system design.
- Strong background in data modeling, performance tuning, and data integration best practices.
- Experience owning end-to-end systems, including production monitoring, incident response, and system reliability engineering.
- Proficiency in cloud-native data platforms (e.g., GCP or AWS), including managed services for analytics and orchestration.
- Familiarity with real-time data processing, streaming architectures, and event-driven design.
Responsibilities
- Lead the end-to-end design and evolution of scalable, resilient data pipelines and infrastructure, driving architecture decisions that impact the company’s data platform long-term.
- Develop and optimize large-scale data processing workflows (batch and streaming) using Spark and related technologies, ingesting data from diverse internal and external sources.
- Provide technical leadership and mentorship to mid- and junior-level engineers.
- Review design docs, PRs, and contribute to engineering best practices across the team.
- Build fault-tolerant, observable systems with self-healing and robust monitoring using tools like Airflow, Datadog, or equivalent.
- Partner with cross-functional stakeholders in Product, Analytics, and Infrastructure to ensure data architecture aligns with business needs and SLAs.
- Take full lifecycle ownership of key data pipelines and integrations—from design to deployment to production support.
Other
- Bachelor’s degree in Computer Science, Engineering, Mathematics, or related field.
- Comfort with purely functional programming is a plus.
- Excellent verbal and written communication skills; comfortable explaining complex concepts to technical and non-technical stakeholders.
- A strong sense of ownership, initiative, and accountability.
- The base compensation range for this position for candidates in the SF Bay Area is: $190,000 - $284,000.
