Counsel's mission is to multiply the world's healthcare capacity by building an AI-first medical practice that automates across the entire clinical stack, allowing clinicians to provide superhuman medical advice. The Senior Data Engineer will own and architect the data infrastructure powering Clinical, AI, Product, and Financial Operations to ensure the platform can scale seamlessly.
Requirements
- 5+ years of experience in data engineering building high-performance data pipelines
- Previously pioneered self-service analytics & business intelligence tooling (e.g. Hex, Sigma, Looker) for a diverse set of stakeholders
- Operational experience with data storage platforms (e.g. Databricks, Iceberg, or Snowflake) and analytical query engines (e.g. Athena or Presto)
- Managed job orchestration (e.g. Dagster, Airflow) and semantic data modeling (dbt, SQL)
- 2+ years working in highly regulated industries such as healthcare or financial services
- Implemented row-level security and data masking for PHI/PII use cases
- Deep familiarity with row and columnar data warehouses (e.g. PostgreSQL, BigQuery, Snowflake)
Responsibilities
- Primarily focus on architecting our data infrastructure layer that drives our financial, clinical, and AI applications
- Build robust batch and streaming ingestion pipelines that unify data from diverse internal and external systems into a consistent, ontology-driven data model
- Maintain dbt-driven SQL models that unify datasets from our product, integrations, financial operations and clinical data, leveraging ontologies (e.g. SNOMED CT, ICD, HL7 FHIR)
- Design data pipelines that handle diverse sets of structured (e.g. SQL, APIs) and unstructured (e.g., documents, notes, embeddings) datasets
- Future-proof the data platform to anticipate and support evolving needs including: AI workflows such as NLP, embeddings, knowledge graphs, and retrieval-augmented generation
- Future-proof the data platform to anticipate and support evolving needs including: Financial workflows for accounting tracking and observability
- Future-proof the data platform to anticipate and support evolving needs including: Clinical and support workflows that allow non-technical teams to self-service data
Other
- You have hands-on experience architecting data platforms from day 0 in a fast-paced, high-growth environment
- You’ve extensively worked with healthcare data and standards (e.g. HL7 FHIR, CDS, ICD-10)
- You have experience with our tech stack: AWS, Google Cloud, PostgreSQL, FHIR servers
- You consider yourself a Swiss-army knife data engineer who can flex into both data infrastructure, semantic modeling, and operational analytics
- You have knowledge of medical statistics and are keen to learn more
