MedScout is looking to build and optimize a data infrastructure that processes billions of healthcare claims to turn complex data into actionable insights that drive business decisions for MedTech commercial teams.
Requirements
- You have 3+ years of experience building, maintaining, and operating data pipelines in a modern data warehouse like Databricks, Snowflake, BigQuery, or AWS Redshift.
- You have strong Python, SQL and PySpark skills.
- You have experience with data transformation tools like DBT or SQLMesh.
- You have a solid understanding of data modeling and schema design, particularly in contexts involving complex relationships and high-volume data processing.
- You have experience with data quality frameworks, including automated testing, validation, and monitoring of data pipelines.
- You have familiarity with modern software development practices including version control (Git), CI/CD, and infrastructure as code.
- Bonus: You have experience working with healthcare claims data or understanding of claims data structures.
Responsibilities
- You will design, implement, and maintain scalable data pipelines to process large volumes of healthcare claims data using Databricks, Python, and PySpark, ensuring high data quality and performance optimization for downstream analytics.
- You will develop processes to integrate multiple data sources, including healthcare claims databases, into a unified data model that powers MedScout's sales enablement platform.
- You will collaborate with data scientists and analysts to implement data transformations that support efficiently delivering advanced analytics, market insights, and predictive modeling capabilities for the platform.
- You will troubleshoot and resolve complex data pipeline issues, optimize system performance, and contribute to the continuous improvement of MedScript's data infrastructure and engineering practices.
- You will optimize workloads and cluster configurations to reduce compute costs while maintaining performance, including implementing auto-scaling policies, right-sizing clusters, and monitoring resource utilization patterns.
Other
- You will work with Product, Customer Success, and Sales leaders to understand what our customers are looking to achieve with our platform and use those insights to inform and validate your thinking as you make design and implementation decisions.
- You work effectively with cross-functional teams, translating business requirements into technical specifications and communicating complex technical concepts to non-technical stakeholders.
- Effort on our inputs: We prepare diligently, leave it all on the "field", and move on quickly. Focusing on good habits and work ethic, not individual outcomes, ultimately creates a winning culture and a successful company.
- Earn Trust: We keep our commitments to our customers, partners, and each other. We listen attentively, speak candidly, and treat others respectfully. We strive to demonstrate empathy, inclusion, and intellectual honesty.
- Intelligence Drives Operations: We learn continuously and have the humility to quickly recognize when our assumptions are wrong so we can readjust accordingly.
