Abacus Insights is transforming the healthcare industry by providing a platform that organizes and exchanges healthcare data from various sources and formats, allowing customers to uncover differentiated insights that address client needs, improve health outcomes, and lower the overall cost of healthcare.
Requirements
- 5+ years of data engineering experience
- Proficient with Python and SQL
- Build and manage efficient ETL pipelines using Databricks workflows or other orchestration framework
- Familiarity with both structured and semi-structured data and ingesting and processing this data using pyspark
- Fundamental AWS services (S3, SQS) or similar services for other clouds
- Terraform and GitLab CICD
- Query tuning and performance optimization in SQL and/or SparkSQL
Responsibilities
- Develop data pipelines integrating with Databricks and Snowflake, ensuring data accuracy and integrity.
- Lead the architecture and implementation of solutions for health plan clients, optimizing cloud-based technologies.
- Collaborate with cross-functional teams and clients to translate requirements into technical solutions.
- Implement robust data security measures and ensure compliance with healthcare regulations like HIPAA.
- Provide technical leadership, mentoring junior engineers and staying updated on industry trends.
- Focus on optimizing data processes for efficiency, regularly reviewing architectures, and creating detailed documentation.
- Conduct training for team members and clients to enhance understanding and utilization of data solutions.
Other
- Work with clients & implementation team and understand the data distribution requirements
- Collaborate with cross-functional teams and clients to translate requirements into technical solutions.
- Basic US Healthcare Knowledge (e.g. Medical Claims, Member/Eligibility etc.)
- Experience communicating with both technical and non-technical stakeholders
- Bachelor’s Degree in computer science, computer engineering or any related IT field
