West Cancer Center is looking to modernize its data platforms and migrate from legacy systems to support analytics and business intelligence. The goal is to create scalable data solutions, optimize data lakes and warehouses, and develop efficient data pipelines to improve the quality and accessibility of data for AI/ML initiatives and business needs.
Requirements
- Azure Data Engineering, Microsoft Fabric Data Engineer, or Microsoft Fabric Engineer certification required
- Experience with relational databases, data modeling, and legacy system migration
- Proficiency in Python, T-SQL, and familiarity with PySpark and big data frameworks
- Knowledge of version control and DevOps pipelines using Git and Azure DevOps
- Expertise in ETL/ELT process design and implementation
- Hands-on experience with data warehousing, modeling, and governance
- Familiarity with Microsoft Fabric, Azure SQL, Azure Data Factory, and Synapse Analytics
Responsibilities
- Develop, monitor, and optimize data pipelines for performance and scalability
- Support AI/ML initiatives with structured, clean data
- Use Jupyter Notebook for data processing, analysis, and reporting
- Build and maintain cloud-based data infrastructure (Azure, AWS)
- Design and implement pipelines for large-scale, distributed datasets
- Lead migration of legacy systems and SQL databases to modern platforms
- Implement and manage ETL/ELT processes
Other
- Experience with healthcare data ecosystems, workflows, and compliance standards
- Collaborate with analysts and stakeholders to deliver technical solutions based on business needs
- Establish and enforce data governance and security protocols
- Ensure data models and warehouse architecture align with business requirements
- Strong problem-solving and analytical skills
