The Enterprise Data Warehouse (EDW) is responding to DOH’s need for centralized data and state of the art data analysis services by modernizing its data portfolio, architecture, and statistical analysis capabilities aimed at improving public health surveillance, interventions, future outbreak prevention, outcomes, and research.
Requirements
- The candidate must have significant, hands-on technical experience and expertise with Azure, Azure Delta Lake, Azure Databricks, Azure Data Factory, Pipelines, Apache Spark, and Python.
- Significant, hands-on technical experience and expertise with the design, implementation and maintenance of business intelligence and data warehouse solutions, with expertise in using SQL Server and Azure Synapse.
- Experience producing ETL/ELT using SQL Server Integration Services and other tools.
- Experience with SQL Server, T-SQL, scripts, queries.
- Experience as an Azure DevOps CI/CD Pipeline Release Manager who can design, implement, and maintain robust and scalable CI/CD pipelines, automate the build, test, and deployment processes for various applications and services, troubleshoot and resolve pipeline issues and bottlenecks, and has experience with Monorepo-based CI/CD pipelines
- Experience with data formatting, capture, search, retrieval, extraction, classification, quality control, cleansing, and information filtering techniques.
- Advanced knowledge of relational databases, dimensional databases, entity relationships, data warehousing, facts, dimensions, and star schema concepts and terminology.
Responsibilities
- Architect / Azure DW Developer position will support both the existing business and reporting requirements of individual DOH / DDAP systems and program areas, and the construction of a modern data warehouse that will serve DOH / DDAP from an enterprise perspective.
- This position’s scope includes the modernization of DOH operations; plan, coordinate and respond to data reporting needs, set standards and define framework; assist with large volume data processing, statistical analysis of large datasets; revamping the EDW into Microsoft’s Azure Cloud utilizing Azure Databricks, Delta Lake and Synapse, including compute, storage and application fabric, as well as services for infrastructure as a service (IaaS), platform as a service (PaaS), software as a service (SaaS) and serverless technologies; create a centralized data model; support for DOH projects like ELC Enhanced Detection Expansion, Data Modernization Initiative, PA NEDSS NextGen, PA LIMS Replacement, Reporting Hub, Verato UMPI, COVID-19 response, and onboarding additional DOH systems into the EDW.
- This position designs, develops, tests, and implements data lakes, databases, extract-load-transform programs, applications, and reports.
- Develop and implement solutions that meet business and technical requirements.
- Participate in testing of implemented solution(s).
- The Architect can design, develop, and implement data and ELT application infrastructure in Azure to provide reliable and scalable applications and systems to meet the organization’s objectives and requirements.
- Creates and maintains technical documentation, diagrams, flowcharts, instructions, manuals, test plans, and test cases.
Other
- The Architect is a senior level resource with advanced, specialized knowledge and experience in data warehousing, database, and programming concepts and technology.
- The selected contractor must have proven experience in the development, maintenance, testing, and maintenance of Azure production systems and projects.
- This position will work with business analysts, application developers, DBAs, network, and system staff to achieve project objectives - delivery dates, cost objectives, quality objectives, and program area customer satisfaction objectives.
- Manage assignments and track progress against agreed upon timelines.
- More than 5 years of relevant experience.
