The Data Engineer designs, builds, maintains and optimizes the data analytics infrastructure, ensuring data is accessible and usable for analytics and operational purposes across the enterprise.
Requirements
- In depth understanding of Microsoft SQL Service Stack, SSRS, SSIS, SSMS & SSAS and able to create and manage solutions using these tools.
- Working knowledge of VS code, git, code repositories, Azure data factory, Azure SQL databases.
- ETL/ELT creation, modification, and monitoring.
- Experience with Microsoft Fabric, Microsoft Power BI, Azure Dev Ops, Microsoft Visual Studio.
- Experience in SQL (TSQL, DB2), Python (pyspark), DAX/MDX expressions.
- Experience with Bicep, Terraform, PowerShell is a plus.
Responsibilities
- Designs, builds, tests, and maintains databases, data lakes, and data warehouses.
- Ensures data storage solutions are secure and compliant with relevant regulations through collaborative work with security staff.
- Monitors and manages the performance of data systems.
- Implements data quality checks and validation processes.
- Troubleshoots data issues ensuring data accuracy and reliability.
- Designs and builds ETL/ELT pipelines to move data from various sources to target systems.
- Ensures data pipelines are scalable, reliable, and efficient.
Other
- Regular and reliable attendance is required as an essential function of this position.
- Works closely with data analysts, and other stakeholders to understand data requirements from importing to transforming and reporting.
- Collaborates on data-driven projects and initiatives.
- Communicates technical information clearly and concisely.
- Keeps up to date with the latest trends and technologies in data engineering.
