Virginia Housing Development Authority dba Virginia Housing is seeking a Sr. Data Engineer to design and implement scalable data pipelines and workflows in the cloud, leveraging available BI technologies.
Requirements
- using Microsoft Azure data platform for engineering and deploying enterprise grade business data solutions
- working with ETL solutions like Microsoft SSIS to deliver complex data solutions
- Programmatic/Scripting/Query Languages including SQL
- Experience with Microsoft Azure data technologies, to include data storage services, Azure Data Lake, Data Factory, Synapse Data Warehouse, Databricks, Power BI and other relevant services
- Experience with SQL Server development technologies like Integration Services (SSIS), Visual Studio.Net language, Management Studio (SSMS)
- Knowledge of Azure Logic Apps, scripting languages like ARM, Bycep, Python, PowerShell or other custom solutions
- Experience working with relational and non-relational databases, dimensional models, SQL queries, data warehouses, ETL processes, and database management systems.
Responsibilities
- Design and implement scalable data pipelines and workflows in the cloud, leveraging available BI technologies.
- Develop and maintain data models, schemas, and structures for efficient data storage and retrieval, utilizing on premises and cloud native data structures, and other appropriate technologies.
- Evaluate and select cloud services and tools to meet specific data requirements, considering factors such as cost, scalability, and performance.
- Define design best practices and ensure compliance with industry standards, keeping abreast of evolving cloud offerings.
- Design, develop, and deploy ETL processes to move data between different systems and platforms, utilizing processing, algorithmic, and programming tools available in the cloud.
- Create and maintain data integration workflows, ensuring data quality and reliability through error handling and validation mechanisms.
- Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes.
Other
- Bachelor's Degree in Data & Analytics, Computer Science, Engineering, or related discipline with an information technology focus plus 6 years of experience
- 8 years of experience
- Based at Virginia Housing’s offices in Richmond, VA.
- To apply for this position, please forward your resume to Humanresources@virginiahousing.com with “Sr. Data Engineer (VA- 4773)” in the subject line.
- No telephone calls, please
