Technatomy is looking to solve the business and technical problem of enabling advanced analytics and machine learning across the CX Insights data platform within VA’s Veteran Enterprise Module & System Integration Services (VEMSIS) program by designing, developing, and maintaining secure and scalable data pipelines in Microsoft Azure.
Requirements
- A minimum of 5 years of experience in data engineering in data engineering, including 3+ years with Microsoft Azure.
- Strong experience with Microsoft Azure services for data engineering (Data Factory, Databricks, Synapse, ADLS, Key Vault, Logic Apps).
- Expertise in SQL, Python, PySpark, and data modeling for analytics and machine learning.
- Hands-on experience developing and maintaining ETL/ELT pipelines and data orchestration workflows in an enterprise environment.
- Familiarity with Agile/Scrum methodologies, CI/CD, and DevOps tools (e.g., Azure DevOps, Git).
- Knowledge of data governance, data lineage, and metadata management practices.
- Experience with REST APIs or LCNC (Low-Code/No-Code) integration tools for Azure.
Responsibilities
- Design, develop, and deploy scalable Azure-based data ingestion, transformation, and curation pipelines using services such as Azure Data Factory, Azure Databricks, Azure Synapse, and Azure Data Lake Storage (ADLS).
- Implement data integration, conditioning, and curation processes supporting the CX Insights medallion data architecture (Bronze/Silver/Gold).
- Develop and optimize ETL/ELT workflows and manage data ingestion from multiple internal and external VA sources.
- Collaborate with business analysts, data quality teams, and AI/ML developers to ensure data accuracy and readiness for analytics and model development.
- Support the VEO Data Product Delivery, Data Quality, and Analytics Delivery initiatives by implementing reusable data pipelines and integrating with visualization tools such as Power BI.
- Implement data quality assurance checks, validation processes, and QA notebooks to monitor data accuracy and performance.
- Contribute to DevOps and MLOps processes, integrating automated testing, deployment, and monitoring for Azure data solutions.
Other
- Support Agile sprint planning, backlog grooming, and product delivery roadmaps as part of multi-disciplinary scrum teams.
- Ensure all development complies with VA security and governance standards, including Authority to Operate (ATO) and data protection for PII.
- Strong analytical and problem-solving skills with the ability to work in a collaborative, cross-functional environment.
- Experience working with Federal agencies, particularly the Department of Veterans Affairs, is a plus.
- Must be able to obtain and maintain a Public Trust clearance.
