Quanata is looking to solve the business and technical problem of designing, building, and maintaining scalable data pipelines and storage systems to support data science, analytics, and data-driven decision-making, by hiring a manager for the Data Engineering team.
Requirements
- Deep, hands-on expertise with Infrastructure as Code (IaC) using Terraform, and container orchestration with Kubernetes and Docker in production environments
- Extended experience working in cloud-native environment with strong preference toward AWS
- Strong programming skills in Python and a solid understanding of the end-to-end machine learning lifecycle, from experimentation to production monitoring.
- Experience in regulated industries: A strong understanding of the technical controls required for compliance frameworks like SOX, HIPAA, or PCI DSS within industries such as Finance, Insurance, or Healthcare.
- Deep domain knowledge in Financial Services or Insurance: A proven understanding of specific use cases like automated claims processing, intelligent underwriting, and fraud detection.
Responsibilities
- Lead, mentor, and grow a high-performing team of Data Engineers, fostering a culture of engineering excellence, innovation, and cross-functional collaboration.
- Drive the team's design and implementation of automated CI/CD/CT pipelines and ETL/ELT processes to accelerate the entire model lifecycle, from data validation and training to production deployment and monitoring.
- Establish Data Engineering best practices to ensure data accuracy, consistency, security, and adherence to governance frameworks.
- Monitor the performance of data systems and implement improvements to enhance efficiency and reduce latency.
- Partner with key stakeholders, data analysts and business leaders, to define platform requirements, drive adoption, and ensure the DE team delivers measurable business value.
- Oversee the integration of security controls (DevSecOps) throughout the data engineering lifecycle, including data encryption, access management, and vulnerability scanning to protect sensitive data and meet industry standards.
Other
- Proven leadership experience with a track record of managing and developing technical teams
- Excellent communication and stakeholder management skills, with a proven ability to partner with business leaders, define technical roadmaps, and drive consensus across teams.
- Problem-Solving: Ability to resolve complex data architecture challenges and drive technical roadmaps.
- BS degree in Computer Science, engineering or related field or equivalent relevant experience
- 6-8 years of professional experience in data management, software engineering, or DevOps engineering
