Solving critical technical challenges across the business as the Lead Data Engineer at the company
Requirements
- Strong programming skills in Python with a solid understanding of core computer science principles
- Knowledge of relational and dimensional data modeling for building data products
- Experience with data quality checks and data monitoring solutions
- Experience orchestrating complex workflows and data pipelines using Airflow or similar tools
- Proficiency with Git, CI/CD pipelines, Docker, and Kubernetes
- Experience architecting solutions on AWS or equivalent public cloud platforms
- Experience developing data APIs, microservices, and event-driven systems to integrate data products
Responsibilities
- Take ownership for achieving objectives and key results for your team, oversee & own technical solutions, communicate schedule, status, and milestones
- Develop, optimize, and maintain complex ETL processes for data movement and transformation
- Review code and provide technical guidance to ensure adherence to high-quality standards and best practices in data engineering
- Develop APIs and microservices to expose and integrate data products with software systems
- Implement monitoring, logging, and alerting systems to proactively identify and resolve issues
- Ensure data quality, security, and compliance with relevant regulations and standards
- Collaborate with cross functional partners (Product Managers, Data Scientists, Machine Learning Engineers, Software Engineers, and Business teams) to build data products
Other
- BS, MS, or PhD in Computer Science, Mathematics, Statistics, Engineering, Operations Research, or a related quantitative field
- 7+ years of experience as a Data Engineer or Software Engineer developing and maintaining data pipelines, infrastructure and architecture
- Strong interpersonal and verbal communication skills
- Proven leadership experience with the ability to mentor and guide a team
- Communicate effectively with both technical and non-technical stakeholders
