McCarthy is seeking a Data Engineer to shape data infrastructure, support existing systems, and drive innovation through ML and AI solutions by delivering end-to-end data pipelines and repositories.
Requirements
- 5+ years of work experience in data management disciplines, including data modeling, integration and development of ETL/ELT pipelines.
- 5+ years of data solution delivery experience, preferably in the Microsoft Azure platforms and tools (Azure Data Factory, Azure SQL, Azure Data Lake Gen2, Azure DevOps).
- Experience with T-SQL (queries, stored procedures, and DDL)
- Experience querying API endpoints
- Experience with Power Query
- Solid understanding of data warehouse and data lake concepts and design (including star schemas)
- Python proficiency for data management, ML and AI development.
Responsibilities
- Profile source system data and design data warehouse and lake schemas
- Transform raw data into usable format based on analytics, reporting and integration requirements.
- Design, implement, and support ETL, ELT and integration pipelines
- Optimize data pipelines for performance, scalability and efficiency.
- Implement data quality checks and validations within data pipelines to ensure accuracy, consistency and completeness of data.
- Collaborate with cross-functional teams to promote AI solutions in the enterprise.
- Apply best practices in solution development, quality control and security in implementing pipelines.
Other
- Excellent analytical, conceptual, and problem-solving abilities with aptitude for acquiring new technical skills
- Entrepreneurial attitude with a passion to deliver value for the organization
- Highly motivated team player with strong interpersonal skills
- Constant learner with a passion for continuous growth and improvement
- Experience with Agile/Scrum methodology preferred
