The Data Engineering and Architecture team at UJA-Federation of New York is seeking to build scalable data pipelines, improve data quality and reliability, and support analytics, reporting, and machine learning initiatives
Requirements
- Strong proficiency in Python, with proven experience in data-focused frameworks (e.g., Pandas, PySpark, Dask, SQLAlchemy)
- Hands-on experience designing and consuming RESTful APIs or GraphQL endpoints
- Solid understanding of cloud environments (Azure preferred)
- Hands-on experience with Azure DevOps tools: pipelines, repositories, boards, and artifacts
- Proficiency in SQL and relational databases (e.g., SQL Server, PostgreSQL, MySQL)
- Solid experience with data lakes and warehouses (Fabric Data Lakes and warehouses preferred)
- Strong knowledge of CI/CD pipelines and version control (Git)
Responsibilities
- Design, build, and maintain robust ETL/ELT pipelines and data workflows using Python
- Implement best practices for data architecture, modeling, and processing at scale
- Collaborate with team members to leverage Azure DevOps for CI/CD, release management, and automated testing
- Ensure compliance with data governance, quality, and security standards
- Mentor junior engineers and contribute to the growth of engineering best practices
- Partner with stakeholders (data scientists, analysts, business teams) to deliver reliable data solutions
- Implement best practices for data architecture, modeling, and processing at scale
Other
- 5+ years of professional experience in data engineering or related roles
- Excellent problem-solving, communication, and collaboration skills
- Reports To: Director, Technical Architect
- Equal Opportunity Employer
- Travel requirements not specified
