Equifax is seeking a Lead Data Engineer to architect robust, scalable data pipelines that fuel the organization's data-driven initiatives.
Requirements
- Expert level skills using programming languages such as Python or SQL and advanced level experience with scripting languages.
- Demonstrated proficiency in all Google Cloud Services
- Experience building and maintaining complex data pipelines, troubleshooting complex issues, transforming and entering data into a data pipeline
- Proficiency in Airflow strongly desired
- Experience designing and implementing advanced to complex data models and experience enabling advanced optimization to improve performance
- Experience leading a team with Git expertise strongly preferred
- Cloud certification strongly preferred
Responsibilities
- Design, architect, and implement scalable and secure data pipelines on GCP, utilizing services like Dataflow, Pub/Sub, and Cloud Storage.
- Develop and maintain data models, ensuring data quality, consistency, and accessibility for various internal stakeholders.
- Automate data processes and workflows using scripting languages like Python, leveraging technologies like Spark and Airflow.
- Monitor and troubleshoot data pipelines, identifying and resolving performance issues proactively.
- Stay up-to-date with the latest trends and advancements in GCP and related technologies, actively proposing and evaluating new solutions.
- Implement data governance best practices, including data security, access control, and lineage tracking.
- Lead security initiatives, design and implement security architecture.
Other
- BS degree in a STEM major or equivalent discipline; Master’s Degree strongly preferred
- 8+ years of experience as a data engineer or related role, with experience demonstrating leadership capabilities
- Strong communication and presentation skills
- Strong leadership qualities
- Full time schedule
