Synchrony's Enterprise Data Lake requires functional & system development to integrate data across internal and external sources, provide analytical insights, and integrate with critical systems. The role aims to ensure high-quality data ingestion, standardization, and curation while maintaining compliance with data standards and driving quality throughout the software development lifecycle.
Requirements
- Hands-on experience writing shell scripts, complex SQL queries, Hive scripts, Hadoop commands and Git
- Ability to write abstracted, reusable code components
- Programming experience in at least one of the following languages: Scala, Java or Python
- Familiar with Ab Initio, Cloudera, Kafka, Spark, Shell Script, Linux & Kafka
- Familiar with Public Cloud (i.e. AWS, GCP, Azure) data engineering services
- Familiar with data management tools (i.e. Collibra)
- Background in ETL, data warehousing or data lake
Responsibilities
- Develop big data applications for Synchrony in Hadoop ecosystem
- Participate in the agile development process including backlog grooming, coding, code reviews, testing and deployment
- Work independently to develop analytic applications leveraging technologies such as: Hadoop, NoSQL, In-memory Data Grids, Kafka, Spark, Ab Initio
- Provide data analysis for Synchrony’s data ingestion, standardization and curation efforts ensuring all data is understood from a business context
- Identify enablers and level of effort required to properly ingest and transform data for the data lake.
- Profile data to assist with defining the data elements, propose business term mappings, and define data quality rules
- Assist with the creation and implementation of data quality rules
Other
- Bachelor's degree in a quantitative field (such as Engineering, Computer Science, Statistics, Econometrics); in lieu of degree, High School Diploma/GED and minimum 2 years of Information Technology experience
- Analytical mindset
- Willingness and aptitude to learn new technologies quickly
- Superior oral and written communication skills
- Ability to collaborate across teams of internal and external technical staff, business analysts, software support and operations staff.
