Synchrony's Enterprise Data Lake requires functional and system development to integrate data across internal and external sources, provide analytical insights, and integrate with critical systems. The role aims to ensure high-quality data ingestion, standardization, and curation while maintaining compliance with data standards, and to drive quality throughout the software development lifecycle.
Requirements
- Hands-on experience writing shell scripts, complex SQL queries, Hive, Kafka, HBase, MySQL, Hadoop commands and Git.
- Ability to write abstracted, reusable code components.
- Programming experience in at least one of the following languages: Scala, Java or Python.
- Scheduling tools like Stone branch, AutoSys, control-M etc.
- Familiarity with code repository like bitbucket, GitHub and devops pipelines.
- Performance tuning experience
- Familiar with Public Cloud (i.e. AWS, GCP, Azure) data engineering services
Responsibilities
- Develop big data applications for Synchrony in Hadoop ecosystem
- Participate in the agile development process including backlog grooming, coding, code reviews, testing and deployment
- Pair with experienced data engineers to develop analytic applications leveraging technologies such as: Hadoop, NoSQL, In-memory Data Grids, Kafka, Spark, Ab Initio
- Provide data analysis for Synchrony’s data ingestion, standardization and curation efforts ensuring all data is understood from a business context
- Identify enablers and level of effort required to properly ingest and transform data for the data lake.
- Profile data to assist with defining the data elements, propose business term mappings, and define data quality rules
- Create source-to-target data mapping documents
Other
- The candidate for the Data Engineer role will join an Agile scrum team
- The engineer will work cross-functionally with operations, other data engineers and product owner to assure capabilities are delivered that meet business needs.
- Superior oral and written communication skills.
- Ability to collaborate across teams of internal and external technical staff, business analysts, software support and operations staff.
- You must be 18 years or older
