OneMain Financial is looking for a Sr. Software Engineer to join their Card Technology team to build and optimize data pipelines and cloud infrastructure for reliable, scalable, and accessible insights.
Requirements
- 4+ years’ experience as a data engineer or relevant role
- Understanding of Big Data technologies
- Good programming knowledge in Python
- Understanding of DataLake architecture and creating pipelines to ingest data into DataLake
- Experience in implementing data pipelines using AWS services, Docker/Kubernetes, and Airflow
- Proficient with different file formats: JSON, Avro, and Parquet
- Knowledge of one or more database technologies (e.g. PostgreSQL, Redshift, Snowflake, NoSQL databases)
Responsibilities
- Create and manage cloud resources in AWS
- Develop infrastructure to collect, transform, combine, and publish/distribute customer data
- Data processing/transformation using technologies like Spark and Cloud Services
- Identify opportunities to optimize data collection, insights, and displays
- Ensure data and results are accessible, scalable, efficient, accurate, complete, and flexible
- Experiment with new technologies/patterns and conduct POCs
- Experience with source control and CI/CD pipelines
Other
- Participate in regular Scrum ceremonies with agile teams
- Mentor junior members and implement industry best practices
- Strong background in math, statistics, computer science, data science, or related discipline
- Comfortable learning and deploying new technologies and tools
- hybrid | Charlotte, NC // 3 days/week: Tuesdays - Thursdays
