CARIAN is seeking a Senior Data Engineer AWS to support a major Customer Data Asset initiative for their client in Newark, NJ, focusing on centralizing customer-level data and enabling advanced analytics and customer insights across the enterprise.
Requirements
- Hands-on expertise with Glue, Step Functions, Lambda, S3, Redshift, DMS, and AppFlow
- Strong Python, PySpark, and advanced SQL
- Experience with SAP and Salesforce integrations preferred
- AWS certifications are a plus
- Preferred certifications: AWS Certified Data Engineer Associate, AWS Certified Solutions Architect Associate or Professional, AWS Certified Developer Associate
- Experience with Snowflake or Databricks is a plus
- 8 or more years of experience in data engineering with strong AWS cloud experience
Responsibilities
- Ingest SAP, Salesforce, Google Analytics, OKTA, and other sources into AWS S3 Raw
- Curate and transform datasets into the Curated layer using Python, PySpark, and SQL
- Build and maintain ELT and ETL pipelines with AWS Glue, Step Functions, Lambda, DMS, and AppFlow
- Design and optimize Redshift tables, views, and materialized views
- Implement CI or CD practices using GitHub and follow client governance standards
- Integrate with on-prem and SaaS systems through Simplement, MuleSoft, OKTA, and JAMS
- Use CloudWatch, CloudTrail, and Secrets Manager for monitoring and security
Other
- Bachelor’s degree in Computer Science, Information Systems, Engineering, Data Science, or a related technical field required
- Master’s degree preferred
- Ability to operate independently and deliver high-quality work at enterprise scale
- Ability to meet client security and compliance requirements including eligibility for 810 access which may require United States citizenship or permanent residency.
- Travel requirements not specified, but 3 days in office required
