NTT DATA's Client is seeking an AWS Glue Developer / Python to join their team to deliver reliable, automated data integrations and services.
Requirements
- 5+ years software engineering or data engineering experience, with demonstrable projects using Python and AWS data services.
- 5+ Experience with PySpark or Spark-based ETL frameworks.
- Minimum 4+ years of Prior work experience with SnapLogic or other iPaaS/ETL platforms (Informatica, Talend, Mulesoft).
- 3+ Experience with observability tools and practices (CloudWatch metrics & logs, structured logging, distributed tracing).
- Strong programming skills in Python, with experience writing clean, testable, and maintainable code.
- Hands-on experience building and maintaining AWS Glue jobs (PySpark or Python shell), including job configuration, partitioning, and performance optimization.
- Practical experience with AWS API Gateway and serverless or container-based backends (Lambda, ECS, EKS, or equivalent).
Responsibilities
- Design, build, test, and deploy backend services and ETL solutions using Python and AWS services.
- Implement and maintain AWS Glue jobs (PySpark/Python) for scalable ETL, including job orchestration, error handling, and performance tuning.
- Design and implement RESTful APIs using AWS API Gateway and Lambda/containers, including security, throttling, and monitoring.
- Develop, maintain, and improve CI/CD pipelines and infrastructure-as-code (IaC) for application and data platform deployments.
- Collaborate with platform and operations teams to automate build, test, deployment, and rollback procedures.
- Troubleshoot production incidents, runbooks, and post-incident analysis to improve reliability.
- Read, interpret, and validate SnapLogic pipelines to understand ETL logic and translate pipeline behavior into equivalent implementation, troubleshooting, or documentation.
Other
- Strong ownership and bias for operational reliability.
- Clear communicator able to explain technical designs and ETL logic to technical and non-technical stakeholders.
- Comfortable working in agile teams and collaborating across disciplines.
- REMOTE
- Must be able to read and interpret SnapLogic pipelines to understand ETL logic and data flows.
