American Express is looking to solve the problem of simplifying access to their Big Data Platform by moving to public cloud - GCP and designing, developing, testing, troubleshooting, and optimizing solutions to meet customer-facing applications, business applications, and/or internal end-user applications needs.
Requirements
- Understanding of GCP services Cloud dataflow, Cloud Pub-Sub, Big Query, Cloud Storage, Cloud Dataflow, Google Composer etc
- Strong SQL knowledge
- Understanding of fundamentals of Git and Git workflows
- Experience of working in agile application development environment
- Technical support to applications on trouble shooting Environment, software and application-level issues
- Write, test programs using Unix Shell scripting, oracle PL/SQL programming
Responsibilities
- Implement scalable and efficient data architectures on GCP
- Collaborate with cross-functional teams to understand data requirements and develop solutions that meet business needs
- Build, test, and deploy data pipelines to move, transform, and process data from various sources to GCP
- Ensure the reliability, scalability, and performance of data pipelines
- Utilize GCP's big data technologies such as BigQuery, Dataflow, Dataprep, and Pub/Sub to implement effective data processing solutions
- Monitor system performance and proactively optimize data pipelines for efficiency
- Troubleshoot and resolve issues
Other
- Bachelor's degree or equivalent experience
- Ability to work in a fast-paced Agile team
- Excellent communication and collaboration skills
- Ability to work in a hybrid, onsite or virtual arrangement depending on role and business need
- 20+ weeks paid parental leave for all parents, regardless of gender, offered for pregnancy, adoption or surrogacy
