American Express is looking to simplify access to its Big Data Platform by moving to GCP and needs engineers to design, develop, test, solve & optimize solutions for this platform.
Requirements
- 3-5 Years of experience in Java/Python development
- Solid Understanding of GCP services Cloud dataflow, Cloud Pub-Sub, Big Query, Cloud Storage, Cloud Dataflow, Google Composer etc
- Strong SQL knowledge
- Understanding of fundamentals of Git and Git workflows
- Technical support to applications on trouble shooting Environment, software and application level issues.
- Ability to write, test programs using Unix Shell scripting, oracle PL/SQL programming
Responsibilities
- Implement scalable and efficient data architectures on GCP
- Build, test, and deploy data pipelines to move, transform, and process data from various sources to GCP
- Ensure the reliability, scalability, and performance of data pipelines
- Use GCP's big data technologies such as BigQuery, Dataflow, Dataprep, and Pub/Sub to implement effective data processing solutions
- Monitor system performance and proactively optimize data pipelines for efficiency
- Troubleshoot and resolve issues
- Create and maintain comprehensive documentation for tools, architecture, processes, and solutions
Other
- Collaborate with multi -functional teams to understand data requirements and develop solutions that meet business needs
- Experience of working in agile application development environment
- Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
- 20+ weeks paid parental leave for all parents, regardless of gender, offered for pregnancy, adoption or surrogacy
- Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
