American Express is seeking to design, build, and enhance a Data Marketplace application to serve as a central hub for discovering, evaluating, and managing enterprise data products, integrating secure workflows, metadata management, data contracts, and compliance validation.
Requirements
- Proven expertise in building enterprise-grade full stack applications and API-driven platforms.
- Strong proficiency in: Backend: Java, Python, Shell Script
- Frontend: React, Angular, or Vue.js
- Databases: SQL (BigQuery, PostgreSQL) and NoSQL
- Cloud Platforms: GCP, AWS, or Azure
- Understanding of data governance, metadata management, and data quality frameworks.
- Solid grasp of CI/CD pipelines, containerization (Docker/Kubernetes), and modern DevOps practices.
Responsibilities
- Design, develop, and deploy the Data Marketplace application from the ground up, including: Search & Review capabilities for data products (DPs), Reviewer dashboards with certification and validation workflows, Data product and contract registry, Integration of data quality results, metadata, and usage policies from multiple sources (e.g., BigQuery, APIs, Collibra, Atlas)
- Implement user authentication and identity validation for multiple personas (Producers, Consumers, Reviewers).
- Build automated workflows for approval hierarchies (L1/L2/L3) and compliance checks against data risk management policies.
- Architect and implement APIs for: Data product metadata ingestion and updates, Data contract management (creation, change requests, approvals), Integration with enterprise data catalog and knowledge hubs
- Collaborate with other engineering teams to ensure interoperability with existing enterprise systems.
- Develop tools for automated policy validation and compliance monitoring.
- Implement audit trails for data product changes and contract updates.
Other
- 7+ years of software development experience, with at least 3 years in a senior or lead role.
- Excellent problem-solving skills and ability to work in a fast-paced, agile environment.
- Work closely with product managers, data architects, and business partners to translate requirements into technical solutions.
- Mentor junior engineers and lead code reviews.
- Participate in sprint planning, backlog grooming, and release management.
