Modernize a legacy platform by designing, developing, and implementing a scalable, resilient, and secure AWS-based system.
Requirements
- Extensive experience with AWS services, including provisioning infrastructure, setting up security controls, and working with cloud-native solutions.
- Proven experience building scalable data ingestion pipelines and implementing both real-time and batch data processing capabilities.
- Experience with data migration and developing reconciliation systems is essential.
- Strong skills in developing back-end solutions, particularly for data processing, data storage (transitional load), and interfacing with legacy systems like Mainframe DB2.
- Hands-on experience with CI/CD pipelines and Infrastructure as Code (IaC) tools.
- Knowledge of implementing security controls like IAM, encryption, and audit logging.
- Experience with observability tools for logging, monitoring, and alerting is required.
Responsibilities
- Build a scalable, resilient, and secure AWS-based data ingestion platform.
- Develop reusable data ingestion pipelines to support current and future data sources, and implement both real-time and batch data processing capabilities.
- Implement a mechanism to identify if a security needs to be created or updated.
- Develop a vendor data transitional load mechanism to temporarily store data.
- Implement a purge mechanism to remove data from the transitional load table based on security creation or updating.
- Enhance the Mainframe DB2 data flow to consume data from newly added files.
- Provision AWS infrastructure using Infrastructure as Code (IaC) tools and ensure it meets security and compliance standards.
Other
- Collaborate with internal stakeholders to define the target AWS architecture and ensure alignment with enterprise security and data governance standards.
- Develop operational documentation, including architecture diagrams, runbooks, and SOPs.
- Conduct DR drills and support user acceptance testing (UAT).
- Ability to analyze requirements and mappings for data ingestion, define technical tasks, and create agile backlogs (Epics, stories).
- This position is not available for independent contractors
