The company is looking to solve the problem of replacing a legacy platform with a scalable, resilient, and secure AWS-based system.
Requirements
- Extensive experience with AWS services, including provisioning infrastructure, setting up security controls, and working with cloud-native solutions
- Proven experience building scalable data ingestion pipelines and implementing both real-time and batch data processing capabilities
- Strong skills in developing back-end solutions, particularly for data processing, data storage (transitional load), and interfacing with legacy systems like Mainframe DB2
- Hands-on experience with CI/CD pipelines and Infrastructure as Code (IaC) tools
- Knowledge of implementing security controls like IAM, encryption, and audit logging
- Experience with observability tools for logging, monitoring, and alerting
- Experience with data migration and developing reconciliation systems
Responsibilities
- Build a scalable, resilient, and secure AWS-based data ingestion platform
- Develop reusable data ingestion pipelines to support current and future data sources
- Implement both real-time and batch data processing capabilities
- Implement a mechanism to identify if a security needs to be created or updated
- Develop a vendor data transitional load mechanism to temporarily store data
- Implement a purge mechanism to remove data from the transitional load table based on security creation or updating
- Enhance the Mainframe DB2 data flow to consume data from newly added files
Other
- Collaborate with internal stakeholders to define the target AWS architecture and ensure alignment with enterprise security and data governance standards
- Develop operational documentation, including architecture diagrams, runbooks, and SOPs
- Conduct DR drills and support user acceptance testing (UAT)
- Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees
- This position is not available for independent contractors