Define the architecture for EPAM's enterprise GenAI platform to deliver scalable and secure AI solutions.
Requirements
- 1+ years in architecture roles involving cloud, data, or production Generative AI/LLM systems
- Knowledge of cloud platforms (Azure, AWS, GCP) and IaC tools (Terraform, Bicep, CDK, CloudFormation)
- Competency in containerization and orchestration technologies (Docker, Kubernetes), as well as API gateways/service meshes
- Proficiency in CI/CD and release management for ML/LLM workloads (Jenkins, GitHub Actions, GitLab CI, Azure DevOps)
- Understanding of Large Language Model (LLM) platforms like Azure AI Foundry, Azure OpenAI, AWS Bedrock, or Google Vertex AI
- Familiarity with security-by-design principles and compliance frameworks tailored to GenAI systems
Responsibilities
- Design enterprise generative AI reference architectures, blueprints, and reusable patterns
- Define multi-cloud platform foundations addressing networking, identity, and secrets management
- Lead efforts in LLMOps/ModelOps, focusing on model evaluation, safety, observability, and rollout strategies
- Create frameworks and governance for agentic systems, including tool governance and the Model Context Protocol (MCP)
- Ensure systems comply with security, risk, and compliance standards, with Responsible AI principles and PII controls applied
- Establish strategies for cost efficiency, reliability, and performance using capacity planning and FinOps techniques
- Improve developer experience through CI/CD pipelines, golden paths, templates, and Infrastructure as Code (IaC) techniques
Other
- This position offers remote setup with the flexibility to work from any location in Georgia, whether it's your home, well-equipped offices in Tbilisi and Batumi or a coworking space in Kutaisi.
- Collaborate with cross-functional teams to align system requirements with strategic objectives
- Advanced proficiency in English (B2+/C1)
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
