Virtue AI is looking to solve the problem of providing robust, trustworthy, and safe AI security solutions for enterprises adopting Large Language Models
Requirements
- Strong programming experience in Python, Go, or a similar language.
- Solid understanding of distributed systems, concurrency, and service-oriented architecture.
- Experience with SQL and NoSQL databases (e.g., Postgres, Redis, MongoDB).
- Hands-on experience with containerization and orchestration (Docker, Kubernetes).
- Familiarity with cloud services (GCP, AWS, or Azure) and infrastructure as code (Terraform).
- Comfort working in fast-paced environments with a focus on secure, reliable delivery.
- Background in building SaaS or enterprise software with on-prem deployment requirements.
Responsibilities
- Design, implement, and maintain scalable services and APIs for red-teaming, guardrails, and agent-safety products.
- Build robust, multi-tenant data pipelines and storage layers that support real-time evaluation and analytics at enterprise scale.
- Develop abstractions for deployment across heterogeneous environments (SaaS, customer Kubernetes clusters, hybrid cloud).
- Partner with ML engineers to integrate inference services (vLLM, Triton, Ray) into secure, production-grade systems.
- Implement observability and performance tooling (latency, throughput, reliability) to meet enterprise SLOs.
- Contribute to CI/CD pipelines, containerization workflows (Docker, Helm), and deployment automation.
- Participate in design reviews, code reviews, and documentation to ensure long-term maintainability.
Other
- High-performing, motivated engineer ready to make a significant impact in the AI security space
- Thrive in an environment that values hard work, collaboration, and technical curiosity
- Collaborate closely with ML engineers, security experts, and product leads
- Work in a fast-paced, customer-focused company
- Participate in design reviews, code reviews, and documentation to ensure long-term maintainability
