Cloud: GCP first (Cloud Run and Compute Engine; Secret Manager, Artifact Registry, Cloud Build/Deploy, Monitoring/Logging); Kubernetes familiarity welcome; equivalent AWS/Azure experience acceptable.
AI/LLM: Agentic architectures (tool/function use, multi‑step orchestration, retrieval/RAG, planners, memory), evaluation/guardrails/safety; experience with OpenAI, Anthropic, Google Gemini, and open‑weight models; familiarity with enterprise AI platforms that unify access to multiple model types.
Reliability: Testing (Pytest or similar), observability, performance tuning.
Responsibilities
Design, build and maintain backend services and APIs primarily in Python (FastAPI/Starlette), emphasizing clean design, performance, and reliability.
Model data and write high‑quality SQL (primarily in BigQuery); use document databases (e.g., Firestore, MongoDB) where appropriate.
Build, harden, and operate containerized services: author Dockerfiles (multi‑stage), manage image versions in Artifact Registry, and enforce container security/scanning.
Deploy on GCP with Cloud Run and Compute Engine; leverage Secret Manager, Artifact Registry, Cloud Build/Deploy, and Cloud Monitoring/Logging; Kubernetes familiarity is a plus.
Integrate LLM/AI capabilities with an agentic approach (tool/function calling, multi‑step orchestration/planning, retrieval/RAG, and memory) using providers such as OpenAI, Anthropic, and Google Gemini, as well as open‑weight models; implement evaluation, safety, and guardrails.
Utilize our enterprise AI platform (Abacus.ai) that provides unified access to multiple language, image, and short‑form video models, plus prompt/version management, safety, and analytics; help define reusable patterns and abstractions for it across products.
Define and version API contracts (REST/GraphQL); document systems and interfaces.
Other
Enjoys collaborating closely with cross-functional partners.
You can translate requirements into scalable software that balances speed, quality, and reliability.
You’re curious about AI and other emerging technology and excited to integrate them responsibly into real products.
You take ownership of products, from design through deployment and maintenance.
Communicates and collaborates effectively with creative, operations, strategy, and data partners.