To design and build core backend services that power Freshworks' Agentic AI Platform, enabling reasoning-driven agents, multi-agent orchestration, dialog management, and outcome-based workflows.
Requirements
- 7+ years of backend engineering experience, with at least 2+ years in AI/ML platform development
- Strong programming skills in Java and Python
- Hands-on experience with LangChain, LangGraph, LangSmith LLM/agent frameworks
- Expertise in distributed systems, event-driven architectures, and microservices
- Solid experience with cloud platforms (AWS), Kubernetes, and IaC (Terraform/Helm)
- Familiarity with databases (PostgreSQL, Redis, MongoDB) and vector databases (ElasticSearch, Pinecone, FAISS, Weaviate)
Responsibilities
- Implement high-performance APIs, orchestration runtimes, agent lifecycle management, and integration with frameworks like LangChain, LangGraph, and LangSmith
- Develop APIs and SDKs for building, deploying, and managing agent workflows and tools
- Build stateful dialog management and memory services to support multi-turn, context-aware agents
- Implement multi-agent communication (A2A) protocols and shared context for collaborative agent behavior
- Work with the Architect to build cloud-native, event-driven backend services using microservices or service mesh architecture
- Design task scheduling and workflow orchestration (e.g., Temporal/Airflow) for agent planning and long-running operations
Other
- 3 days/week in-office presence in San Mateo, CA or Bellevue, WA
- Participate in on-call rotations and improve platform resiliency and fault tolerance
- Contribute to open-source AI agentic frameworks or backend libraries (preferred)
- Exposure to conversation orchestration, dialog state tracking, and AI-driven planning systems (preferred)
