EarnIn is seeking a Senior backend engineer to help build, deploy, and evaluate agentic systems that use large language models (LLMs) to autonomously reason and act in user-facing workflows, supporting the company's mission to provide fair and intelligent financial tools.
Requirements
- 4+ years of industry software engineering experience
- Strong understanding of LLM APIs (e.g. OpenAI, Claude) and prompt engineering.
- Experience developing or integrating with agentic systems (e.g., LangChain, custom frameworks).
- Familiarity with designing evaluation frameworks for AI behavior, including automated checks and offline test harnesses.
- Experience with API design, async workflows, and production database usage (SQL or NoSQL).
- Experience with LLM evaluation tooling, prompt unit testing, or behavioral regression suites.
- Familiarity with vector stores (e.g., Weaviate, Pinecone, Qdrant).
Responsibilities
- Build backend services in Python to support agentic applications powered by LLMs.
- Design and implement prompt orchestration layers, memory/context pipelines, and external tool integrations used by agents.
- Develop systems for evaluating agent behavior, including success metrics, error tracing, and regression testing of multi-step workflows.
- Expose and maintain RESTful APIs that interact with internal tools and external-facing LLM applications.
- Manage observability for agent pipelines, using tools like logging, tracing, and distributed monitoring.
- Build and maintain asynchronous processing systems (e.g., Celery, asyncio, or messaging queues).
Other
- Collaborate cross-functionally with ML engineers, data scientists, and product to shape intelligent and safe AI features.
- Clear communication and collaborative mindset.
- This is a hybrid position in Mountain View (Headquarters) and will require in-office work 2 days a week.
