Invoca is looking to build the next generation of AI-powered customer experiences by architecting and deploying applied AI systems, engineering advanced agentic AI workflows, and translating business needs into AI-powered solutions.
Requirements
- Advanced proficiency in Python and hands-on experience building applications with leading AI/ML frameworks (e.g., LangChain, LlamaIndex, CrewAI, PyTorch). You are an expert with data and ML libraries (e.g., Pandas, spaCy), applying these skills to product development.
- Demonstrated success deploying and maintaining applications powered by LLMs and other generative models in a production environment, highlighting your product development and software engineering capabilities.
- Deep, hands-on experience designing, building, and optimizing RAG pipelines, including expertise in vector databases (e.g., Qdrant, Pinecone, Weaviate), embedding strategies, and chunking techniques, as applied to agentic AI workflows.
- Demonstrable experience with modern evaluation techniques for multi-step AI agents. You should be able to speak to the trade-offs of evaluating reasoning traces, tool usage, and final outcomes using frameworks like LangSmith, DeepEval, Ragas, TruLens, or custom-built solutions, showcasing your understanding of agentic AI frameworks.
- Demonstrable skill in designing, testing, and optimizing complex prompts and few-shot examples to maximize model performance for specific tasks, crucial for developing effective agentic AI workflows.
- Experience in fine-tuning foundation models for specific downstream tasks, with a clear understanding of when to fine-tune versus when to use in-context learning or agentic approaches, demonstrating your expertise in agentic AI frameworks.
- Advanced proficiency with API-driven frameworks for accessing and serving self-hosted foundation models (e.g., AWS SageMaker/Bedrock, Databricks Model Serving, TGI, vLLM), focusing on building resilient, scalable, and optimized integrations through strong software engineering.
Responsibilities
- Architect and Deploy Applied AI Systems: Design, build, and deploy scalable, production-grade applications using foundation models and other advanced AI techniques, directly influencing product performance and efficiency through strong software engineering practices.
- Engineer Advanced Agentic AI Workflows & Frameworks: Go beyond basic implementation. Engineer robust Retrieval-Augmented Generation (RAG) pipelines and multi-step agentic workflows that can reason, use tools, and solve complex product problems.
- Contribute to Agentic AI System Evaluation: Establish and manage rigorous evaluation frameworks for complex AI agents. You will go beyond simple response quality to assess the entire agentic process, including the validity of reasoning steps, correctness of tool use, task completion rates, and overall robustness, contributing to the continuous improvement of our products.
- Excel in Prompt Engineering and Optimization: Craft, test, and manage sophisticated prompt chains and templates to ensure optimal performance, reliability, and cost-effectiveness from our AI models, driving product innovation.
- Build for Scale and Reliability: Develop resilient serving architectures that seamlessly integrate Large Language Models (LLMs) with enterprise systems, ensuring high availability and performance through expert software engineering.
- Champion MLOps for Applied AI: Develop and maintain sophisticated MLOps and CI/CD pipelines tailored for the unique challenges of generative AI, including prompt versioning, RAG pipeline management, and continuous evaluation of agent behavior, ensuring product quality and efficiency.
- Translate Business Needs into AI-Powered Solutions: Work as a strategic partner to product and engineering teams, deeply understanding customer challenges and translating them into innovative, viable, and impactful AI features, driving product development from conception to deployment.
Other
- 5+ years of professional experience in Applied AI Engineering, ML Engineering, or a closely related role with a strong focus on building and deploying AI-powered products and applications, demonstrating a strong foundation in software engineering.
- This role is remote and open to candidates located in the United States and Canada only.
- Please note that we are unable to provide visa sponsorship for this position.
- Bachelor's Degree in Computer Science, Engineering, Statistics, or a related field (or equivalent practical experience).
- An advanced degree (Master's or Ph.D.) is a plus, providing a solid foundation for software engineering and product development.
