Rise8 is looking to solve the business problem of transforming the United States Government by leveraging applied Generative AI. They aim to deliver "outcomes in prod" by building secure, scalable enterprise systems and applying this to Large Language Models, enabling enterprise-wide adoption of AI.
Requirements
- 7-10 years of professional experience designing, building, and deploying secure, scalable enterprise applications, including at least 2 years of recent, hands-on experience working directly with Large Language Models and MLOps principles.
- Demonstrated mastery of Python and its production ecosystem (e.g., FastAPI, Flask). You have a history of building robust APIs and services.
- Proven, practical experience building applications with LLM orchestration frameworks (LangChain, LlamaIndex) and an understanding of the underlying architecture, including hands-on work with Vector Databases (e.g., Pinecone, ChromaDB, Weaviate).
- Strong familiarity with modern DevSecOps principles and experience adapting them to the Machine Learning lifecycle. You must have experience with containerization (Docker, Kubernetes) and CI/CD pipelines.
- Experience with enterprise container platforms (OpenShift, Tanzu, or similar) is a significant plus.
- You believe that testing is the foundation of quality. You have experience with Test-Driven Development (TDD) and a deep understanding of how to apply that mindset to AI through Evaluation-Driven Development (EDD).
- Experience with MLOps tooling such as MLFlow, Kubeflow, or Weights & Biases.
Responsibilities
- Architect and Build Production AI Systems: Lead the end-to-end design, build, and deployment of a secure, scalable Generative AI platform on enterprise container platforms like OpenShift, integrating open-source LLMs and internal data sources using Retrieval-Augmented Generation (RAG) architecture.
- Implement an Evaluation-First MLOps Lifecycle: Engineer a robust, "reusable process" for deploying and managing LLMs. This includes building CI/CD-style pipelines for phased rollouts, creating "golden" datasets for benchmarking, and implementing an Evaluation-Driven Development (EDD) process to continuously measure model accuracy, safety, and performance.
- Codify and Scale Excellence: Develop the definitive prompt engineering guidelines and architectural patterns for the enterprise. You won't just write documents; you will codify the learnings from your production deployments into clear, actionable playbooks and templates that empower other teams.
- Drive Technical Innovation: Conduct hands-on research of open-source models (e.g., Llama, Mistral), vector databases, and frameworks (e.g., LangChain, LlamaIndex). You will provide expert recommendations based on practical, proof-of-concept evaluations to ensure we are using the best tools for the job.
- Embody Senior Engineering Leadership: As a Level 6 engineer, you will exemplify Rise8's core values. You will proactively solve complex problems, mentor other engineers, and communicate compelling technical narratives to both developers and stakeholders, ensuring your work aligns with business objectives and delivers tangible value.
Other
- You want to make tomorrow better than today.
- You have a passion for high-speed security and you care about risk management over compliance.
- You believe the biggest vulnerability in any system is time. You live to securely reduce cycle time.
- You enjoy daily decision making and real product delivery.
- Ability to obtain a security clearance for US Government work.
