Pryon is building an industry-leading knowledge management and Retrieval-Augmented Generation (RAG) platform that transforms unstructured data into meaningful experiences. The company is seeking a Product Manager for Large-Scale AI Infrastructure to define and drive the strategy for Pryon’s HPC RAG platform, which ingests and indexes petabyte-scale multimodal data and serves low-latency, high-throughput inference across mission-critical knowledge bases.
Requirements
- 10+ years in product management, with at least 5 in AI/ML infrastructure or large-scale distributed systems.
- Proven track record building state of the art inference and RAG: direct experience delivering high-performance distributed systems at scale.
- Deep familiarity with RAG architectures, multimodal ingestion, and LLM-backed retrieval.
- Familiarity with HPC cluster management software such as Slurm
- Strong background in high-throughput, low-latency production environments—ideally with petabyte-scale ingestion and real-time inference.
- Understanding of federal compliance environments (audit logging, IL5/6 certifications).
Responsibilities
- Own the end-to-end product vision for Pryon’s HPC platform across data ingestion, retrieval, inference, compliance, and scalability.
- Translate scale targets (thousands of concurrent requests, billions of documents, and sub-second latency) into actionable product requirements and success metrics.
- Partner with Engineering, Security, Research and Infrastructure teams to design horizontal scalability, multimodal ingestion, and regulatory compliance (FOIA, OIG, CISA).
- Drive roadmap alignment across ingestion, retrieval, ranking, and inference sub-tracks, ensuring delivery against Beta and GA milestones.
- Serve as the internal and external voice of the AI platform, presenting to agency stakeholders, strategic partners, and the Pryon executive team.
Other
- Ability to balance technical depth with executive-level communication, ensuring teams and stakeholders are aligned.
- Remote first organization
- 100% Company paid Health/Dental/Vision benefits for you and your dependents
- Life Insurance, Short-term and Long-term Disability
- 401k
- Unlimited PTO
- We are interested in every qualified candidate who is authorized to work in the United States. However, we are not able to sponsor or take over sponsorship of employment visas at this time.
