Epiq is standing up a brand-new AI Architecture function to design the platform, pipelines, and standards that power AI across Legal Solutions
Requirements
- 7+ years in software engineering with 3+ years architecting AI/ML systems in production (or equivalent experience)
- Python for AI services and familiarity with .NET/C-Sharp for product integration and service contracts
- Proven delivery of training/inference pipelines on containers/Kubernetes with a major cloud (preferably Azure)
- Hands-on experience with model lifecycle (selection/fine-tuning, versioning, deployment, rollback), CI/CD, observability, and evaluation/guardrails for LLM and ML systems
- Strong communication with the ability to translate complex concepts into actionable roadmaps for technical and non-technical partners
- Azure ML registries/endpoints, Azure OpenAI, AKS, GitHub Actions/Azure DevOps; experience with mlflow, Airflow/Prefect, Feast/feature stores, vector search (e.g., Azure AI Search, pgvector, Milvus, FAISS)
- Data privacy/compliance background in regulated industries
Responsibilities
- Own the AI system architecture end-to-end: data flows, model development, training/inference pipelines, deployment strategies, and integration into .NET products
- Stand up and evolve LLMOps/MLOps foundations: model/asset registry, CI/CD, evaluation (offline/online), observability, rollback/kill switches, and cost/performance controls
- Build Azure-first services and infrastructure (e.g., Azure ML, Azure OpenAI, AKS, Azure Functions, Azure Storage, Azure Key Vault), enabling secure, scalable AI in production
- Implement guardrails and governance (privacy, data handling, RBAC, auditability) and partner with Security/Legal to operationalize responsible AI
- Collaborate with product and engineering to identify high-value use cases and deliver measurable outcomes, not just prototypes
- Mentor and influence engineers through design reviews, reference implementations, standards, and training
- Act as a conduit to IT/DevOps to align infra, networking, and platform reliability with product needs
Other
- Location-based market rate for the role
- Your abilities in relation to the job specification
- Performance during screening and interview
- Pay parity with the wider team in the considered location
- Bachelor's degree or equivalent experience (not explicitly mentioned but implied)
