GC AI is building an AI platform for in-house lawyers to improve the accuracy and quality of legal information provided by AI agents, leveraging LLMs and company knowledge to offer better and faster legal advice.
Requirements
- Experience using generative AI for legal work.
- Experience conducting evaluations of generative AI outputs.
- Ability to design and interpret evaluation metrics and to abstract legal reasoning and processes into logical and repeatable steps.
- Technologically curious with an aptitude for learning new tools, software, and skills
- You’re nerdy about legal tech, especially in areas like prompt engineering and quality assurance.
- You’ve worked closely with software engineers before.
- In addition to U.S. expertise you are familiar with the law of other countries.
Responsibilities
- Design and run rigorous evaluations measuring the quality of our AI-generated outputs in order to ensure they meet the high standards expected by top-tier legal professionals.
- Review and validate product outputs for accuracy, relevance, comprehensiveness, helpfulness, etc.
- Translate nuanced, real-world legal expectations into concrete, testable prompts and evaluation criteria.
- Draft and iterate on system prompts for our various AI systems.
- Assess foundational model performance and suitability for different legal tasks.
- Build and annotate complex legal datasets and document collections.
- Act as the bridge between technical teams and legal domain expertise, translating complex legal concepts into clear product requirements and vice versa.
Other
- Law degree.
- License to practice law in a U.S. jurisdiction.
- 3+ years of legal experience, ideally gained in an in-house environment in a product, regulatory, or litigation counsel role.
- Deep familiarity with U.S. legal research and regulatory law.
- Strong quantitative and analytical skills.
