The University of St.Gallen is looking to solve the problem of developing frameworks for evaluating reasoning in AI systems, specifically in the field of Argumentative AI and Natural Language Processing (NLP). As AI becomes more integrated into decision-making, there's a growing need for machines that can reason, argue, and provide transparent explanations, setting new benchmarks for reliability, interpretability, and ethical use.
Requirements
- Demonstrated interest or experience in Natural Language Processing (NLP) and Argumentative AI
- Familiarity with Natural Language Inference (NLI), corpus creation, and evaluation methodologies (strong plus)
- Interest or experience in human–AI interaction, argumentation theory, or AI ethics (plus)
- Strong programming skills in Python
- Experience in web/frontend development (e.g., React, Vue, or similar frameworks) is an advantage
Responsibilities
- Designing and developing a multi-layered evaluation framework for reasoning in Argumentative AI
- Building interactive interfaces for annotation and expert feedback
- Conducting user studies to assess the usability and quality of LLM-generated output
- Collaborating closely with domain experts to ensure that evaluation methods are aligned with philosophical concepts
- Contributing to interdisciplinary publications
- Advancing the theoretical and practical aspects of large language models and data-driven AI
Other
- A Master’s degree in Computer Science, Artificial Intelligence, Computational Linguistics, or a related discipline
- Excellent communication and collaboration skills, with the ability to work in interdisciplinary teams
- Diligent, responsible, structured, goal-oriented, and independent working style
- Very good command of spoken and written English
- Intellectually curious, motivated to bridge technical and philosophical domains, and eager to contribute to the broader development of AI evaluation standards.
