The Enigma Project at Stanford University School of Medicine aims to understand the computational principles of natural intelligence using AI. The project seeks to create a foundation model of the brain by capturing the relationship between perception, cognition, behavior, and brain activity dynamics, offering insights into brain algorithms and aligning AI with human-like neural representations.
Requirements
- Extensive experience building, using, and fine-tuning large-scale multimodal foundation models
- Expertise in modern deep learning libraries (preferably PyTorch) and recent developments in multimodal foundation models
- Strong publication record in top-tier machine learning conferences and journals, particularly in areas related to multi-modal modeling
- Strong programming skills in Python and deep learning frameworks
- Experience in processing and analyzing large-scale, high-dimensional data of different sources
- Familiarity with training, fine tuning, and quantization of LLMs or multimodal models using common techniques and frameworks (LoRA, PEFT, AWQ, GPTQ, or similar)
- Experience with large-scale distributed model training frameworks (e.g. Ray, DeepSpeed, HF Accelerate, FSDP)
Responsibilities
- Design and implement large-scale multimodal deep learning architectures that relate sensory inputs to neuronal correlates of perception, action, and cognition
- Develop novel computational approaches for training and optimizing frontier models on unprecedented amounts of neural data
- Provide technical leadership in distributed training systems and model optimization techniques
- Guide cross-functional teams in establishing technical frameworks and evaluation metrics for brain foundation models
- Stay ahead of the latest developments in machine learning and neuroscience, and propose innovative solutions to advance the project's goals
- Training frontier multi-modal models on large-scale data of neuronal recordings that relate sensory input to neuronal correlates of perception, action, cognition, and intelligence.
Other
- Communicate research findings through publications, presentations, workshops and research blogs
- Demonstrated ability to lead research projects and mentor others
- Ability to work effectively in a collaborative, multidisciplinary environment
- Demonstrated project leadership experience.
- Demonstrated experience leading and/or managing technical professionals.
