Microsoft's Human Intelligence team in Windows Applied Sciences Group is looking to advance multimodal face normalization and RGB+NIR recognition for secure sign-in experiences, aiming to transform diverse inputs into robust identity representations and improve perception for real-world deployment.
Requirements
- Publications in CVPR/ICCV/ECCV/NeurIPS/ICLR/ICML/SIGGRAPH or related journals.
- Experience in face recognition/verification, multimodal learning/fusion, metric learning, representation or generative modeling.
- Depth in multimodal normalization (pre-FR normalizers, prototype learning) and RGB↔NIR FR.
- Experience with VLMs/LLMs (prompting, fine-tuning, tool-use) for visual reasoning, explainability, or safety.
- Scalable training (DDP/multi-node), dataset curation, reproducible MLOps; familiarity with liveness/FAS and fairness/robustness evaluation.
- Proficient PyTorch/JAX background; ability to implement/reproduce SOTA.
Responsibilities
- Research & prototype methods in areas such as: Unified face normalization across modalities (e.g., RGB↔NIR), with joint prototype + feature learning and cross-modal alignment.
- Multimodal face recognition (fusion across RGB, NIR, depth/IR, audio cues where appropriate), with robustness/fairness under distribution shift.
- Large Language Models-aided face verification: explore Vision Language Models (VLM)/Large Language Models (LLM) pipelines that (i) use visual context in the photo (attributes, scene cues, spatiotemporal hints) to assist verification; (ii) provide interpretable rationales; and (iii) improve failure detection and human-in-the-loop triage.
- Efficiency & reliability: distillation/quantization/pruning, lightweight encoders/normalizers, calibration and uncertainty, liveness/antispoof integration.
- Evaluate thoroughly: define datasets and protocols; run ablations and benchmarks (ROC, EER, TPR@FAR, latency/memory, fairness/robustness).
- Production immersion: learn Windows Hello-style pipelines (signals, constraints, on-device considerations) to align research with deployment.
- Publish: communicate results via talks, internal tech reports, and submissions to top venues.
Other
- Currently enrolled in a Master’s or Ph.D. program in CS, EE, Applied Math, or related field with a focus in vision/graphics/ML.
- Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship.
- In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position as well as a cover letter and any relevant work or research samples.
- Microsoft is an equal opportunity employer.
