At Apple, the business problem is to advance the field of generative AI and multimodal foundation models to deliver the next groundbreaking Apple products and experiences, strengthening the company's commitment to leave the world better than it was found.
Requirements
- Strong experience in deep learning with demonstrated work in at least one area of multimodal systems (e.g. vision, language, video, etc.)
- Proficiency in Python and in a modern deep learning framework such as PyTorch or JAX
- Deep expertise in multimodal foundation models
- Strong research experience in at least one major area of model development (data curation, pre-training, fine-tuning, alignment, or evaluation), particularly as it applies to multimodal systems
- Experience with large-scale training pipelines, including working with large datasets and scaling models across distributed systems
- Track record of impactful research published at top ML conferences (CVPR, ICCV/ECCV, NeurIPS, ICML, ICLR, etc.)
- PhD, or equivalent practical experience, in Computer Science, Computer Vision, Machine Learning, or related technical field
Responsibilities
- Designing, implementing, and evaluating foundation models based on the latest advancements in the fields, taking into account future hardware design and product needs
- Engaging and collaborating with several teams across Apple to deliver the best products
- Developing state of the art solutions for challenging problems in Computer Vision and Machine Learning
- Crafting upcoming research directions in the field of multimodal foundation models that will inspire future Apple products
- Working alongside highly accomplished and deeply technical scientists and engineers to develop state of the art solutions
- Building experiences that demonstrate the power of sensing hardware as well as large foundation models
- Advancing the state of the art in Computer Vision and Machine Learning, touching all aspects of language and multimodal foundation models
Other
- BS and a minimum of 3 years relevant industry experience
- Ability to work in a collaborative environment
- Ability to communicate the results of analyses in a clear and effective manner
- Ability to work independently and drive research projects from conception to completion
- Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services
