Apple's AI and Machine Learning org is looking to innovate and create groundbreaking technology for multi-modal models with strong agent and reasoning capabilities, specifically focusing on audio data.
Requirements
- Deep technical skills in one or more machine learning areas, such as computer vision, audio, combinatorial optimization, causality analysis, natural language processing, and deep learning.
- Strong software development skills with proficiency in Python; hands-on experience working with deep learning toolkits like PyTorch, TensorFlow, or JAX (one of).
- 5+ years of experience developing and evaluating ML applications, demonstrating a passion for understanding and improving model/data quality.
- Deep understanding of multi-modal foundation models.
- Staying up-to-date with emerging trends in generative AI and multi-modal LLMs.
- The ability to formulate machine learning problems, design, experiment, implement, and communicate solutions effectively with multi-functional teams.
- Demonstrated publication records in relevant conferences (e.g., CVPR, ICCV, ECCV, NeurIPS, ICML, ICLR, etc.).
Responsibilities
- Innovating and applying innovative research in foundation models to with a particular focus on audio data.
- Working across the full ML pipeline-from pre-training on large-scale unlabeled audio corpora to post-training evaluation and fine-tuning with task-specific datasets.
- Designing and developing a comprehensive multi-modal data generation and curation framework for foundation models at Apple.
- Building robust model evaluation pipelines that support continuous improvement and performance assessment.
- Analyzing multi-modal data to better understand its influence on model behavior and outcomes.
- Showcase your groundbreaking research work by publishing and presenting at premier academic venues.
- Designing self-supervised and semi-supervised representation learning pipelines, and fine-tuning strategies for tasks like speech recognition and speaker identification.
Other
- Collaborating closely with our team of machine learning researchers, engineers, and data scientists.
- Spearhead groundbreaking research initiatives and develop transformative products designed to build for billions of users worldwide.
- Guiding product teams in selecting effective ML solutions.
- Apple is an equal opportunity employer that is committed to inclusion and diversity.
- We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.
