Apple is looking to leverage the potential of multimodal foundation and large language models to enable real-time human understanding on Apple devices, advancing AI and computer vision capabilities.
Requirements
- Experience with Robust API Design: Proven ability to design developer-facing APIs with a clear understanding of architectural tradeoffs, design patterns, and anti-patterns. Strong intuition for maintainability and extensibility. Exceptional debugging and performance optimization skills.
- Experience with iOS/macOS development: Familiarity with Swift, SwiftUI, modern concurrency (e.g., structured concurrency with async/await), and Apple system frameworks such as Cocoa/Cocoa Touch, Core ML, Metal, and Accelerate.
- Foundational understanding of machine learning: Solid grasp of ML algorithms and development pipelines, with the ability to work effectively with ML practitioners and integrate ML components into production systems.
- Experience integrating on-device CV/ML algorithms: Familiarity with common computer vision techniques (e.g., object detection, segmentation, tracking, pose estimation), sequence models for real-time inference and FMs/LLMs optimized for on-device performance.
- Experience with scene understanding and AR frameworks: Exposure to ARKit, RealityKit, or other 3D perception pipelines (e.g., LiDAR-based depth fusion, spatial tracking).
Responsibilities
- Designing robust, extensible architectures and APIs for engineering partners.
- Developing applications and tools for algorithm evaluation, prototyping, and technology demonstrations.
- Supporting teams across Apple by integrating ML and CV components into production systems.
- Advocating for engineering excellence, code quality, thorough test suites, and long-term maintainability.
Other
- Track record of multi-functional collaboration and product delivery: Demonstrated success delivering high-performance, production-quality code in collaborative, multi-disciplinary environments.
- Highly motivated and skilled Senior Software Engineer
- Balance research and product requirements
- Partnering with HW, SW and AI teams
- Collaborate with multi-functional teams, including researchers, data scientists, software engineers, human interface designers and application domain experts.
