The Architecture team within Apple's Video Computer Vision and Video Engineering teams is responsible for bringing together computer vision algorithms, firmware, and low-level software teams to drive exciting programs across many Apple products by enabling the co-design of computer vision algorithms and systems.
Requirements
- Demonstrated experience in optimizing computer vision algorithms for performance, power, and memory on embedded platforms.
- Familiarity with firmware integration, operating system constraints, power and memory constraints, and low-level software development for image signal processing (ISP) in real-time applications.
- Strong understanding of perception sensing technologies including color and monochrome cameras, depth sensors, and IMUs.
- Breadth of knowledge in some areas of computer vision including either classical methods or ML.
- Experience in optimizing and fine-tuning ISP pipelines, including tasks like noise reduction, color correction, demosaicing, and dynamic range enhancement.
- Ideal candidates will also have exposure to modern innovative techniques including vision transformers, foundation models, and vision-language models, with a focus on integrating these methods into resource-constrained environments.
- Proficiency in debugging and optimizing performance at the firmware or OS level, with specific expertise in tuning ISP performance to ensure tight integration between hardware capabilities and algorithmic performance.
Responsibilities
- enabling the co-design of computer vision algorithms and systems through a deep understanding of the complexities and trade-offs between algorithm performance, imaging pipeline, system resources, and real-time constraints.
- developing and improving CV perception algorithms and ISP pipelines.
- optimizing computer vision algorithms for performance, power, and memory on embedded platforms.
- Familiarity with firmware integration, operating system constraints, power and memory constraints, and low-level software development for image signal processing (ISP) in real-time applications.
- understanding and articulating trade-offs between multiple sensing solutions and their impact on both high-level algorithms and low-level system performance.
- translating ambiguous, high-level product goals into detailed feature-level architectures and system requirements.
- deriving defensible end-to-end requirements at the system level and decompose them into module/component specific requirements that include firmware, ISP, and OS constraints.
Other
- BS in Computer Science, Electrical engineering, or other relevant fields with a minimum of 8 years relevant proven experience.
- Validated ability to work in a highly multi-functional environment at the intersection of Computer Vision, Embedded Systems, ISP, Mechanical and Electrical engineering, Optical Science, Human Factors or similar.
- Strong leadership skills to drive large multi-functional efforts, resolve conflicts, and present results to the highest levels of Apple leadership.
- Demonstrated ability to bridge the gap between high-level algorithm design and low-level system optimization-including the challenges of optimizing ISP performance under tight power and latency constraints.
- Are you ready to be a part of the next big thing at Apple?
