Pioneering the next generation of intelligent, on-device experiences by bridging the gap between powerful LLMs and the resource-constrained environment of mobile devices.
Requirements
- Proven experience building and shipping complex, high-performance applications that run on-device
- Strong understanding of mobile system fundamentals, including concurrency, memory management, and power optimization
- Experience or strong interest in AI/ML concepts, particularly in the areas of Large Language Models, agentic systems, and MLOps
- Experience working with on-device LLMs or other on-device ML models (e.g., using Core ML, TensorFlow Lite, or PyTorch Mobile)
- Hands-on experience with agentic frameworks or tool-use architectures (e.g., LangChain, custom agents)
- Strong skills in Swift (desired) and at least one other object-oriented programming language
- Experience with on-device databases (e.g., Core Data, Realm, SQLite)
Responsibilities
- Architect and Develop Agentic Systems: Design and build the core architecture for on-device agents and the tools they will use. This includes creating the agentic reasoning and planning layer, the on-device tool registry, and the data-flow pipelines
- On-Device LLM Integration: Integrate on-device LLMs to run efficiently on iOS devices, managing memory, power consumption, and compute resources
- Hybrid On-Device/PCC Architecture: Engineer a seamless system that can execute agentic workflows and tool calls both on the user's device and on a personal computer, ensuring a consistent and reliable user experience across platforms
- On-Device Data and Input Integration: Design and build robust integrations with on-device databases (e.g., Core Data, SQLite), and other device inputs like user location, motion data, and sensor data, to provide rich context for the agents
- Tool Building and Management: Create a flexible and scalable "tooling" framework that allows agents to interact with various applications and data sources on the device (e.g., health, location, calendar, etc.)
- Performance and Privacy Optimization: Continuously monitor and optimize the performance of the on-device agents, focusing on latency, battery life, and resource usage. Ensure all data handling adheres to the highest standards of user privacy and security
- Technical Leadership: Serve as a technical leader within the team, providing guidance and mentorship to other engineers, participating in code reviews, and helping to set the technical roadmap for the agentic systems
Other
- 5+ years of professional software engineering experience, with a significant focus on mobile development (iOS)
- Cross-Functional Collaboration: Partner with product managers, UX designers, and ML researchers to translate product requirements into technical specifications and deliver high-quality, impactful features
- A track record of leading complex technical projects from concept to launch
- A passion for building innovative user experiences
- Exceptional problem-solving and analytical skills
