Lenovo is seeking to integrate and implement Small Language Model (SLM) inferencing for next-generation AI systems onto Windows laptop and desktop computers to realize its Hybrid AI vision
Requirements
- Expertise in Windows development, including Win32 APIs, DLL development, and system-level programming
- Strong understanding of Windows software security best practices (e.g., secure coding, privilege management, sandboxing)
- Experience with GGML, GGUF, and llama.cpp for local model inference
- Proficiency in C/C++ for client and systems development
- Familiarity with ONNX, OpenVino, RyzenAI, and QNN runtimes
- Working knowledge of Python and deep learning frameworks such as PyTorch
- Strong problem-solving and debugging skills in complex, multi-threaded environments
Responsibilities
- Design, implement, and maintain core agent runtimes responsible for: Dynamic model loading and lifecycle management
- Scheduling, prioritization, and queuing of model inference requests
- Information retrieval, data preprocessing, and context preparation pipelines
- Develop system integrations to support interoperability between Windows applications, services, and AI runtime components
- Implement security and privacy controls, including process isolation, sandboxing, audit logging, and compliance with enterprise-grade software security standards
- Optimize runtime performance for latency, throughput, and memory footprint across heterogeneous compute platforms (CPU, GPU, NPU) and across various vendor AI Frameworks (such as OpenVino, RyzenAI, and QNN)
- Embed safety and interpretability features into the stack, including guardrails, telemetry, and explainability mechanisms
Other
- Mentor junior engineers by providing technical guidance, conducting code reviews, and supporting onboarding
- Author technical documentation and best practices, contributing to internal knowledge bases, design proposals, and architecture reviews
- Collaborate with cross-functional teams (AI researchers, product managers, QA, and DevOps) to deliver robust, production-ready solutions
- We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, religion, sexual orientation, gender identity, national origin, status as a veteran, and basis of disability or any federal, state, or local protected class
- Contribute to platform reliability, including fault tolerance, error handling, and automated recovery strategies
