NVIDIA is looking to solve the problem of defining the next era of computing by leveraging AI, where their GPU acts as the brain of computers, robots, and self-driving cars. The System Software Engineer - AI and Cloud will contribute to this by working on groundbreaking projects that craft the future of technology, engaging with advanced AI models and cloud-native architectures.
Requirements
- Proficiency in Python and JavaScript for programming and debugging, with a strong foundation in data structures, algorithms, and software design principles.
- Basic familiarity with C++ programming and its application in high-performance computing environments.
- Experience in crafting cloud-native systems optimized for Kubernetes deployment, using inference frameworks such as vLLM and NVIDIA Triton Inference Server.
- A solid understanding of API design principles for building scalable, production-ready inference systems.
- Advanced knowledge of LLMs, modern AI software architecture, and cloud APIs.
- Contributions to public-facing technical content and open-source projects.
- Expertise in deploying LLM inference frameworks like Triton Inference Server, vLLM, or TensorRT, including on Kubernetes or edge devices to improve performance.
Responsibilities
- Evaluate cloud-native, full-stack applications using microservices architecture to power AI use cases, bringing to bear NVIDIA frameworks, SDKs, and microservices.
- Design and implement agentic workflows with advanced techniques like Retrieval-Augmented Generation (RAG) and the latest AI models.
- Evaluate user experiences and analyze the technical performance of AI solutions, compiling findings into comprehensive reports.
- Offer practical suggestions for product improvement to senior executives and engineering management.
- Develop developer-focused content, including detailed tutorials and code samples, to demonstrate the latest features in NVIDIA’s tools and libraries.
- Write technical whitepapers and product briefs, and run technical demos of our products at prominent industry conferences.
Other
- A Bachelor’s or Master’s in Software Engineering, Computer Science, Computer Engineering, Electrical Engineering or a related degree (or equivalent experience)
- 3+ years of experience.
- Engage with various teams across NVIDIA such as product, marketing, hardware, software engineering, and QA to improve NVIDIA's product offerings.
- NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer.
- As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
