Ampere is looking to solve the problem of advancing AI capabilities and delivering high-performance, energy efficient, and sustainable cloud computing solutions.
Requirements
- Previous development experience with LLVM/MLIR/XLA for deep learning.
- Strong expertise in programming languages such as Python, C/C++ with a strong background in performance tuning.
- Deep knowledge of Graph IR, such as Torch FX Graph IR, MLIR Dialects, etc.
- Experience with pattern recognition and fusion strategies.
- Solid understanding of AI and machine learning concepts, including neural networks and data processing frameworks.
- Experience with deep learning frameworks like PyTorch and Llama.cpp
- Experience with serving platforms like vLLM and SGLang
Responsibilities
- Optimize the computational graph to fully unlock the potentials of Ampere’s deep learning accelerator.
- Go deep into to the entire SW/HW stack to accelerate the deep learning including but not limited to inference serving, framework integration, compiler, runtime library, communication and compute kernel development, and performance tuning.
- Work on deep learning model enabling with performance and accuracy for popular frameworks like PyTorch and Llama.cpp and for serving platforms like vLLM and SGLang.
- HW/SW codesign to optimize existing AI architectures to enhance computational efficiency, increase throughput, reduce latency, and improve the scalability.
- Be a key team member in building state-of-the-art software and hardware AI co-processors/accelerators.
- Collaborate with cross-functional teams to integrate AI solutions into Ampere's cloud-native processor platforms and accelerators.
Other
- BS Computer Science, Mathematics or a related technical field & 12 years of related experience; or MS degree & 8 years; or PhD & 5 years
- Unlimited Flextime and 10+ paid holidays
- Premium medical insurance, dental insurance, vision insurance, as well as income protection and a 401K retirement plan
- A variety of healthy snacks, energizing espresso, and refreshing drinks to keep you fueled and focused throughout the day
- Long-term incentive and comprehensive benefits