AWS is looking to empower customers to harness state-of-the-art AI technologies for transformative business opportunities by developing custom Large Language Models (LLMs) and optimizing them for high-performance deployment on AWS's custom AI accelerators.
Requirements
- Hands-on experience with deep learning and/or machine learning methods (e.g. for training, fine tuning, and inference)
- Hands-on experience with generative AI technology
- 1+ years of experience hands-on experience with developing, deploying, or optimizing machine learning models using a recognized ML library or framework
Responsibilities
- Design and implement distributed training pipelines for LLMs using tools such as Fully Sharded Data Parallel (FSDP) and DeepSpeed, ensuring scalability and efficiency
- Adapt LLMs for new languages, domains, and vision applications through continued pre-training, fine-tuning, and Reinforcement Learning with Human Feedback (RLHF)
- Optimize AI models for deployment on AWS Inferentia and Trainium, leveraging the AWS Neuron SDK and developing custom kernels for enhanced performance
- Interact with enterprise customers and foundational model providers to understand their business and technical challenges, co-developing tailored generative AI solutions
Other
- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language
- 2+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies.
