Red Hat is looking to democratize AI with open source and needs a Senior Machine Learning Engineer to build and improve implementations of novel training methods for model fine-tuning and post-training libraries.
Requirements
- 3+ years of experience in Python development.
- Significant background in AI/ML projects or coursework (neural networks, deep learning, language models, reinforcement learning).
- Strong experience with common model architecture development and adapter frameworks (e.g. PyTorch, Transformers, PEFT, etc.).
- Familiarity with distributed training frameworks (e.g. FSDP, DeepSpeed) and inference runtimes (e.g. vLLM).
- Experience in open-source projects and collaborative development workflows.
- Existing background in software development or engineering, building robust and consumable libraries and implementations.
- Experience with unit testing, integration testing, and performance testing.
Responsibilities
- Develop core libraries for various model post-training methods and innovations.
- Work directly on upstream, open source projects and engage with community needs and contributions.
- Contribute to core post-training algorithm research and engineering, introducing new methods both to community efforts and our own Training Hub.
- Understand and adapt novel architectures and techniques to work with various post-training algorithms, across distributed training frameworks.
- Optimize, enhance, and improve robustness and usability of both existing and in-flight projects, working closely with researchers to validate prototype logic.
- Maintain and expand library feature pool, and address core algorithm bugs and blockers.
- Work closely with software engineers on interface and testing designs.
Other
- Bachelor's degree in computer science or equivalent.
- Occasional travel to partner collaboratively in our Boston, MA office multiple times per quarter.
- Successful applicants must reside in a state where Red Hat is registered to do business.
- Strong self-motivation and organizational skills.
- Excellent written and verbal communication skills.
