Rakuten Institute of Technology (RIT) is looking to enhance its in-house Large Language Models (LLMs) and integrate them into Rakuten's services to impact millions of users worldwide.
Requirements
- Experience participating in machine learning projects, having completed the entire cycle of model training, experimental design, and evaluation.
- Basic knowledge and understanding of natural language processing, deep learning and generative AI, including LLMs, RAG, and AI agents, and a passion for staying at the forefront of these technologies.
- High-level coding skills in Python, with a strong understanding of software engineering principles.
- Experience in pre-training/fine-tuning existing LLMs (> 1B) using PyTorch.
- Familiarity with efficient training and inference techniques such as LoRA, pruning, knowledge distillation, and mixed precision training.
- Experience with distributed training frameworks such as DeepSpeed and FSDP.
- Experience in developing software to process a large-scale dataset using a distributed computing framework (e.g., Hadoop)
Responsibilities
- Develop and train LLMs, including data processing, pre-training, and fine-tuning. This also includes designing and running experiments, writing code, and evaluating results.
- Implement and verify latest technologies in Deep Learning, LLMs and AI agent fields, and reflect the implementation into in-house machine learning libraries.
- Work collaboratively with globally distributed people in a range of roles, including researchers, engineers, product managers, designers, and other key product stakeholders to accomplish complex tasks that deliver value to our business.
- Present findings and insights in team meetings and contributing to project documentation.
- Stay up to date on research and product advances in AI.
Other
- Proven experience in a research-focused role within industry, academia, or government institutions.
- Strong communication skills to understand and effectively convey technical information.
- A strong emphasis on teamwork and a proactive attitude towards learning.
- Ability to speak, write, and communicate in Japanese is a plus
- Experience presenting as first author at top-tier peer-reviewed conferences.
