Tenstorrent is looking for a Senior Machine Learning Engineer to develop realistic demonstrations of AI applications and APIs for the Tenstorrent Cloud, aiming to revolutionize AI performance, ease of use, and cost efficiency by unifying innovations in software models, compilers, platforms, networking, and semiconductors.
Requirements
- Fluent in Python; experience with Pytorch and HuggingFace models.
- Have used and developed APIs for AI/ML applications.
- Experienced with AI serving frameworks such as vllm, llm-d, LlamaIndex, torchserve, etc.
- Experienced in performance benchmarking, profiling, and real-time system optimization.
- Experienced with Containers, Docker, Git, CI/CD, Agile.
Responsibilities
- Hands-on design, development, and support of realistic demonstrations of AI applications running on Tenstorrent hardware in our cloud.
- Your help in anticipating, clarifying, and de-risking technological requirements for such demonstrations.
- Your help encouraging development and design choices in sustainable directions that will allow our capabilities to compound.
- Your support enabling customer access to trying our latest hardware and software.
- Developing realistic demonstrations of AI applications, and APIs for them, for the Tenstorrent Cloud.
- Experience spanning into platform infrastructure and Kubernetes is also highly valuable.
Other
- This role is hybrid OR remote, based out of Santa Clara, CA, Austin, TX, Toronto, ON.
- Compensation for all engineers at Tenstorrent ranges from $100k - $500k including base and variable compensation targets.
- Tenstorrent offers a highly competitive compensation package and benefits, and we are an equal opportunity employer.
- This offer of employment is contingent upon the applicant being eligible to access U.S. export-controlled technology.
- Due to U.S. export laws, including those codified in the U.S. Export Administration Regulations (EAR), the Company is required to ensure compliance with these laws when transferring technology to nationals of certain countries (such as EAR Country Groups D:1, E1, and E2).
