Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

Upwork Logo

Principal ML Infrastructure Engineer

Upwork

$216,500 - $390,750
Aug 26, 2025
Remote, US
Apply Now

Upwork is seeking a Principal ML Infrastructure Engineer to design, develop, and maintain robust and scalable ML infrastructure components to support the company's machine learning initiatives.

Requirements

  • Senior/Leadership level experience in ML infrastructure engineering, ideally at an innovative technology company.
  • Solid foundation in software engineering and ML concepts.
  • Compute: AWS, EKS, Databricks
  • Data: Snowflake, S3, SQLMesh, Feast
  • Workflow Automation: Airflow
  • Experiment Tracking: Weights & Biases, MLflow
  • LLM Inference: Fireworks, in-house deployment on EKS

Responsibilities

  • Own technical workstreams from start to finish, contribute to the team’s product roadmap, and be responsible for major technical decisions and tradeoffs.
  • Design, implement, and optimize distributed systems and infrastructure components to support large-scale machine learning workflows.
  • Develop and maintain frameworks, libraries, and tools to streamline the end-to-end machine learning lifecycle.
  • Architect and implement highly available, fault-tolerant, and secure systems that meet the performance and scalability requirements of production machine learning workloads.
  • Collaborate and publish with machine learning researchers and data scientists on novel research and translate research into scalable and efficient software solutions.
  • Stay current with the latest advancements in machine learning infrastructure, distributed computing, and cloud technologies, and integrate them into our platform to drive innovation.
  • Mentor teammates, conduct code reviews, and uphold engineering best practices to ensure the delivery of high-quality software solutions.

Other

  • Proven Impact: Show us your track record of delivering impactful solutions.
  • Innovative Thinker: Bring creativity and fresh ideas to the table.
  • Collaborative Mindset: Strong communication and teamwork skills are a must.
  • Continuous Learner: Stay updated with the latest advancements in the field of AI.
  • Comprehensive medical insurance coverage for both you and your family
  • Unlimited paid time off
  • 401(k) plan with matching contributions
  • 12 weeks of paid parental leave
  • Employee Stock Purchase Plan