Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

San Francisco Compute Company Logo

Software Engineer - Large Scale Inference

San Francisco Compute Company

Salary not specified
Oct 8, 2025
San Francisco, California, US
Apply Now

SF Compute aims to solve the problem of compute being a commodity that is not easily accessible or affordable for startups, and compute providers facing financial instability due to underutilized clusters. The company is building a real-time trading venue for compute contracts to address this.

Requirements

  • SQL experience
  • previously scaled distributed work scheduling systems
  • comfortable working in Rust
  • some Kubernetes or terraform experience

Responsibilities

  • build and scale software systems that accept, distribute, and purchase compute for inference work loads
  • building out and defining the inference products at SFC
  • Quantify, optimize, and visualize the unit economics of inference
  • Design solutions to maximize compute utilization
  • Create automated compute purchasing software to optimally fulfill inference job demand
  • Scale inference software pipeline systems to hundred trillion token scale

Other

  • You enjoy the craftsmanship of software
  • You’re a thoughtful high-agency engineer
  • Have a deep appreciation for reliable fault tolerant systems
  • Are a strong communicator and work well with others
  • Visa Sponsorships