Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

Emerald AI Logo

Software Engineer, AI/ML Systems

Emerald AI

Salary not specified
Nov 15, 2025
Oakland, CA, United States of America
Apply Now

Emerald AI is looking to solve the problem of power constraints becoming a critical bottleneck for the skyrocketing demand for compute in AI data centers. Their Emerald Conductor software platform aims to make data centers flexible and responsive, allowing them to adjust power usage dynamically to enable AI growth without overwhelming the grid, while also strengthening the grid and supporting renewable energy expansion.

Requirements

  • 3+ years of experience in systems engineering or backend infrastructure
  • Strong programming skills in more than one language (Python, Go, Rust, C++, etc.) with a focus on high-performance and reliable systems
  • Experience with ML workflows and tools (e.g., PyTorch, scikit-learn), particularly for modeling system behavior
  • Deep understanding of distributed systems, resource scheduling, and telemetry instrumentation
  • Familiarity with platforms such as Kubernetes, Slurm, Ray, or similar schedulers
  • Experience applying ML to systems problems (e.g., load prediction, anomaly detection, reinforcement learning for scheduling)
  • Knowledge of workload characteristics in AI/ML pipelines (training, inference, batch vs. real-time)

Responsibilities

  • Design and implement approaches for orchestration of AI/ML workloads considering factors such as resource allocation, load balancing, data management and performance.
  • Contribute to the design and implementation of performance monitoring of various optimization strategies.
  • Plan and conduct experiments with training and inference workloads using state-of-the-art AI models, such as LLMs.
  • Contribute to the design and development of mechanisms for power optimization and control with your deep knowledge of AI systems design.
  • Develop models for forecasting various parameters of data center compute jobs and demand.

Other

  • Bachelors / Masters in Computer Science, Computer Engineering or Electrical Engineering with 5+ years of experience or a PhD degree in relevant field with 2+ years of industry experience.
  • Work from D.C., Boston, or the Bay Area, with 1 WFH day/week.
  • Make an impact. Solve the AI power bottleneck and shape how data centers scale sustainably.
  • Join a world-class team of AI, cloud, software, and energy experts in a collaborative, low-ego environment.
  • Build from 0→1. Influence strategy, GTM, org design, and customer/investor engagement from day one.