Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

Arize AI Logo

Senior AI Product Engineer, Backend

Arize AI

$125,000 - $225,000
Sep 29, 2025
Remote, US
Apply Now

Arize AI is looking to build and deploy high-performing, reliable models as the AI landscape shifts from traditional ML to generative AI and agentic systems.

Requirements

  • Strong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages.
  • Knowledge of working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etc.
  • Experience with distributed stream processing - Kafka, Gazette, or similar.
  • Experience with OLAP systems.
  • Familiarity with system observability tooling like Prometheus.
  • Working knowledge of Machine Learning and/or Data Science.
  • First-hand experience working with large language models (LLMs) or developing AI products.

Responsibilities

  • Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript.
  • Build high-volume and highly available analytics systems.
  • Design and build APIs specific to our customers’ Machine Learning and LLM workflows.
  • Prototype, optimize, and maintain scalable backend services that power the Arize core platform.
  • Extend, and contribute back to, open source OLAP databases and distributed message queue frameworks.
  • Develop and integrate collection tools for robust monitoring of ML and LLM pipelines.
  • Research and implement cutting-edge visualization & dimensionality reduction algorithms in a distributed environment.

Other

  • 5+ years of experience working with high-performance backend systems.
  • Previous work building and operating highly complex SaaS platforms/systems.
  • Enthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologies.
  • Collaborate with our product, design, and directly with customer engineering teams to enhance and expand our product offerings.
  • Contribute to the build our own in-house AI Agents
  • Estimated annual salary for this role is between $125,000 - $225,000, plus a competitive equity package.
  • Comprehensive benefits package, including medical, dental, vision, a 401(k) plan, unlimited paid time off, a generous parental leave plan, and additional support for mental health and wellness.