Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

Red Hat Logo

Senior Context Engineer-Prompt Engineering & AI Testing-Infrastructure

Red Hat

$170,770 - $281,770
Aug 27, 2025
Boston, MA, USA • Raleigh, NC, USA
Apply Now

Red Hat is looking to solve the problem of designing, testing, and maintaining systems and pipelines that support AI-driven workflows, ensuring prompt-powered features are deployed, monitored, and validated reliably at scale across multiple environments.

Requirements

  • Hands-on experience with DevOps tools and practices, including CI/CD systems (Jenkins, GitLab CI), container orchestration (Kubernetes), and infrastructure-as-code.
  • Proficiency in scripting languages such as Python or Bash.
  • Strong understanding of cloud platforms (AWS, Azure, GCP) and hybrid cloud environments.
  • Experience with system monitoring, logging, and performance tuning.
  • Experience deploying or managing machine learning models in production environments.
  • Familiarity with prompt-engineering principles and AI workflow validation.
  • Knowledge of security scanning, compliance automation, and canary or A/B testing for AI systems.

Responsibilities

  • Develop and maintain CI/CD pipelines for prompt-driven workflows and AI-generated code validation.
  • Create infrastructure-as-code and automation scripts (e.g., Terraform, Ansible) to provision, configure, and monitor validation environments.
  • Build tools and frameworks for continuous prompt testing, performance tracking, and failure analysis.
  • Implement observability and alerting for prompt workflows, capturing metrics such as latency, accuracy, and error rates.
  • Integrate security and compliance checks into the prompt development lifecycle, especially for generated code execution.
  • Collaborate with engineering, QA, and platform teams to ensure prompt workflows are seamlessly integrated into existing systems.

Other

  • Bachelor’s degree in Computer Science, Software Engineering, or related field, or equivalent experience.
  • Excellent analytical and troubleshooting skills in complex, distributed environments.
  • Comprehensive medical, dental, and vision coverage
  • Paid time off and holidays
  • Paid parental leave plans for all new parents