Red Hat is looking to leverage AI models to generate code and execute automated workflows, and needs a Prompt Engineer to design, test, and refine the prompts that enable these AI models to perform these tasks accurately and reliably.
Requirements
- Hands-on experience working with large language models (e.g., GPT, LLaMA, Claude) for code generation or workflow automation.
- Strong coding skills in Python or a similar language, with the ability to integrate AI outputs into backend or frontend systems.
- Familiarity with testing methodologies and frameworks, including unit, integration, and regression testing.
- Prior experience with AI-assisted development tools or IDE integrations.
- Knowledge of prompt-engineering best practices, including bias mitigation and output evaluation metrics.
- Familiarity with model performance metrics such as functional correctness, ROUGE, or BLEU.
Responsibilities
- Design, iterate, and optimize prompts for AI-assisted code generation and workflow execution.
- Collaborate with product owners, developers, and QA to translate feature requirements into effective prompting strategies and evaluation benchmarks.
- Validate AI-generated outputs through structured test cases, regression testing, and performance evaluation.
- Build or adapt internal tooling to streamline prompt testing, versioning, and deployment.
- Capture insights from prompt performance, including failure modes, and iterate toward more consistent, high-quality results.
- Document prompt patterns, metrics, and best practices to support knowledge sharing across the team.
Other
- Bachelor's degree in Computer Science, Engineering, or related field, or equivalent practical experience.
- Excellent analytical, problem-solving, and communication skills.
