#promptfoo

Want the full 46-page handbook? Promptfoo for QA: The Complete Engineer's Handbook (2026 Edition) by...

How to build an LLM-as-judge eval system that scores AI agent prompts on quality, identity, and safety.

Red Team Frameworks and Plugins OWASP LLM Top 10 OWASP ID Risk Description Promptfoo...

Qwen3-Coder isn’t just another code model—it’s a breakthrough in agentic code intelligence, made...

Moonshot Labs just changed the game with Kimi K2—a one-trillion parameter, open-source LLM built...

Introduction Have you ever wondered if AI could write an entire book — from idea to...

Red teaming isn’t just for enterprise apps anymore — if you’re running models locally, it’s time to...

Promptfoo is your go-to toolkit when you want to test how well your prompts, chat agents, or RAG...

In this blog post, I explore Promptfoo, a CLI and library that transforms LLM development with its test-driven approach. Through a hands-on project, readers will learn how to utilize Promptfoo to systematically test, evaluate, and improve LLM outputs. From setting up your evaluation framework to analyzing side-by-side comparisons of model performances, this guide provides all the necessary steps and insights for leveraging Promptfoo in your LLM projects. Whether you're new to LLM development or looking to refine your prompt engineering skills, this post will equip you with the knowledge to effectively use Promptfoo.