PromptFoo
Open-source CLI for testing, evaluating, and red-teaming LLM applications
PromptFoo is an open-source tool for testing and evaluating LLM outputs. It lets you compare prompts and models side-by-side across 50+ providers, define test cases in declarative YAML with assertions and scoring, and red-team LLM apps against 50+ vulnerability types including jailbreaks and prompt injection. Results are viewable in a terminal matrix or built-in web UI. Integrates into CI/CD pipelines to gate deployments on eval results. Used by 200,000+ developers and 80+ Fortune 500 companies.
Pricing: Free / enterprise
PromptFoo Alternatives
Explore 14 products in the Prompt engineering category. View all PromptFoo alternatives.
Orq.ai
Sovereign AI gateway and LLMOps platform: model routing, prompt management, evals, and governance
Work on PromptFoo? Feature it at the top of Prompt engineering.
Is your product missing?