promptfoo
Fewer than 5 people recommend it so far, so there's no written verdict. Here is what commenters said.
4recommend
0warn against
Jan 31, 2026first mention
Aug 21, 2026latest mention
Why people recommend it
“I used Promptpoo at the beginning of the year - it was exactly, what I needed”
“I use promptfoo for evaluation.”
Show 2 more
“my experience with Promptfoo is great at testing model outputs”
“promptfoo (Technically no programming required for an eval creator, just yaml)”
Caveats and dissent
No one in these comments warned against it.
From the makers not counted in the ranking
“co-founder of Promptfoo”
“Promptfoo eval gates blocking bad output before it persists”
“Working on promptfoo”
Threads where it came up
- OpenAI just open-sourced Codex Security 2 mentions
- A week of using Codex more than Claude 1 mention
- Launch HN: Speko (YC S26) – OpenRouter for Voice AI 1 mention
- Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding? 1 mention
- Ask HN: Who wants to be hired? (June 2026) 1 mention
- OpenAI Acquires Promptfoo 1 mention
Also written as Promptfoo. Data: promptfoo.json. Quotes are verbatim; the verdict and theme labels are written by a model from these comments, and every clause links to its sources.
All comments 6
“I also have some custom evals using promptfoo to make sure I’m not introducing regressions when switching models.”
“"promptfoo of voice models": that is closer to how it started.”
“I used Promptpoo at the beginning of the year - it was exactly, what I needed”
“I use promptfoo for evaluation.”
“my experience with Promptfoo is great at testing model outputs”
“promptfoo (Technically no programming required for an eval creator, just yaml)”