Promptfoo
ChatGPT pluginMake for all
- Featured
- No
not on the featured shelf
Movement
From our daily snapshots over the last 30 days.
Rank by placement
Rank in Developer tools
In its category
How this plugin compares with others in the same category. Positions are counted within the category, not across the whole directory.
Developer tools449th of 537 by placement
| # | Plugin | Position | 7d |
|---|---|---|---|
| 446 | #5200 | — | |
| 447 | #5207 | — | |
| 448 | #5209 | — | |
| 449 | #5213 | — | |
| 450 | #5216 | — | |
| 451 | #5220 | — | |
| 452 | #5221 | — |
Promptfoo skills for configuring providers and targets, writing eval suites, and setting up or running red team workflows against LLM apps.
Example prompts
- “Write a Promptfoo eval for this behavior.”
- “Use Promptfoo to connect my HTTP endpoint to an eval.”
- “Set up or run Promptfoo red teaming for this API.”
Skills
promptfoo-evals
Write, run, and improve non-redteam Promptfoo eval suites for a configured target: test cases, assertions, rubrics, datasets, and CI gates. Use promptfoo-provider-setup first for a new or broken connection; use the redteam skills for adversarial scans.
promptfoo-provider-setup
Connect Promptfoo to a model, live HTTP API, local Python/JavaScript provider, or app code. Use for request/auth mapping, response parsing, OpenAPI setup, and connection smoke tests. Use promptfoo-evals for broader eval coverage and promptfoo-redteam-setup for attack selection.
promptfoo-redteam-run
Execute, inspect, and rerun an existing Promptfoo redteam scan. Use for generated YAML, result exports, attack success rates, grader/target errors, filtered reruns, and CI gates. Use promptfoo-provider-setup for connections and promptfoo-redteam-setup for new scan plans.
promptfoo-redteam-setup
Create or refine a Promptfoo redteam config and generate probes from target behavior, code, or OpenAPI evidence. Use for purpose, trust boundaries, plugins, strategies, and grading guidance. Use promptfoo-provider-setup for connection work and promptfoo-redteam-run for an existing scan.
- Categories
- Sign-in
- On Install
- Capabilities
- Read, Write
- Availability
- Available
- Version
- 0.1.3
- Keywords
- eval, redteam, llm, testing, promptfoo
- Created
- September 22, 2026
- More info