Promptfoo

Open-source CLI for testing prompts and red-teaming LLM apps.

Open Source Prompt Management & Testing promptfoo.dev

About Promptfoo

Promptfoo lets you define test cases for your prompts and run them locally across models, comparing outputs side by side. It also includes security and red-teaming checks.

A developer favourite for catching prompt regressions before release.

FAQ

What is Promptfoo?

Open-source CLI for testing prompts and red-teaming LLM apps.

Is Promptfoo free?

Yes. Promptfoo is open source and free to use or self-host.

What are some alternatives to Promptfoo?

Agenta, Arize Phoenix, Braintrust, DeepEval, Google AI Studio.

Alternatives to Promptfoo

All prompt management & testing →

Agenta

Open Source

Open-source platform for prompt management, evaluation and observability.

Visit ↗

Arize Phoenix

Open Source

Open-source tracing, evaluation and prompt playground for LLM apps.

Visit ↗

Braintrust

Freemium

Prompt management combined with evaluation and tracing.

Visit ↗

DeepEval

Open Source

Open-source framework for unit-testing LLM outputs.

Visit ↗

Google AI Studio

Free

Google’s free playground for writing and testing prompts with Gemini.

Visit ↗

Helicone

Open Source

Open-source LLM observability with prompt versioning and cost tracking.

Visit ↗

Langfuse

Open Source

Open-source LLM engineering platform with prompt management, tracing and evals.

Visit ↗

LangSmith

Freemium

LangChain’s platform for tracing, evaluating and managing prompts.

Visit ↗

Latitude

Open Source

Open-source platform for prompt engineering and AI agents.

Visit ↗

Lunary

Open Source

Open-source monitoring and prompt management for AI apps.

Visit ↗

Maxim AI

Freemium

End-to-end platform for prompt experimentation, evaluation and observability.

Visit ↗

MLflow Prompt Registry

Open Source

Open-source MLOps platform with GenAI tracing, evaluation and a prompt registry.

Visit ↗