Promptfoo is described as 'Open-source tool for automated LLM prompt, agent, and RAG evaluation, supporting red teaming, multi-model comparisons, CI/CD, CLI, and vulnerability scanning' and is an app in the development category. There are six alternatives to Promptfoo for a variety of platforms, including Mac, Windows, Linux, Web-based and SaaS apps. The best Promptfoo alternative is AgentInspect, which is both free and Open Source. Other great apps like Promptfoo are Langfuse, Provael, Corrath and Kiln AI.
AgentInspect captures framework-native TypeScript agent runs as local execution trees, derives deterministic TraceFacts and TraceContract checks for CI, and packages share-checked Evidence v2 artifacts for offline review.
Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more.
Germany
EU
Red-team open vision-language-action robot policies in simulation and get an attack success rate with a matched benign control.
India
Corrath is an AI security gateway built for developers and organizations building with Large Language Models.
India
HandoffProbe is an open-source CLI for adversarial security testing of AI agent handoffs. It checks whether security properties such as delegated authority, principal identity, tenant continuity, approval and consent, credential audience, replay protection, cancellation, retry...
AustriaEU
Canada
