Top Sites>Build Secure AI Applications | Promptfoo

User-agent: *
Allow: /
Sitemap: https://www.promptfoo.dev/sitemap.xml

# Promptfoo

## Docs

- [Api Reference](/docs/api-reference/)
- [Tags](/docs/tags/)
- [Changelog](/docs/tags/changelog/)
- [Custom](/docs/tags/custom/)
- [Features](/docs/tags/features/)
- [Multi Turn](/docs/tags/multi-turn/)
- [Red Team](/docs/tags/red-team/)
- [Releases](/docs/tags/releases/)
- [Strategies](/docs/tags/strategies/)
- [Updates](/docs/tags/updates/)
- [Configuration](/docs/category/configuration/)
- [Integrations](/docs/category/integrations/)
- [Usage](/docs/category/usage/)
- [Code Scanning](/docs/code-scanning/)
- [Cli](/docs/code-scanning/cli/)
- [Github Action](/docs/code-scanning/github-action/)
- [Vscode Extension](/docs/code-scanning/vscode-extension/)
- [Caching](/docs/configuration/caching/)
- [Chat](/docs/configuration/chat/)
- [Datasets](/docs/configuration/datasets/)
- [Expected Outputs](/docs/configuration/expected-outputs/)
- [Classifier](/docs/configuration/expected-outputs/classifier/)
- [Deterministic](/docs/configuration/expected-outputs/deterministic/)
- [Guardrails](/docs/configuration/expected-outputs/guardrails/)
- [Javascript](/docs/configuration/expected-outputs/javascript/)
- [Model Graded](/docs/configuration/expected-outputs/model-graded/)
- [Answer Relevance](/docs/configuration/expected-outputs/model-graded/answer-relevance/)
- [Context Faithfulness](/docs/configuration/expected-outputs/model-graded/context-faithfulness/)
- [Context Recall](/docs/configuration/expected-outputs/model-graded/context-recall/)
- [Context Relevance](/docs/configuration/expected-outputs/model-graded/context-relevance/)
- [Conversation Relevance](/docs/configuration/expected-outputs/model-graded/conversation-relevance/)
- [Factuality](/docs/configuration/expected-outputs/model-graded/factuality/)
- [G Eval](/docs/configuration/expected-outputs/model-graded/g-eval/)
- [Llm Rubric](/docs/configuration/expected-outputs/model-graded/llm-rubric/)
- [Max Score](/docs/configuration/expected-outputs/model-graded/max-score/)
- [Model Graded Closedqa](/docs/configuration/expected-outputs/model-graded/model-graded-closedqa/)
- [Pi](/docs/configuration/expected-outputs/model-graded/pi/)
- [Search Rubric](/docs/configuration/expected-outputs/model-graded/search-rubric/)
- [Select Best](/docs/configuration/expected-outputs/model-graded/select-best/)
- [Moderation](/docs/configuration/expected-outputs/moderation/)
- [Python](/docs/configuration/expected-outputs/python/)
- [Ruby](/docs/configuration/expected-outputs/ruby/)
- [Similar](/docs/configuration/expected-outputs/similar/)
- [Guide](/docs/configuration/guide/)
- [Huggingface Datasets](/docs/configuration/huggingface-datasets/)
- [Modular Configs](/docs/configuration/modular-configs/)
- [Outputs](/docs/configuration/outputs/)
- [Parameters](/docs/configuration/parameters/)
- [Prompts](/docs/configuration/prompts/)
- [Rate Limits](/docs/configuration/rate-limits/)
- [Reference](/docs/configuration/reference/)
- [Scenarios](/docs/configuration/scenarios/)
- [Telemetry](/docs/configuration/telemetry/)
- [Test Cases](/docs/configuration/test-cases/)
- [Testing Llm Chains](/docs/configuration/testing-llm-chains/)
- [Tools](/docs/configuration/tools/)
- [Contributing](/docs/contributing/)
- [Enterprise](/docs/enterprise/)
- [Audit Logging](/docs/enterprise/audit-logging/)
- [Authentication](/docs/enterprise/authentication/)
- [Findings](/docs/enterprise/findings/)
- [Guardrails](/docs/enterprise/guardrails/)
- [Red Teams](/docs/enterprise/red-teams/)
- [Remediation Reports](/docs/enterprise/remediation-reports/)
- [Service Accounts](/docs/enterprise/service-accounts/)
- [Teams](/docs/enterprise/teams/)
- [Webhooks](/docs/enterprise/webhooks/)
- [Faq](/docs/faq/)
- [Getting Started](/docs/getting-started/)
- [Guides](/docs/guides/)
- [Azure Vs Openai](/docs/guides/azure-vs-openai/)
- [Censored Vs Uncensored Ollama](/docs/guides/censored-vs-uncensored-ollama/)
- [Chatbase Redteam](/docs/guides/chatbase-redteam/)
- [Choosing Best Gpt Model](/docs/guides/choosing-best-gpt-model/)
- [Compare Open Source Models](/docs/guides/compare-open-source-models/)
- [Deepseek Benchmark](/docs/guides/deepseek-benchmark/)
- [Evaling With Harmbench](/docs/guides/evaling-with-harmbench/)
- [Evaluate Coding Agents](/docs/guides/evaluate-coding-agents/)
- [Evaluate Crewai](/docs/guides/evaluate-crewai/)
- [Evaluate Elevenlabs](/docs/guides/evaluate-elevenlabs/)
- [Evaluate Json](/docs/guides/evaluate-json/)
- [Evaluate Langgraph](/docs/guides/evaluate-langgraph/)
- [Evaluate Llm Temperature](/docs/guides/evaluate-llm-temperature/)
- [Evaluate Openai Agents Python](/docs/guides/evaluate-openai-agents-python/)
- [Evaluate Openai Assistants](/docs/guides/evaluate-openai-assistants/)
- [Evaluate Rag](/docs/guides/evaluate-rag/)
- [Factuality Eval](/docs/guides/factuality-eval/)
- [Google Cloud Model Armor](/docs/guides/google-cloud-model-armor/)
- [Gpt Mmlu Comparison](/docs/guides/gpt-mmlu-comparison/)
- [Gpt Vs Claude Vs Gemini](/docs/guides/gpt-vs-claude-vs-gemini/)
- [Gpt Vs Reasoning Model](/docs/guides/gpt-vs-reasoning-model/)
- [Hle Benchmark](/docs/guides/hle-benchmark/)
- [Langchain Prompttemplate](/docs/guides/langchain-prompttemplate/)
- [Llm As A Judge](/docs/guides/llm-as-a-judge/)
- [Llm Redteaming](/docs/guides/llm-redteaming/)
- [Mixtral Vs Gpt](/docs/guides/mixtral-vs-gpt/)
- [Multimodal Red Team](/docs/guides/multimodal-red-team/)
- [Prevent Llm Hallucinations](/docs/guides/prevent-llm-hallucinations/)
- [Qwen Benchmark](/docs/guides/qwen-benchmark/)
- [Sandboxed Code Evals](/docs/guides/sandboxed-code-evals/)
- [Testing Guardrails](/docs/guides/testing-guardrails/)
- [Text To Sql Evaluation](/docs/guides/text-to-sql-evaluation/)
- [Installation](/docs/installation/)
- [Agent Skill](/docs/integrations/agent-skill/)
- [Aws Codecommit](/docs/integrations/aws-codecommit/)
- [Azure Pipelines](/docs/integrations/azure-pipelines/)
- [Bitbucket Pipelines](/docs/integrations/bitbucket-pipelines/)
- [Burp](/docs/integrations/burp/)
- [Ci Cd](/docs/integrations/ci-cd/)
- [Circle Ci](/docs/integrations/circle-ci/)
- [Github Action](/docs/integrations/github-action/)
- [Gitlab Ci](/docs/integrations/gitlab-ci/)
- [Google Sheets](/docs/integrations/google-sheets/)
- [Helicone](/docs/integrations/helicone/)
- [Jenkins](/docs/integrations/jenkins/)
- [Jest](/docs/integrations/jest/)
- [Langfuse](/docs/integrations/langfuse/)
- [Looper](/docs/integrations/looper/)
- [Mcp Server](/docs/integrations/mcp-server/)
- [Mcp](/docs/integrations/mcp/)
- [Mocha Chai](/docs/integrations/mocha-chai/)
- [N8n](/docs/integrations/n8n/)
- [Portkey](/docs/integrations/portkey/)
- [Python](/docs/integrations/python/)
- [Sharepoint](/docs/integrations/sharepoint/)
- [Sonarqube](/docs/integrations/sonarqube/)
- [Splunk](/docs/integrations/splunk/)
- [Travis Ci](/docs/integrations/travis-ci/)
- [Intro](/docs/intro/)
- [Model Audit](/docs/model-audit/)
- [Ci Cd](/docs/model-audit/ci-cd/)
- [Scanners](/docs/model-audit/scanners/)
- [Usage](/docs/model-audit/usage/)
- [Providers](/docs/providers/)
- [Abliteration](/docs/providers/abliteration/)
- [Ai21](/docs/providers/ai21/)
- [Aimlapi](/docs/providers/aimlapi/)
- [Alibaba](/docs/providers/alibaba/)
- [Anthropic](/docs/providers/anthropic/)
- [Aws Bedrock](/docs/providers/aws-bedrock/)
- [Azure](/docs/providers/azure/)
- [Bedrock Agents](/docs/providers/bedrock-agents/)
- [Browser](/docs/providers/browser/)
- [Cerebras](/docs/providers/cerebras/)
- [Claude Agent Sdk](/docs/providers/claude-agent-sdk/)
- [Cloudera](/docs/providers/cloudera/)
- [Cloudflare Ai](/docs/providers/cloudflare-ai/)
- [Cloudflare Gateway](/docs/providers/cloudflare-gateway/)
- [Cohere](/docs/providers/cohere/)
- [Cometapi](/docs/providers/cometapi/)
- [Custom Api](/docs/providers/custom-api/)
- [Custom Script](/docs/providers/custom-script/)
- [Databricks](/docs/providers/databricks/)
- [Deepseek](/docs/providers/deepseek/)
- [Docker](/docs/providers/docker/)
- [Echo](/docs/providers/echo/)
- [Elevenlabs](/docs/providers/elevenlabs/)
- [Envoy](/docs/providers/envoy/)
- [F5](/docs/providers/f5/)
- [Fal](/docs/providers/fal/)
- [Fireworks](/docs/providers/fireworks/)
- [Github](/docs/providers/github/)
- [Go](/docs/providers/go/)
- [Google](/docs/providers/google/)
- [Groq](/docs/providers/groq/)
- [Helicone](/docs/providers/helicone/)
- [Http](/docs/providers/http/)
- [Huggingface](/docs/providers/huggingface/)
- [Hyperbolic](/docs/providers/hyperbolic/)
- [Ibm Bam](/docs/providers/ibm-bam/)
- [Jfrog](/docs/providers/jfrog/)
- [Litellm](/docs/providers/litellm/)
- [Llama.cpp](/docs/providers/llama.cpp/)
- [LlamaApi](/docs/providers/llamaApi/)
- [Llamafile](/docs/providers/llamafile/)
- [Localai](/docs/providers/localai/)
- [Manual Input](/docs/providers/manual-input/)
- [Mcp](/docs/providers/mcp/)
- [Mistral](/docs/providers/mistral/)
- [Modelslab](/docs/providers/modelslab/)
- [Nscale](/docs/providers/nscale/)
- [Ollama](/docs/providers/ollama/)
- [Openai Agents](/docs/providers/openai-agents/)
- [Openai Chatkit](/docs/providers/openai-chatkit/)
- [Openai Codex App Server](/docs/providers/openai-codex-app-server/)
- [Openai Codex Sdk](/docs/providers/openai-codex-sdk/)
- [Openai](/docs/providers/openai/)
- [Openclaw](/docs/providers/openclaw/)
- [Opencode Sdk](/docs/providers/opencode-sdk/)
- [Openllm](/docs/providers/openllm/)
- [Openrouter](/docs/providers/openrouter/)
- [Perplexity](/docs/providers/perplexity/)
- [Python](/docs/providers/python/)
- [Quiverai](/docs/providers/quiverai/)
- [Replicate](/docs/providers/replicate/)
- [Ruby](/docs/providers/ruby/)
- [Sagemaker](/docs/providers/sagemaker/)
- [Sequence](/docs/providers/sequence/)
- [Simulated User](/docs/providers/simulated-user/)
- [Slack](/docs/providers/slack/)
- [Snowflake](/docs/providers/snowflake/)
- [Text Generation Webui](/docs/providers/text-generation-webui/)
- [Togetherai](/docs/providers/togetherai/)
- [Transformers](/docs/providers/transformers/)
- [Truefoundry](/docs/providers/truefoundry/)
- [Vercel](/docs/providers/vercel/)
- [Vertex](/docs/providers/vertex/)
- [Vllm](/docs/providers/vllm/)
- [Voyage](/docs/providers/voyage/)
- [Watsonx](/docs/providers/watsonx/)
- [Webhook](/docs/providers/webhook/)
- [Websocket](/docs/providers/websocket/)
- [Xai](/docs/providers/xai/)
- [Red Team](/docs/red-team/)
- [Agents](/docs/red-team/agents/)
- [Architecture](/docs/red-team/architecture/)
- [Coding Agents](/docs/red-team/coding-agents/)
- [Configuration](/docs/red-team/configuration/)
- [Discovery](/docs/red-team/discovery/)
- [Dod Ai Ethics](/docs/red-team/dod-ai-ethics/)
- [Eu Ai Act](/docs/red-team/eu-ai-act/)
- [Foundation Models](/docs/red-team/foundation-models/)
- [Gdpr](/docs/red-team/gdpr/)
- [Guides](/docs/red-team/guides/)
- [Iso 42001](/docs/red-team/iso-42001/)
- [Llm Supply Chain](/docs/red-team/llm-supply-chain/)
- [Llm Vulnerability Types](/docs/red-team/llm-vulnerability-types/)
- [Mcp Security Testing](/docs/red-team/mcp-security-testing/)
- [Mitre Atlas](/docs/red-team/mitre-atlas/)
- [Model Drift](/docs/red-team/model-drift/)
- [Multi Input](/docs/red-team/multi-input/)
- [Nist Ai Rmf](/docs/red-team/nist-ai-rmf/)
- [Owasp Agentic Ai](/docs/red-team/owasp-agentic-ai/)
- [Owasp Api Top 10](/docs/red-team/owasp-api-top-10/)
- [Owasp Llm Top 10](/docs/red-team/owasp-llm-top-10/)
- [Plugins](/docs/red-team/plugins/)
- [Aegis](/docs/red-team/plugins/aegis/)
- [Age Bias](/docs/red-team/plugins/age-bias/)
- [Ascii Smuggling](/docs/red-team/plugins/ascii-smuggling/)
- [Beavertails](/docs/red-team/plugins/beavertails/)
- [Bfla](/docs/red-team/plugins/bfla/)
- [Bias](/docs/red-team/plugins/bias/)
- [Bola](/docs/red-team/plugins/bola/)
- [Coding Agent](/docs/red-team/plugins/coding-agent/)
- [Competitors](/docs/red-team/plugins/competitors/)
- [Context Compliance Attack](/docs/red-team/plugins/context-compliance-attack/)
- [Contracts](/docs/red-team/plugins/contracts/)
- [Coppa](/docs/red-team/plugins/coppa/)
- [Cross Session Leak](/docs/red-team/plugins/cross-session-leak/)
- [Custom](/docs/red-team/plugins/custom/)
- [Cyberseceval](/docs/red-team/plugins/cyberseceval/)
- [Data Exfil](/docs/red-team/plugins/data-exfil/)
- [Debug Access](/docs/red-team/plugins/debug-access/)
- [Disability Bias](/docs/red-team/plugins/disability-bias/)
- [Divergent Repetition](/docs/red-team/plugins/divergent-repetition/)
- [Donotanswer](/docs/red-team/plugins/donotanswer/)
- [Ecommerce](/docs/red-team/plugins/ecommerce/)
- [Excessive Agency](/docs/red-team/plugins/excessive-agency/)
- [Ferpa](/docs/red-team/plugins/ferpa/)
- [Financial](/docs/red-team/plugins/financial/)
- [Gender Bias](/docs/red-team/plugins/gender-bias/)
- [Goal Misalignment](/docs/red-team/plugins/goal-misalignment/)
- [Hallucination](/docs/red-team/plugins/hallucination/)
- [Harmbench](/docs/red-team/plugins/harmbench/)
- [Harmful](/docs/red-team/plugins/harmful/)
- [Hijacking](/docs/red-team/plugins/hijacking/)
- [Imitation](/docs/red-team/plugins/imitation/)
- [Indirect Prompt Injection](/docs/red-team/plugins/indirect-prompt-injection/)
- [Insurance](/docs/red-team/plugins/insurance/)
- [Intent](/docs/red-team/plugins/intent/)
- [Malicious Code](/docs/red-team/plugins/malicious-code/)
- [Mcp](/docs/red-team/plugins/mcp/)
- [Medical](/docs/red-team/plugins/medical/)
- [Memory Poisoning](/docs/red-team/plugins/memory-poisoning/)
- [Model Identification](/docs/red-team/plugins/model-identification/)
- [Off Topic](/docs/red-team/plugins/off-topic/)
- [Overreliance](/docs/red-team/plugins/overreliance/)
- [Pharmacy](/docs/red-team/plugins/pharmacy/)
- [Pii](/docs/red-team/plugins/pii/)
- [Pliny](/docs/red-team/plugins/pliny/)
- [Policy](/docs/red-team/plugins/policy/)
- [Politics](/docs/red-team/plugins/politics/)
- [Prompt Extraction](/docs/red-team/plugins/prompt-extraction/)
- [Race Bias](/docs/red-team/plugins/race-bias/)
- [Rag Document Exfiltration](/docs/red-team/plugins/rag-document-exfiltration/)
- [Rag Poisoning](/docs/red-team/plugins/rag-poisoning/)
- [Rag Source Attribution](/docs/red-team/plugins/rag-source-attribution/)
- [Rbac](/docs/red-team/plugins/rbac/)
- [Realestate](/docs/red-team/plugins/realestate/)
- [Reasoning Dos](/docs/red-team/plugins/reasoning-dos/)
- [Religion](/docs/red-team/plugins/religion/)
- [Shell Injection](/docs/red-team/plugins/shell-injection/)
- [Special Token Injection](/docs/red-team/plugins/special-token-injection/)
- [Sql Injection](/docs/red-team/plugins/sql-injection/)
- [Ssrf](/docs/red-team/plugins/ssrf/)
- [System Prompt Override](/docs/red-team/plugins/system-prompt-override/)
- [Teen Safety](/docs/red-team/plugins/teen-safety/)
- [Telecom](/docs/red-team/plugins/telecom/)
- [Tool Discovery](/docs/red-team/plugins/tool-discovery/)
- [Toxic Chat](/docs/red-team/plugins/toxic-chat/)
- [Unsafebench](/docs/red-team/plugins/unsafebench/)
- [Unverifiable Claims](/docs/red-team/plugins/unverifiable-claims/)
- [Vlguard](/docs/red-team/plugins/vlguard/)
- [Vlsu](/docs/red-team/plugins/vlsu/)
- [Wordplay](/docs/red-team/plugins/wordplay/)
- [Xstest](/docs/red-team/plugins/xstest/)
- [Quickstart](/docs/red-team/quickstart/)
- [Rag](/docs/red-team/rag/)
- [Risk Scoring](/docs/red-team/risk-scoring/)
- [Strategies](/docs/red-team/strategies/)
- [Audio](/docs/red-team/strategies/audio/)
- [Authoritative Markup Injection](/docs/red-team/strategies/authoritative-markup-injection/)
- [Base64](/docs/red-team/strategies/base64/)
- [Basic](/docs/red-team/strategies/basic/)
- [Best Of N](/docs/red-team/strategies/best-of-n/)
- [Citation](/docs/red-team/strategies/citation/)
- [Composite Jailbreaks](/docs/red-team/strategies/composite-jailbreaks/)
- [Custom Strategy](/docs/red-team/strategies/custom-strategy/)
- [Custom](/docs/red-team/strategies/custom/)
- [Gcg](/docs/red-team/strategies/gcg/)
- [Goat](/docs/red-team/strategies/goat/)
- [Hex](/docs/red-team/strategies/hex/)
- [Homoglyph](/docs/red-team/strategies/homoglyph/)
- [Hydra](/docs/red-team/strategies/hydra/)
- [Image](/docs/red-team/strategies/image/)
- [Indirect Web Pwn](/docs/red-team/strategies/indirect-web-pwn/)
- [Iterative](/docs/red-team/strategies/iterative/)
- [Jailbreak Templates](/docs/red-team/strategies/jailbreak-templates/)
- [Layer](/docs/red-team/strategies/layer/)
- [Leetspeak](/docs/red-team/strategies/leetspeak/)
- [Likert](/docs/red-team/strategies/likert/)
- [Math Prompt](/docs/red-team/strategies/math-prompt/)
- [Meta](/docs/red-team/strategies/meta/)
- [Mischievous User](/docs/red-team/strategies/mischievous-user/)
- [Multi Turn](/docs/red-team/strategies/multi-turn/)
- [Other Encodings](/docs/red-team/strategies/other-encodings/)
- [Prompt Injection](/docs/red-team/strategies/prompt-injection/)
- [Retry](/docs/red-team/strategies/retry/)
- [Rot13](/docs/red-team/strategies/rot13/)
- [Tree](/docs/red-team/strategies/tree/)
- [Video](/docs/red-team/strategies/video/)
- [Attack Generation](/docs/red-team/troubleshooting/attack-generation/)
- [Best Practices](/docs/red-team/troubleshooting/best-practices/)
- [Connecting To Targets](/docs/red-team/troubleshooting/connecting-to-targets/)
- [Data Handling](/docs/red-team/troubleshooting/data-handling/)
- [False Positives](/docs/red-team/troubleshooting/false-positives/)
- [Grading Results](/docs/red-team/troubleshooting/grading-results/)
- [Inference Limit](/docs/red-team/troubleshooting/inference-limit/)
- [Linking Targets](/docs/red-team/troubleshooting/linking-targets/)
- [Multi Turn Sessions](/docs/red-team/troubleshooting/multi-turn-sessions/)
- [Multiple Response Types](/docs/red-team/troubleshooting/multiple-response-types/)
- [Overview](/docs/red-team/troubleshooting/overview/)
- [Remote Generation](/docs/red-team/troubleshooting/remote-generation/)
- [Releases](/docs/releases/)
- [Tracing](/docs/tracing/)
- [Command Line](/docs/usage/command-line/)
- [Node Package](/docs/usage/node-package/)
- [Self Hosting](/docs/usage/self-hosting/)
- [Sharing](/docs/usage/sharing/)
- [Troubleshooting](/docs/usage/troubleshooting/)
- [Web Ui](/docs/usage/web-ui/)
- [Write For Promptfoo](/docs/write-for-promptfoo/)