Build a suite of test conversations and run them against an agent, so you can change a prompt without wondering what you broke.
The Test tab lets you keep a set of test conversations and run them against an
agent whenever you change something. It is the difference between hoping a prompt
change helped and knowing it did.
The Test tab only appears if the Early Access Program is enabled for your
environment. See Experimental features.
Generating a suite
Generate suite reads your agent prompt and writes test cases for you, grouped by
what each one is probing.
The groups are worth understanding, because they are the things that actually go
wrong on live calls:
Group
What it tests
Flow
The conversation going as intended, including a clean refusal.
Policy
The agent holding its line when the caller is wrong about something.
Boundaries
Difficult callers, such as someone threatening to hang up.
Recovery
Getting back on track after confusion or interruption.
Actions
The agent actually doing the thing, not just talking about it.
Regenerate tests replaces the suite. Add test case writes one yourself.
Running tests
Run executes the whole suite. Each case also has its own run control, so you can
re-run just the one you are working on.Setup context supplies the context values the tests run with, so cases that
depend on a name or an order number behave like a real call.
Building tests from real calls
The best test cases are conversations that already went wrong.Open a call in Calls and use Create test from call on the Summary
tab. The conversation becomes a case on this tab. You can also reach past calls from
the Test Agent panel and resume from any point in one.
When something goes wrong on a live call, turn that call into a test before you fix
the prompt. Then you can prove the fix worked, and you will notice if a later change
breaks it again.
Improve an agent from a call
Testing tells you something broke. Train your agent is how you fix it, using a
real conversation as the evidence.
This one is not gated. Train your agent works whether or not Experimental
Features are enabled.
The Test Agent panel, which lists recent calls you can review.
Ending a browser test call, which drops you straight into it.
The panel puts the call transcript on the left and a feedback box on the right.
Describe what should have happened in plain language. You can also click any agent
message in the transcript to comment on that specific turn, and those comments are
sent along with your overall feedback.Get Recommendations then proposes prompt changes.
Reviewing the changes
Recommendations never apply silently. They open in a Prompt changes window
first.
Green is added text and red is removed. Changes are numbered, and Previous and
Next step through them. You can reject any single change to keep the original
wording.Accept All applies everything. If you rejected some, the button counts what is
left, such as Accept 1 Change.
Accepting only updates the prompt in the editor. Click Save on the agent for
the change to take effect on real calls.
Create a test from the call before you accept a recommendation. Then run the suite
afterwards and you will know whether the fix worked.
Where to go next
Change the prompt and settings you are testing in Agents.
{"docsConfig":{"theme":"mint","$schema":"https://mintlify.com/docs.json","name":"Fluents","colors":{"primary":"#4F26B0","light":"#4F26B0","dark":"#4F26B0"},"logo":{"light":"https://mintcdn.com/fluents/W3_lTopfh-MPxgIG/logo/light.png?fit=max\u0026auto=format\u0026n=W3_lTopfh-MPxgIG\u0026q=85\u0026s=df6ec38fc1edc83ff878dba4d265142e","dark":"https://mintcdn.com/fluents/W3_lTopfh-MPxgIG/logo/dark.png?fit=max\u0026auto=format\u0026n=W3_lTopfh-MPxgIG\u0026q=85\u0026s=f140612cf4bd33328d32cbd17bd34253"},"favicon":"https://mintcdn.com/fluents/W3_lTopfh-MPxgIG/favicon.png?fit=max\u0026auto=format\u0026n=W3_lTopfh-MPxgIG\u0026q=85\u0026s=05805ec9db48c56a8c20e0d6f5a1ee09","api":{"playground":{"display":"simple"}},"appearance":{"default":"light"},"footer":{"socials":{"website":"https://www.fluents.ai/"}},"seo":{},"styling":{"latex":false},"navigation":{"pages":[]}},"deployment":{"deploymentMetadataValue":{"subdomain":"fluents","hasAudioNarration":false,"actualSubdomain":"fluents","customDomains":["docs.fluents.ai"],"gitSource":{"type":"github","owner":"fluentsai","repo":"docs","deployBranch":"main","contentDirectory":"","isPrivate":false,"mountPath":"","label":""},"feedback":{"thumbs":true},"entitlements":{"AI_CHAT":{"status":"DISABLED"}},"buildId":"6ad147dc5dc4effd88fe8578","clientVersion":"0.0.4167","searchFilterCounts":[{"language":"default","tag":"API Documentation","count":70},{"language":"default","tag":"Product Documentation","count":48},{"language":"default","tag":"Feature Guides","count":32},{"language":"default","tag":"Integrations","count":16},{"language":"default","tag":"Integration Partners","count":16},{"language":"default","tag":"Agents","count":12},{"language":"default","tag":"Calls","count":11},{"language":"default","tag":"Numbers","count":10},{"language":"default","tag":"Agent skills","count":10},{"language":"default","tag":"Getting Started","count":9}]},"assistantConfig":{},"basePath":"","hasChatPermissions":false,"hasWebMcpPermissions":false,"toggles":[{"name":"kill-isr","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-rbac-roles","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-mintlify-slack","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-integrations-settings","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"rbac-expansion","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-pr-grouping","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-prefix","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"analytics-v7","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"user-flows-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"no-publish-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-onboarding","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving-live","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"stripTemperatureMiddleware","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"support-platform-pylon-zendesk","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"instant-rollback","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications-server","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-fable","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fixed-ai-action-pricing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automation-resolve-merge-conflict","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"scoped-publishing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"mintql","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"page-level-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-version-history-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"billing-page-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"full-page-search","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workspace-projects","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"assistant-v5","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fork-pr-previews","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"revalidation-jwt","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-sso-scim","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"hobby-abuse-scan","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"dashboard-inbox","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-signup","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-dual-write","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-enabled","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"approve-review-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-metadata","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"sso-setup-deadline-banner","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-serve","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"live-agents","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"llms-txt-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false}],"googleFontsInlined":false},"customCss":[{"filePath":"styles.css","content":"#sidebar-group li>ul,.sidebar-group li>ul{margin-left:0.8rem;border-left:1px solid rgb(17 24 39 / 0.10)}.dark #sidebar-group li>ul,.dark .sidebar-group li>ul{border-left-color:rgb(255 255 255 / 0.12)}#sidebar-group li>ul>li,.sidebar-group li>ul>li{position:relative}#sidebar-group li>ul>li::before,.sidebar-group li>ul>li::before{content:'';position:absolute;left:1.15rem;top:0.95rem;width:5px;height:5px;border-radius:50%;background:rgb(17 24 39 / 0.25)}.dark #sidebar-group li>ul>li::before,.dark .sidebar-group li>ul>li::before{background:rgb(255 255 255 / 0.3)}#sidebar-group li>ul>li:has(>a[class~=\"bg-primary/10\"])::before,#sidebar-group li>ul>li:has(>a[aria-current=\"page\"])::before,.sidebar-group li>ul>li:has(>a[class~=\"bg-primary/10\"])::before,.sidebar-group li>ul>li:has(>a[aria-current=\"page\"])::before{background:#4F26B0}#sidebar-group li>ul>li:has(>a[class~=\"bg-primary/10\"])::after,#sidebar-group li>ul>li:has(>a[aria-current=\"page\"])::after,.sidebar-group li>ul>li:has(>a[class~=\"bg-primary/10\"])::after,.sidebar-group li>ul>li:has(>a[aria-current=\"page\"])::after{content:'';position:absolute;left:-1px;top:0.25rem;bottom:0.25rem;width:2px;border-radius:1px;background:#4F26B0}"}],"page":{"pagePath":"product/features/agent-testing","slug":"/product/features/agent-testing","pageMetadata":{"title":"Testing an agent","sidebarTitle":"Testing an agent","description":"Build a suite of test conversations and run them against an agent, so you can change a prompt without wondering what you broke.","href":"/product/features/agent-testing"},"description":{"compiledSource":"\"use strict\";\nconst {jsx: _jsx} = arguments[0];\nconst {useMDXComponents: _provideComponents} = arguments[0];\nfunction _createMdxContent(props) {\n const _components = {\n p: \"p\",\n ..._provideComponents(),\n ...props.components\n };\n return _jsx(_components.p, {\n children: \"Build a suite of test conversations and run them against an agent, so you can change a prompt without wondering what you broke.\"\n });\n}\nfunction MDXContent(props = {}) {\n const {wrapper: MDXLayout} = {\n ..._provideComponents(),\n ...props.components\n };\n return MDXLayout ? _jsx(MDXLayout, {\n ...props,\n children: _jsx(_createMdxContent, {\n ...props\n })\n }) : _createMdxContent(props);\n}\nreturn {\n default: MDXContent\n};\n","frontmatter":{},"scope":{}},"pageType":"default","mdx":{"mdxSource":{"compiledSource":"\"use strict\";const{Fragment:_Fragment,jsx:_jsx,jsxs:_jsxs}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){const _components={a:`a`,hr:`hr`,li:`li`,p:`p`,strong:`strong`,tbody:`tbody`,td:`td`,th:`th`,thead:`thead`,tr:`tr`,ul:`ul`,..._provideComponents(),...props.components},{Frame,Heading,Note,OptimizedImage,Table,Tip,Warning}=_components;if(!Frame)_missingMdxReference(`Frame`,true);if(!Heading)_missingMdxReference(`Heading`,true);if(!Note)_missingMdxReference(`Note`,true);if(!OptimizedImage)_missingMdxReference(`OptimizedImage`,true);if(!Table)_missingMdxReference(`Table`,true);if(!Tip)_missingMdxReference(`Tip`,true);if(!Warning)_missingMdxReference(`Warning`,true);return _jsxs(_Fragment,{children:[_jsxs(_components.p,{children:[`The `,_jsx(_components.strong,{children:`Test`}),` tab lets you keep a set of test conversations and run them against an\nagent whenever you change something. It is the difference between hoping a prompt\nchange helped and knowing it did.`]}),`\n`,_jsx(Note,{children:_jsxs(_components.p,{children:[`The Test tab only appears if the `,_jsx(_components.strong,{children:`Early Access Program`}),` is enabled for your\nenvironment. See `,_jsx(_components.strong,{children:_jsx(_components.a,{href:`/product/features/experimental-feature`,children:`Experimental features`})}),`.`]})}),`\n`,_jsx(_components.hr,{}),`\n`,_jsx(Heading,{level:`2`,id:`generating-a-suite`,children:`Generating a suite`}),`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Generate suite`}),` reads your agent prompt and writes test cases for you, grouped by\nwhat each one is probing.`]}),`\n`,_jsx(Frame,{children:_jsx(OptimizedImage,{src:`https://mintcdn.com/fluents/Ntis-q5QWqwCqRQw/images/product/agent/generate-test-suite.jpg?fit=max\u0026auto=format\u0026n=Ntis-q5QWqwCqRQw\u0026q=85\u0026s=81bdedf64abc0971ed031817f122c223`,alt:`A generated test suite with cases grouped under Flow, Policy, Boundaries, Recovery and Actions`,\"data-og-width\":`1496`,width:`1496`,\"data-og-height\":`697`,height:`697`,\"data-path\":`images/product/agent/generate-test-suite.jpg`,\"data-optimize\":`true`,\"data-opv\":`3`,srcset:`https://mintcdn.com/fluents/Ntis-q5QWqwCqRQw/images/product/agent/generate-test-suite.jpg?w=280\u0026fit=max\u0026auto=format\u0026n=Ntis-q5QWqwCqRQw\u0026q=85\u0026s=c309c0f6613880da62aadbbba483c584 280w, https://mintcdn.com/fluents/Ntis-q5QWqwCqRQw/images/product/agent/generate-test-suite.jpg?w=560\u0026fit=max\u0026auto=format\u0026n=Ntis-q5QWqwCqRQw\u0026q=85\u0026s=42b5030ba66a7e0fa187fc62a2f4ab22 560w, https://mintcdn.com/fluents/Ntis-q5QWqwCqRQw/images/product/agent/generate-test-suite.jpg?w=840\u0026fit=max\u0026auto=format\u0026n=Ntis-q5QWqwCqRQw\u0026q=85\u0026s=2bd78ed473b22a1ed74696909153fd94 840w, https://mintcdn.com/fluents/Ntis-q5QWqwCqRQw/images/product/agent/generate-test-suite.jpg?w=1100\u0026fit=max\u0026auto=format\u0026n=Ntis-q5QWqwCqRQw\u0026q=85\u0026s=26bf6da2afe1dce33720d67058b7f052 1100w, https://mintcdn.com/fluents/Ntis-q5QWqwCqRQw/images/product/agent/generate-test-suite.jpg?w=1650\u0026fit=max\u0026auto=format\u0026n=Ntis-q5QWqwCqRQw\u0026q=85\u0026s=f0cc53a92cedafd7da8ec76a92e39a7b 1650w, https://mintcdn.com/fluents/Ntis-q5QWqwCqRQw/images/product/agent/generate-test-suite.jpg?w=2500\u0026fit=max\u0026auto=format\u0026n=Ntis-q5QWqwCqRQw\u0026q=85\u0026s=fce56f8abb57d8d37ab44ea9fb01cc52 2500w`})}),`\n`,_jsx(_components.p,{children:`The groups are worth understanding, because they are the things that actually go\nwrong on live calls:`}),`\n`,_jsxs(Table,{children:[_jsx(_components.thead,{children:_jsxs(_components.tr,{children:[_jsx(_components.th,{children:`Group`}),_jsx(_components.th,{children:`What it tests`})]})}),_jsxs(_components.tbody,{children:[_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`Flow`})}),_jsx(_components.td,{children:`The conversation going as intended, including a clean refusal.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`Policy`})}),_jsx(_components.td,{children:`The agent holding its line when the caller is wrong about something.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`Boundaries`})}),_jsx(_components.td,{children:`Difficult callers, such as someone threatening to hang up.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`Recovery`})}),_jsx(_components.td,{children:`Getting back on track after confusion or interruption.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`Actions`})}),_jsx(_components.td,{children:`The agent actually doing the thing, not just talking about it.`})]})]})]}),`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Regenerate tests`}),` replaces the suite. `,_jsx(_components.strong,{children:`Add test case`}),` writes one yourself.`]}),`\n`,_jsx(_components.hr,{}),`\n`,_jsx(Heading,{level:`2`,id:`running-tests`,children:`Running tests`}),`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Run`}),` executes the whole suite. Each case also has its own run control, so you can\nre-run just the one you are working on.`]}),`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Setup context`}),` supplies the context values the tests run with, so cases that\ndepend on a name or an order number behave like a real call.`]}),`\n`,_jsx(_components.hr,{}),`\n`,_jsx(Heading,{level:`2`,id:`building-tests-from-real-calls`,children:`Building tests from real calls`}),`\n`,_jsx(_components.p,{children:`The best test cases are conversations that already went wrong.`}),`\n`,_jsxs(_components.p,{children:[`Open a call in `,_jsx(_components.strong,{children:_jsx(_components.a,{href:`/product/features/call`,children:`Calls`})}),` and use `,_jsx(_components.strong,{children:`Create test from call`}),` on the Summary\ntab. The conversation becomes a case on this tab. You can also reach past calls from\nthe `,_jsx(_components.strong,{children:`Test Agent`}),` panel and resume from any point in one.`]}),`\n`,_jsx(Tip,{children:_jsx(_components.p,{children:`When something goes wrong on a live call, turn that call into a test before you fix\nthe prompt. Then you can prove the fix worked, and you will notice if a later change\nbreaks it again.`})}),`\n`,_jsx(_components.hr,{}),`\n`,_jsx(Heading,{level:`2`,id:`improve-an-agent-from-a-call`,children:`Improve an agent from a call`}),`\n`,_jsxs(_components.p,{children:[`Testing tells you something broke. `,_jsx(_components.strong,{children:`Train your agent`}),` is how you fix it, using a\nreal conversation as the evidence.`]}),`\n`,_jsx(Note,{children:_jsxs(_components.p,{children:[`This one is not gated. `,_jsx(_components.strong,{children:`Train your agent`}),` works whether or not Experimental\nFeatures are enabled.`]})}),`\n`,_jsx(_components.p,{children:`You can reach it three ways:`}),`\n`,_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[_jsx(_components.strong,{children:`Improve agent`}),` on a call’s Summary tab in `,_jsx(_components.strong,{children:_jsx(_components.a,{href:`/product/features/call`,children:`Calls`})}),`.`]}),`\n`,_jsxs(_components.li,{children:[`The `,_jsx(_components.strong,{children:`Test Agent`}),` panel, which lists recent calls you can review.`]}),`\n`,_jsx(_components.li,{children:`Ending a browser test call, which drops you straight into it.`}),`\n`]}),`\n`,_jsx(_components.p,{children:`The panel puts the call transcript on the left and a feedback box on the right.\nDescribe what should have happened in plain language. You can also click any agent\nmessage in the transcript to comment on that specific turn, and those comments are\nsent along with your overall feedback.`}),`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Get Recommendations`}),` then proposes prompt changes.`]}),`\n`,_jsx(Heading,{level:`3`,id:`reviewing-the-changes`,children:`Reviewing the changes`}),`\n`,_jsxs(_components.p,{children:[`Recommendations never apply silently. They open in a `,_jsx(_components.strong,{children:`Prompt changes`}),` window\nfirst.`]}),`\n`,_jsx(Frame,{children:_jsx(OptimizedImage,{src:`https://mintcdn.com/fluents/Ntis-q5QWqwCqRQw/images/product/agent/prompt-changes-review.jpg?fit=max\u0026auto=format\u0026n=Ntis-q5QWqwCqRQw\u0026q=85\u0026s=102bc9e2f4d606a8fe3c1ceb79390189`,alt:`The Prompt changes window showing a proposed addition to the agent prompt in green, with Reject All and Accept All in the footer`,\"data-og-width\":`1496`,width:`1496`,\"data-og-height\":`697`,height:`697`,\"data-path\":`images/product/agent/prompt-changes-review.jpg`,\"data-optimize\":`true`,\"data-opv\":`3`,srcset:`https://mintcdn.com/fluents/Ntis-q5QWqwCqRQw/images/product/agent/prompt-changes-review.jpg?w=280\u0026fit=max\u0026auto=format\u0026n=Ntis-q5QWqwCqRQw\u0026q=85\u0026s=741a645849fc0b6d51df530105422c09 280w, https://mintcdn.com/fluents/Ntis-q5QWqwCqRQw/images/product/agent/prompt-changes-review.jpg?w=560\u0026fit=max\u0026auto=format\u0026n=Ntis-q5QWqwCqRQw\u0026q=85\u0026s=c957fa03fce037f9606c3d3a0141450d 560w, https://mintcdn.com/fluents/Ntis-q5QWqwCqRQw/images/product/agent/prompt-changes-review.jpg?w=840\u0026fit=max\u0026auto=format\u0026n=Ntis-q5QWqwCqRQw\u0026q=85\u0026s=bed288fa81e52c08d1c8de1bd3ad9496 840w, https://mintcdn.com/fluents/Ntis-q5QWqwCqRQw/images/product/agent/prompt-changes-review.jpg?w=1100\u0026fit=max\u0026auto=format\u0026n=Ntis-q5QWqwCqRQw\u0026q=85\u0026s=a44efcc95062afaf4b75cdf980fd682a 1100w, https://mintcdn.com/fluents/Ntis-q5QWqwCqRQw/images/product/agent/prompt-changes-review.jpg?w=1650\u0026fit=max\u0026auto=format\u0026n=Ntis-q5QWqwCqRQw\u0026q=85\u0026s=024b95ab79ae31ad3bb38f13775714e4 1650w, https://mintcdn.com/fluents/Ntis-q5QWqwCqRQw/images/product/agent/prompt-changes-review.jpg?w=2500\u0026fit=max\u0026auto=format\u0026n=Ntis-q5QWqwCqRQw\u0026q=85\u0026s=730d8cc85cd2b3ba980b62253c74a4bd 2500w`})}),`\n`,_jsxs(_components.p,{children:[`Green is added text and red is removed. Changes are numbered, and `,_jsx(_components.strong,{children:`Previous`}),` and\n`,_jsx(_components.strong,{children:`Next`}),` step through them. You can reject any single change to keep the original\nwording.`]}),`\n`,_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Accept All`}),` applies everything. If you rejected some, the button counts what is\nleft, such as `,_jsx(_components.strong,{children:`Accept 1 Change`}),`.`]}),`\n`,_jsx(Warning,{children:_jsxs(_components.p,{children:[`Accepting only updates the prompt in the editor. Click `,_jsx(_components.strong,{children:`Save`}),` on the agent for\nthe change to take effect on real calls.`]})}),`\n`,_jsx(Tip,{children:_jsx(_components.p,{children:`Create a test from the call before you accept a recommendation. Then run the suite\nafterwards and you will know whether the fix worked.`})}),`\n`,_jsx(_components.hr,{}),`\n`,_jsx(Heading,{level:`2`,id:`where-to-go-next`,children:`Where to go next`}),`\n`,_jsxs(_components.ul,{children:[`\n`,_jsxs(_components.li,{children:[`Change the prompt and settings you are testing in `,_jsx(_components.strong,{children:_jsx(_components.a,{href:`/product/features/agent`,children:`Agents`})}),`.`]}),`\n`,_jsxs(_components.li,{children:[`Find the calls worth turning into tests in `,_jsx(_components.strong,{children:_jsx(_components.a,{href:`/product/features/call`,children:`Calls`})}),`.`]}),`\n`]})]})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent};function _missingMdxReference(id,component){throw new Error(`Expected `+(component?`component`:`object`)+\" `\"+id+\"` to be defined: you likely forgot to import, pass, or provide it.\")}","frontmatter":{},"scope":{"config":{},"pageMetadata":{"title":"Testing an agent","sidebarTitle":"Testing an agent","description":"Build a suite of test conversations and run them against an agent, so you can change a prompt without wondering what you broke.","href":"/product/features/agent-testing"}}},"mdxSourceWithNoJs":null},"mdxExtracts":{"tableOfContents":[{"title":"Generating a suite","slug":"generating-a-suite","depth":2,"children":[]},{"title":"Running tests","slug":"running-tests","depth":2,"children":[]},{"title":"Building tests from real calls","slug":"building-tests-from-real-calls","depth":2,"children":[]},{"title":"Improve an agent from a call","slug":"improve-an-agent-from-a-call","depth":2,"children":[{"title":"Reviewing the changes","slug":"reviewing-the-changes","depth":3,"children":[]}]},{"title":"Where to go next","slug":"where-to-go-next","depth":2,"children":[]}],"codeExamples":{}},"jsLinks":[],"subdomain":"fluents","siteName":"Fluents","title":"Testing an agent - Fluents","navMaps":{"firstHrefInVersion":{},"firstHrefInLanguage":{}},"lastModified":"2026-08-19T01:10:36.929Z","originalFileLocation":"product/features/agent-testing.mdx"},"headHtml":"\u003cscript data-mint-head>(function(){var d=document.documentElement,p=null;if(!p){try{p=localStorage.getItem(\"isDarkMode\")}catch(e){}if(p==='true')p='dark';else if(p==='false')p='light';if(p!=='light'\u0026\u0026p!=='dark'\u0026\u0026p!=='system')p=\"light\"}var r=p==='system'?(matchMedia(\"(prefers-color-scheme: dark)\").matches?'dark':'light'):p;d.classList.remove(r==='dark'?'light':'dark');d.classList.add(r);d.setAttribute(\"data-theme-preference\",p)})();\u003c/script>\u003cmeta data-mint-head name=\"description\" content=\"Build a suite of test conversations and run them against an agent, so you can change a prompt without wondering what you broke.\">\u003cmeta data-mint-head name=\"application-name\" content=\"Fluents\">\u003cmeta data-mint-head name=\"generator\" content=\"Mintlify\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/fluents/9O1LYrnNFDJkAmx2/_generated/favicon/android-chrome-192x192.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"apple-touch-icon\" type=\"image/png\" sizes=\"180x180\" href=\"/mintlify-assets/_mintlify/favicons/fluents/9O1LYrnNFDJkAmx2/_generated/favicon/apple-touch-icon.png\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/fluents/9O1LYrnNFDJkAmx2/_generated/favicon/favicon-16x16.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/fluents/9O1LYrnNFDJkAmx2/_generated/favicon/favicon-32x32.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/fluents/9O1LYrnNFDJkAmx2/_generated/favicon/favicon.ico\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/fluents/9O1LYrnNFDJkAmx2/_generated/favicon-dark/android-chrome-192x192.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/fluents/9O1LYrnNFDJkAmx2/_generated/favicon-dark/favicon-16x16.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/fluents/9O1LYrnNFDJkAmx2/_generated/favicon-dark/favicon-32x32.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/fluents/9O1LYrnNFDJkAmx2/_generated/favicon-dark/favicon.ico\" media=\"(prefers-color-scheme: dark)\">\u003cmeta data-mint-head property=\"og:title\" content=\"Testing an agent - Fluents\">\u003cmeta data-mint-head property=\"og:description\" content=\"Build a suite of test conversations and run them against an agent, so you can change a prompt without wondering what you broke.\">\u003cmeta data-mint-head property=\"og:site_name\" content=\"Fluents\">\u003cmeta data-mint-head property=\"og:url\" content=\"https://docs.fluents.ai/product/features/agent-testing\">\u003cmeta data-mint-head property=\"og:type\" content=\"website\">\u003cmeta data-mint-head property=\"og:image\" content=\"https://fluents.mintlify.site/_mintlify/api/og/v2?division=Agents\u0026amp;title=Testing+an+agent\u0026amp;description=Build+a+suite+of+test+conversations+and+run+them+against+an+agent%2C+so+you+can+change+a+prompt+without+wondering+what+you+broke.\u0026amp;theme=7f3a67d1a8f0582c318cb41d\u0026amp;signature=dfaef19842155624007e6791d14941b9c816a70cf29436094cf0c76bbb6a9a47\">\u003cmeta data-mint-head property=\"og:image:width\" content=\"1200\">\u003cmeta data-mint-head property=\"og:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"twitter:card\" content=\"summary_large_image\">\u003cmeta data-mint-head name=\"twitter:title\" content=\"Testing an agent - Fluents\">\u003cmeta data-mint-head name=\"twitter:description\" content=\"Build a suite of test conversations and run them against an agent, so you can change a prompt without wondering what you broke.\">\u003cmeta data-mint-head name=\"twitter:image\" content=\"https://fluents.mintlify.site/_mintlify/api/og/v2?division=Agents\u0026amp;title=Testing+an+agent\u0026amp;description=Build+a+suite+of+test+conversations+and+run+them+against+an+agent%2C+so+you+can+change+a+prompt+without+wondering+what+you+broke.\u0026amp;theme=7f3a67d1a8f0582c318cb41d\u0026amp;signature=dfaef19842155624007e6791d14941b9c816a70cf29436094cf0c76bbb6a9a47\">\u003cmeta data-mint-head name=\"twitter:image:width\" content=\"1200\">\u003cmeta data-mint-head name=\"twitter:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"msapplication-config\" content=\"/mintlify-assets/_mintlify/favicons/fluents/9O1LYrnNFDJkAmx2/_generated/favicon/browserconfig.xml\">\u003cmeta data-mint-head name=\"apple-mobile-web-app-title\" content=\"Fluents\">\u003cmeta data-mint-head name=\"msapplication-TileColor\" content=\"#4F26B0\">\u003clink data-mint-head rel=\"canonical\" href=\"https://docs.fluents.ai/product/features/agent-testing\">\u003clink data-mint-head rel=\"alternate\" type=\"application/xml\" href=\"/sitemap.xml\">\u003clink data-mint-head rel=\"alternate\" type=\"text/markdown\" href=\"/product/features/agent-testing.md\">\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https://docs.fluents.ai/#organization\",\"name\":\"Fluents\",\"url\":\"https://docs.fluents.ai\",\"logo\":{\"@type\":\"ImageObject\",\"url\":\"https://mintcdn.com/fluents/W3_lTopfh-MPxgIG/logo/light.png?fit=max\u0026auto=format\u0026n=W3_lTopfh-MPxgIG\u0026q=85\u0026s=df6ec38fc1edc83ff878dba4d265142e\"}},{\"@type\":\"WebSite\",\"@id\":\"https://docs.fluents.ai#website\",\"name\":\"Fluents\",\"url\":\"https://docs.fluents.ai\",\"publisher\":{\"@id\":\"https://docs.fluents.ai/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https://docs.fluents.ai/product/features/agent-testing#webpage\",\"url\":\"https://docs.fluents.ai/product/features/agent-testing\",\"name\":\"Testing an agent\",\"description\":\"Build a suite of test conversations and run them against an agent, so you can change a prompt without wondering what you broke.\",\"dateModified\":\"2026-08-19T01:10:36.929Z\",\"isPartOf\":{\"@id\":\"https://docs.fluents.ai#website\"},\"breadcrumb\":{\"@id\":\"https://docs.fluents.ai/product/features/agent-testing#breadcrumb\"}},{\"@type\":\"BreadcrumbList\",\"@id\":\"https://docs.fluents.ai/product/features/agent-testing#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Feature Guides\",\"item\":\"https://docs.fluents.ai/product/features/dashboard\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Agents\",\"item\":\"https://docs.fluents.ai/product/features/agent\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Testing an agent\",\"item\":\"https://docs.fluents.ai/product/features/agent-testing\"}]},{\"@type\":[\"Article\",\"TechArticle\"],\"@id\":\"https://docs.fluents.ai/product/features/agent-testing#article\",\"headline\":\"Testing an agent\",\"name\":\"Testing an agent\",\"description\":\"Build a suite of test conversations and run them against an agent, so you can change a prompt without wondering what you broke.\",\"url\":\"https://docs.fluents.ai/product/features/agent-testing\",\"mainEntityOfPage\":{\"@id\":\"https://docs.fluents.ai/product/features/agent-testing#webpage\"},\"dateModified\":\"2026-08-19T01:10:36.929Z\",\"publisher\":{\"@id\":\"https://docs.fluents.ai/#organization\"},\"isPartOf\":{\"@id\":\"https://docs.fluents.ai#website\"}}]}\u003c/script>\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@type\":\"WebSite\",\"name\":\"Fluents\",\"publisher\":{\"@type\":\"Organization\",\"name\":\"Fluents\"},\"provider\":{\"@type\":\"Organization\",\"name\":\"Mintlify\",\"url\":\"https://mintlify.com\"}}\u003c/script>","agentPointerHref":"/product/features/agent-testing.md","siteName":"Fluents","nav":{"global":null,"anchors":[{"anchor":"Product Documentation","icon":"book","groups":[{"group":"Getting Started","icon":"rocket","pages":[{"title":"Introduction to Fluents","sidebarTitle":"Introduction","icon":"hand-wave","href":"/product/welcome"},{"group":"Quickstart","icon":"play","expanded":true,"pages":[{"title":"Quickstart","sidebarTitle":"Overview","href":"/product/quickstart/index"},{"title":"Create your first inbound agent","sidebarTitle":"Your first inbound agent","href":"/product/quickstart/first-inbound-agent"},{"title":"Create your first outbound agent","sidebarTitle":"Your first outbound agent","href":"/product/quickstart/first-outbound-agent"},{"title":"Set up your first campaign","sidebarTitle":"Your first campaign","href":"/product/quickstart/first-campaign"},{"title":"Improving an agent","sidebarTitle":"Improving an agent","href":"/product/quickstart/improving-an-agent"}]},{"group":"Use cases","icon":"briefcase","pages":[{"title":"Use cases","sidebarTitle":"Overview","href":"/product/use-cases/index"},{"title":"Book appointments for a clinic","sidebarTitle":"Clinic appointments","href":"/product/use-cases/clinic-appointments"}]},{"title":"Documentation assistant","sidebarTitle":"Documentation assistant","icon":"comments","href":"/product/features/assistant"}]},{"group":"Core Concepts","icon":"lightbulb","pages":[{"group":"Agents","icon":"robot","pages":[{"title":"What an agent is","sidebarTitle":"What an agent is","href":"/product/concepts/agent/intro"},{"title":"What the agent says","sidebarTitle":"What the agent says","href":"/product/concepts/agent/basic"},{"title":"How a call runs","sidebarTitle":"How a call runs","href":"/product/concepts/agent/advanced"},{"title":"What happens after a call","sidebarTitle":"After a call","href":"/product/concepts/agent/post-call"}]},{"title":"How campaigns work","sidebarTitle":"Campaigns","href":"/product/concepts/campaigns"},{"title":"How numbers work","sidebarTitle":"Numbers","href":"/product/concepts/numbers"},{"title":"How voices work","sidebarTitle":"Voices","href":"/product/concepts/voices"}]},{"group":"Feature Guides","icon":"book","pages":[{"group":"Activity","icon":"chart-line","expanded":true,"pages":[{"title":"Dashboard","sidebarTitle":"Dashboard","href":"/product/features/dashboard"},{"title":"Calls","sidebarTitle":"Calls","href":"/product/features/call"},{"title":"Reports","sidebarTitle":"Reports","tag":"BETA","href":"/product/features/reports"}]},{"group":"Agents","icon":"robot","pages":[{"title":"Agents","sidebarTitle":"Agents","href":"/product/features/agent"},{"title":"Data","sidebarTitle":"Data","href":"/product/features/data"},{"title":"Post-call","sidebarTitle":"Post-call","description":"Decide what to pull out of every call, judge whether the call went well, and send a follow up email or SMS afterwards.","href":"/product/features/post-call"},{"title":"Testing an agent","sidebarTitle":"Testing an agent","href":"/product/features/agent-testing"}]},{"group":"Agent skills","icon":"puzzle-piece","pages":[{"title":"Appointment Scheduling","sidebarTitle":"Appointment Scheduling","description":"Let the agent read your real availability, offer times, and book the appointment on your calendar during the call.","href":"/product/features/skills/appointment-scheduling"},{"title":"Call Routing","sidebarTitle":"Call Routing","href":"/product/features/skills/call-routing"},{"title":"Call Back Later","sidebarTitle":"Call Back Later","href":"/product/features/skills/call-back-later"},{"title":"Knowledge Search","sidebarTitle":"Knowledge Search","href":"/product/features/skills/knowledge-search"},{"title":"Switch Communication","sidebarTitle":"Switch Communication","href":"/product/features/skills/switch-communication"},{"title":"In Call Email","sidebarTitle":"In Call Email","href":"/product/features/skills/in-call-email"},{"title":"In Call SMS","sidebarTitle":"In Call SMS","href":"/product/features/skills/in-call-sms"},{"title":"Call Screen Handling","sidebarTitle":"Call Screen Handling","href":"/product/features/skills/call-screen-handling"},{"title":"IVR Navigation","sidebarTitle":"IVR Navigation","href":"/product/features/skills/ivr-navigation"},{"title":"End Call","sidebarTitle":"End Call","href":"/product/features/skills/end-conversation"}]},{"group":"Campaigns","icon":"bullhorn","pages":[{"title":"Campaigns","sidebarTitle":"Campaigns","href":"/product/features/campaigns"},{"title":"Campaign Schedules","sidebarTitle":"Campaign schedules","href":"/product/features/campaign-schedules"}]},{"group":"Connections","icon":"plug","pages":[{"title":"Numbers","sidebarTitle":"Numbers","href":"/product/features/numbers"},{"title":"DNC List","sidebarTitle":"DNC List","href":"/product/features/dnc-list"},{"title":"Providers and connections","sidebarTitle":"Providers","href":"/product/features/providers"}]},{"group":"Libraries","icon":"layer-group","pages":[{"title":"Prompts","sidebarTitle":"Prompts","href":"/product/features/prompts"},{"title":"Voices","sidebarTitle":"Voices","href":"/product/features/voice"},{"title":"Knowledge Bases","sidebarTitle":"Knowledge Bases","href":"/product/features/knowledge-base"}]},{"group":"Automation","icon":"bolt","pages":[{"title":"Actions","sidebarTitle":"Actions","href":"/product/features/actions"},{"title":"Webhooks","sidebarTitle":"Webhooks","href":"/product/features/webhook"},{"title":"Web Widget","sidebarTitle":"Web Widget","href":"/product/features/widget"}]},{"title":"Early Access","sidebarTitle":"Early Access","icon":"flask","href":"/product/features/experimental-feature"},{"group":"Account","icon":"user-gear","pages":[{"title":"Sign up","sidebarTitle":"Sign up","href":"/product/features/account/sign-up"},{"title":"Settings","sidebarTitle":"Settings","href":"/product/features/account/settings"},{"title":"Get API key","sidebarTitle":"Get API key","href":"/product/features/account/get-api-key"}]}]}]},{"anchor":"Integrations","icon":"book","pages":[{"title":"Integrations","href":"/product/integrations/active-campaign"}]},{"anchor":"API Documentation","icon":"rectangle-terminal","pages":[{"title":"API Documentation","href":"/api-reference/account_connections/get-account-connection"}]},{"anchor":"Contact","icon":"envelope","href":"mailto:support@fluents.ai"}]},"basePath":"","title":"Testing an agent - Fluents","buildId":"dpl_9RFrWkXdFTJCytfx6jAofvAaEXr6","deploymentId":"dpl_9RFrWkXdFTJCytfx6jAofvAaEXr6","dynamics":["07c022d89b","a74be98ba7"],"chunks":["Frame-1H5zLJUq.js","DynamicMarkdown-RhjEuCHC.js","zoom-image-lightbox-CkI5al_8.js","lightbox-handle-r17bVUz3.js"]}