Your agent answers. Find out where it’s wrong, and why.
Send its conversations and its answers are checked against your own docs, with what went wrong grouped by cause and the fix drafted for you to approve.
Sound familiar?
- Your evals pass, and customers still get wrong answers.
- A bad answer could be the prompt, the retriever or a missing page, and nobody can say which.
- You find out an answer was wrong when the customer comes back, or does not.
- Every deploy changes what it says, and nothing tells you what got worse.
What you connect, and what happens next
Send its conversations
Make a key, then point your OpenTelemetry exporter at us or map any tool’s webhook; on the plan you can also post to the API. Send what it retrieved and the tools it called, and the findings say more about why.
Point us at your docs
Your docs site’s address, read once, or what your agent retrieves from. Answers are graded against your docs as they stood when it answered; with nothing written to check against, a verdict is withheld rather than guessed.
Add your deploys
On the plan: a Vercel or GitHub release webhook, so a fix to your agent is measured from the day it shipped.
Read what it found
What failed, grouped by cause and counted, with the fix drafted for you to approve: a page to write, a change to the instructions, or an issue for your product.
Nothing reaches a customer without a person approving the exact words.
Your first week
A verdict on your agent
How many answers were graded, how many held, and how many were withheld for want of anything written to check them against.
Where it failed
Failed answers grouped by cause, and the three biggest patterns, each with a customer’s own words.
Who came back
People who returned about the same thing after an answer that looked right, where your agent sends a person id. Without one, it says so and shows how to add it.
What it costs you
- Free
- A sample of up to 500 of your agent’s newest answers from the last 30 days, graded once. No card.
- Then
- We’re in beta, so talk to us about what comes next.
Request beta access.
Read your docs first: a sample taken before them mostly comes back unjudged, and Free grades one sample, once.
Request beta access