Fin AI quality
Fin gives answers. ResponZ tells you if they're right.
- Read-only (OAuth)
- Intercom unchanged
- Results in 30 seconds
Answers to fixLast 30 days
32
Fin · E-invoicing
A link to an article, no concrete steps.
link onlyunresolved
41
Leo D. · Pricing and billing
Outdated price quoted.
stale info
48
Fin · Accounting export
Partial answer, the customer had to follow up.
unresolved
58
Camille R. · Thank-you note
Right tone, a bit generic.
off tone
<40
Alert threshold
Flagged automatically
What resolution rate doesn't tell you
A resolution rate counts closed conversations. It doesn't check the answers.
Intercom shows94%Resolution rate
In realityFin quoted a six-month-old article. The answer was wrong. The conversation was closed.
Intercom shows1,240Conversations handled this month
In reality180 were about a question Fin wasn't trained to handle.
Intercom shows3.8/5Average CSAT
In realityThe average hides 4-star ratings that are actually disappointments.
Four criteria, every answer
The quality layer Fin doesn't have.
Relevance
0 to 100The answer addresses the question asked, no dodging, no boilerplate.
Accuracy
0 to 100The information matches your help center and your rules. No made-up facts, no stale articles.
Tone
0 to 100The answer keeps your brand voice: professional, empathetic.
Completeness
0 to 100Every part of the question is covered.
Overall score from 0 to 100 per conversation
Under 40/100, the answer is flagged automatically.Not a one-off audit. A daily feed of what Fin gets wrong.
Every day, the topic, the score, the exact reason it failed and a link to the conversation in Intercom.
12 to 27%
of conversations resolved by Fin are reopened by day 7.
Resolution rate measures volume. ResponZ measures accuracy. Two numbers for two different questions.
Find your worst Fin answer from last week.
- 100 conversations free
- No credit card
- Intercom unchanged