Respon
AI & Automation

Reporting Fin to leadership: the one-page monthly report

A one-page monthly Fin report template: five figures, each followed by what it doesn't tell you, and how to present it to leadership in five minutes.

Jérôme Gambiez · Founder, ResponZ
· 7 min read

One page, five figures, each followed by what it doesn't tell you. Here's the template, ready to copy, and how to read it.

The template at a glance

The values below are fictional, to show how to fill the page. Alert thresholds are reference points to adapt to your support, not benchmarks.

FigureThis monthPrevious monthWhat it doesn't tell youAnnotation
Fin resolution rate52%49%Whether the answers were rightE.g. definition changed on the 3rd
7-day reopen rate9%8%Customers who left without reopeningWatch above your own reference point
Share rated Poor in audit14% (40 audited)11% (40 audited)Conversations not sampledSample size and sampling method
Cost per resolved conversation€0.80€0.85The quality of what's resolvedTotal monthly cost, excluding team
Topics taken out of scope32How many customers are affectedList of the three topics

What are the three questions to ask before presenting a resolution rate?

  1. How many of these resolutions reopen within seven days? A rate that rises while reopens rise doesn't mean the same as a rate that rises alone. See the reopen rate.
  2. Which topics are handled worst? An average hides the two or three topics where Fin gets it wrong every time. Those are what leadership can decide to take out of scope or document.
  3. Who reviews the answers? Without regular review, the report only holds activity rates. A short ritual is enough: see auditing Fin's answers every week.

What are the five figures in the report?

  • Resolution. The figure leadership expects, taken as Intercom computes it, with its definition noted if it changed during the month.
  • 7-day reopen rate. The guardrail on resolution: a resolution that reopens isn't one.
  • Share rated Poor in audit. On a sample of reviewed conversations, the share of answers judged bad. Always give the sample size.
  • Cost per resolved conversation. Fin's total cost for the month divided by the number of resolutions. For the full profitability logic, see Fin's ROI, which we don't redo here.
  • Topics taken out of scope. The topics you decided to stop giving to Fin this month, or the ones that should be removed.

What doesn't each figure tell you?

The table gives it in one line. Here's the reasoning. Resolution measures an outcome, not accuracy: a wrong answer the customer gives up on inflates it, which is why containment rate lies. The reopen rate only sees those who come back; those who give up escape it. The Poor share is worth what the sample is worth: 40 well-drawn conversations say more than 400 hand-picked ones, but less than full coverage. Cost per resolution falls when you resolve more, even badly. Out-of-scope topics are a list, not a volume: add the number of customers affected if you have it.

How do you annotate breaks in the series?

Intercom revised its Fin metrics: "Fin Constrained" conversations no longer count in "Fin Involved", which changes the denominator of the resolution rate (see Intercom's help page and what the Fin counter actually counts). A curve that rises because of this is not an improvement.

The ruleA dated note under the chart, never a series rewritten silently. If you recompute history, say so and keep the old series next to it.

How do you present the page in five minutes?

  1. Minute 1: resolution and the previous month, with the annotation if there is one.
  2. Minutes 2 and 3: reopens and the Poor share, the quality behind the rate.
  3. Minute 4: cost per resolution and out-of-scope topics.
  4. Minute 5: one decision to ask for, for example taking a topic out of scope or allocating one hour of review a week.

Frequently asked questions

Which figures belong in a Fin report for leadership? Five, not twenty: resolution, 7-day reopen rate, share rated Poor in audit, cost per resolved conversation, out-of-scope topics.

Is the resolution rate enough? No. It measures an outcome, not whether the answer was right. Without reopens and an audit, you can't tell whether the rate is rising for good reasons.

How do you annotate a change of definition? A dated note under the chart, the definition before and after, and the old series kept for comparison.

How often should you present it? Monthly to leadership; reviewing answers happens weekly.

Where do you find these figures in Intercom? The native "Fin AI Agent" report gives resolution, escalation and the customer experience (CX) score. The 7-day reopen rate, the Poor share and the worst-handled topics need an audit or a tool. ResponZ computes them for you: see Fin answer quality and conversation analytics.

Your next bad Fin answer is happening right now.

Free · No credit card · Read-only