Skip to main content
Analytics

See what your customers ask, before they tell you

Most customer feedback arrives too late. Surveys, tickets, escalations to product — by the time the signal reaches the people who could fix the underlying issue, twenty other customers have already had the same problem and given up. Your chatbot is sitting on all of it. Every question a visitor types is a customer voice signal: a moment of intent captured in their own words. NebulaHex Analytics turns that raw signal into something you can act on.

4 metric cards · 2 charts · Most Asked Questions · Export CSV

Analytics · All Bots

Last 7 days

7d14d30dAll

Total Messages

4,217

+18%

Conversations

892

+12%

Leads Captured

47

+24%

Fallback Rate

8.3%

Healthy

Messages over time

MonTueWedThuFriSatSun
Scope:All Bots (3)Click to filter
Jump to section

01

Every conversation is research you didn’t have to schedule

A traditional research program — surveys, user interviews, usability tests — has the same chronic problem: it costs time and money to ask people what they want, so you don’t ask very often, you don’t ask very many, and the people who reply are rarely the ones who matter most. Meanwhile, your support inbox quietly fills with the answers, but nobody on the product or marketing side ever reads it.

A chatbot inverts that. Every visitor who has a question types the question. They type it freely, in their own phrasing, with their own assumptions. They are not framing it for a researcher; they are not editing it for politeness. They want an answer. That gives you a continuous, low-cost stream of authentic voice-of-customer data — provided you have somewhere to look at it.

That is what NebulaHex Analytics is for. Not a vanity dashboard with a single “messages this week” number. The layer that takes the raw transcripts your bot is already producing and surfaces the patterns: which questions repeat, which ones the bot struggles with, when traffic spikes, where your knowledge has holes, and how many of those conversations turn into a real lead.

02

Two analytics surfaces, one set of metrics

NebulaHex ships with two analytics surfaces side by side. They share the same metric definitions and the same time-range selector. You’ll move between them constantly.

GLOBAL

Global Analytics

Sidebar — rolls up every bot in your workspace

  • Bot selector defaults to All Bots
  • Compare bots side-by-side in Bot Performance table
  • Click any bot to drill into its dedicated view
PER-BOT

Per-bot Analytics

Inside each bot, alongside Conversations and Settings

  • Same metrics, scoped to one bot
  • Export CSV button for the selected time range
  • Bookmark this if you own one bot specifically

Both surfaces share a time-range selector: 7 days, 14 days, 30 days, or All. Picking a range re-runs every chart, every metric card, every table on the page against that window. Default is 7 days — the right cadence for a weekly health check. Switch to 30 or All when you’re hunting for trends or building a quarterly review.

03

The four headline metrics

Across the top of every analytics view sit four headline metric cards. They look simple. They are not — each one tells a specific story about a specific failure mode, and reading them in order is how you keep your bot honest.

Total Messages

4,217

Every message in the selected window — visitor messages and bot replies combined. The raw-volume signal. Tells you whether anyone is actually using the bot, and whether usage is trending up, flat, or down.

If this is near zero on a bot you launched a month ago, the bot is fine. The problem is upstream: widget not embedded, channel not connected, or the page where you put the widget gets no traffic.

Conversations

892

A conversation is a single chat thread — one visitor’s session of back-and-forth with your bot. One conversation usually contains many messages. The ratio of Messages to Conversations gives you a sense of depth.

High messages-per-conversation ratio means visitors are engaging in real exchanges. A ratio close to one means people type once and leave — either the bot nailed the first answer, or the first answer pushed them away.

Leads Captured

47

A lead is a contact your bot collected during a chat — typically a name, email, or phone number a visitor handed over voluntarily. The conversion number. The one your finance team cares about because it ties chat activity to dollars.

On the global view, leads are broken out per bot in the Bot Performance table, so you can see which bot is actually doing the work.

Fallback Rate

8.3%

The most under-appreciated number on the page. The percentage of bot replies that fell back to a generic answer because the bot wasn’t confident enough to give a grounded one.

Color-coded so you can read it at a glance: green when low, amber when moderate, red when it climbs higher. Watch this number. When it goes up, your knowledge has fallen behind your customers.

Fallback rate at a glance

< 10%

Healthy

10–25%

Watch this

> 25%

Knowledge gap

Fallback rate gets its own visual treatment because it’s the leading indicator the other three lag. Conversations and Leads only tell you what happened. Fallback Rate tells you whether your bot is starting to lose its grip on your knowledge — before that loss shows up in the conversion numbers.

04

The two charts

Below the metric cards sit two charts that turn point-in-time numbers into shapes you can read.

Messages Over Timeis a daily timeline of message volume across the selected window. The shape tells you several things at once. Steady-state usage shows up as a flat line with weekly cycles. A campaign launch shows up as a sharp peak. A bug that took your widget offline shows up as a flat zero day in the middle of the line — usually correlatable to something else that happened in the business. You won’t read this chart every day, but you should read it before every weekly review, because anomalies stand out fast.

Response Confidenceis the chart that rewards careful reading. Every time your bot answers, it computes a confidence score from 0 to 100%. The chart bins those scores into four buckets: Low, Medium, Good, and High. A healthy bot’s distribution is heavily weighted toward Good and High. A bot that’s drifting will start to bulge in the Medium and Low buckets — and the fallback rate climbs in lockstep.

Response confidence distribution

2,230 replies in the last 7 days

32
148
612
1438

Low

0–25%

Medium

25–50%

Good

50–75%

High

75–100%

The reason this chart matters more than the average confidence number is that an average hides the tails. A bot whose replies split 50/50 between High and Low can have the same average confidence as a bot whose replies are uniformly Medium — but the first bot is delighting half its visitors and failing the other half, while the second bot is mediocre across the board. The distribution shows you which one you have.

05

The two tables

Two tables sit below the charts. The first is the one your marketing team will love.

Most Asked Questionsis a top-10 list of the exact phrases visitors typed into your bot, ranked by frequency, for the selected time window. No preprocessing. No clustering. No “intent” abstraction layer hiding the words. You see what your customers literally typed.

Most asked questions

Last 7 days · raw visitor phrases, ranked

  1. #1where is my order89
  2. #2do you ship to canada67
  3. #3how do I cancel my subscription54
  4. #4is there a free trial41
  5. #5what’s your return policy38
  6. #6can I get a refund33
  7. #7how do I track my order28

This list is gold. The single most valuable view on the page for anyone outside support. A content marketer reading this list will leave with their next three blog posts. A product manager will find the missing feature their users keep wishing for. A founder will see, in five minutes, what their customers are confused about — without commissioning a study, without running a survey.

Performance is the second table. Three numbers your operations team cares about:

  • Average Response Latency — how long, on average, your bot takes to reply. A grounded answer takes longer than a fallback. A bot with rich knowledge will run a bit slower than a thin one — that’s the model thinking, not a bug.
  • Model Usage — the cumulative compute across the time range. The number you’ll cite when explaining usage growth, and the number that matters if you’re using BYOK.
  • Average Confidence Score — the arithmetic mean of every assistant reply’s confidence. Good for trend tracking. For diagnosis, read the distribution chart above.

06

Export & extend

Per-bot analytics has an Export CSVbutton at the top right. Pick a time range — 7 days, 30 days, All — then click export. You’ll get a CSV containing the conversations and lead data for that window, ready to drop into a spreadsheet, a BI tool, or whatever pipeline your data team already uses.

The export is the right tool when you want to do something the dashboard doesn’t yet: pivot leads by source, build a custom funnel, hand a slice of conversations to a research firm for tagging, or join chat data against your CRM in a warehouse. The dashboard answers most of the questions most teams have. The export answers the ones nobody could have anticipated.

07

Same data, different jobs

The same analytics page serves three very different teams in very different ways. Here’s what that looks like.

🛠️

Support managers monitoring bot health

Your daily 9 a.m. coffee dashboard. The story is in three numbers, in this order: fallback rate, conversation count, Most Asked Questions. When fallback rate creeps from 8% to 15% over two weeks, scroll to Most Asked, find the new questions that weren’t there last month, write or upload one new knowledge source per question, watch the rate fall back. A closed loop you can run weekly in fifteen minutes.

📝

Marketing teams mining customer questions for content

Open the global Analytics tab, set the range to 30 days or All, scroll to Most Asked, and read. Each phrase is a piece of content waiting to be written: a help article, a pricing-page section, a comparison post, a long-tail landing page. The phrasing is real because real customers typed it — it’s the search intent your SEO tool is trying to estimate, except you don’t have to estimate.

🔍

Ops & product teams catching gaps before tickets

Tickets are a lagging indicator. Bot analytics is leading. A new phrasing appearing in Most Asked is often the first signal something has changed in your product — a confusing release note, a broken integration, a deprecated feature customers are still trying to use. A weekly habit of comparing this week’s top questions to last week’s catches a surprising amount before it hits the ticket queue.

08

How your data is handled

Your conversations are your data. They’re stored encrypted at rest and transmitted over encrypted connections. Access is gated by role-based permissions inside your workspace — owners and admins see everything, editors and viewers see what their role allows, and nothing crosses the boundary between organizations. Conversations and analytics are scoped per workspace.

Your data is never used to train AI models. Teams using BYOK route inference through their own provider account — same dashboard, same metrics, billing flows through their provider relationship. See our privacy policy and terms for the full posture.

09

Read your bot every week

Connect a bot, get visitors typing, and your analytics page has signal in it the same hour. Open the Analytics tab in your sidebar to see the global rollup, click into any bot for its dedicated view, and spend fifteen minutes a week reading the patterns. You’ll know what your customers want before they fill out a survey, before they file a ticket, and well before they leave for a competitor.

Your customers are already telling you what they want.

In their own words. In real time. The analytics start the moment your bot starts answering — without you ever having to ask.