All Measure What Matters

Vanity vs Real Metrics

Some numbers go up, feel good, and change nothing. The sorting test in depth: what makes a metric real, why vanity numbers survive, and the practice of demoting them.

Every practice's reporting contains two kinds of numbers wearing identical clothes. Both arrive in charts. Both can go up. One kind — enquiries, booked work, days-to-paid, repeat share — connects to money and decisions. The other — impressions, followers, traffic, "engagement" — mostly connects to feelings. The pillar gave the sorting test; this guide is about actually using it, because the sorting is harder than it looks: vanity metrics are vanity precisely because they're the ones designed to be looked at.

What makes a metric real — three properties, all required: it's connected to money by a path you can trace (visitors → enquiries → bookings → revenue: each arrow checkable); it would change a decision if it moved (a number you'd act on at 40 but not at 60 is an instrument; one you'd admire at both is décor); and it's denominated honestly (rates over counts: "12 enquiries from 300 visits" teaches; "1,400 visits!" performs).

Why vanity numbers survive audit after audit

Knowing the test isn't enough, because vanity metrics have structural advantages worth naming so you can see them operating:

They're bigger. Impressions come in thousands; bookings come in handfuls. Rooms gravitate to large numbers — and every step toward money shrinks the count while raising the meaning.

They're smoother. Traffic climbs gently; bookings arrive lumpy. The smooth line feels like signal and the lumpy one like noise, when it's precisely the reverse for a small practice.

They always go up. Cumulative followers and lifetime page views cannot decline — which is why reports built to please are built from them.

They flatter effort, not effect. Posts published and emails sent measure your activity. Real metrics measure the market's response, which is riskier — and the only thing that pays.

The demotion practice

You rarely need to delete vanity numbers — some are useful diagnostics mid-funnel (traffic explains why enquiries moved; it just can't stand in for them). The discipline is hierarchy:

The index card leads. The handful of real numbers opens every review, every agency report, every monthly look. Anything else appears afterwards, as explanation.

Every diagnostic must serve a real number. Keep traffic because it explains enquiries; keep profile views because they explain calls. A diagnostic serving nothing is décor and gets dropped — each one costs attention, and attention is the scarcest thing a practice measures with.

Translate on sight. The habit that makes this permanent: whenever a standalone big number appears — "3,000 impressions!" — ask aloud what it became. Impressions → visits → enquiries → bookings. The chain either connects or it doesn't, and one month of asking retrains everyone who reports to you, vendors included.

Questions practices actually ask

Are follower counts ever a real metric? For a practice selling attention (a creator, a media business), audience is inventory. For a practice selling services, followers are at best a proof-of-life diagnostic — three arrows and a miracle away from money.

My agency's report is all vanity numbers. Fire them? First, ask for the translation — "which of these became enquiries?" A good agency can answer and will happily restructure the report; one that can't or won't has told you what it's optimising.

Doesn't traffic matter for AI visibility and SEO? As a diagnostic, yes — rising qualified traffic often precedes enquiries by months on the compounding channels. Watch it in that role: leading indicator on the way to real numbers, never the destination.

What if my real numbers are too small to read? That's information, not a measurement failure: small numbers mean judging by quarters not weeks, and by experiments not dashboards. Resist the gravitational pull toward bigger-but-fake numbers just because they wiggle more readably.


Part of Measure What Matters — the instrument panel.

Explore further

Based on the themes in this article, you might find these topics interesting.