How to Know If Your Marketing Is Actually Working

Last year a healthcare brand doing a little over $20 million came to me convinced their paid search was carrying the business. Their dashboard said so. Every report put branded search at the top, glowing, and so every quarter they shifted more budget into it and trimmed everything that looked softer. The logic felt airtight. The channel with the best return gets more money, you compound the winner, the business grows. The founder had been running that play for two years and could not understand why revenue had flattened while spend kept climbing.

When we built an actual mix model against three years of their spend and revenue, branded search turned out to be one of the least incremental things they were buying. People were searching the brand name because a podcast sponsorship and a stretch of earned press had already done the convincing. Paid search was standing at the finish line taking credit for a race it never ran. Worse, every dollar they had moved out of those upstream channels had quietly shrunk the pool of people who would go on to search the brand at all. They had been defunding the very thing that fed the channel they thought was winning. The growth lever was sitting near the bottom of the dashboard, starved, because it rarely earned the last click.

That gap, between what the dashboard rewards and what the business actually responds to, is the most expensive problem I see in brands between $5 and $50 million. Across more than a hundred engagements and the better part of ninety million dollars in managed budget, the pattern repeats almost word for word. The numbers look fine until they don't, and by the time revenue flattens the misallocation has usually been compounding for a year or more. It is also, for what it costs to fix, the most recoverable money in the building. Here is how I think about it.

1. How do you know if your marketing is actually working?

You know your marketing is working when you can turn a channel off, or scale it up, and watch revenue move the way your model predicted it would.

Most teams never run that test, because the tools they were handed were not built to answer the question. Attribution software assigns credit based on the clicks it can see, which structurally overweights the channels sitting closest to the purchase and ignores everything that built the intent upstream. It is very good at telling you which touchpoint was last in line. It is nearly useless at telling you which spend actually caused the sale. Working marketing is measured by incrementality, and incrementality is a counterfactual question. Not which channel got the credit, but what would have happened to revenue if that money had never been spent. When you cannot answer that, you are not managing a marketing budget. You are decorating one.

2. Why does my dashboard disagree with my revenue?

Your dashboard disagrees with your revenue because last-click attribution counts conversions, not causes, and conversions are not where growth comes from.

Walk it through and the math is almost comic. Every channel in the funnel claims the same sale, so when you add up the attributed revenue across platforms it comes out to more sales than the company actually made. The totals cannot reconcile because the credit is double and triple counted, and whatever sits nearest checkout always wins the argument. Branded search, retargeting, and email are the usual beneficiaries. They are cheap, they convert at a beautiful rate, and they spend almost all of their time harvesting demand that other channels created upstream. That is why cutting them hurts immediately and scaling them does so little. You feel the loss when you turn them off because they are catching real intent. You see no new growth when you pour money in because they were never the thing generating the intent in the first place. A dashboard cannot tell those two situations apart. That distinction is the entire game.

3. What is marketing mix modeling, and do I need it at my size?

Marketing mix modeling measures how each channel actually moves revenue by analyzing your real spend and sales over time, independent of cookies, pixels, or the channels self-reporting their own performance.

Instead of trusting the platforms to grade their own homework, it looks at the whole system at once and isolates what each input contributed, including the things attribution can never see, like brand demand, seasonality, price, and the lag between a campaign and the sale it eventually produces. For years it was a tool only enterprise brands could afford, run by teams of econometricians on eight-figure budgets, which is why most mid-market companies still operate on attribution dashboards built for direct response. That has changed, and the brands moving first are the ones quietly pulling ahead. A focused mix model on a company spending a few hundred thousand a month routinely surfaces six and seven figures of misallocated budget, money already committed, simply pointed at the wrong channels. The win is rarely a bigger budget. It is finding out which third of the current one is doing the work and moving the rest to join it.

4. Why does share of voice predict growth better than clicks?

Share of voice predicts growth because brands that hold more category attention than their market share tend to grow into it, and brands that hold less tend to shrink toward it.

This is one of the most durable findings in marketing science, and it is almost entirely missing from the dashboards founders study every morning. Clicks describe what already happened. Share of voice tells you where the business is heading before the revenue confirms it. When a brand lets its share of attention slip below its share of market, growth has usually already stalled in the data even if the trailing numbers still look healthy, and by the time the revenue catches up the cause is months in the past and hard to trace. When I audit a company, the first thing I want to see is not their return on ad spend. It is whether they are buying and earning enough attention to defend the position they already hold, because that number tells me what next year looks like, and the dashboard only tells me about last week.

5. Why can't my agency or in-house team just figure this out?

Your agency and your in-house team usually cannot solve this, not because they lack talent, but because the question runs against their incentives and outside their toolset.

Agencies are paid to run channels, and the channels they run are the ones that look best in the attribution they report on. Asking the agency buying your paid search whether paid search is incremental is asking it to argue for a smaller invoice. In-house teams are sharp, but they were hired to execute against the measurement system they inherited, and pulling a credible mix model apart requires a statistics and econometrics background that most marketing careers never touch. This is the part of the work I came up through. My doctorate sits across marketing, statistics, and psychology, and I spent two decades teaching the methods before I spent the last several running them against live client P&Ls. The reason this gap persists in so many good companies is that almost no one sits at the intersection of the modeling and the marketing. The people who understand the math do not usually understand the buying, and the people who understand the buying cannot usually build the model. You need someone who has lived on both sides of that line, and you need them from outside the org chart, where there is nothing to protect.

6. What should you do before spending another dollar on ads?

Before you spend another dollar, get an independent read on what your current spend is actually producing.

A marketing effectiveness audit looks at your real numbers, separates the channels creating demand from the ones merely harvesting it, measures where your attention sits against your category, and tells you where the next dollar belongs. For most brands at this size it pays for itself in the first reallocation, often many times over, because the money it frees was already being spent. Every month you wait, the misallocation keeps compounding and a competitor who fixed theirs keeps pulling further ahead on the one metric that predicts who wins the category. If you have been scaling on faith and a dashboard, this is the place to start, and it is worth starting now.

If you want a clear, independent answer on what your marketing is really doing, you can book a strategy call here: https://www.orr-consulting.com/bookamarketingstrategycall

FAQs

How do you know if your marketing is actually working? You know it is working when you can turn a channel off, or scale it up, and watch revenue move the way your model predicted. Working marketing is measured by incrementality, the counterfactual of what would have happened without the spend, not by which pixel fired last.

Why does my marketing dashboard disagree with my revenue? Last-click attribution counts conversions, not causes, so every channel claims the same sale and the attributed totals exceed the sales the company actually made. Whatever sits nearest checkout wins the credit, which is why cutting harvesting channels hurts immediately while scaling them produces almost no new growth.

What is marketing mix modeling, and do I need it at my size? Marketing mix modeling measures how each channel moves revenue by analyzing real spend and sales over time, independent of cookies or self-reported platform data. A focused model on a mid-market brand routinely finds six and seven figures of already-budgeted spend aimed at the wrong channels.

Why does share of voice predict growth better than clicks? Brands holding more category attention than their market share tend to grow into it, and brands holding less tend to shrink toward it. Clicks describe yesterday. Share of voice signals where the business is heading before the revenue confirms it.

Why can't my agency or in-house team just figure this out? Agencies are paid to run the channels they report on, so asking them whether those channels are incremental works against their own invoice, and in-house teams were hired to execute against the measurement system they inherited. Pulling apart a credible mix model takes a statistics and econometrics background most marketing careers never touch, which is why an independent read is usually required.

What should you do before spending another dollar on ads? Get an independent marketing effectiveness audit that separates the channels creating demand from the ones harvesting it and measures your share of attention against your category. For most brands at this size it pays for itself in the first reallocation, and every month of delay lets the misallocation compound.