There is an astonishing amount of misinformation swirling around how businesses measure the true impact of their marketing dollars, leading many to misallocate resources and miss significant growth opportunities. Understanding marketing attribution and, more profoundly, incrementality is not just an academic exercise; it’s about revealing the real ROI of your marketing spend. How many of your marketing channels are truly adding new customers, rather than just taking credit for conversions that would have happened anyway?
Key Takeaways
- Traditional last-click attribution models inflate the perceived value of channels closer to conversion and fail to account for true incremental lift.
- Employing controlled experimentation, such as A/B tests or geo-experiments, is essential for isolating the causal impact of marketing activities.
- A hybrid approach combining both attribution modeling and incrementality testing provides a more accurate and actionable view of marketing effectiveness.
- Focusing solely on ROAS can be misleading; prioritize strategies that drive genuine incremental revenue, even if their immediate ROAS appears lower.
- Regularly re-evaluate your incrementality measurements as consumer behavior and market dynamics shift, ensuring your marketing investments remain effective.
“Rounded numbers seem less believable. Specific numbers appear trustworthy. So, when someone asks for 17 cents, we think they must have a good reason.”
Myth 1: Last-Click Attribution Accurately Reflects Marketing Value
The biggest lie we tell ourselves in marketing is that the last touchpoint before a conversion deserves all the credit. It’s a convenient fiction, I’ll grant you, easy to implement in most analytics platforms, but it’s fundamentally flawed. This model assigns 100% of the conversion value to the very last marketing interaction a customer had before purchasing. This approach severely undervalues upper-funnel activities, like brand awareness campaigns or initial content discovery, that are absolutely critical in guiding a customer towards a purchase decision.
Think about it: a prospect sees your ad on Google Ads, then later researches your product, reads a blog post you published, and finally clicks a retargeting ad on a social platform to convert. Last-click says the retargeting ad did all the work. That’s just not true. It’s like saying the final touch on a relay race wins the gold, ignoring the three other runners who got the baton there. According to a 2023 IAB Digital Ad Spend Report, while many marketers are moving beyond last-click, it still forms the backbone of reporting for far too many.
We ran into this exact issue at my previous firm. A client, a B2B SaaS company based out of Atlanta, was convinced their paid search campaigns were their golden goose because last-click ROAS looked phenomenal. When we implemented a more sophisticated, data-driven attribution model that considered multiple touchpoints, we discovered their content marketing, which they were about to cut, was playing a significant role in introducing new leads to their product early in the journey. Paid search was simply capturing demand that content had already created. Without understanding that, they would have decimated their lead pipeline.
Myth 2: Higher ROAS Always Means Better Marketing Spend
Return on Ad Spend (ROAS) is a seductive metric. It’s clean, it’s quantitative, and it feels like a direct measure of efficiency. But chasing high ROAS blindly can be a dangerous game, often leading to diminishing returns and a skewed understanding of your true impact. The problem? ROAS doesn’t account for incrementality. A campaign might show an incredible 5x ROAS, but if 80% of those conversions would have happened anyway without your ad, your incremental ROAS is actually quite poor.
Consider a brand running a campaign targeting existing customers or those already highly likely to convert (e.g., direct traffic search terms). The ROAS will look fantastic because these users were already primed. However, the campaign isn’t necessarily driving new, additional revenue. It’s merely intercepting existing demand. This is where the distinction between correlation and causation becomes critical. High ROAS often indicates correlation with existing demand, not causation of new demand.
I had a client last year, a regional e-commerce retailer specializing in outdoor gear, who was obsessed with maintaining a 400% ROAS on all their campaigns. They were pouring money into branded search terms and retargeting known purchasers. Their ROAS looked great on paper, but their overall customer acquisition costs were rising, and their new customer growth was stagnating. We hypothesized they were overspending on audiences who would have converted organically. By reallocating a portion of that budget to prospecting campaigns with a lower immediate ROAS but higher incremental potential (measured through geo-testing), we saw a significant uptick in new customer acquisition and overall revenue growth within two quarters, even as the blended ROAS dipped slightly. That’s a win, despite what the initial ROAS numbers might suggest.
Myth 3: Incrementality is Too Complex for Most Businesses
Many marketers, especially those at small to medium-sized businesses, shy away from incrementality testing, believing it’s an overly complex, resource-intensive endeavor reserved for tech giants. This is simply not true. While sophisticated econometric modeling can be complex, accessible methods for measuring incrementality are available to businesses of all sizes.
The core concept of incrementality is simple: what would have happened if we hadn’t run this marketing activity? To answer this, you need a control group. One of the most straightforward methods is a geo-experiment. You identify geographically distinct regions, expose one group (test) to your marketing campaign, and withhold it from another comparable group (control). By comparing the performance lift in the test group against the control, you can isolate the incremental impact of your campaign. For instance, if you’re running a campaign in Georgia, you might test it in the Atlanta metro area while using Augusta or Savannah as a control, ensuring similar demographics and market conditions.
Another powerful tool is Google Ads’ Experiment feature, which allows you to run A/B tests on campaign changes with statistical significance. You can test variations in bidding strategies, ad copy, or even the presence or absence of certain campaigns to understand their true incremental value. Meta Business also offers similar experiment capabilities within its platform. These aren’t rocket science; they’re built-in features designed to help you make smarter decisions.
Myth 4: Marketing Mix Modeling (MMM) is a Silver Bullet
Marketing Mix Modeling (MMM) has seen a resurgence, especially with privacy changes limiting user-level tracking. MMM uses historical data to statistically quantify the impact of various marketing channels (and other factors like seasonality, promotions, and competitor activity) on sales or other key performance indicators. It can provide a high-level view of how different channels contribute to overall business outcomes, and for that, it’s valuable. However, it’s not a silver bullet, and relying solely on it can lead to misinterpretations.
The primary limitation of MMM is its aggregate nature. It tells you what happened in the past, based on historical spend and outcomes, but it struggles with real-time optimization and granular, campaign-level insights. It’s fantastic for strategic budget allocation across broad channels (e.g., how much to spend on TV versus digital), but less effective for tactical adjustments within a specific digital campaign (e.g., which creative performs better on Instagram for a specific audience segment). Furthermore, MMM can struggle with new channels or rapidly changing market conditions because it relies heavily on historical data patterns. Its accuracy is highly dependent on the quality and completeness of that data, and frankly, many companies don’t have the clean, consistent data sets required for truly robust MMM.
My advice? Use MMM as a foundational layer for strategic planning, but complement it with more granular incrementality testing (like geo-experiments or A/B tests) for tactical optimization. The two approaches are not mutually exclusive; they’re complementary. MMM gives you the forest; incrementality testing helps you understand the trees.
Myth 5: All Conversions Are Created Equal
A conversion is a conversion, right? Not exactly. While a sale is always a good thing, not all sales contribute equally to your long-term business health or reflect true incremental value. This myth often ties back to the ROAS trap we discussed earlier. If your marketing is primarily driving conversions from existing customers or those with a low lifetime value (LTV), you might be generating revenue, but not necessarily sustainable growth.
True incremental value comes from acquiring new customers, increasing purchase frequency from existing, high-LTV customers, or expanding into new markets. A marketing campaign that drives a high volume of low-margin sales might look good on your conversion report, but if those customers never return or cost more to serve than they generate in profit, that “conversion” isn’t nearly as valuable as a higher-margin sale to a new, high-LTV customer.
We need to be more discerning about the type of conversions we’re driving. Are they first-time purchases? Repeat purchases? High-value product sales? Subscription sign-ups? By segmenting your conversions and understanding the incremental impact on each segment, you can shift your marketing spend towards activities that drive the most profitable and sustainable growth. For instance, a campaign targeting lookalike audiences on Meta’s platforms might have a lower immediate ROAS than a retargeting campaign, but if it consistently brings in high-LTV new customers, its long-term incremental value is far superior. This is where a deep understanding of customer lifetime value (CLTV) becomes critical for effective incremental measurement.
Ultimately, a robust understanding of incrementality allows businesses to move beyond vanity metrics and truly optimize their marketing investments for sustainable growth. It’s about asking the hard questions and demanding proof of impact, not just correlation.
What is the difference between marketing attribution and incrementality?
Marketing attribution assigns credit for conversions to various touchpoints in the customer journey, helping understand which channels interacted with the customer. Incrementality, on the other hand, measures the causal effect of a marketing activity, determining how many conversions would not have occurred without that specific intervention.
Why is last-click attribution considered misleading?
Last-click attribution is misleading because it gives all credit for a conversion to the final touchpoint, ignoring all prior interactions that influenced the customer’s decision. This undervalues early-stage awareness and consideration channels, leading to potentially misinformed budget allocation.
What are some common methods for measuring incrementality?
Common methods for measuring incrementality include A/B testing (e.g., testing ad creatives or bidding strategies), geo-experiments (comparing performance in exposed versus unexposed geographic regions), and holdout groups (withholding a campaign from a segment of the audience). These methods establish a control group to isolate the true impact.
Can incrementality be measured for offline marketing channels?
Yes, incrementality can absolutely be measured for offline channels like TV, radio, or print. Geo-experiments are particularly effective here, where you run a campaign in specific regions and compare sales or foot traffic lift against control regions where the campaign was not run. Econometric modeling can also help quantify the impact of offline spend.
How often should a business reassess its incrementality measurements?
Businesses should reassess their incrementality measurements regularly, ideally quarterly or bi-annually, especially if market conditions, consumer behavior, or marketing strategies change significantly. Continuous testing and analysis ensure that marketing investments remain effective and aligned with business goals.
