ANALYTICS & ATTRIBUTION

How to Measure Promotion-Mode Incrementality Without Trusting Attributed ROAS

Updated: 9/18/26

Short answer: Attributed ROAS cannot show whether Promotion Mode created additional profit. Measure incrementality with a predeclared counterfactual—such as holdout markets, audiences, products, or staggered timing—and evaluate contribution margin, new customers, and post-promotion effects.

Why promotions break ordinary comparisons

A promotion changes many variables at once: price, urgency, inventory, email volume, direct traffic, conversion rate, and customer timing. Promotion Mode may also relax ROAS tolerance and expand daily budget. Comparing promotional results with the previous week mixes advertising effects with business and seasonal effects.

Platform attribution answers which ads received credit under a defined model. Incrementality asks what would have happened without the additional advertising behavior.

Write the causal question before launch

Define the treatment precisely. Is the change additional budget, looser ROAS tolerance, Promotion Mode as a package, or the promotion itself? Choose one primary question. If every commercial and media variable changes simultaneously, the analysis cannot identify which change produced the result.

Choose the business outcome

Use contribution profit where possible. Revenue ignores discounts, fulfillment, payment costs, returns, and product mix. Lead-generation promotions should use qualified pipeline or closed revenue rather than form submissions.

Select a practical counterfactual

Geo experiments can compare treated markets with a modeled control assembled from untreated regions. Audience holdouts can exclude a randomly selected eligible group. Product holdouts can keep comparable items under the normal media treatment. Staggered rollouts can introduce the setting at different times.

No design is perfect. Geography can differ in weather or competition; audiences can overlap through household devices; products can have different baseline demand. Document the likely biases before reading the result.

Build the measurement window

Include a pre-period long enough to establish normal relationships, the complete promotional period, and a post-period that captures conversion lag and pull-forward. A promotion may look highly incremental during the sale but be partly offset by weaker demand afterward.

Track a layered scorecard

Layer	Metrics
Media delivery	Spend, CPC, impression share, auction mix
Conversion	Orders, qualified leads, conversion rate
Economics	Contribution margin, discount cost, returns
Customer	New-customer rate, repeat rate, lifetime value
Incrementality	Lift, confidence interval, cost per incremental outcome
Aftereffects	Post-period decline and demand pull-forward

Do not optimize the experiment while it runs

A mid-test change to geography, offer, budget rules, or tracking can invalidate the comparison. Set safety thresholds for genuine business risk, but otherwise let the planned window mature. Separate operational monitoring from the final causal readout.

Reconcile platform and experiment results

Attributed conversions can exceed incremental conversions because ads receive credit for customers who would have purchased anyway. They can also miss effects that occur through later direct visits, stores, or devices. Report both views and explain the question each answers.

The MTC guide to Meridian GeoX testing covers experiment planning in more detail.

Practical takeaway: Promotion Mode should be judged by incremental contribution profit, not by the temporary ROAS shown inside the advertising platform.

Pre-register the analysis

Before launch, document the treatment, eligible units, exclusions, primary outcome, observation window, model, confidence standard, and rules for removing bad data. Store the plan where media, analytics, finance, and commercial teams can review it. Pre-registration reduces the temptation to switch metrics or time windows until the result looks favorable.

After the test, report the estimate with uncertainty and practical significance. A statistically positive lift may still be too small to cover discount costs, and a promising but uncertain result may justify a larger follow-up test rather than an immediate rollout.

Frequently asked questions

Can a pre/post comparison prove lift?

Usually not by itself because seasonality, price, competitor activity, and customer timing also change.

What if there are too few markets for a geo test?

Consider audience or product holdouts, staggered timing, or a carefully modeled baseline with explicit limitations.

Should attributed ROAS still be reported?

Yes, as an operational metric. Present it beside incremental outcomes and margin rather than treating it as causal proof.