Country: Mexico
You are in the Mexico edition. Type your country to switch.
Nigeria
The Americas
Loading every country…
No country matches. Check the spelling, or choose "Any country" for the Global edition.
You are learning in the Mexico edition, with examples in pesos and from Mexico.
Your learning profile
Marketing analytics and measurement · Lesson 4 of 9
Experiments and incrementality
The only way to know what a campaign caused is to compare people who saw it with similar people who did not. This lesson explains test and control groups, geographic tests and holdouts, then works an uplift calculation from conversion rates to incremental sales and cost per incremental sale.
This lesson is complete in writing. A video for it is on its way.
What you will learn
- By the end you can explain what incrementality means and why it is the only measure of what marketing caused.
- You can describe a test group, a control group, a holdout and a geographic test.
- You can calculate uplift, incremental sales and cost per incremental sale from two conversion rates.
- You can say why a platform's cost per sale and the cost per incremental sale differ so much.
Key terms in this lesson
- Incrementality
- The extra result that a piece of marketing caused, found by comparing what happened with it against what would have happened without it.
- Control group
- A set of people or places that is deliberately not shown a piece of marketing so that its results can be compared fairly with a matched group that was.
- Percentage point
- The unit for the gap between two percentages. A rate that moves from 4% to 5% has risen 1 percentage point, which is a 25% rise in the rate itself.
- Sample size
- The number of observations, such as trades, in a test. Small samples make it hard to tell a real effect from luck.
- Step 1: What incrementality means, not started
- Step 2: Test, control, holdout and geo, not started
- Step 3: A worked uplift calculation, not started
- Step 4: Reported cost per sale against incremental, not started
- Step 5: Running a test that can be trusted, not started
About 6 min of reading
Step 1 of 5
What incrementality means
Opening this step…
Step 2 of 5
Test, control, holdout and geo
This step opens when you finish the one above.
Step 3 of 5
A worked uplift calculation
This step opens when you finish the one above.
Step 4 of 5
Reported cost per sale against incremental
This step opens when you finish the one above.
Step 5 of 5
Running a test that can be trusted
This step opens when you finish the one above.
Key takeaways
The key takeaways open when you finish every step.
Lesson quiz
5 questions. You need 85% to pass.
The quiz opens when you finish every step.
Read first
Stockertim Learn is education. It explains how investing works and never recommends buying or selling anything.
Popular in Mexico: Financial markets law and regulation: foundationsFutures contracts and CFDs