Country
You are in the Global edition. Type your country to switch.
Nigeria
Loading every country…
No country matches. Check the spelling, or choose "Any country" for the Global edition.
Your learning profile
Advanced strategies & derivatives: Advanced · Lesson 7 of 7
Backtesting pitfalls: why past results mislead
A backtest checks how a strategy would have done on past data. It is easy to fool yourself with overfitting, survivorship bias, look-ahead bias and ignored costs, so a good backtest is a skeptical one.
This lesson is complete in writing. A video for it is on its way.
What you will learn
- By the end you can explain what a backtest is and what it can and cannot show.
- You can recognize overfitting, survivorship bias and look-ahead bias.
- You can explain how costs and liquidity change backtest results.
- You can judge a backtest's return against its risk and drawdowns.
- You can follow a checklist for testing a strategy fairly.
Key terms in this lesson
- Backtest
- A test of how a strategy would have performed on past data.
- Overfitting
- Tuning a model or strategy so closely to past data that it captures noise and fails on new data.
- Survivorship bias
- Distorted results from studying only the survivors, such as companies still listed, and ignoring those that failed.
- Look-ahead bias
- Using information in a test that would not have been known at the time.
- Step 1: Testing an idea on the past, not started
- Step 2: Overfitting: finding patterns in noise, not started
- Step 3: Survivorship and look-ahead bias, not started
- Step 4: Costs, spreads and liquidity, not started
- Step 5: Judging return against risk, not started
- Step 6: A checklist for a fair test, not started
About 7 min of reading
Step 1 of 6
Testing an idea on the past
Opening this step…
Step 2 of 6
Overfitting: finding patterns in noise
This step opens when you finish the one above.
Step 3 of 6
Survivorship and look-ahead bias
This step opens when you finish the one above.
Step 4 of 6
Costs, spreads and liquidity
This step opens when you finish the one above.
Step 5 of 6
Judging return against risk
This step opens when you finish the one above.
Step 6 of 6
A checklist for a fair test
This step opens when you finish the one above.
Key takeaways
The key takeaways open when you finish every step.
Lesson quiz
5 questions. You need 85% to pass.
The quiz opens when you finish every step.
Read first
Stockertim Learn is education. It explains how investing works and never recommends buying or selling anything.
Popular this week: Basics: BeginnerUS & global markets: Beginner