Skip to content
Edition NigeriaGlobal
Country: Türkiye

You are in the Türkiye edition. Type your country to switch.

Set up your profile

You are learning in the Türkiye edition, with examples in lira and from Türkiye.

Advanced strategies & derivatives: Advanced · Lesson 7 of 7

Backtesting pitfalls: why past results mislead

A backtest checks how a strategy would have done on past data. It is easy to fool yourself with overfitting, survivorship bias, look-ahead bias and ignored costs, so a good backtest is a skeptical one.

Advanced8 min read6 steps

This lesson is complete in writing. A video for it is on its way.

What you will learn

  • By the end you can explain what a backtest is and what it can and cannot show.
  • You can recognize overfitting, survivorship bias and look-ahead bias.
  • You can explain how costs and liquidity change backtest results.
  • You can judge a backtest's return against its risk and drawdowns.
  • You can follow a checklist for testing a strategy fairly.

Key terms in this lesson

Backtest
A test of how a strategy would have performed on past data.
Overfitting
Tuning a model or strategy so closely to past data that it captures noise and fails on new data.
Survivorship bias
Distorted results from studying only the survivors, such as companies still listed, and ignoring those that failed.
Look-ahead bias
Using information in a test that would not have been known at the time.

Step 1 of 6

Testing an idea on the past

Opening this step…

Step 2 of 6

Overfitting: finding patterns in noise

This step opens when you finish the one above.

Step 3 of 6

Survivorship and look-ahead bias

This step opens when you finish the one above.

Step 4 of 6

Costs, spreads and liquidity

This step opens when you finish the one above.

Step 5 of 6

Judging return against risk

This step opens when you finish the one above.

Step 6 of 6

A checklist for a fair test

This step opens when you finish the one above.

Key takeaways

The key takeaways open when you finish every step.

Lesson quiz

5 questions. You need 85% to pass.

The quiz opens when you finish every step.

Read first

Stockertim Learn is education. It explains how investing works and never recommends buying or selling anything.

Up next

Advanced strategies & derivativesFactor investing: value, momentu…Read nowFactor investing: value, momentum, quality and sizeAdvanced strategies & derivatives · Intermediate · 15 minRisk & psychologyOverconfidence: when a few wins …Read nowOverconfidence: when a few wins go to your headRisk & psychology · Intermediate · 5 minRisk & psychologyConfirmation bias: seeing only w…Read nowConfirmation bias: seeing only what you want to seeRisk & psychology · Intermediate · 5 minTrading: risk, costs and processData hygiene for backtests: poin…Read nowData hygiene for backtests: point-in-time data, survivorship, look-ahead and corporate actionsTrading: risk, costs and process · Advanced · 15 minAdvanced strategies & derivativesPairs and relative value in plai…Read nowPairs and relative value in plain termsAdvanced strategies & derivatives · Advanced · 5 minAdvanced strategies & derivativesEvent-driven investing: earnings…Read nowEvent-driven investing: earnings, mergers and share offeringsAdvanced strategies & derivatives · Advanced · 15 minAI & securityLeakage, look-ahead bias and wal…Read nowLeakage, look-ahead bias and walk-forward validationAI & security · Advanced · 15 minAdvanced strategies & derivativesCovered calls: income from stock…Read nowCovered calls: income from stocks you ownAdvanced strategies & derivatives · Advanced · 15 minAdvanced strategies & derivativesFutures contracts explainedRead nowFutures contracts explainedAdvanced strategies & derivatives · Intermediate · 15 minAdvanced strategies & derivativesLeverage and margin: how borrowi…Read nowLeverage and margin: how borrowing magnifies riskAdvanced strategies & derivatives · Intermediate · 15 min
English