Skip to content
Edition NigeriaGlobal
Country

You are in the Nigeria edition. Type your country to switch.

Set up your profile

AI and machine learning applied to financial data · Lesson 6 of 10

Model risk management and explainability

Model risk is the chance of loss or harm from a model that is wrong or used wrongly. Good practice inventories models, validates them independently, monitors them in use and explains their outputs. Explanation tools show which inputs pushed a prediction up or down.

Advanced9 min read5 steps

This lesson is complete in writing. A video for it is on its way.

What you will learn

  • By the end you can define model risk and name its main sources.
  • You can describe the lifecycle of model risk management: inventory, validation, approval, monitoring and retirement.
  • You can read a simple explanation of one prediction, with each input's plus or minus contribution, and check that it adds up.
  • You can complete and critique a basic model card.

Key terms in this lesson

Model risk
The risk of loss or harm from a model that is wrong, out of date or used for something it was not designed for.
SR 11-7
Supervisory guidance on model risk management issued by US banking regulators in 2011, which set expectations for model development, independent validation and governance.
Explainability
How well people can understand why a model produced a given output, in terms of which inputs mattered and in which direction.
SHAP value
A widely used way to explain one prediction by sharing out the difference between that prediction and the model's average across the inputs, so each input gets a plus or minus contribution.
Model card
A short document that records what a model is for, the data it learned from, how it was tested, where it performs poorly, who owns it and when it was last reviewed.

Step 1 of 5

What model risk is

Opening this step…

Step 2 of 5

The model risk management lifecycle

This step opens when you finish the one above.

Step 3 of 5

Explainability: why did the model say that?

This step opens when you finish the one above.

Step 4 of 5

What explanations can and cannot tell you

This step opens when you finish the one above.

Step 5 of 5

Exercise: completing a model card

This step opens when you finish the one above.

Key takeaways

The key takeaways open when you finish every step.

Lesson quiz

5 questions. You need 85% to pass.

The quiz opens when you finish every step.

Read first

Stockertim Learn is education. It explains how investing works and never recommends buying or selling anything.

Up next

English