Skip to content

Stockertim Dictionary · Artificial intelligence

Temperature

Also called sampling temperature, temperature setting

In short

Temperature is a sampling setting that controls how varied a model's output is: lower values give more predictable wording, higher values give more varied and surprising text.

  • Beginner
  • Concept
  • Checked

In detail

At each step a language model scores every possible next token by how likely it looks. Sampling then picks one. Temperature reshapes those scores before the pick. When the temperature is low, the most likely tokens dominate and the wording varies little from run to run. When it is higher, less likely tokens get a bigger share, so the text becomes more varied, sometimes more creative and sometimes less accurate.

Temperature is one reason the same prompt can give different answers on different runs. Even at a low setting, some variation can remain because of how the software is built. Many chat assistants fix the temperature for the user, while tools built on a model's programming interface usually expose it as a number, often between 0 and 1 or 0 and 2, depending on the service.

The setting changes style and variety, not knowledge. A low temperature does not make an answer true, and a high one does not make the model more intelligent. It is a dial for consistency against variety, chosen to suit the task.

Worked example

Northwind Bikes uses an AI tool for two jobs: extracting invoice fields and brainstorming product names.

  1. For invoice extraction the team sets a low temperature, so the same invoice produces the same fields each time.
  2. For naming ideas the team raises the temperature, so each run offers a wider spread of suggestions.
  3. Both outputs are still checked by a person before use.

Matching the setting to the task gives consistent extraction and varied brainstorming, without changing what the model knows.

In practice

Developers set temperature low for classification, extraction and anything that is tested against fixed answers, and higher for drafting options or creative wording. When a prompt is evaluated, the temperature used is recorded so results can be repeated.

Watch out

  • A low temperature reduces variety; it does not remove hallucination.
  • Temperature here is a software setting and has nothing to do with heat or hardware.

Learn it properly

Official sources

Facts last checked on 3 November 2026.

Education, not advice: the Stockertim Dictionary explains what terms mean. It never recommends buying or selling anything.

English