What is temperature in a language model?
Temperature is a setting that controls how much randomness a model introduces when generating its next word, and it's part of why asking a model the same question twice can produce different citations.
When a language model generates text, at each step it's choosing among many possible next words, each with some likelihood. Temperature controls how sharply that choice favors the most likely option. At low temperature, the model almost always picks the highest-probability word, producing repetitive, predictable output. At higher temperature, it more often picks less likely words, producing more varied output, and, along the way, more varied citations.
This matters for AI visibility because temperature is usually set by the platform, not the user, and most consumer AI products run at a temperature well above zero for the sake of natural-sounding answers. That means the same prompt run twice through the same model can surface a different set of sources, not because anything about the web changed, but because the model's word-by-word choices landed differently both times.
This is the mechanical reason a prompt basket needs to be run more than once to mean anything: a single run at nonzero temperature is one sample from many possible answers, not the answer.
Related
- Sampling varianceSampling variance is the run-to-run variation you get from asking a language model the same question more than once.
- NondeterminismNondeterminism is the property that running the exact same input through a model can produce different output each time, and it doesn't fully go away even when settings ask the model to be as predictable as possible.
- Model driftModel drift is when an engine's answers change because the provider changed the model behind it, not because anything about your brand changed.
- Prompt basketA prompt basket is the fixed set of questions a visibility tool asks engines on your behalf in order to measure how often you are named.
Want to know where you actually stand on this? Run a free visibility check or try the free tools.