Skip to content
DigitalNeuron

Modelle & Forschung

Neue Frontier-Modelle, Benchmarks, Trainingsmethoden und die Forschung dahinter.

2 Beiträge

What is a context window, and why does it run out?

A context window is the maximum amount of text, measured in tokens, that a model can consider in a single request. It holds the system instructions, the conversation so far, any documents you paste in, and the answer being generated. When the total exceeds the limit, something has to be dropped or summarised.

Aktualisiert 4 Min. Lesezeit