The unit a model processes text in, roughly a word or sub-word; tokens determine context-window size and cost.
A token is the unit language models use to process text, roughly equivalent to a word or piece of a word. Tokens matter in agentic gaming because they determine both how much a model can hold in its context window and how much each inference call costs. A dungeon that produces a large state each tick burns more tokens per action, raising cost and potentially slowing the run.
