Token

Definition: A token is the basic unit an LLM processes: a chunk of a word (often ~4 characters in English). Text is split into tokens before processing.

Models bill and limit usage per token (input + output). The longer the text, the more tokens it consumes.

See also

← Full AI glossary · AI news