What is a ChatGPT token?
A ChatGPT token is a fundamental unit of text used by the Large Language Model (LLM).
It may be a word, part of a word, a character, a punctuation mark or a symbol.
A token is about four characters or 0.75 words on average.
It is essential for processing and producing language.
ChatGPT converts input text into tokens through a process called tokenisation.
The total number of tokens includes both the input text and the AI-generated responses.
The total affects factors such as the maximum context length the model can maintain, which in turn influences how much of the previous conversation it can consider whilst producing a response.