A neural network trained on massive text corpora to predict the next token, enabling it to generate and understand language.
Last updated
A neural network architecture that uses self-attention to weigh the importance of every word in a sequence relative to e...
A chunk of text, roughly a word or part of a word, that a language model reads and generates.
The maximum amount of text, measured in tokens, that a model can consider at once.
A large model pre-trained on broad data that can be adapted to many downstream tasks.
Prices keep falling and context windows keep growing. We break down how providers charge, what hidden limits to watch and how to c...
Nearly every modern AI model shares one architecture. Understanding the transformer explains what these models are good at and whe...
Browse the full AI glossary or compare AI tools that use this technology.