A neural network architecture that uses self-attention to weigh the importance of every word in a sequence relative to every other word.
Last updated
A neural network trained on massive text corpora to predict the next token, enabling it to generate and understand langu...
A numeric vector that represents the meaning of text, an image or another object so that similar items sit close togethe...
A computing model made of connected nodes organised in layers that learn by adjusting the strength of their connections.
Nearly every modern AI model shares one architecture. Understanding the transformer explains what these models are good at and whe...
Browse the full AI glossary or compare AI tools that use this technology.