AI learning

Chapter 6 · The Transformer2018

GPT: generative pretraining

GPT models are decoder-only transformers trained to predict the next token, scaled up generation after generation.

Preparing gpt lineage: from gpt to scale
YOUR BROWSER, YOUR CHOICE