AI learning

Chapter 7 · Large language models2020

Scaling laws

Loss falls predictably as you scale model size, data and compute together.

Preparing scaling laws: why bigger models learn more
YOUR BROWSER, YOUR CHOICE