AI learning

Chapter 8 · Shaping models: tuning and alignment

Distillation

A small student model learns to imitate a large teacher, keeping much of its skill at lower cost.

Preparing distillation: a small student learns from a big teacher
YOUR BROWSER, YOUR CHOICE