Chapter 3 · Neural networks
Epochs, batches and steps
Data is fed in small batches; one pass over all data is an epoch.
Chapter 3 · Neural networks
Data is fed in small batches; one pass over all data is an epoch.
Epoch 1 · batch 1 of 3 · step 1
The model learns from a small batch, updates once, then takes the next batch. When every example has been used once, that is one epoch. Then the data is shuffled and the next epoch begins.
Real datasets are huge. Instead of using all of it for each update, training cuts it into small groups called batches.
Choose the data size, batch size and epochs. Press Next step to light up each batch. The graph compares your batch size (pink) with using all the data at once (violet).
Press Next step to take the first batch.
There are 100 examples and the batch size is 20. How many steps make one epoch?
What is an epoch?
Why shuffle the data between epochs?