Chapter 17 · AI and society
Energy and the environment
Training and running large models uses a lot of electricity and water; efficiency gains matter.
Preparing ai energy and the environment
Chapter 17 · AI and society
Training and running large models uses a lot of electricity and water; efficiency gains matter.
Every answer needs computing, and computing needs power, usually with cooling. Add up many requests, or one long training run, and it becomes a real amount.
Training a large model keeps many chips running for days or weeks. That uses a lot of electricity at once.
The starting figures are illustrative placeholders, not measurements. Replace every one with a figure from a source you trust.
The result is only as good as the figures you typed. Treat it as a way to think, not a measured fact.
Why can running a model matter as much as training it?
What decides the carbon from a kWh?
How should you treat an energy estimate?