Chapter 18 · Hands-on: set up your AI workbench
The model landscape: open and closed
Some models are used only through a company's service; open-weight models can be downloaded and run yourself, under their licence.
Chapter 18 · Hands-on: set up your AI workbench
Some models are used only through a company's service; open-weight models can be downloaded and run yourself, under their licence.
You send questions. The model stays with the service.
You can download the file and run it yourself.
A hosted model is like a service window: you pass a question through and get an answer, but you never hold the model. An open-weight model is a file you can take home and run yourself, as long as you follow its licence.
Before you download any model, read its page. One popular place to browse open-weight models is Hugging Face. Your runner’s own model library has similar pages. You only need a web browser for this lesson.
Search for any small model you saw in the last lessons and open its page. This page is often called a model card: a short description of what the model is for, how it was made and how to use it.
Check: you can find the model card text and the name of whoever published it.
Look for a field named License near the top, or a file called LICENSE. The licence is the rulebook for what you may do with the model.
Check: you can write down the licence name.
Open the licence text and answer the checklist below in your own words. Some licences are very permissive. Others allow personal use but limit selling or large-scale use. If a rule is unclear, treat it as not allowed until you are sure.
Check: you know whether you may use the model for your purpose.
“Open-weight” means the trained numbers are published. It does not always mean the training data or the full recipe is open. “Open source” has a stricter meaning, so check which words a project uses.
Check: you can say what you get: weights only, or weights plus code and data.
In a text file in your ai-workbench folder, write the model name, who published it, its licence and the date you checked. Licences can change, so a dated note saves you later.
Check: a small note exists with four lines of information.
Pick one for each card. There are no products to compare here: only the two kinds of model.
My private documents must never leave my computer.
I want to work on a plane with no internet.
I want to try an idea in five minutes with no setup.
I want to fine-tune a model on my own examples.
My task needs a very large model, and my laptop is small.
I need the model to stay exactly the same for months.
I will use AI only a few times a month.
Pick an answer for each card.
What can you do with an open-weight model that you cannot do with a hosted one?
Does open-weight always mean no rules?
Your documents must stay on your computer. Which fits best?