AI tools

Run an AI model on your computer

Chat with a large language model on your own computer, free and private, using Ollama.

  1. Install Ollama
    Terminal
    brew install ollama
  2. Start it in the background
    Terminal
    brew services start ollama

    It keeps running after restarts, so you only do this once.

  3. Download a small model and chat with it
    Terminal
    ollama run llama3.2

    The first run downloads the model (about 2 GB; bigger models are several GB). Works best on a fairly recent computer with at least 8 GB of memory. Type /bye to stop chatting.

Check it worked

  1. List the models you've downloaded
    Terminal
    ollama list
Undo it
  1. Remove the model
    Terminal
    ollama rm llama3.2
  2. Stop and uninstall Ollama
    Terminal
    brew services stop ollama && brew uninstall ollama
  1. Install Ollama
    Terminal · Ubuntu / Debian
    curl -fsSL https://ollama.com/install.sh | sh

    The official install script. It also sets Ollama up to run in the background.

  2. Download a small model and chat with it
    Terminal · Ubuntu / Debian
    ollama run llama3.2

    The first run downloads the model (about 2 GB; bigger models are several GB). Works best on a fairly recent computer with at least 8 GB of memory. Type /bye to stop chatting.

Check it worked

  1. List the models you've downloaded
    Terminal · Ubuntu / Debian
    ollama list
Undo it
  1. Remove the model
    Terminal · Ubuntu / Debian
    ollama rm llama3.2
  1. Install Ollama
    PowerShell
    winget install Ollama.Ollama

    It runs in the background from the system tray. Close and reopen PowerShell afterwards.

  2. Download a small model and chat with it
    PowerShell
    ollama run llama3.2

    The first run downloads the model (about 2 GB; bigger models are several GB). Works best on a fairly recent computer with at least 8 GB of memory. Type /bye to stop chatting.

Check it worked

  1. List the models you've downloaded
    PowerShell
    ollama list
Undo it
  1. Remove the model
    PowerShell
    ollama rm llama3.2
  2. Uninstall Ollama
    PowerShell
    winget uninstall Ollama.Ollama

New to LLMs? I explain it in plain English on Layman Terms.