Run DeepSeek-R1 Locally with Ollama and Open WebUI (Even on a Jetson Orin Nano)

Install DeepSeek-R1 locally with Ollama and Open WebUI for a private, ChatGPT-style chat in your browser. Choose a model size, and run the 1.5B model on an NVIDIA Jetson Orin Nano.

What you’ll set up

This guide runs the DeepSeek-R1 reasoning model on your own computer using Ollama (which downloads and runs models) and Open WebUI (a ChatGPT-style interface in your browser). Nothing is sent to the cloud. At the end I show the small 1.5B model running on an NVIDIA Jetson Orin Nano.

Requirements

  • Python 3.11 or newer
  • Conda (see my conda cheat sheet)
  • Admin rights to install software
  • At least 8 GB of RAM (16 GB or more for the larger models)
  • Tested on Ubuntu Linux

Step 1: Create a conda environment

conda create -n webui python=3.11 -y && conda activate webui 

Step 2: Install Ollama

Linux

curl -fsSL https://ollama.com/install.sh | sh

# Check it installed
ollama --version

macOS

  1. Download Ollama from ollama.com/download/mac.
  2. Open the .dmg and drag Ollama into Applications.
  3. Start Ollama from Applications.

Windows

  1. Download the installer from ollama.com/download/windows.
  2. Run it and follow the steps.
  3. Start Ollama from the Start menu.

Step 3: Install Open WebUI

pip install open-webui

Step 4: Download a DeepSeek-R1 model

Start with the smallest model. It runs on almost any machine:

# DeepSeek-R1-Distill-Qwen-1.5B (smallest, good for edge devices)
ollama run deepseek-r1:1.5b

Larger models give better answers but need much more memory:

# DeepSeek-R1-Distill-Qwen-7B
ollama run deepseek-r1:7b

# DeepSeek-R1-Distill-Llama-8B
ollama run deepseek-r1:8b

# DeepSeek-R1-Distill-Qwen-14B
ollama run deepseek-r1:14b

# DeepSeek-R1-Distill-Qwen-32B
ollama run deepseek-r1:32b

# DeepSeek-R1-Distill-Llama-70B
ollama run deepseek-r1:70b

# Full DeepSeek-R1 (671B, needs server-class hardware)
ollama run deepseek-r1:671b

Step 5: Start Open WebUI

open-webui serve

Then open http://localhost:8080 in your browser, pick the DeepSeek model, and start chatting.

Demo

Running it on an NVIDIA Jetson Orin Nano

I also ran the 1.5B model on an NVIDIA Jetson Orin Nano with 8 GB of memory, and it ran smoothly. Small reasoning models like this are practical on edge devices when you need AI without an internet connection.

Run DeepSeek-R1 Locally with Ollama and Open WebUI (Even on a Jetson Orin Nano)
Run DeepSeek-R1 Locally with Ollama and Open WebUI (Even on a Jetson Orin Nano)