unslothai/unsloth

★ 79,276⑂ 7,382

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

About unslothai/unsloth

unslothai/unsloth is an open-source project on GitHub, mainly written in Python. Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more. It currently holds 79,276 stars and 7,382 forks with 490 open issues, and was last pushed on 2026-11-10 (repository created 2023-11-29).

Project Overview

Git Homed tracks it on the Image Trending board and on the AI Image Trending list.

GitHub Repository Details

Repository unslothai/unsloth · default branch main · size 678523 KB · watchers 379 · source: GitHub REST API and repository README

README

https://github.com/unslothai/unsloth/blob/HEAD/Unsloth logo

Unsloth is the first desktop app to run and train models.

Features • Quickstart • Notebooks • Documentation

https://github.com/unslothai/unsloth/blob/HEAD/unsloth desktop

⚡ Get started

Download the native Unsloth Desktop app for your operating system:
Platform Link
Windows Download
macOS Download
Linux / Ubuntu (deb) Download
Linux / Ubuntu (ARM64) (deb) Download
Linux (AppImage) Download
Windows (ARM64) Download

Download from Unsloth or GitHub Releases.

Or if you prefer to install manually:

macOS, Linux, WSL:

curl -fsSL https://unsloth.ai/install.sh | sh

Windows:

irm https://unsloth.ai/install.ps1 | iex

Docker:

The Unsloth Docker image unsloth/unsloth is available on Docker. Read guide.

Homebrew:

brew install --cask unsloth

Winget (Windows):

winget install --id UnslothAI.Unsloth -e

Community:

⭐ Features

Unsloth works on Windows, Linux, WSL and macOS. We support Multi GPU setups, NVIDIA, AMD, Intel GPUs, CPUs and the Vulkan backend.

Run & Build with AI

Train & Deploy

🚀 Unsloth Start

Unsloth Start connects Claude Code, Codex and other agents to local models with one command.

unsloth start claude --model unsloth/Qwen3.8-27B-GGUF:UD-Q4_K_XL

| Agent | Command | | --- | --- | | Claude Code | unsloth start claude | | OpenAI Codex | unsloth start codex | | Visual Studio Code | unsloth start vscode | | DeepSeek Harness | unsloth start dsh | | OpenCode | unsloth start opencode | | Hermes Agent | unsloth start hermes | | Pi | unsloth start pi | | OpenClaw | unsloth start openclaw | | Mistral Vibe | unsloth start vibe |

📥 Install

Unsloth can be used in three ways: Unsloth Desktop, the desktop app; Unsloth Studio, the web UI; or Unsloth Core, the code based version.

Unsloth Desktop (recommended)

Platform Link
Windows Download
macOS Download
Linux / Ubuntu (deb) Download
Linux / Ubuntu (ARM64) (deb) Download
Linux (AppImage) Download
Windows (ARM64) Download

To choose Desktop's local HTTP port, set UNSLOTH_DESKTOP_PORT=9000 in the environment that launches the app, then fully quit and reopen Desktop. Unset or empty keeps the default port 8888. If the selected port is busy, Desktop tries the next 20 ports. Choose a port between 1024 and 65515; Desktop rejects ranges containing a browser-restricted port. This setting applies to Desktop, including backend restarts after updates; it does not change the web UI's unsloth studio -p option or the separate LAN access port.

Unsloth Studio (web UI)

macOS, Linux, WSL:

curl -fsSL https://unsloth.ai/install.sh | sh

Windows:

irm https://unsloth.ai/install.ps1 | iex

Homebrew:

brew install --cask unsloth

Docker

Use our Docker image ``unsloth/unsloth``. On Linux and Mac, set up GPU access once with
curl -fsSL https://raw.githubusercontent.com/unslothai/unsloth/main/docker/install_nvidia_toolkit.sh -o install_nvidia_toolkit.sh && sudo -E bash install_nvidia_toolkit.sh
For Windows instructions and more information, read our Unsloth Docker Guide.

Linux / WSL (Bash):

# for a public Cloudflare HTTPS link: use  -e UNSLOTH_STUDIO_SECURE=1  instead of -p 8000:8000, and  -p 127.0.0.1:8888:8888  instead of -p 8888:8888
docker run -d --name unsloth --gpus all --ipc=host \
  -p 8000:8000 -p 8888:8888 \
  -v "$PWD":/workspace/host \
  -v unsloth-workspace:/workspace \
  -v "$HOME/.cache/huggingface":/workspace/.cache/huggingface \
  -v unsloth-studio:/opt/unsloth-studio \
  unsloth/unsloth && docker logs -f unsloth
See Docker docs for more information. For notebooks only, use the unsloth/unsloth:core tag; all tags and options are on Docker Hub.
For AMD there is a separate image: unsloth/unsloth-rocm.

---

Launch

unsloth studio

HTTP Secure Deployment

unsloth studio --secure

Remote HTTPS & LAN Access

Server-side tools are on by default - so be careful! Keep your password safe, or use --disable-tools when exposing Unsloth.

Global HTTPS Access: Creates a free Cloudflare link that serves Unsloth - you can access the link globally (even on your phone!)

unsloth studio --secure
-H 0.0.0.0 and different ports also work:
unsloth studio -H 0.0.0.0 -p 8888
LAN Access (home network): Settings > API keys > LAN access

Your own reverse proxy or custom domain (Cloudflare Named Tunnel, nginx, Caddy) running on the same computer: Unsloth Desktop only serves its web UI to a proxy for hostnames you list (comma separated), so set them, then quit and reopen it:

export UNSLOTH_STUDIO_PROXY_HOSTS=studio.example.com            # Linux: start Unsloth Desktop from this shell
launchctl setenv UNSLOTH_STUDIO_PROXY_HOSTS studio.example.com  # macOS
setx UNSLOTH_STUDIO_PROXY_HOSTS studio.example.com              # Windows
The proxy must send that hostname as Host (cloudflared's default, so leave its HTTP Host Header override unset) or as X-Forwarded-Host. Sign in with the password from Settings > Remote access > Remote password.

To serve HTTPS with your own certificate without passing --ssl-certfile/--ssl-keyfile (Docker, systemd), set both variables before unsloth studio; passing either flag ignores them:

UNSLOTH_STUDIO_SSL_CERTFILE=/path/to/full-chain.pem \
UNSLOTH_STUDIO_SSL_KEYFILE=/path/to/private-key.pem \
unsloth studio

Password management & headless starts

Exposing Unsloth (--secure, --cloudflare, or a non-loopback -H) asks once at the terminal for a new admin password. Ctrl+C there aborts the launch rather than exposing the auto-generated one; set a password non-interactively instead, or use -H 127.0.0.1 to stay off the network.

Headless starts:

UNSLOTH_STUDIO_PASSWORD='your-strong-password' unsloth studio --secure   # via env var
Reset your password:
unsloth studio reset-password

Developer, Nightly, Uninstall

To see developer, nightly and uninstallation etc. instructions, see advanced installation.

Unsloth Core (code-based)

Linux, WSL:

curl -LsSf https://astral.sh/uv/install.sh | sh
uv venv unsloth_env --python 3.13
source unsloth_env/bin/activate
uv pip install unsloth --torch-backend=auto

Windows:

winget install -e --id Python.Python.3.13
winget install --id=astral-sh.uv  -e
uv venv unsloth_env --python 3.13
.\unsloth_env\Scripts\activate
uv pip install torchao
uv pip install unsloth --torch-backend=auto
Install torchao first on Windows: --torch-backend looks for it only on the PyTorch index, which has no recent Windows torchao, so a one-step install silently resolves an old Unsloth.

AMD, Intel, DGX Spark, Blackwell:

See our Blackwell guide and DGX Spark guide.
To install Unsloth on AMD and Intel GPUs, follow our AMD Guide and Intel Guide.

📒 Free Notebooks

Train for free with our notebooks. Read our guide. Add dataset, run, then deploy your trained model.

| Model | Free Notebooks | Performance | Memory use | |-----------|---------|--------|----------| | Unsloth Studio | ▶️ Start for free | | | | Decision model (Qwen3.5-4B) | ▶️ Start for free-Decision.ipynb) | 1.5x faster | 60% less | | Gemma 4 (E2B) | ▶️ Start for free-Vision.ipynb) | 1.5x faster | 50% less | | Qwen3.5 (4B) | ▶️ Start for free_Vision.ipynb) | 1.5x faster | 60% less | | gpt-oss (20B) | ▶️ Start for free-Fine-tuning.ipynb) | 2x faster | 70% less | | Qwen3.5 GSPO | ▶️ Start for free_Vision_GRPO.ipynb) | 2x faster | 70% less | | gpt-oss (20B): GRPO | ▶️ Start for free-GRPO.ipynb) | 2x faster | 80% less | | Qwen3: Advanced GRPO | ▶️ Start for free-GRPO.ipynb) | 2x faster | 70% less | | embeddinggemma (300M) | ▶️ Start for free.ipynb) | 2x faster | 20% less | | Llama 3.1 (8B) Alpaca | ▶️ Start for free-Alpaca.ipynb) | 2x faster | 70% less | | Llama 3.2 Conversational | ▶️ Start for free-Conversational.ipynb) | 2x faster | 70% less | | Orpheus-TTS (3B) | ▶️ Start for free-TTS.ipynb) | 1.5x faster | 50% less |

📥 Advanced Installation

The below advanced instructions are for Unsloth Studio. For Unsloth Core advanced installation, view our docs.

Developer / Nightly / Experimental installs: macOS, Linux, WSL:

The developer install builds from the main branch, which is the latest (nightly) source.
git clone https://github.com/unslothai/unsloth
cd unsloth
./install.sh --local
unsloth studio -p 8888
To install into an isolated location, set UNSLOTH_STUDIO_HOME:
UNSLOTH_STUDIO_HOME="$PWD/.studio" ./install.sh --local
UNSLOTH_STUDIO_HOME="$PWD/.studio" unsloth studio -p 8888
Then to update:
cd unsloth && git pull
./install.sh --local
unsloth studio -p 8888

Developer / Nightly / Experimental installs: Windows PowerShell:

The developer install builds from the main branch, which is the latest (nightly) source.
git clone https://github.com/unslothai/unsloth.git
cd unsloth
Set-ExecutionPolicy -Scope Process -ExecutionPolicy RemoteSigned
.\install.ps1 --local
unsloth studio -p 8888
To install into an isolated location, set UNSLOTH_STUDIO_HOME:
$env:UNSLOTH_STUDIO_HOME="$PWD\.studio"; .\install.ps1 --local
$env:UNSLOTH_STUDIO_HOME="$PWD\.studio"; unsloth studio -p 8888
Then to update:
cd unsloth; git pull
.\install.ps1 --local
unsloth studio -p 8888

Advanced launch options

Skip PyTorch (GGUF-only mode):

curl -fsSL https://unsloth.ai/install.sh | UNSLOTH_NO_TORCH=1 sh
$env:UNSLOTH_NO_TORCH=1; irm https://unsloth.ai/install.ps1 | iex

Skip the post-install prompt that starts Unsloth (useful for automated installs):

curl -fsSL https://unsloth.ai/install.sh | UNSLOTH_SKIP_AUTOSTART=1 sh
$env:UNSLOTH_SKIP_AUTOSTART=1; irm https://unsloth.ai/install.ps1 | iex

Keep the install-time package cache under the Unsloth Studio directory instead of reusing an existing uv cache. Downloads are slower the first time, and an explicit UV_CACHE_DIR still wins over this:

curl -fsSL https://unsloth.ai/install.sh | UNSLOTH_ISOLATE_UV_CACHE=1 sh
$env:UNSLOTH_ISOLATE_UV_CACHE=1; irm https://unsloth.ai/install.ps1 | iex
For a local run the flag is --isolated-uv-cache:
./install.sh --local --isolated-uv-cache
.\install.ps1 --local --isolated-uv-cache

Discard the previous environment immediately when reinstalling, instead of keeping a copy until the new one works. A reinstall normally holds both at once, so it needs room for two; this needs room for one, at the cost of not being able to undo a failed install:

curl -fsSL https://unsloth.ai/install.sh | UNSLOTH_INSTALL_NO_ROLLBACK=1 sh
$env:UNSLOTH_INSTALL_NO_ROLLBACK=1; irm https://unsloth.ai/install.ps1 | iex
For a local run the flag is --no-rollback:
./install.sh --local --no-rollback
.\install.ps1 --local --no-rollback

Pinning the Python version:

curl -fsSL https://unsloth.ai/install.sh | UNSLOTH_PYTHON=3.12 sh
$env:UNSLOTH_PYTHON='3.12'; irm https://unsloth.ai/install.ps1 | iex

Install to a custom location with UNSLOTH_STUDIO_HOME:

curl -fsSL https://unsloth.ai/install.sh | UNSLOTH_STUDIO_HOME=/abs/path sh
$env:UNSLOTH_STUDIO_HOME='C:\path'; irm https://unsloth.ai/install.ps1 | iex

Point the frontend build at a corporate npm mirror/proxy with UNSLOTH_NPM_REGISTRY:

UNSLOTH_NPM_REGISTRY=https://artifactory.example.com/api/npm/npm/ ./install.sh --local
$env:UNSLOTH_NPM_REGISTRY='https://artifactory.example.com/api/npm/npm/'; .\install.ps1 --local

Cap Unsloth's native CPU thread pools on high-core hosts: UNSLOTH_CPU_THREADS=8 unsloth studio -p 8888.

Vulkan, custom llama.cpp backends:

Pick the llama.cpp build GGUF chat runs on during installation. PyTorch is picked separately from your GPU, so this does not change it:

export UNSLOTH_LLAMA_CPP_BACKEND=vulkan   # or cpu, cuda, rocm, auto
curl -fsSL https://unsloth.ai/install.sh | sh
$env:UNSLOTH_LLAMA_CPP_BACKEND="vulkan"   # or cpu, cuda, rocm, auto
irm https://unsloth.ai/install.ps1 | iex

To choose PyTorch yourself, pin its index:

curl -fsSL https://unsloth.ai/install.sh | UNSLOTH_TORCH_INDEX_FAMILY=cpu sh   # or a family like rocm7.2
Or skip PyTorch for GGUF chat only:
curl -fsSL https://unsloth.ai/install.sh | UNSLOTH_NO_TORCH=1 sh

audio.cpp audio engine:

Setup also installs audio.cpp (prebuilt by unslothai/audio.cpp), which runs the audio.cpp speech, music and speech-to-text models on the Audio page, in Voice settings and behind /v1/audio/*. It is optional and never blocks setup:

Uninstall

MacOS, WSL, Linux: curl -fsSL https://raw.githubusercontent.com/unslothai/unsloth/main/scripts/uninstall.sh | sh

Windows (PowerShell): irm https://raw.githubusercontent.com/unslothai/unsloth/main/scripts/uninstall.ps1 | iex

For more info, see our docs.

Deleting model files

You can delete old model files either from the bin icon in model search or by removing the relevant cached model folder from the default Hugging Face cache directory. By default, HF uses:

MacOS, Linux, WSL: ~/.cache/huggingface/hub/

Windows: %USERPROFILE%\.cache\huggingface\hub\

💚 Community and Links

| Type | Links | | ----------------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------ | |   Discord | Join Discord server | |   r/unsloth Reddit | Join Reddit community | | 📚 Documentation & Wiki | Read Our Docs | |   Twitter (aka X) | Follow us on X | | 🔮 Our Models

GitHub Stars & Activity

79,276Stars
7,382Forks
490Open issues
PythonLanguage

GitHub Popularity

GitHub stars79,276
Forks7,382
Open issues490
Primary languagePython
LicenseApache-2.0
Stars gained today0
Created2023-11-29
Last pushed2026-11-10

Trending History

Trending statusnot on today's boards

Related GitHub Projects

1
→
2

Comfy-Org / ComfyUI

Python★ 147,283⑂ 0
→
3

ultralytics / ultralytics

Python★ 63,514⑂ 0
→
4

ultralytics / yolov5

Python★ 58,280⑂ 0
→
5

roboflow / supervision

Python★ 51,645⑂ 0
→
6

huggingface / diffusers

Python★ 34,931⑂ 0
→
7

ATH-MaaS / Pixelle-Video

Python★ 30,170⑂ 0
→
8

lucidrains / vit-pytorch

Python★ 25,578⑂ 0
→

More Trending Repositories