magnitudedev/magnitude

▲ 61 stars today★ 7,519⑂ 534

Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.

About magnitudedev/magnitude

magnitudedev/magnitude is an open-source project on GitHub, mainly written in Rust. Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. It currently holds 7,519 stars and 534 forks with 44 open issues, and was last pushed on 2026-10-29 (repository created 2026-06-12).

Project Overview

Git Homed tracks it on the Today's Trending board, currently at rank #64 with 61 new stars today.

GitHub Repository Details

Repository magnitudedev/magnitude · default branch main · size 153394 KB · watchers 33 · source: GitHub REST API and repository README

README

https://github.com/magnitudedev/magnitude/blob/HEAD/Magnitude icon

Magnitude

Run open models as fast as your hardware allows

https://github.com/magnitudedev/magnitude/blob/HEAD/Download Magnitude https://github.com/magnitudedev/magnitude/blob/HEAD/Documentation https://github.com/magnitudedev/magnitude/blob/HEAD/Discord https://github.com/magnitudedev/magnitude/blob/HEAD/Follow Magnitude on Twitter https://github.com/magnitudedev/magnitude/blob/HEAD/GitHub Repo stars

Magnitude is an open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. It's over 2x faster than Ollama and works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU. One click connects it to the agent you already use (Pi, OpenCode, Hermes, Codex, and more).

⭐ Help us reach more developers and grow the Magnitude community. Star this repo!

Get started

Magnitude comes with a desktop app and a CLI. Install from your terminal:

macOS / Linux:

curl -fsSL https://magnitude.dev/install.sh | sh

Windows PowerShell:

irm https://magnitude.dev/install.ps1 | iex

Or download the installer:

Run it on a server

On Linux and macOS, magnitude server setup runs Magnitude as a service that starts at boot, keeps running after logout, updates itself, and serves browsers and agents on other computers. See Remote server.

Why Magnitude?

Over 2x faster than Ollama

https://github.com/magnitudedev/magnitude/blob/HEAD/Magnitude vs Ollama, average of 11 popular local models: 1.32x faster prefill and 2.19x faster decode on Mac, 1.34x faster prefill and 2.17x faster decode on NVIDIA

View full benchmarks →

FAQ

What is Magnitude?

An open source inference engine that optimizes each model for your exact hardware. It ships as a desktop app that runs open models and connects them to the agent you already use.

How is it faster than llama.cpp, Ollama, or LM Studio?

They ship one-size-fits-all kernels, because tuning each model for each chip by hand would take forever. Magnitude tunes them automatically. When you download a model, it spends up to a minute on your actual chip trying different ways to split up the math (how many GPU threads team up, how big a chunk each one takes, how far ahead to load data) and keeps the fastest combination that doesn't change the model's output. See the full benchmarks against Ollama.

What hardware do I need?

Any Apple Silicon, NVIDIA, AMD, or Intel GPU, or nothing but a CPU. There is no fixed minimum. Smaller machines run smaller models, and more memory lets you run larger ones.

What operating systems does it support?

macOS, Linux, and Windows.

Which models does it support?

See the full list at magnitude.dev/models. We write optimized kernels for the most popular open-weight families, which is how we beat generalist engines.

Which agents work with it?

One click connects Pi, OpenCode, Hermes, OpenClaw, Codex, Claude Code, Oh My Pi, and Cline. Anything else works through the OpenAI-compatible API.

Is it private?

Yes. Prompts, files, and models stay on your machine. No internet needed once a model is downloaded.

GitHub Stars & Activity

7,519Stars
534Forks
44Open issues
RustLanguage

GitHub Popularity

GitHub stars7,519
Forks534
Open issues44
Primary languageRust
LicenseApache-2.0
Stars gained today61
Created2026-06-12
Last pushed2026-10-29

Trending History

Daily boardrank #64 · ▲ 61 stars

Related GitHub Projects

1

rustdesk / rustdesk

Rust★ 127,670⑂ 20,201▲ 130 stars
→
2

ruvnet / RuView

Rust★ 101,814⑂ 13,225▲ 212 stars
→
3

pbakaus / impeccable

Rust★ 97,611⑂ 5,757▲ 2,300 stars
→
4

juspay / hyperswitch

Rust★ 45,588⑂ 6,575▲ 31 stars
→
5

janhq / jan

Rust★ 45,194⑂ 3,121▲ 36 stars
→
6

vercel-labs / agent-browser

Rust★ 44,969⑂ 3,077▲ 71 stars
→
7

macro-inc / macro

Rust★ 5,993⑂ 546▲ 57 stars
→
8

agentgateway / agentgateway

Rust★ 5,820⑂ 1,029▲ 35 stars
→

More Trending Repositories