vllm-project/vllm

▲ 3,311 stars today★ 95,837⑂ 24,127

A high-throughput and memory-efficient inference and serving engine for LLMs

About vllm-project/vllm

vllm-project/vllm is an open-source project on GitHub, mainly written in Python. A high-throughput and memory-efficient inference and serving engine for LLMs It currently holds 95,837 stars and 24,127 forks with 9,610 open issues, and was last pushed on 2026-10-29 (repository created 2023-02-09).

Project Overview

Git Homed tracks it on the Today's Trending board.

GitHub Repository Details

Repository vllm-project/vllm · default branch main · size 333412 KB · watchers 607 · source: GitHub REST API and repository README

README

https://github.com/vllm-project/vllm/blob/HEAD/vLLM

Easy, fast, and cheap LLM serving for everyone

| Documentation | Blog | Paper | Twitter/X | User Forum | Developer Slack |

🔥 We have built a vLLM website to help you get started with vLLM. Please visit vllm.ai to learn more. For events, please visit vllm.ai/events to join us.

---

About

vLLM is a fast and easy-to-use library for LLM inference and serving.

Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has grown into one of the most active open-source AI projects built and maintained by a diverse community of many dozens of academic institutions and companies from over 2000 contributors.

vLLM is fast with:

vLLM is flexible and easy to use with: vLLM seamlessly supports 200+ model architectures on Hugging Face, including: Find the full list of supported models here.

Getting Started

Install vLLM with uv (recommended) or pip:

uv pip install vllm
vllm download-kernels  # precompiled kernels for faster startup

Or build from source for development.

Visit our documentation to learn more.

Contributing

We welcome and value any contributions and collaborations. Please check out Contributing to vLLM for how to get involved.

Citation

If you use vLLM for your research, please cite our paper:

@inproceedings{kwon2023efficient,
  title={Efficient Memory Management for Large Language Model Serving with PagedAttention},
  author={Woosuk Kwon and Zhuohan Li and Siyuan Zhuang and Ying Sheng and Lianmin Zheng and Cody Hao Yu and Joseph E. Gonzalez and Hao Zhang and Ion Stoica},
  booktitle={Proceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles},
  year={2023}
}

Contact Us

Media Kit

GitHub Stars & Activity

95,837Stars
24,127Forks
9,610Open issues
PythonLanguage

GitHub Popularity

GitHub stars95,837
Forks24,127
Open issues9,610
Primary languagePython
LicenseApache-2.0
Stars gained today3,311
Created2023-02-09
Last pushed2026-10-29

Trending History

Monthly boardrank #68 · ▲ 3,311 stars

Related GitHub Projects

1

Graphify-Labs / graphify

Python★ 149,279⑂ 14,354▲ 615 stars
→
2

ComposioHQ / awesome-claude-skills

Python★ 79,689⑂ 9,754▲ 88 stars
→
3

usestrix / strix

Python★ 76,182⑂ 8,643▲ 325 stars
→
4

mvanhorn / last30days-skill

Python★ 68,501⑂ 6,101▲ 135 stars
→
5

jingyaogong / minimind

Python★ 65,627⑂ 8,605▲ 188 stars
→
6

virgiliojr94 / book-to-skill

Python★ 38,208⑂ 4,063▲ 161 stars
→
7

elementalsouls / Claude-BugHunter

Python★ 7,963⑂ 1,237▲ 1,094 stars
→
8

kajisho5 / ffmpeg-skill

Python★ 7,450⑂ 681▲ 367 stars
→

More Trending Repositories