Name: vllm-project/vllm
Rating: 5 (91757 reviews)
Author: vllm-project

Git

vllm-project / vllm

Compare

Python

91.8kstars

22.2kforks

Activity

LLM Apps

LLM Infra

ML Frameworks

Repository Trajectory

Trended #13 on monthly

September 3, 2025

Trended #11 on weekly

August 13, 2025

Trended #4 on daily

August 7, 2025

First tracked on GitTrend

August 7, 2025

Similar Projects

Select up to three alternatives to compare with this repository:

huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

165.6k

34.6k

LMCache/LMCacheLMCache: Supercharge Your LLM with the Fastest KV Cache Layer

11.8k

1.9k

OpenBMB/UltraRAGUltraRAG v3: A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

5.7k

448

rasbt/LLMs-from-scratchImplement a ChatGPT-like LLM in PyTorch from scratch, step by step

105k

16.1k

GeeeekExplorer/nano-vllmNano vLLM

15.4k

2.6k

tenstorrent/tt-metal🤘 TT-NN operator library, and TT-Metalium low level kernel programming model.

1.7k

681

Loading README...

Related Blogs

The AI Agent Ascendancy Begins — Week of March 23, 2026

Mar 23, 2026

Contributors

Git

Languages

Python

85%

Cuda

C++

Shell

About

A high-throughput and memory-efficient inference and serving engine for LLMs

docs.vllm.ai

Related Blogs

The AI Agent Ascendancy Begins — Week of March 23, 2026

Mar 23, 2026

Topics

amd

cuda

deepseek

gpt

hpu

inference

inferentia

llama

llm

llmops

llm-serving

mlops

model-serving

pytorch

qwen

rocm

tpu

trainium

transformer

xpu

Readme

Activity

91.8kstars(143/day)

22.2kforks

Contributors

Git

Languages

Python

85%

Cuda

C++

Shell