Name: sgl-project/mini-sglang
Rating: 5 (5051 reviews)
Author: sgl-project

Git

sgl-project / mini-sglang

Compare

Python

5.1kstars

850forks

Activity

LLM Apps

LLM Infra

Languages & Runtimes

Repository Trajectory

Trended #4 on weekly

December 28, 2025

Trended #4 on daily

December 21, 2025

First tracked on GitTrend

December 21, 2025

Similar Projects

Select up to three alternatives to compare with this repository:

z-lab/dflashDFlash: Block Diffusion for Flash Speculative Decoding

6.1k

431

datawhalechina/self-llm《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程

32.2k

3.1k

chopratejas/headroomCompress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.

72.2k

5.5k

Similar because:Llm InfraLlm Apps

jundot/omlxLLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

21.7k

1.9k

Similar because:Llm InfraLlm Apps

BerriAI/litellmPython SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

58.7k

11.4k

Similar because:Llm InfraLlm Apps

MemPalace/mempalaceThe best-benchmarked open-source AI memory system. And it's free.

59.1k

7.6k

Similar because:Llm AppsLlm Infra

Loading README...

Related Blogs

The AI Agent Ascendancy Begins — Week of March 23, 2026

Mar 23, 2026

Contributors

Git

Languages

Cuda

Python

76%

C++

About

A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

Related Blogs

The AI Agent Ascendancy Begins — Week of March 23, 2026

Mar 23, 2026

Topics

Readme

Activity

5.1kstars(202/day)

850forks

Contributors

Git

Languages

Cuda

Python

76%

C++