logo
Git
BerriAI / litellm
Compare

Python

58.7kstars

11.4kforks

Activity

LLM Apps

LLM Infra

CLI Tools

Repository Trajectory

Trended #3 on daily

March 25, 2026

Trended #12 on weekly

July 30, 2025

First tracked on GitTrend

July 30, 2025

Similar Projects

Select up to three alternatives to compare with this repository:

chopratejas/headroomCompress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.

72.2k

5.5k

Similar because:Llm InfraLlm AppsCli Toolsanthropiclangchainllmopenai
decolua/9routerUnlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.

28.8k

5.3k

Similar because:Llm AppsCli Toolsai-gatewayanthropicllmllm-gatewayopenaiopenai-proxy
diegosouzapw/OmniRouteNever stop coding. Free MIT AI gateway: one endpoint, 352 providers (150+ free), 1200+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 550+ contributors

66.2k

9.3k

Similar because:Llm AppsCli Toolsai-gatewayanthropicllm-gatewayopenaiopenai-proxy
katanemo/planoDelivery infrastructure for agentic apps - Plano is an AI-native proxy and data plane that offloads plumbing work, so you stay focused on your agent's core logic (via any AI framework).

7k

484

Similar because:Llm InfraCli Toolsai-gatewaygatewayllm-gatewayllmopsopenai
Andyyyy64/whichllmFind the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

6.6k

363

Similar because:Llm InfraCli ToolsLlm Appsllm
HKUDS/nanobotLightweight, open-source AI agent for your tools, chats, and workflows.

48.2k

8.5k

Similar because:Llm AppsCli Toolsanthropicllmopenai

Loading README...

Contributors

Languages

TypeScript

11%

Python

89%

About

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

docs.litellm.ai/docs/

Related Blogs

The AI Agent Ascendancy Begins — Week of March 23, 2026

Mar 23, 2026

Topics

ai-gateway

anthropic

azure-openai

bedrock

gateway

langchain

litellm

llm

llm-gateway

llmops

mcp-gateway

openai

openai-proxy

vertex-ai

Readme

Activity

58.7kstars(289/day)

11.4kforks

Contributors

Languages

TypeScript

11%

Python

89%