logo
Git
kvcache-ai / ktransformers
Compare

Python

19.5kstars

1.6kforks

Activity

LLM Infra

ML Frameworks

Languages & Runtimes

Repository Trajectory

Trended #18 on weekly

July 24, 2026

Trended #17 on weekly

July 23, 2026

Trended #6 on daily

July 20, 2026

Trended #2 on daily

July 19, 2026

Trended #14 on weekly

December 4, 2025

First tracked on GitTrend

December 4, 2025

Similar Projects

Select up to three alternatives to compare with this repository:

karpathy/nanoGPTThe simplest, fastest repository for training/finetuning medium-sized GPTs.

63.1k

10.9k

Similar because:Llm InfraMl FrameworksLanguages Runtimes
hiyouga/LLaMA-FactoryUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

74.8k

9.2k

Similar because:Llm InfraMl FrameworksLanguages Runtimes
marin-community/marinOpen-source framework for the research and development of foundation models.

3.6k

292

Similar because:Llm InfraMl FrameworksLanguages Runtimes
NVIDIA/Megatron-LMOngoing research training transformer models at scale

17.9k

4.5k

Similar because:Llm InfraMl FrameworksLanguages Runtimes
openai/parameter-golfTrain the smallest LM you can that fits in 16MB. Best model wins!

5.2k

3.3k

Similar because:Llm InfraMl FrameworksLanguages Runtimes
NexaAI/nexa-sdkRun the latest LLMs and VLMs across GPU, NPU, and CPU with PC (Python/C++) & mobile (Android & iOS) support, running quickly with OpenAI gpt-oss, Granite4, Qwen3VL, Gemma 3n and more.

8.4k

1.1k

Similar because:Llm InfraLanguages RuntimesMl Frameworks

Loading README...

Contributors

Languages

Python

58%

Cuda

7%

C++

30%

CMake

1%

Vue

1%

C

2%

About

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

kvcache-ai.github.io/ktransformers/

Related Blogs

The AI Agent Ascendancy Begins — Week of March 23, 2026

Mar 23, 2026

Topics

Readme

Activity

19.5kstars(360/day)

1.6kforks

Contributors

Languages

Python

58%

Cuda

7%

C++

30%

CMake

1%

Vue

1%

C

2%