Name: NexaAI/nexa-sdk
Rating: 5 (8372 reviews)
Author: NexaAI

Git

NexaAI / nexa-sdk

Compare

8.4kstars

1.1kforks

Activity

LLM Infra

ML Frameworks

Languages & Runtimes

Repository Trajectory

Trended #9 on daily

December 20, 2025

First tracked on GitTrend

December 20, 2025

Similar Projects

Select up to three alternatives to compare with this repository:

ollama/ollamaGet up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

181k

17.9k

unslothai/unslothLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

76.2k

6.9k

google/adk-goAn open-source, code-first Go toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

8.8k

tenstorrent/tt-metal🤘 TT-NN operator library, and TT-Metalium low level kernel programming model.

1.7k

681

vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs

91.8k

22.2k

mudler/LocalAI🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more. Features: Generate Text, MCP, Audio, Video, Images, Voice Cloning, Distributed, P2P and decentralized inference

49.1k

4.4k

Loading README...

Contributors

Git

Languages

Shell

Jupyter Notebook

15%

HTML

Inno Setup

Python

Kotlin

23%

51%

About

Run the latest LLMs and VLMs across GPU, NPU, and CPU with PC (Python/C++) & mobile (Android & iOS) support, running quickly with OpenAI gpt-oss, Granite4, Qwen3VL, Gemma 3n and more.

docs.nexa.ai/

Topics

gemma3

gpt-oss

granite4

llama

llama3

llm

on-device-ai

phi3

qwen3

qwen3vl

sdk

stable-diffusion

vlm

Readme