Name: NVIDIA/Megatron-LM
Rating: 5 (17895 reviews)
Author: NVIDIA

Git

NVIDIA / Megatron-LM

Compare

Python

17.9kstars

4.5kforks

Activity

LLM Infra

ML Frameworks

Languages & Runtimes

Repository Trajectory

Trended #11 on daily

February 25, 2026

First tracked on GitTrend

February 25, 2026

Similar Projects

Select up to three alternatives to compare with this repository:

FareedKhan-dev/train-llm-from-scratchA straightforward method for training your LLM, from downloading data to generating text.

9.6k

1.3k

ggml-org/ggmlTensor library for machine learning

15.4k

1.8k

karpathy/nanoGPTThe simplest, fastest repository for training/finetuning medium-sized GPTs.

63.1k

10.9k

marin-community/marinOpen-source framework for the research and development of foundation models.

3.6k

292

openai/parameter-golfTrain the smallest LM you can that fits in 16MB. Best model wins!

5.2k

3.3k

hiyouga/LLaMA-FactoryUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

74.8k

9.2k

Loading README...

Contributors

Git

Languages

Python

99%

Shell

About

Ongoing research training transformer models at scale

docs.nvidia.com/megatron-core/developer-guide/latest/get-started/quickstart.html

Topics

large-language-models

model-para

transformers

Readme

Activity

17.9kstars(16/day)

4.5kforks

Contributors

Git

Languages

Python

99%

Shell