Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
| Date | Stars |
|---|---|
| 2026-07-24 | 8486 |
| 2026-07-25 | 8486 |
| 2026-07-28 | 8486 |
| 2026-07-30 | 8486 |
| 2026-07-31 | 8487 |
| 2026-08-07 | 8484 |
| 2026-08-18 | 8485 |
| 2026-08-21 | 8484 |
| 2026-08-23 | 8485 |
| 2026-08-24 | 8484 |
| 2026-08-25 | 8484 |
| 2026-08-28 | 8485 |
| 2026-08-29 | 8485 |
| 2026-09-01 | 8485 |
| 2026-09-02 | 8486 |
| 2026-09-03 | 8489 |
| 2026-09-04 | 8489 |
| 2026-09-05 | 8488 |
| 2026-09-06 | 8488 |
| 2026-09-07 | 8487 |
| 2026-09-09 | 8487 |
| 2026-09-11 | 8488 |
| 2026-09-14 | 8487 |
| 2026-09-17 | 8487 |
| 2026-09-20 | 8487 |
Today
— stars today
This week
-1 stars this week
This month
+3 stars this month
Momentum
0.0
growth rate 0.00%/day
<p align="center" width="50%">
<img src="docs/assets/logo.png" alt="LMFlow" style="width: 50%; min-width: 200px; display: block; margin: auto; background-color: transparent;">
</p>
# LMFlow
<h4 align="center">
<p>
<b>English</b> |
<a href="https://github.com/OptimalScale/LMFlow/blob/main/docs/readme/README_zh-hans.md">简体中文</a> |
<a href="https://github.com/OptimalScale/LMFlow/blob/main/docs/readme/README_es.md">Español</a> |
<a href="https://github.com/OptimalScale/LMFlow/blob/main/docs/readme/README_jp.md">日本語</a> |
<a href="https://github.com/OptimalScale/LMFlow/blob/main/docs/readme/README_ko.md">한국어</a> |
<a href="https://github.com/OptimalScale/LMFlow/blob/main/docs/readme/README_hindi.md">हिंदी</a>
<p>
</h4>
[](https://lmflow.com)
[](https://github.com/OptimalScale/LMFlow/blob/main/LICENSE)
[](https://www.python.org/downloads/release/python-390/)
[](https://optimalscale.github.io/LMFlow/)
[](https://discord.gg/u9VJNpzhvA)
[](https://join.slack.com/t/lmflow/shared_invite/zt-1wju9nicy-woXbNtS~5MavHSAtiMxmxQ)
[](https://ibb.co/ZhM4hhn)
An extensible, convenient, and efficient toolbox for finetuning large machine learning models, designed to be user-friendly, speedy and reliable, and accessible to the entire community.
<p align="center" width="100%">
<img src="docs/assets/features.png" alt="LMFlow-features" style="width: 100%; min-width: 300px; display: block; margin: auto;">
</p>
## Latest News
> [!IMPORTANT]
> * :exclamation: [2025-07-09] We have a major update to LMFlow with full Accelerate support and extensive streamlining. If you're looking for the previous version, please use `git checkout v0.0.10`, or check out the [v0.0.10 branch](https://github.com/OptimalScale/LMFlow/tree/v0.0.10). View all releases [here](https://github.com/OptimalScale/LMFlow/tags).
* [2024-12-02] Support [Hymba](https://github.com/NVlabs/hymba), a new family of small language models featuring a hybrid-head parallel architecture. Check out [Post-training Hymba](https://github.com/OptimalScale/LMFlow/tree/main/experimental/Hymba) for more details.
* [2024-07-01] 🏆 LMFlow receives the [**Best Demo Paper Award**](https://docs.google.com/presentation/d/1TVDooAZqkNObz5ysVhDFtqnnVHR-u8wqYvgix-gzPMs/edit#slide=id.g2e55907bbcc_0_70) at **NAACL 2024**! 🎉
* [2024-06-30] Expanding Optimization Options! We now support custom optimizer training with a variety of optimizers. Dive into the details and try out the new features with our updated script at [custom_optimizers](https://github.com/OptimalScale/LMFlow/blob/main/scripts/run_finetune_with_custom_optim.sh).
* [2024-04-25] :rocket: Support conversation template! We've preset the latest [Llama-3](https://huggingface.co/meta-llama/Meta-Llama-3-70B) and [Phi-3](https://huggingface.co/microsoft/Phi-3-mini-128k-instruct) conversation templates as well as some frequently used templates such as `chatml` (see all templates [here](https://optimalscale.github.io/LMFlow/examples/DATASETS.html#conversation-template)), and we are working on adding more preset templates. Adding corresponding `--conversation_template` in the shell script and you are all set! :rocket:
<details> <summary>More news...</summary>
* [2024-03-27] Support [LISA](https://arxiv.org/abs/2403.17919), enabling 7B training in 24G memory without offloading!
* [2023-09-11] Support [speculative decoding](https://arxiv.org/abs/2211.17192). Check out [speculative_decoding](https://gExcerpt of 24,440 characters
Read on GitHub
Rui Pan
454
Yizhen Jia · China
376
shizhediao · Thinking Machines Lab · United States
181
Hanze Dong
176
Guanyu Yao · UBSB · United States
88
75
62
Juanxi Tian · NTU · Singapore
43
Qing Lian
29
Xiang LIU · Hong Kong
25
22
Wei Xiong
12
11
11
10
8
8
Jingyuan Zhu
5
4
Sean · Hong Kong
4
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:0ab753c90ae2a3e7, topic:deep-learning, topic:pytorch
matched fp:0ab753c90ae2a3e7, topic:transformer, topic:language-model
matched fp:0ab753c90ae2a3e7, topic:chatgpt