Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
An open collection of methodologies to help with successful training of large language models.
| Date | Stars |
|---|---|
| 2026-07-31 | 565 |
| 2026-08-01 | 565 |
| 2026-08-02 | 565 |
| 2026-08-06 | 565 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
# 📖 The Large Language Model Training Handbook An open collection of methodologies to help with successful training of large language models. This is technical material suitable for LLM training engineers and operators. That is the content here contains lots of scripts and copy-n-paste commands to enable you to quickly solve your problems. If you are not interested in technical details but want more of a detailed overview and concepts please refer to the sister [The Large Language Model Training Playbook](https://github.com/huggingface/large_language_model_training_playbook) instead. note: The list of topics will expand over time - at the moment filling in only a subset ## [Model parallelism](./parallelism/) ## [Maximizing throughput](./throughput/) ## [Tensor precision / Data types](./dtype/) ## [Training hyper-parameters and model initializations](./hparams/) ## [Instabilities](./instabilities/) ## [Debugging software and hardware failures](./debug/) ## [SLURM](./slurm/) ## [Resources](./resources/) ## License The content of this site is distributed under [Attribution-ShareAlike 4.0 International](./LICENSE-CC-BY-SA). Unless specified otherwise the code in this repo is licensed under [Apache License, Version 2.0](https://www.apache.org/licenses/LICENSE-2.0).
Excerpt of 1,297 characters
Read on GitHubWould you bet a product on this? Bounded 0–100 and slow moving.
matched fp:0ea94c7abb1736db, topic:large-language-models, topic:llm
matched fp:0ea94c7abb1736db, topic:cuda
matched fp:0ea94c7abb1736db, topic:pytorch
matched fp:0ea94c7abb1736db, topic:nlp
