Top AI Repos β open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
π Awesome System for Machine Learning β‘οΈ AI System Papers and Industry Practice. β‘οΈ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). π» OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. ποΈ Llama3, Mistral, etc. π§βπ» Video Tutorials.
| Date | Stars |
|---|---|
| 2026-07-31 | 4242 |
| 2026-08-02 | 4242 |
| 2026-08-04 | 4260 |
| 2026-08-06 | 4265 |
Today
+5 stars today
This week
β stars this week
This month
β stars this month
Momentum
0.0
growth rate 0.00%/day
[](https://github.com/HuaizhengZhang/Awesome-System-for-Machine-Learning/graphs/commit-activity)
[](https://github.com/HuaizhengZhang/Awesome-System-for-Machine-Learning/graphs/commit-activity)
[](https://github.com/HuaizhengZhang/Awesome-System-for-Machine-Learning/commits/master)
[](https://GitHub.com/Naereen/ama)
[](https://awesome.re)
[](https://github.com/HuaizhengZhang/Awesome-System-for-Machine-Learning/blob/master/LICENSE)
[](https://GitHub.com/HuaizhengZhang/Awesome-System-for-Machine-Learning/stargazers/)
# AI System School
### π«π«π« System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI)
### Updates:
- Video Tutorials [[YouTube]](https://youtu.be/ChD1_aVZJ0g?si=Kg-yB3F4Iea0Xp9J) [[bilibili]](https://www.bilibili.com/video/BV1ZwYUerEtL/) [[ε°ηΊ’δΉ¦]](http://xhslink.com/MmrjcT)
- We are preparing a new website [[Lets Go AI]](https://letsgoai.pro/) for this repo!!!
### *Path to System for AI* [[Whitepaper You Must Read]](./paper/mlsys-whitepaper.pdf)
A curated list of research in machine learning systems. Link to the code if available is also present. Now we have a [team](#maintainer) to maintain this project. *You are very welcome to pull request by using our template*.

## System for AI (Ordered by Category)
### ML / DL Infra
- [Data Processing](data_processing.md#data-processing)
- [Training System](training.md#training-system)
- [Inference System](inference.md#inference-system)
- [Machine Learning Infrastructure](infra.md#machine-learning-infrastructure)
### LLM Infra
- [LLM Training](llm_training.md#llm_training)
- [LLM Serving](llm_serving.md#llm_serving)
### Domain-Specific Infra
- [Video System](video_system.md#video-system)
- [AutoML System](AutoML_system.md#automl-system)
- [Edge AI](edge_system.md#edge-or-mobile-papers)
- [GNN System](GNN_system.md#system-for-gnn-traininginference)
- [Federated Learning System](federated_learning_system.md#federated-learning-system)
- [Deep Reinforcement Learning System](drl_system.md#deep-reinforcement-learning-system)
## System for ML/LLM Conference
### Conference
- OSDI
- SOSP
- SIGCOMM
- NSDI
- MLSys
- ATC
- Eurosys
- Middleware
- SoCC
- TinyML
## General Resources
- [Survey](#survey)
- [Book](#book)
- [Video](#video)
- [Course](#course)
- [Blog](#blog)
## Survey
- Toward Highly Available, Intelligent Cloud and ML Systems [[Slide]](http://sysnetome.com/Talks/cguo_netai_2018.pdf)
- A curated list of awesome System Designing articles, videos and resources for distributed computing, AKA Big Data. [[GitHub]](https://github.com/madd86/awesome-system-design)
- awesome-production-machine-learning: A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning [[GitHub]](https://github.com/EthicalML/awesome-production-machine-learning)
- Opportunities and Challenges Of Machine Learning Accelerators In Production [[Paper]](https://www.usenix.org/system/files/opml19papers-ananthanarayanan.pdf)
- Ananthanarayanan, Rajagopal, et al. "
- 2019 {USENIX} Conference on Operational Machine Learning (OpML 19). 2019.
- How (and How Not) to Write a Good Systems Paper [[Advice]](https://www.usenix.org/legacy/events/samples/subExcerpt of 15,229 characters
Read on GitHubHunter Zhang Β· ByteDance Seed Β· United States
474
Yizheng Huang Β· United States
5
3
3
2
2
Stjepan JurekoviΔ Β· Manning Publication Β· Croatia
2
Ce Gao Β· @TensorChord
2
2
Saeid Ghafouri
2
1
1
Haifeng Jin
1
1
Yuan Tang Β· Red Hat Β· United States
1
1
Guo Shuai Β· ByteDance Β· China
1
Yuanming Li Β· Singapore
1
Adam Narozniak Β· Poland
1
@hpcaitech Β· Singapore
1
Would you bet a product on this? Bounded 0β100 and slow moving.
matched fp:f3bdef10e7a75f22, llm:Repository description and README: 'Awesome System for Machine Learning', curated list of AI system papers, industry practice, topics include ai-infra, genai, large-language-models, llmsys, mlsys, model-serving, model-training; contains links, papers, tutorials.
matched fp:f3bdef10e7a75f22, llm:Repository description and README: 'Awesome System for Machine Learning', curated list of AI system papers, industry practice, topics include ai-infra, genai, large-language-models, llmsys, mlsys, model-serving, model-training; contains links, papers, tutorials.
matched fp:f3bdef10e7a75f22, llm:Repository description and README: 'Awesome System for Machine Learning', curated list of AI system papers, industry practice, topics include ai-infra, genai, large-language-models, llmsys, mlsys, model-serving, model-training; contains links, papers, tutorials.