Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
A Comprehensive Survey on Long Context Language Modeling
| Date | Stars |
|---|---|
| 2026-07-31 | 252 |
| 2026-08-05 | 253 |
| 2026-08-06 | 253 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
# A Comprehensive Survey on Long Context Language Modeling 💡 <div align="center"> <p align="center"> <a href="https://arxiv.org/abs/2503.17407">📝 Paper</a> | <a href="#updates">📄 Updates</a> | <a href="#paper-list">📚 Paper List</a> </p> </div> <div align="center"> <!--  --> [](https://github.com/LCLM-Horizon/A-Comprehensive-Survey-For-Long-Context-Language-Modeling/blob/main/LICENSE)  [](https://github.com/LCLM-Horizon/A-Comprehensive-Survey-For-Long-Context-Language-Modeling/commits/main) [](https://github.com/LCLM-Horizon/A-Comprehensive-Survey-For-Long-Context-Language-Modeling/pulls) [](https://github.com/LCLM-Horizon/A-Comprehensive-Survey-For-Long-Context-Language-Modeling) <!--  --> </div> > This repository provides a collection of papers and resources focused on Long Context Language Modeling. For a clear taxonomy and more insights about the methodology, you can refer to our survey: [A Comprehensive Survey on Long Context Language Modeling](https://arxiv.org/abs/2503.17407) with an overview shown below. > > We appreciate any useful suggestions for improvement of this paper list or survey from peers and commit to regularly updating the repository. > > If you would like to include your paper or any modifications in this survey and repository, please feel free to raise issues or send an email to [[email protected]](mailto:[email protected]), [[email protected]](mailto:[email protected]), or [[email protected]](mailto:[email protected]). We sincerely appreciate your collaboration! > > We would like to extend our sincere gratitude to [Awesome-LLM-Long-Context-Modeling](https://github.com/Xnhyacinth/Awesome-LLM-Long-Context-Modeling) for providing valuable reference to support the expansion of this project and the development of the comprehensive scholarly survey. > > We would also like to mention [Thus Spake Long-Context Large Language Model](https://arxiv.org/abs/2502.17129) ([GitHub](https://github.com/OpenMOSS/Thus-Spake-Long-Context-LLM)), a concurrent survey that details the development history of long-context LLMs. They've created a [video](https://www.bilibili.com/video/BV11h9AYoEYj/) with Thus Spake Zarathustra symphony to introduce LCLM-related work. > > If you find our survey useful for your research, please consider citing the following paper: ```bibtex @article{liu2025comprehensive, title={A Comprehensive Survey on Long Context Language Modeling}, author={Liu, Jiaheng and Zhu, Dawei and Bai, Zhiqi and He, Yancheng and Liao, Huanxuan and Que, Haoran and Wang, Zekun and Zhang, Chenchen and Zhang, Ge and Zhang, Jiebin and others}, journal={arXiv preprint arXiv:2503.17407}, year={2025} } ``` <img src="assets/overview.png" width="100%"> ## Updates - [2026.05.19] Expand the paper list with remaining 2026 works and selected 2025 Q4 papers from Awesome-LLM-Long-Context-Modeling while preserving the existing taxonomy. - [2026.05.19] Standardize README formatting and incorporate recent long-context modeling papers from Awesome-LLM-Long-Context-Modeling into the existing taxonomy. - [2025.03.25] Our [paper](https://arxiv.org/abs/2503.17407) is finally out on arXiv. - [2025.03.13] We have a good communication with the authors of [concurrent work](https://github.com/OpenMOSS/Thus-Spake-Long-Context-LLM), and will pro
Excerpt of 307,927 characters
Read on GitHubWould you bet a product on this? Bounded 0–100 and slow moving.
matched fp:a8ee25b198fd8b5d, llm:Repository title and description: 'A Comprehensive Survey on Long Context Language Modeling' — indicates a survey/review paper/resource on long-context LMs.
matched fp:a8ee25b198fd8b5d, llm:Repository title and description: 'A Comprehensive Survey on Long Context Language Modeling' — indicates a survey/review paper/resource on long-context LMs.
matched fp:a8ee25b198fd8b5d, llm:Repository title and description: 'A Comprehensive Survey on Long Context Language Modeling' — indicates a survey/review paper/resource on long-context LMs.