Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
LLMRouter: An Open-Source Library for LLM Routing
| Date | Stars |
|---|---|
| 2026-07-31 | 2184 |
| 2026-08-03 | 2193 |
| 2026-08-06 | 2193 |
| 2026-08-12 | 2327 |
| 2026-08-18 | 2376 |
| 2026-08-19 | 2386 |
| 2026-08-20 | 2395 |
| 2026-08-21 | 2408 |
| 2026-08-22 | 2473 |
| 2026-08-23 | 2495 |
| 2026-08-24 | 2516 |
| 2026-08-25 | 2532 |
| 2026-08-26 | 2542 |
| 2026-08-27 | 2562 |
| 2026-08-28 | 2606 |
| 2026-08-29 | 2632 |
| 2026-08-30 | 2647 |
| 2026-08-31 | 2676 |
| 2026-09-01 | 2731 |
| 2026-09-02 | 2747 |
| 2026-09-03 | 2756 |
| 2026-09-04 | 2765 |
| 2026-09-05 | 2772 |
| 2026-09-06 | 2780 |
| 2026-09-07 | 2784 |
| 2026-09-08 | 2792 |
| 2026-09-09 | 2801 |
| 2026-09-10 | 2813 |
| 2026-09-11 | 2828 |
| 2026-09-12 | 2838 |
| 2026-09-13 | 2849 |
| 2026-09-14 | 2856 |
| 2026-09-15 | 2861 |
| 2026-09-16 | 2869 |
| 2026-09-17 | 2871 |
| 2026-09-18 | 2877 |
| 2026-09-19 | 2885 |
| 2026-09-20 | 2908 |
Today
+23 stars today
This week
+59 stars this week
This month
+500 stars this month
Momentum
151.0
growth rate 2.07%/day
<div align="center">
<img src="assets/logo_claw.png" alt="LLMRouter Logo" width="200">
</div>
<h1 align="center">🚀 LLMRouter: An Open-Source Library for LLM Routing</h1>
<div align="center">
<p>
<a href="https://www.python.org/downloads/release/python-3109/"><img src="https://img.shields.io/badge/PYTHON-3.10-3776AB?style=for-the-badge&logo=python&logoColor=white" alt="Python"></a>
<a href="https://github.com/ulab-uiuc/LLMRouter/pulls"><img src="https://img.shields.io/badge/PRS-WELCOME-orange?style=for-the-badge" alt="PRs"></a>
<a href="https://join.slack.com/t/llmrouteropen-ri04588/shared_invite/zt-3mkx82cut-A25v5yR52xVKi7_jm_YK_w"><img src="https://img.shields.io/badge/SLACK-JOIN%20US-4A154B?style=for-the-badge&logo=slack&logoColor=white" alt="Slack"></a>
<a href="https://github.com/ulab-uiuc/LLMRouter/issues/136"><img src="https://img.shields.io/badge/💬WeChat-Group-07c160?style=for-the-badge&logo=wechat&logoColor=white&labelColor=1a1a2e" alt="WeChat"></a>
<a href="https://ulab-uiuc.github.io/LLMRouter/"><img src="https://img.shields.io/badge/DOCS-ONLINE-0A9EDC?style=for-the-badge&logo=readthedocs&logoColor=white" alt="Docs"></a>
<a href="https://arxiv.org/abs/2608.06867"><img src="https://img.shields.io/badge/PAPER-B31B1B?style=for-the-badge&logo=arxiv&logoColor=white" alt="Paper"></a>
<a href="https://x.com/youjiaxuan/status/2005877938554589370"><img src="https://img.shields.io/badge/TWITTER-ANNOUNCEMENTS-1DA1F2?style=for-the-badge&logo=x&logoColor=white" alt="Twitter"></a>
<a href="https://huggingface.co/datasets/ulab-ai/xRouteBench"><img src="assets/hf-logo.svg" alt="xRouteBench" height="28"><img src="https://img.shields.io/badge/HUGGING%20FACE-xRouteBench-FFD21E?style=for-the-badge&labelColor=555555" alt="xRouteBench Dataset" height="28"></a>
<a href="LICENSE"><img src="https://img.shields.io/badge/LICENSE-MIT-2EA44F?style=for-the-badge" alt="License"></a>
</p>
</div>
## ✨ Introduction
<div align="center">
<img src="assets/llmrouter_.png" alt="LLMRouter Overview" style="width: 100%; max-width: 1000px;">
</div>
**LLMRouter** is an intelligent routing system designed to optimize LLM inference by dynamically selecting the most suitable model for each query. To achieve intelligent routing, it defines:
1. 🚀 *Smart Routing*: Automatically routes queries to the optimal LLM based on task complexity, cost, and performance requirements.
2. 📊 *Multiple Router Models*: Support for **over 16 routing models**, organized into five major categories—**single-round routers, multi-round routers, multimodal routers, agentic routers, and personalized routers**—covering a wide range of strategies such as KNN, SVM, MLP, Matrix Factorization, Elo Rating, graph-based routing, BERT-based routing, hybrid probabilistic methods, transformed-score routers, and more.
3. 🛠️ *Unified CLI*: Complete command-line interface for training, inference, and interactive chat with Gradio-based UI.
4. 📈 *Data Generation Pipeline*: Complete pipeline for generating training data from 11 benchmark datasets with automatic API calling and evaluation.
## 📰 News
- 🔥 **[2026-08]**: We are honored to have **LLMRouter** featured among the top papers on 🤗 Hugging Face [Daily Papers](https://huggingface.co/papers/2608.06867).
- 🚀 **[2026-08]: LLMRouter** - We've released LLMRouter, a unified infrastructure for developing, evaluating, and deploying LLM routers! LLMRouter formulates routing as a unified sequential decision process spanning single-turn, multi-turn, and personalized scenarios, and provides a modular framework with 16+ representative routing methods. It also introduces xRouteBench, a comprehensive benchmark covering generic LLM, memory-augmented, vision, time-series, and personalized routing, with automated supervision construction and joint evaluation of response quality and inference cost. Experiments show that learned routers outperform the strongest fixed-model baseline by 14.6% relatively, whExcerpt of 43,436 characters
Read on GitHub
225
Claude · @anthropics
63
44
42
31
18
14
8
3
2
1
1
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:a370051e4a626d79, llm:Repository name and description: 'LLMRouter: An Open-Source Library for LLM Routing' (Python). Suggests tooling to route requests between LLMs or chains — likely an inference-serving / routing middleware for LLMs.
matched fp:a370051e4a626d79, llm:Repository name and description: 'LLMRouter: An Open-Source Library for LLM Routing' (Python). Suggests tooling to route requests between LLMs or chains — likely an inference-serving / routing middleware for LLMs.
matched fp:a370051e4a626d79, llm:Repository name and description: 'LLMRouter: An Open-Source Library for LLM Routing' (Python). Suggests tooling to route requests between LLMs or chains — likely an inference-serving / routing middleware for LLMs.