Top AI Repos — open-source AI, indexed and scored

Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.

ai-dynamo/dynamo

A Datacenter Scale Distributed Inference Serving Framework

86NOASSERTIONRust

View on GitHub Website

Stars: 7,691
Forks: 1,408
Watchers: 73
Open issues: 272
Contributors: 348

Star history, last 90 days+117 over 5 snapshots

2026-07-24 · 7,5742026-08-06 · 7,691

Star history, last 90 days
Date	Stars
2026-07-24	7574
2026-07-25	7578
2026-07-28	7611
2026-07-30	7611
2026-08-06	7691

Today

+80 stars today

This week

+80 stars this week

This month

— stars this month

Momentum

460.0

growth rate 1.05%/day

From the README

<!--
SPDX-FileCopyrightText: Copyright (c) 2024-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
SPDX-License-Identifier: Apache-2.0

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->

![Dynamo banner](./docs/fern/assets/img/dynamo-frontpage-banner.png)

[![License](https://img.shields.io/badge/License-Apache_2.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
[![GitHub Release](https://img.shields.io/github/v/release/ai-dynamo/dynamo)](https://github.com/ai-dynamo/dynamo/releases/latest)
[![PyPI](https://img.shields.io/pypi/v/ai-dynamo)](https://pypi.org/project/ai-dynamo/)
[![Ask DeepWiki](https://deepwiki.com/badge.svg)](https://deepwiki.com/ai-dynamo/dynamo)
[![Discord](https://dcbadge.limes.pink/api/server/D92uqZRjCZ?style=flat)](https://discord.gg/D92uqZRjCZ)
![Community Contributors](https://img.shields.io/badge/community_contributors-160%2B-brightgreen)

| **[Docs](https://docs.nvidia.com/dynamo/)** | **[Roadmap](https://github.com/ai-dynamo/dynamo/issues/9178)** | **[Recipes](https://github.com/ai-dynamo/dynamo/tree/main/recipes)** | **[Examples](https://github.com/ai-dynamo/dynamo/tree/main/examples)** | **[Prebuilt Containers](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/collections/ai-dynamo)** | **[Digest](docs/fern/pages/blog/latest.mdx)** | **[Design Proposals](https://github.com/ai-dynamo/dynamo/issues?q=is%3Aissue+label%3A%22dep%3Adraft%22%2C%22dep%3Aproposed%22%2C%22dep%3Aapproved%22%2C%22dep%3Aimplementing%22%2C%22dep%3Acompleted%22%2C%22dep%3Adeferred%22%2C%22dep%3Asuperseeded%22)** | **[How to Contribute](#community-and-contributing)** |

<!-- The SVG badge uses systemLanguage so it only draws for Simplified Chinese/China browser language preferences. -->
<p align="left">
  <a href="./README.zh-CN.md" hreflang="zh-CN"><img src="./docs/fern/assets/img/readme-zh-cn-link.svg" alt="简体中文" height="28" /></a>
</p>

# Dynamo

**The open-source, datacenter-scale inference stack.** Dynamo is the orchestration layer above inference engines — it doesn't replace SGLang, TensorRT-LLM, or vLLM, it turns them into a coordinated multi-node inference system. Disaggregated serving, intelligent routing, multi-tier KV caching, and automatic scaling work together to maximize throughput and minimize latency for LLM, reasoning, multimodal, and video generation workloads.

Built in Rust for performance, Python for extensibility.

## Community Events

<!-- EVENTS:START -->
| Date | Event | Location |
|:-----|:------|:---------|
| Thu, Jul 16, 2026 | **[Austin vLLM & llm-d AI Inference Meetup](https://calendar.google.com/calendar/render?action=TEMPLATE&text=Austin+vLLM+%26+llm-d+AI+Inference+Meetup&dates=20260716T220000Z%2F20260716T230000Z&location=https%3A%2F%2Fluma.com%2Frxmldtp2%3Ftk%3DXiKvay&details=%3Cp%3E%E2%80%8B%3Cstrong%3E5%3A00PM+%E2%80%93+5%3A30PM+%E2%80%94+Doors+Open%2C+Check-In%3C%2Fstrong%3E%3Cbr%3E%3Cbr%3E%3Cstrong%3E5%3A30PM+%E2%80%93+5%3A40PM+%E2%80%94+Welcome+and+Opening+Remarks%3C%2Fstrong%3E%3C%2Fp%3E%3Cblockquote%3E%3Cp%3E%E2%80%8BJake+O%27Shea%2C+Principal%2C+Antler+%26amp%3B+Co-Founder+%2F+Organizer%2C+AITX%3Cbr%3ESasa+Zelenovic%2C+Sr.+Technical+Marketing+Manager%2C+Red+Hat+AI%3C%2Fp%3E%3C%2Fblockquote%3E%3Cp%3E%E2%80%8B%3Cstrong%3E5%3A40PM+%E2%80%93+6%3A10PM+%E2%80%94+Intro+to+vLLM+and+Project+Update%3C%2Fstrong%3E%3C%2Fp%3E%3Cblockquote%3E%3Cp%3E%E2%80%8BKyle+Sayers%2C+Sr.+Machine+Learning+Engineer%2C+Red+Hat+AI%3C%2Fp%3E%3C%2Fblockquote%3E%3Cp%3E%E2%80%8B%3Cstrong%3E6%3A10PM+%E2%80%93+6%3A30PM+%E2%80%94+Intro+to

Excerpt of 22,787 characters

Read on GitHub

Top contributors20 shown

PeaBrane
462
keivenchang
277
grahamking
269
tedzhouhk
248
julienmancuso
226
nv-anants
215
ishandhanani
211
biswapanda
191
dagil-nvidia
175
rmccorm4
Ryan McCormick · @NVIDIA · United States
160
alec-flowers
148
hhzhang16
148
jthomson04
147
dmitry-tokarev-nv
138
KrishnanPrash
120
nnshah1
116
tanmayv25
Tanmay Verma · NVIDIA · United States
109
nv-tusharma
107
atchernych
91
saturley-hall
91

Quality score

Would you bet a product on this? Bounded 0–100 and slow moving.

86/10086

Maintenance: 100%; How recently the default branch was pushed to
Releases: 96%; Recency and cadence of tagged releases
Community: 98%; Contributor breadth and bus factor
Issue backlog: 60%; Open issues measured against the size of the audience
Documentation: 100%; README depth, plus a homepage and topics
Licensing: 35%; How freely the code can be adopted

What to know before adopting

Nothing flagged — maintained, documented and cleanly licensed.
Licence terms need review before adoption.

Details

Created: last year
Last push: 3 hours ago
Last release: 14 hours ago
Release tag: v1.3.1
Releases in the last year: 30
Default branch: main
Size: 651k KB
Owner type: Organization
Owner location: United States of America
Discovered via: topic:vllm
First indexed: 14 days ago
Last synced: 2 hours ago

ai-dynamo/dynamo

A Datacenter Scale Distributed Inference Serving Framework

86NOASSERTIONRust

View on GitHub Website

Stars: 7,691
Forks: 1,408
Watchers: 73
Open issues: 272
Contributors: 348

Star history, last 90 days+117 over 5 snapshots

2026-07-24 · 7,5742026-08-06 · 7,691

Star history, last 90 days
Date	Stars
2026-07-24	7574
2026-07-25	7578
2026-07-28	7611
2026-07-30	7611
2026-08-06	7691

Today

+80 stars today

This week

+80 stars this week

This month

— stars this month

Momentum

460.0

growth rate 1.05%/day

From the README

<!--
SPDX-FileCopyrightText: Copyright (c) 2024-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
SPDX-License-Identifier: Apache-2.0

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->

![Dynamo banner](./docs/fern/assets/img/dynamo-frontpage-banner.png)

[![License](https://img.shields.io/badge/License-Apache_2.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
[![GitHub Release](https://img.shields.io/github/v/release/ai-dynamo/dynamo)](https://github.com/ai-dynamo/dynamo/releases/latest)
[![PyPI](https://img.shields.io/pypi/v/ai-dynamo)](https://pypi.org/project/ai-dynamo/)
[![Ask DeepWiki](https://deepwiki.com/badge.svg)](https://deepwiki.com/ai-dynamo/dynamo)
[![Discord](https://dcbadge.limes.pink/api/server/D92uqZRjCZ?style=flat)](https://discord.gg/D92uqZRjCZ)
![Community Contributors](https://img.shields.io/badge/community_contributors-160%2B-brightgreen)

| **[Docs](https://docs.nvidia.com/dynamo/)** | **[Roadmap](https://github.com/ai-dynamo/dynamo/issues/9178)** | **[Recipes](https://github.com/ai-dynamo/dynamo/tree/main/recipes)** | **[Examples](https://github.com/ai-dynamo/dynamo/tree/main/examples)** | **[Prebuilt Containers](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/collections/ai-dynamo)** | **[Digest](docs/fern/pages/blog/latest.mdx)** | **[Design Proposals](https://github.com/ai-dynamo/dynamo/issues?q=is%3Aissue+label%3A%22dep%3Adraft%22%2C%22dep%3Aproposed%22%2C%22dep%3Aapproved%22%2C%22dep%3Aimplementing%22%2C%22dep%3Acompleted%22%2C%22dep%3Adeferred%22%2C%22dep%3Asuperseeded%22)** | **[How to Contribute](#community-and-contributing)** |

<!-- The SVG badge uses systemLanguage so it only draws for Simplified Chinese/China browser language preferences. -->
<p align="left">
  <a href="./README.zh-CN.md" hreflang="zh-CN"><img src="./docs/fern/assets/img/readme-zh-cn-link.svg" alt="简体中文" height="28" /></a>
</p>

# Dynamo

**The open-source, datacenter-scale inference stack.** Dynamo is the orchestration layer above inference engines — it doesn't replace SGLang, TensorRT-LLM, or vLLM, it turns them into a coordinated multi-node inference system. Disaggregated serving, intelligent routing, multi-tier KV caching, and automatic scaling work together to maximize throughput and minimize latency for LLM, reasoning, multimodal, and video generation workloads.

Built in Rust for performance, Python for extensibility.

## Community Events

<!-- EVENTS:START -->
| Date | Event | Location |
|:-----|:------|:---------|
| Thu, Jul 16, 2026 | **[Austin vLLM & llm-d AI Inference Meetup](https://calendar.google.com/calendar/render?action=TEMPLATE&text=Austin+vLLM+%26+llm-d+AI+Inference+Meetup&dates=20260716T220000Z%2F20260716T230000Z&location=https%3A%2F%2Fluma.com%2Frxmldtp2%3Ftk%3DXiKvay&details=%3Cp%3E%E2%80%8B%3Cstrong%3E5%3A00PM+%E2%80%93+5%3A30PM+%E2%80%94+Doors+Open%2C+Check-In%3C%2Fstrong%3E%3Cbr%3E%3Cbr%3E%3Cstrong%3E5%3A30PM+%E2%80%93+5%3A40PM+%E2%80%94+Welcome+and+Opening+Remarks%3C%2Fstrong%3E%3C%2Fp%3E%3Cblockquote%3E%3Cp%3E%E2%80%8BJake+O%27Shea%2C+Principal%2C+Antler+%26amp%3B+Co-Founder+%2F+Organizer%2C+AITX%3Cbr%3ESasa+Zelenovic%2C+Sr.+Technical+Marketing+Manager%2C+Red+Hat+AI%3C%2Fp%3E%3C%2Fblockquote%3E%3Cp%3E%E2%80%8B%3Cstrong%3E5%3A40PM+%E2%80%93+6%3A10PM+%E2%80%94+Intro+to+vLLM+and+Project+Update%3C%2Fstrong%3E%3C%2Fp%3E%3Cblockquote%3E%3Cp%3E%E2%80%8BKyle+Sayers%2C+Sr.+Machine+Learning+Engineer%2C+Red+Hat+AI%3C%2Fp%3E%3C%2Fblockquote%3E%3Cp%3E%E2%80%8B%3Cstrong%3E6%3A10PM+%E2%80%93+6%3A30PM+%E2%80%94+Intro+to

Excerpt of 22,787 characters

Read on GitHub

Top contributors20 shown

PeaBrane
462
keivenchang
277
grahamking
269
tedzhouhk
248
julienmancuso
226
nv-anants
215
ishandhanani
211
biswapanda
191
dagil-nvidia
175
rmccorm4
Ryan McCormick · @NVIDIA · United States
160
alec-flowers
148
hhzhang16
148
jthomson04
147
dmitry-tokarev-nv
138
KrishnanPrash
120
nnshah1
116
tanmayv25
Tanmay Verma · NVIDIA · United States
109
nv-tusharma
107
atchernych
91
saturley-hall
91

Quality score

Would you bet a product on this? Bounded 0–100 and slow moving.

86/10086

Maintenance: 100%; How recently the default branch was pushed to
Releases: 96%; Recency and cadence of tagged releases
Community: 98%; Contributor breadth and bus factor
Issue backlog: 60%; Open issues measured against the size of the audience
Documentation: 100%; README depth, plus a homepage and topics
Licensing: 35%; How freely the code can be adopted

What to know before adopting

Nothing flagged — maintained, documented and cleanly licensed.
Licence terms need review before adoption.

Details

Created: last year
Last push: 3 hours ago
Last release: 14 hours ago
Release tag: v1.3.1
Releases in the last year: 30
Default branch: main
Size: 651k KB
Owner type: Organization
Owner location: United States of America
Discovered via: topic:vllm
First indexed: 14 days ago
Last synced: 2 hours ago

Top AI Repos — open-source AI, indexed and scored

ai-dynamo/dynamo

From the README

Top contributors20 shown

Quality score

What to know before adopting

Categories

Details

ai-dynamo/dynamo

From the README

Top contributors20 shown

Quality score

What to know before adopting

Categories

Details

Top AI Repos — open-source AI, indexed and scored

Trend

From the README

Top contributors20 shown

Quality score

What to know before adopting

Categories

Details

Trend

From the README

Top contributors20 shown

Quality score

What to know before adopting

Categories

Details