Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.
| Date | Stars |
|---|---|
| 2026-07-31 | 355 |
| 2026-08-02 | 359 |
| 2026-08-06 | 359 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
35.0
growth rate 0.00%/day
<p align="center">
<img src="assets/otari-logo.svg" width="320" alt="otari logo"/>
</p>
<div align="center">
**An OpenAI-compatible LLM gateway you own and run yourself.**
Put one endpoint in front of 40+ providers, then manage API keys, enforce budgets, and track usage in one place.
[](https://github.com/mozilla-ai/otari/actions/workflows/otari-tests.yml)
[](https://github.com/mozilla-ai/otari/actions/workflows/otari-lint.yml)
[](https://github.com/mozilla-ai/otari/actions/workflows/otari-typecheck.yml)
[](https://github.com/mozilla-ai/otari/actions/workflows/otari-docker.yml)
[📖 Docs](docs/index.md) · [🚀 otari.ai](https://otari.ai) · [📝 Launch blog](https://blog.mozilla.ai/otari-own-your-ai-stack/) · [💬 Discord](https://discord.gg/ZfZPfTdtSe)
</div>
<p align="center">
<img src="assets/otari-demo.gif" width="720" alt="A tour of the Otari admin dashboard: spend and usage analytics, providers, models, users, budgets, and API keys"/>
</p>
Otari is the proxy server at the heart of [otari.ai](https://otari.ai). Your apps talk to Otari, which routes to your providers. Otari authenticates each request, enforces budgets before the call runs, resolves your provider credential, forwards the request, and logs the usage. Run it yourself and your provider keys and usage data stay in your environment. Or connect it to otari.ai and the platform runs it for you.
<!-- Rendered from assets/architecture.mmd (kept in the repo). Regenerate with:
npx -y @mermaid-js/mermaid-cli -i assets/architecture.mmd -o assets/architecture.png -b transparent -s 3 -->
<p align="center">
<img src="assets/architecture.png" width="560" alt="Otari sits between your apps and your providers: OpenAI and Anthropic SDKs call Otari, which handles auth, virtual keys, budgets, usage logging, guardrails, and built-in tools, then routes via any-llm to 40+ providers including OpenAI, Anthropic, and llamafile"/>
</p>
## Why Otari
- **One endpoint, many providers.** A single URL that speaks the OpenAI and Anthropic APIs, in front of 40+ providers via [any-llm](https://github.com/mozilla-ai/any-llm), so client code doesn't need to know which provider serves a request.
- **Your keys stay yours.** Provider credentials live in one place you control. Clients get virtual keys you can scope and revoke.
- **Cost control before the spend.** Per-user and per-key budgets are enforced before a request runs, not reconciled after the bill.
- **Everything is tracked.** Usage and spend are logged across every model and app, queryable through `/v1/usage`.
## The Otari ecosystem
A few names you'll run into, and how they fit together:
| Name | What it is | Where |
| --- | --- | --- |
| **otari.ai** | The hosted platform. Provider routing, auth, and usage handled for you. | [otari.ai](https://otari.ai) |
| **Otari** | The proxy server otari.ai deploys (this repo). Run it standalone or connected to the platform. | [mozilla-ai/otari](https://github.com/mozilla-ai/otari) |
| **any-llm** | The Python SDK Otari uses for core LLM routing across 40+ providers. | [mozilla-ai/any-llm](https://github.com/mozilla-ai/any-llm) |
| **Otari SDKs** | Client SDKs you use to talk to otari.ai or a self-hosted Otari. | [Python](https://github.com/mozilla-ai/otari-sdk-python) (`pip install otari`) · [TypeScript](https://github.com/mozilla-ai/otari-sdk-ts) · [Rust](https://github.com/mozilla-ai/otari-sdk-rust) · [Go](https://github.com/mozilla-ai/otari-sdk-go) |
| **Otari CLI** | Command-line tool for accessing and managing Otari, a thin wrapper over the Python SDK. Excerpt of 16,096 characters
Read on GitHubWould you bet a product on this? Bounded 0–100 and slow moving.
matched fp:1af7c38d1c8ab673, topic:llm-gateway, topic:ai-gateway, topic:llm-proxy