Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
⚡ Edgen: Local, private GenAI server alternative to OpenAI. No GPU required. Run AI models locally: LLMs (Llama2, Mistral, Mixtral...), Speech-to-text (whisper) and many others.
| Date | Stars |
|---|---|
| 2026-07-31 | 372 |
| 2026-08-06 | 371 |
Today
-1 stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
<p align="center">
<img alt="GitHub" src="https://img.shields.io/github/license/edgenai/edgen">
<!-- TODO: uncomment to show discord -->
<!-- <img alt="Discord" src="https://img.shields.io/discord/1163068604074426408?logo=discord&label=Discord&link=https%3A%2F%2Fdiscord.gg%2FMMUcgBtV"> -->
</p>
<h3 align="center">
A Local GenAI API Server: A drop-in replacement for OpenAI's API for Local GenAI
</h3>
<p align="center">
|
<!-- TODO: add proper links -->
<a href="https://docs.edgen.co"><b>Documentation</b></a> |
<a href="https://blog.edgen.co"><b>Blog</b></a> |
<a href="https://discord.gg/QUXbwqdMRs"><b>Discord</b></a> |
<a href="https://github.com/orgs/edgenai/projects/1/views/1"><b>Roadmap</b></a> |
</p>
<div align="center">
<img src="https://edgen.co/images/demo.gif" alt="EdgenChat, a local chat app powered by ⚡Edgen">
<p align="center">
<a href="https://chat.edgen.co">EdgenChat</a>, a local chat app powered by ⚡Edgen
</p>
</div>
- [x] **OpenAI Compliant API**: ⚡Edgen implements an [OpenAI compatible API](https://docs.edgen.co/api-reference), making it a drop-in replacement.
- [x] **Multi-Endpoint Support**: ⚡Edgen exposes multiple AI endpoints such as chat completions (LLMs) and speech-to-text (Whisper) for audio transcriptions.
- [x] **Model Agnostic**: LLMs (Llama2, Mistral, Mixtral...), Speech-to-text (whisper) and [many others](https://docs.edgen.co/documentation/models).
- [x] **Optimized Inference**: You don't need to take a PhD in AI optimization. ⚡Edgen abstracts the complexity of optimizing inference for different hardware, platforms and models.
- [x] **Modular**: ⚡Edgen is **model** and **runtime** agnostic. New models can be added easily and ⚡Edgen can select the best runtime for the user's hardware: you don't need to keep up about the latest models and ML runtimes - **⚡Edgen will do that for you**.
- [x] **Model Caching**: ⚡Edgen caches foundational models locally, so 1 model can power hundreds of different apps - users don't need to download the same model multiple times.
- [x] **Native**: ⚡Edgen is built in 🦀Rust and is natively compiled to all popular platforms: **Windows, MacOS and Linux**. No docker required.
- [ ] **Graphical Interface**: A graphical user interface to help users efficiently manage their models, endpoints and permissions.
⚡Edgen lets you use GenAI in your app, completely **locally** on your user's devices, for **free** and with **data-privacy**. It's a drop-in replacement for OpenAI (it uses the a compatible API), supports various functions like text generation, speech-to-text and works on Windows, Linux, and MacOS.
### Features
- [x] Session Caching: ⚡Edgen maintains top performance with big contexts (big chat histories), by caching sessions. Sessions are auto-detected in function of the chat history.
- [x] [GPU support](https://github.com/edgenai/edgen#gpu-support): CUDA, Vulkan. Metal
### Endpoints
- [x] \[Chat\] [Completions](https://docs.edgen.co/api-reference/chat)
- [x] \[Audio\] [Transcriptions](https://docs.edgen.co/api-reference/audio)
- [x] \[Embeddings\] [Embeddings](https://platform.openai.com/docs/api-reference/embeddings)
- [ ] \[Image\] Generation
- [ ] \[Chat\] Multimodal chat completions
- [ ] \[Audio\] Speech
### Supported Models
Check in the [documentation](https://docs.edgen.co/documentation/models)
### Supported platforms
- [x] Windows
- [x] Linux
- [x] MacOS
## 🔥 Hot Topics
## Why local GenAI?
- **Data Private**: On-device inference means **users' data** never leave their devices.
- **Scalable**: More and more users? No need to increment cloud computing infrastructure. Just let your users use their own hardware.
- **Reliable**: No internet, no downtime, no rate limits, no API keys.
- **Free**: It runs locally on hardware the user already owns.
## Quickstart
1. [Download](https://edgen.co/download) and start ⚡Edgen
2. Chat with ⚡[EdgenChat](https://chat.edgen.co)
Ready to start your own GExcerpt of 7,198 characters
Read on GitHubWould you bet a product on this? Bounded 0–100 and slow moving.
matched fp:a9dda7e6c16051d6, llm:Repository topics and description: 'Local, private GenAI server alternative to OpenAI. No GPU required. Run AI models locally: LLMs (Llama2, Mistral, Mixtral...), Speech-to-text (whisper)...' topics include llm, genai, localai, ml, openai, tauri, rust.
matched fp:a9dda7e6c16051d6, llm:Repository topics and description: 'Local, private GenAI server alternative to OpenAI. No GPU required. Run AI models locally: LLMs (Llama2, Mistral, Mixtral...), Speech-to-text (whisper)...' topics include llm, genai, localai, ml, openai, tauri, rust.
matched fp:a9dda7e6c16051d6, llm:Repository topics and description: 'Local, private GenAI server alternative to OpenAI. No GPU required. Run AI models locally: LLMs (Llama2, Mistral, Mixtral...), Speech-to-text (whisper)...' topics include llm, genai, localai, ml, openai, tauri, rust.
matched fp:a9dda7e6c16051d6, llm:Repository topics and description: 'Local, private GenAI server alternative to OpenAI. No GPU required. Run AI models locally: LLMs (Llama2, Mistral, Mixtral...), Speech-to-text (whisper)...' topics include llm, genai, localai, ml, openai, tauri, rust.