Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.
| Date | Stars |
|---|---|
| 2026-07-24 | 362 |
| 2026-07-25 | 368 |
| 2026-07-28 | 383 |
| 2026-07-30 | 388 |
| 2026-07-31 | 389 |
| 2026-08-06 | 389 |
Today
— stars today
This week
+1 stars this week
This month
— stars this month
Momentum
36.0
growth rate 0.26%/day
 # mlx-serve — run any LLM on your Mac **OpenAI- and Anthropic-compatible local inference for Apple Silicon — MLX *and* GGUF — faster than LM Studio on identical MLX weights. No Python. No cloud. No Electron.** [](https://github.com/ddalcu/mlx-serve/releases/latest) [](https://github.com/ddalcu/mlx-serve/stargazers) [](https://github.com/ddalcu/mlx-serve/releases) [](https://github.com/ddalcu/mlx-serve/commits/main) [](LICENSE) [](https://github.com/ddalcu/mlx-serve/releases/latest) [](https://ziglang.org) [](https://trendshift.io/repositories/43025) **[mlxserve.com](https://mlxserve.com/)** · [Download MLX Core.app](https://github.com/ddalcu/mlx-serve/releases/latest) · [Changelog](CHANGELOG.md) mlx-serve is a native Zig server that runs **any LLM on Apple Silicon** — MLX-format models *and* every GGUF on HuggingFace (Qwen, Llama, Mistral, Gemma, DeepSeek V4 Flash, thousands more). It exposes **OpenAI-compatible** *and* **Anthropic-compatible** HTTP APIs out of the box, so the same `http://localhost:11234` works with Claude Code, the OpenAI SDK, Continue, Cursor, Open WebUI, and anything else that speaks one of those wires. Beyond text, the same server generates **images, video, music, speech (with voice cloning), and 3D models** — all natively on MLX. Ships with **MLX Core**, a macOS menu-bar app with chat, agent mode, MCP tool calling, and model management. ## Get started ### Use the app (recommended) **MLX Core** is a signed, notarized macOS menu-bar app that bundles the server. Browse and download models with a progress UI, chat, run agent mode with MCP tools, generate images / video / music / speech / 3D, and tune every server flag from a Settings window. No terminal, nothing to configure. The server underneath is the same binary the CLI runs, on the same `http://localhost:11234`, so Claude Code and any OpenAI or Anthropic client can point at it while the app is running. [<img src="website/appiconb.png" width="48" align="center">](https://github.com/ddalcu/mlx-serve/releases/latest) **[Download MLX Core.app](https://github.com/ddalcu/mlx-serve/releases/latest)** — latest release for macOS (Apple Silicon) ### Install via Homebrew ```bash brew tap ddalcu/mlx-serve https://github.com/ddalcu/mlx-serve brew install --cask mlx-core # the app (recommended) brew install mlx-serve # CLI + server only, no GUI ``` ### Prefer the terminal? Ollama-style, if that's your habit: ```bash mlx-serve run gemma4 # downloads Gemma 4 E4B (4-bit), serves it, chats right in your terminal mlx-serve pull qwen3.6:27b # just download (resumable, straight from Hugging Face) mlx-serve list # what's on disk mlx-serve serve # serve everything you've pulled — models load on demand by name ``` Short names, `org/repo` HuggingFace ids, and `name:tag` all work. Or drive the server directly with flags, which is what you want for scripts, launchd, or a headless Mac: ```bash # one model, pinned for the life of the process mlx-serve --model ~/.mlx-serve/models/mlx-community/gemma-4-e4b-it-4bit --serve --port 11234 # a whole fol
Excerpt of 42,213 characters
Read on GitHubWould you bet a product on this? Bounded 0–100 and slow moving.
matched fp:024053a1ed869bbd, topic:inference, desc:inference server
matched fp:024053a1ed869bbd, topic:llm
matched fp:024053a1ed869bbd, topic:voice-cloning, readme:voice cloning
matched fp:024053a1ed869bbd, topic:image-generation