Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
🦀 A curated list of Rust tools, libraries, and frameworks for working with LLMs, GPT, AI
| Date | Stars |
|---|---|
| 2026-07-31 | 589 |
| 2026-08-06 | 590 |
Today
+1 stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
```
__ __ __
.---.-.--.--.--.-----.-----.-----.--------.-----.___.----.--.--.-----| |_ ___| | .--------.
| _ | | | | -__|__ --| _ | | -__|___| _| | |__ --| _|___| | | |
|___._|________|_____|_____|_____|__|__|__|_____| |__| |_____|_____|____| |__|__|__|__|__|
https://github.com/jondot/awesome-rust-llm
```
**Awesome Rust LLM** is an awesome style list that keeps track and curates the best Rust based LLM frameworks, libraries, tools, tutorials, articles and more. PRs are welcome!
## Models & Inference
* [llm](https://github.com/rustformers/llm) - a Rust library for running inference from a number of supported LLMs, loads [ggml](https://github.com/ggerganov/ggml) based models
* [rust-bert](https://github.com/guillaume-be/rust-bert) - all in one pipelines for for transformer-based models (BERT, DistilBERT, GPT2,...). Good for local embedding, port of `transformers` (python)
* [llm-chain](https://github.com/sobelio/llm-chain) - chaining LLMs in Rust
* [smartgpt](https://github.com/Cormanz/smartgpt) ([how it works](https://twitter.com/jondot/status/1660576729549664261))- use LLMs with the ability to complete complex tasks using plugins
* [diffusers](https://github.com/pykeio/diffusers) - Stable Diffusion using Rust, 45% faster than Pytorch
* [postgresml](https://github.com/postgresml/postgresml) - an amazing Postgres extension to do model fetching, inference all with SQL as part of your Postgres instance
## Projects
* [aichat](https://github.com/sigoden/aichat) - a pure Rust CLI implementing AI chat, with advanced features such as real-time streaming, text highlighting and more
* [browser-agent](https://github.com/m1guelpf/browser-agent/) - a headless browser driven by GPT-4. Sends off a simplified page representation and receives & executes instructions from GPT using a custom message format
* [tenere](https://github.com/pythops/tenere) - TUI interface for LLMs
How it works? here's a prompt snippet:
```
You must respond with ONLY one of the following commands AND NOTHING ELSE:
- CLICK X - click on a given element. You can only click on links, buttons, and inputs!
- TYPE X \"TEXT\" - type the specified text into the input with id X and press ENTER
- ANSWER \"TEXT\" - Respond to the user with the specified text once you have completed the objective
```
* [ajeto](https://github.com/bausano/ajeto) - LLM personal assistant
* [shortgpt](https://github.com/rupeshs/shortgpt) - Ask shortgpt for instant and concise answers
* [autorust](https://github.com/minskylab/auto-rust) - macros that generate AI driven rust code in compile time
* [clerk](https://github.com/blankenshipz/clerk) - LLM based file organizer
* [gptcommit](https://github.com/zurawiki/gptcommit) - prepare commit message with GPT
## LLM Memory
* [indexify](https://github.com/diptanu/indexify) - A retrieval and long term memory service for LLMs
* [memex](https://github.com/spyglass-search/memex) - Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.
* [motorhead](https://github.com/getmetal/motorhead) - a memory and information retrieval server for LLMs.
* Uses Redis as vector store for long term memory,
* Works with OpenAI API
* [js example](https://github.com/getmetal/motorhead/blob/main/examples/chat-js), [python example](https://github.com/getmetal/motorhead/blob/main/examples/chat-py)
## Core Libraries
* [tiktoken](https://github.com/openai/tiktoken) - tiktoken is a Python library with a Rust core implementing a fast [BPE](https://en.wikipedia.org/wiki/Byte_pair_encoding) tokeniser for use with OpenAI's models
* BPE is done in Rust
* Made by OpenAI
* [tiktoken-rs](https://github.com/zurawiki/tiktoken-rs) - a Rust focused library based on the `tiktoken` core with additional enhancements for use in Rust code. (Pyton parts in `tiktoken` done in pure Rust)
Excerpt of 5,406 characters
Read on GitHub
Dotan J. Nahum · SpectralOps · Israel
8
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:87ddd04d6187cca3, topic:llm, topic:gpt