Top AI Repos โ open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
๐ฃ๏ธ Chat with LLM like Vicuna totally in your browser with WebGPU, safely, privately, and with no server. Powered by web llm.
| Date | Stars |
|---|---|
| 2026-07-31 | 630 |
| 2026-08-01 | 630 |
| 2026-08-06 | 630 |
Today
โ stars today
This week
โ stars this week
This month
โ stars this month
Momentum
0.0
growth rate 0.00%/day
<div align="center">
<img src="./docs/images/icon.jpg" alt="icon" height="160"/>
<h1 align="center">ChatLLM Web</h1>
<h2 align="center">๐ Check the AI search engine https://discovai.io, discover top ai tools that best match your need</h2>
English / [็ฎไฝไธญๆ](./docs/README_CN.md) / [ๆฅๆฌ่ช](./docs/README_JA.md)
๐ฃ๏ธ Chat with LLM like Vicuna totally in your browser with WebGPU, safely, privately, and with no server. Powered By [web-llm](https://github.com/mlc-ai/web-llm).
[Try it now](https://chat-llm-web.vercel.app)
</div>
## Features
- ๐ค Everything runs inside the browser with **no server support** and is **accelerated with WebGPU**.
- โ๏ธ Model runs in a web worker, ensuring that it doesn't block the user interface and providing a seamless experience.
- ๐ Easy to deploy for free with one-click on Vercel in under 1 minute, then you get your own ChatLLM Web.
- ๐พ Model caching is supported, so you only need to download the model once.
- ๐ฌ Multi-conversation chat, with all data stored locally in the browser for privacy.
- ๐ Markdown and streaming response support: math, code highlighting, etc.
- ๐จ responsive and well-designed UI, including dark mode.
- ๐ป PWA supported, download it and run totally offline.
## Instructions
- ๐ To use this app, you need a browser that supports WebGPU, such as Chrome 113 or Chrome Canary. Chrome versions โค 112 are not supported.
- ๐ป You will need a GPU with about 6.4GB of memory. If your GPU has less memory, the app will still run, but the response time will be slower.
- ๐ฅ The first time you use the app, you will need to download the model. For the Vicuna-7b model that we are currently using, the download size is about 4GB. After the initial download, the model will be loaded from the browser cache for faster usage.
- โน๏ธ For more details, please visit [mlc.ai/web-llm](https://mlc.ai/web-llm/)
## Roadmap
- [โ
] LLM: using web worker to create an LLM instance and generate answers.
- [โ
] Conversations: Multi-conversation support is available.
- [โ
] PWA
- [] Settings:
- ui: dark/light theme
- device:
- gpu device choose
- cache usage and manage
- model:
- support multi models: vicuna-7bโ
RedPajama-INCITE-Chat-3B []
- params config: temperature, max-length, etc.
- export & import model
## Deploy to Vercel
1. Click
[](https://vercel.com/new/clone?repository-url=https%3A%2F%2Fgithub.com%2FRyan-yang125%2FChatLLM-Web&project-name=chat-llm-web&repository-name=ChatLLM-Web), follow the instructions, and finish in just 1 minute.
2. Enjoy it ๐
## Development
```shell
git clone https://github.com/Ryan-yang125/ChatLLM-Web.git
cd ChatLLM-Web
npm i
npm run dev
```
## Screenshots
## ๐ History
[](https://star-history.com/#Ryan-yang125/ChatLLM-Web&Date)
## LICENSE
[MIT](./LICENSE)
Excerpt of 3,049 characters
Read on GitHub
42
Ikko Eltociear Ashimine ยท Japan
4
2
Matt Hoffner ยท Porch.com
1
Would you bet a product on this? Bounded 0โ100 and slow moving.
matched fp:badbebe952501d67, topic:deep-learning
matched fp:badbebe952501d67, topic:llm
matched fp:badbebe952501d67, topic:chatgpt