Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
轻松玩转LLM兼容openai&langchain,支持文心一言、讯飞星火、腾讯混元、智谱ChatGLM等
| Date | Stars |
|---|---|
| 2026-07-31 | 449 |
| 2026-08-01 | 449 |
| 2026-08-02 | 449 |
| 2026-08-05 | 449 |
| 2026-08-06 | 449 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
  
<h1 align = "center">🔥ChatLLM 基于知识库🔥</h1>
> star之后可联系wx: 313303303领取1000w tokens(国产模型)
> star之后可联系wx: 313303303领取1000w tokens(国产模型)
> star之后可联系wx: 313303303领取1000w tokens(国产模型)
<div align=center>
<img src="data/imgs/LLM.drawio.png"/>
</div>

## todo: SimpleGraphRAG
## [ChatLLM API 分发系统上线](https://api.chatllm.vip/)
<details markdown="1">
<summary>Click to Star⭐️免费领取tokens</summary>
https://api.chatllm.vip/
</details>
## Install
```shell
pip install -U chatllm
```
## [Docs](https://yuanjie-ai.github.io/ChatLLM/)
## Usages
### [目前适配的LLMs](LLMS.md)
> 计划推出国内 oneapi,支持各种主流大模型,兼容openai客户端生态。
```python
from chatllm.applications import ChatBase
qa = ChatBase()
qa.load_llm(model_name_or_path="THUDM/chatglm-6b")
for i in qa(query='周杰伦是谁', knowledge_base='周杰伦是傻子'):
print(i, end='')
# 根据已知信息无法回答该问题,因为周杰伦是中国内地流行歌手、演员、音乐制作人、导演,
# 是具有一定的知名度和专业能力的人物,没有提供足够的信息无法判断他是傻子。
```
## OpenaiEcosystem
<details markdown="1">
<summary>Click to 无缝对接openai生态</summary>
```shell
# 服务端
pip install "chatllm[openai]" && chatllm-run openai <本地模型地址>
```
- SDK:`pip install openai`
```python
import openai
openai.api_base = 'http://0.0.0.0:8000/v1'
openai.api_key = 'chatllm'
prompt = "你好"
completion = openai.Completion.create(prompt=prompt, stream=True, model="text-davinci-003")
for c in completion:
print(c.choices[0].text, end='')
# 你好👋!我是人工智能助手 ChatGLM-6B,很高兴见到你,欢迎问我任何问题。
```
- 客户端:[点击下载chatbox](https://chatboxapp.xyz/),也可接入客户端

### [openai_keys](./data/openai_keys.md): `不定期更新免费keys`
</details>
## ChatOCR
<details markdown="1">
<summary>Click to ChatOCR</summary>
```python
from meutils.pipe import *
from chatllm.llmchain.applications import ChatOCR
llm = ChatOCR()
file_path = "data/invoice.jpg"
llm.display(file_path, 700)
llm.chat('识别编号,公司名称,开票日期,开票人,收款人,复核人,金额', file_path=file_path) | xprint
```

</details>
## ChatMind
<details markdown="1">
<summary>Click to ChatMind</summary>
```shell
pip install "chatllm" && chatllm-run webui --name chatmind
```

</details>
## ChatPDF
<details markdown="1">
<summary>Click to ChatPDF</summary>
```shell
pip install "chatllm[pdf]" && chatllm-run webui --name chatpdf
```
- python交互
```python
from chatllm.applications.chatpdf import ChatPDF
qa = ChatPDF(encode_model='nghuyong/ernie-3.0-nano-zh')
qa.load_llm(model_name_or_path="THUDM/chatglm-6b")
qa.create_index('财报.pdf') # 构建知识库
for i in qa(query='东北证券主营业务'):
print(i, end='')
# 根据已知信息,东北证券的主营业务为证券业务。公司作为证券公司,主要从事证券经纪、证券投资咨询、与证券交易、
# 证券投资活动有关的财务顾问、证券承销与保荐、证券自营、融资融券、证券投资基金代销和代销金融产品待业务。
```
- 支持召回结果查看

</details>
## Deploy
<details markdown="1">
<summary>Click to Deploy</summary>
- ChatGLM-6B 模型硬件需求
| **量化等级** | **最低 GPU 显存**(推理) | **最低 GPU 显存**(高效参数微调) |
|-----------|-------------------|-----------------------|
| FP16(无量化) | 13 GB | 14 GB |
| INT8 | 8 GB | 9 GB |
| INT4 | 6 GB | 7 GB |
- 从本地加载模型
- [安装指南](docs/INSTALL.md)
- [ChatGLM-6B Mac 本地部署实操记录](https://www.yuque.com/arvinxx/llm/chatglm-6b-deployment-on-mac)
- [THUDM/ChatGLM-6B#从本地加载模型](https://github.com/THUDM/ChatGLM-6B#从本地加载模型)
</details>
## TODO
<details markdown="1">
<summary>Click to TODO</summary>
- [ ] ChatLLM 应用
- [x] 接入非结构化文档(已支持 md、pdf、docx、txt 文件格式)
- [ ] 搜索引擎与本地网页接入
- [ ] 结构化数据接入(如 csv、Excel、SQL 等)
- [ ] 知识图谱/图数据库接入
- [ ] 增加 ANN 后端,ES/RedisSearch【确保生产高可用】
- [ ] 增加多级缓存缓存
- [ ] 多路召回
- [ ] 问
- [ ] 标量匹配
- [x] 多种向量化,向量匹配
- [ ] 增加相似问,换几个问法
- [ ] 高置信度直接返回答案【匹配标准问】
Excerpt of 5,599 characters
Read on GitHubWould you bet a product on this? Bounded 0–100 and slow moving.
matched fp:17c864b769dc7eae, llm:Topics list includes chatllm, llm, langchain, lora, p-tuning, chatgpt, chatweb and description: '轻松玩转LLM兼容openai&langchain,支持文心一言、讯飞星火、腾讯混元、智谱ChatGLM等' (working with LLMs, OpenAI & LangChain compatible, supports many Chinese models).
matched fp:17c864b769dc7eae, llm:Topics list includes chatllm, llm, langchain, lora, p-tuning, chatgpt, chatweb and description: '轻松玩转LLM兼容openai&langchain,支持文心一言、讯飞星火、腾讯混元、智谱ChatGLM等' (working with LLMs, OpenAI & LangChain compatible, supports many Chinese models).
matched fp:17c864b769dc7eae, llm:Topics list includes chatllm, llm, langchain, lora, p-tuning, chatgpt, chatweb and description: '轻松玩转LLM兼容openai&langchain,支持文心一言、讯飞星火、腾讯混元、智谱ChatGLM等' (working with LLMs, OpenAI & LangChain compatible, supports many Chinese models).
matched fp:17c864b769dc7eae, llm:Topics list includes chatllm, llm, langchain, lora, p-tuning, chatgpt, chatweb and description: '轻松玩转LLM兼容openai&langchain,支持文心一言、讯飞星火、腾讯混元、智谱ChatGLM等' (working with LLMs, OpenAI & LangChain compatible, supports many Chinese models).