Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
| Date | Stars |
|---|---|
| 2026-07-24 | 8107 |
| 2026-07-25 | 8109 |
| 2026-07-28 | 8109 |
| 2026-07-30 | 8109 |
| 2026-07-31 | 8118 |
| 2026-08-01 | 8118 |
| 2026-08-02 | 8118 |
| 2026-08-03 | 8119 |
| 2026-08-04 | 8120 |
| 2026-08-05 | 8122 |
| 2026-08-06 | 8123 |
Today
+1 stars today
This week
+14 stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.17%/day
# GPTCache : A Library for Creating Semantic Cache for LLM Queries Slash Your LLM API Costs by 10x 💰, Boost Speed by 100x ⚡ [](https://pypi.org/project/gptcache/) [](https://pypi.org/project/gptcache/) [](https://codecov.io/gh/zilliztech/GPTCache) [](https://opensource.org/license/mit/) [](https://twitter.com/zilliz_universe) [](https://discord.gg/Q8C6WEjSWV) 🎉 GPTCache has been fully integrated with 🦜️🔗[LangChain](https://github.com/hwchase17/langchain) ! Here are detailed [usage instructions](https://python.langchain.com/docs/modules/model_io/models/llms/integrations/llm_caching#gptcache). 🐳 [The GPTCache server docker image](https://github.com/zilliztech/GPTCache/blob/main/docs/usage.md#Use-GPTCache-server) has been released, which means that **any language** will be able to use GPTCache! 📔 This project is undergoing swift development, and as such, the API may be subject to change at any time. For the most up-to-date information, please refer to the latest [documentation]( https://gptcache.readthedocs.io/en/latest/) and [release note](https://github.com/zilliztech/GPTCache/blob/main/docs/release_note.md). **NOTE:** As the number of large models is growing explosively and their API shape is constantly evolving, we no longer add support for new API or models. We encourage the usage of using the get and set API in gptcache, here is the demo code: https://github.com/zilliztech/GPTCache/blob/main/examples/adapter/api.py ## Quick Install `pip install gptcache` ## 🚀 What is GPTCache? ChatGPT and various large language models (LLMs) boast incredible versatility, enabling the development of a wide range of applications. However, as your application grows in popularity and encounters higher traffic levels, the expenses related to LLM API calls can become substantial. Additionally, LLM services might exhibit slow response times, especially when dealing with a significant number of requests. To tackle this challenge, we have created GPTCache, a project dedicated to building a semantic cache for storing LLM responses. ## 😊 Quick Start **Note**: - You can quickly try GPTCache and put it into a production environment without heavy development. However, please note that the repository is still under heavy development. - By default, only a limited number of libraries are installed to support the basic cache functionalities. When you need to use additional features, the related libraries will be **automatically installed**. - Make sure that the Python version is **3.8.1 or higher**, check: `python --version` - If you encounter issues installing a library due to a low pip version, run: `python -m pip install --upgrade pip`. ### dev install ```bash # clone GPTCache repo git clone -b dev https://github.com/zilliztech/GPTCache.git cd GPTCache # install the repo pip install -r requirements.txt python setup.py install ``` ### example usage These examples will help you understand how to use exact and similar matching with caching. You can also run the example on [Colab](https://colab.research.google.com/drive/1m1s-iTDfLDk-UwUAQ_L8j1C-gzkcr2Sk?usp=share_link). And more examples you can refer to the [Bootcamp](https://gptcache.readthedocs.io/en/latest/bootcamp/openai/chat.html) Before running the example, **make sure** the OPENAI_API_KEY environment variable is set by executing `echo $OPENAI_API_KEY`. If it is not already set, it can be set by using `export OPENAI_API_KEY=YOUR
Excerpt of 23,805 characters
Read on GitHub
SimFG
199
Starlord · @zilliztech · United States
54
Jael Gu · Zilliz
45
37
James · Zilliz · United States
26
wxywb · zilliz · China
24
ryjiang · Zilliz · China
15
15
binbin · zilliz · China
11
KY HU · ByteDance · China
9
Frank Liu · @voyage-ai @mongodb
7
6
Mohammad Mohtashim · CAIRE
3
zhuwenxing · @milvus-io · China
3
3
Saba Sturua · @jina-ai · Germany
3
2
Cheney Zhang · @zilliztech · China
2
Pouyan · NVIDIA · Switzerland
2
1
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:72fe7657c96f8455, topic:vector-search, topic:similarity-search, topic:semantic-search
matched fp:72fe7657c96f8455, topic:llm, topic:gpt, topic:llama
matched fp:72fe7657c96f8455, topic:chatbot, topic:chatgpt