Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
| Date | Stars |
|---|---|
| 2026-07-31 | 606 |
| 2026-08-03 | 605 |
| 2026-08-06 | 605 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
<p align="center"> <img width="256" height="256" alt="kani" src="docs/_static/[email protected]"> </p> <p align="center"> <a href="https://github.com/zhudotexe/kani/actions/workflows/pytest.yml"> <img alt="Test Package" src="https://github.com/zhudotexe/kani/actions/workflows/pytest.yml/badge.svg"> </a> <a href="https://kani.readthedocs.io/en/latest/?badge=latest"> <img alt="Documentation Status" src="https://readthedocs.org/projects/kani/badge/?version=latest"> </a> <a href="https://pypi.org/project/kani/"> <img alt="PyPI" src="https://img.shields.io/pypi/v/kani"> </a> <a href="https://colab.research.google.com/github/zhudotexe/kani/blob/main/examples/colab_examples.ipynb"> <img alt="Quickstart in Colab" src="https://colab.research.google.com/assets/colab-badge.svg"> </a> <a href="https://discord.gg/eTepTNDxYT"> <img alt="Discord" src="https://img.shields.io/discord/1150902904773935214?color=5865F2&label=discord&logo=discord&logoColor=white"> </a> <br/> <a href="examples/4_engines_zoo.py"> <img alt="Model zoo" src="https://img.shields.io/badge/examples-model_zoo-blue"> </a> <a href="examples/5_advanced_retrieval.py"> <img alt="Retrieval example" src="https://img.shields.io/badge/examples-retrieval-blue"> </a> </p> # kani (カニ) kani (カニ) is a lightweight and highly hackable framework for chat-based language models with **tool usage/function calling**. Compared to other LM frameworks, kani is less opinionated and offers more fine-grained customizability over the parts of the control flow that matter, making it the perfect choice for NLP researchers, hobbyists, and developers alike. kani comes with support for the following models out of the box, with a **model-agnostic** framework to add support for many more: - OpenAI Models (`pip install "kani[openai]"`) - Anthropic Models (`pip install "kani[anthropic]"`) - Google AI Models (`pip install "kani[google]"`) - Hugging Face transformers (`pip install "kani[huggingface]"`) - llama.cpp (`pip install "kani[cpp]"`) - vLLM (`pip install "kani[vllm]"`) - and more with [community extensions](https://kani.readthedocs.io/en/latest/community/extensions.html)! **Check out the [Model Zoo](examples/4_engines_zoo.py) for code examples of loading popular models in Kani!** Interested in contributing? Check out our [guide](https://kani.readthedocs.io/en/latest/community/contributing.html). [Read the docs on ReadTheDocs!](http://kani.readthedocs.io/) [Read our paper on arXiv!](https://arxiv.org/abs/2309.05542) ## Installation kani requires Python 3.10 or above. To install model-specific dependencies, kani uses various extras (brackets after the library name in `pip install`). To determine which extra(s) to install, see the [model table](https://kani.readthedocs.io/en/latest/engines.html), or use the `[all]` extra to install everything. ```shell # for OpenAI models $ pip install "kani[openai]" # for Hugging Face models $ pip install "kani[huggingface]" torch # for multimodal inputs $ pip install "kani[multimodal]" # or install everything: $ pip install "kani[all]" ``` For the most up-to-date changes and new models, you can also install the development version from Git's `main` branch: ```shell $ pip install "kani[all] @ git+https://github.com/zhudotexe/kani.git@main" ``` ## Quickstart <a href="https://colab.research.google.com/github/zhudotexe/kani/blob/main/examples/colab_examples.ipynb"> <img alt="Quickstart in Colab" src="https://colab.research.google.com/assets/colab-badge.svg"> </a> kani requires Python 3.10 or above. First, install the library. In this quickstart, we'll use the OpenAI engine, though kani is [model-agnostic](https://kani.readthedocs.io/en/latest/engines.html). ```shell $ pip install "kani[openai]" ``` Then, let's use kani to create a simple chatbot using ChatGPT as a backend. ```python # import the library import asyncio from kani import Kani, chat_in_terminal from kani.engines.openai import Ope
Excerpt of 15,775 characters
Read on GitHub
733
9
6
Imgbot · Imgbot · United States
4
3
1
1
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:a332e75a8ae0b271, topic:large-language-models, topic:llama
matched fp:a332e75a8ae0b271, topic:function-calling
matched fp:a332e75a8ae0b271, topic:chatgpt