Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
The web framework for building LLM microservices [deprecated]
| Date | Stars |
|---|---|
| 2026-07-31 | 993 |
| 2026-08-04 | 993 |
| 2026-08-06 | 993 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
<div align="center">
<img src="https://raw.githubusercontent.com/ajndkr/lanarky/main/assets/logo-light-mode.png#gh-light-mode-only" alt="lanarky-logo-light-mode" width="500">
<img src="https://raw.githubusercontent.com/ajndkr/lanarky/main/assets/logo-dark-mode.png#gh-dark-mode-only" alt="lanarky-logo-dark-mode" width="500">
<h4>The web framework for building LLM microservices.</h4>
[](https://github.com/ajndkr/lanarky/stargazers)
[](https://github.com/ajndkr/lanarky/blob/main/LICENSE)
[](https://twitter.com/intent/follow?screen_name=LanarkyAPI)
[](https://pypi.org/project/lanarky/)
[](https://coveralls.io/github/ajndkr/lanarky?branch=main)
[](https://pypi.org/project/lanarky/)
[](https://pypistats.org/packages/lanarky)
</div>
> ⚠️ **Disclaimer**: This project is now in maintenance mode. I won't be adding new features or actively maintaining the project as I have moved on to other projects and priorities. While I will address critical bugs and security issues as needed, active development has ceased from my end. I do encourage the community to continue to contribute to the project if they find it useful. Thank you for using lanarky!
Lanarky is a **python (3.9+)** web framework for developers who want to build microservices using LLMs.
Here are some of its key features:
- **LLM-first**: Unlike other web frameworks, lanarky is built specifically for LLM developers.
It's unopinionated in terms of how you build your microservices and guarantees zero vendor lock-in
with any LLM tooling frameworks or cloud providers
- **Fast & Modern**: Built on top of FastAPI, lanarky offers all the FastAPI features you know and love.
If you are new to FastAPI, visit [fastapi.tiangolo.com](https://fastapi.tiangolo.com) to learn more
- **Streaming**: Streaming is essential for many real-time LLM applications, like chatbots. Lanarky has
got you covered with built-in streaming support over **HTTP** and **WebSockets**.
- **Open-source**: Lanarky is open-source and free to use. Forever.
To learn more about lanarky and get started, you can find the full documentation on [lanarky.ajndkr.com](https://lanarky.ajndkr.com)
## Installation
The library is available on PyPI and can be installed via `pip`:
```bash
pip install lanarky
```
## Getting Started
Lanarky provides a powerful abstraction layer to allow developers to build
simple LLM microservices in just a few lines of code.
Here's an example to build a simple microservice that uses OpenAI's `ChatCompletion` service:
```python
from lanarky import Lanarky
from lanarky.adapters.openai.resources import ChatCompletionResource
from lanarky.adapters.openai.routing import OpenAIAPIRouter
app = Lanarky()
router = OpenAIAPIRouter()
@router.post("/chat")
def chat(stream: bool = True) -> ChatCompletionResource:
system = "You are a sassy assistant"
return ChatCompletionResource(stream=stream, system=system)
app.include_router(router)
```
Visit [Getting Started](https://lanarky.ajndkr.com/getting-started) for the full tutorial on building
and testing your first LLM microservice with Lanarky.
## Contributing
[](https://github.com/ajndkr/lanarky/actions/workflows/code-check.yaml)
[](https://github.com/ajndkr/lanarky/actions/workflows/publish.yaml)
Contributions are more than welcome! If you have an idea for a new feature or want to help improve lanarky,
please create an issuExcerpt of 4,415 characters
Read on GitHub
Ajinkya Indulkar · @sensity-ai · Netherlands
144
10
4
3
3
1
1
Amine Djeghri · Sorbonne Université · France
1
1
1
1
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:bdd25cfa756a7874, topic:llmops