Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Super-fast Structured Outputs
| Date | Stars |
|---|---|
| 2026-07-31 | 823 |
| 2026-08-05 | 828 |
| 2026-08-06 | 828 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
<div align="right"> <a href="https://github.com/guidance-ai/llguidance/issues/337"><img src="https://img.shields.io/badge/We%20Are%20Hiring!-8A2BE2"></a> <a href="https://discord.gg/cjPfAK43dz"><img src="https://img.shields.io/badge/Discord-Join%20Us-5865F2?logo=discord&logoColor=white" alt="Discord"></a> <a href="mailto:[email protected]"><img src="https://img.shields.io/badge/Email-guidanceai%40microsoft.com-0078D4?logo=microsoft-outlook&logoColor=white" alt="Email"></a> <img src="https://img.shields.io/badge/Hours-10am--2pm%20Pacific-gray" alt="Hours"> </div> # Low-level Guidance (llguidance) <p align="center"> <img src="https://github.com/guidance-ai/jsonschemabench/raw/main/maskbench/plots/hero.png" width="700"> <br/> <em>Performance results from <a href ="https://github.com/guidance-ai/jsonschemabench/tree/main/maskbench">MaskBench</a></em> </p> --- * 2025-06-23 llguidance is now deemed v1.0.0 * 2025-06-11 [Making Structured Outputs Go Brrr](https://guidance-ai.github.io/llguidance/llg-go-brrr) blog post released * 2025-05-20 LLGuidance [shipped](https://x.com/OpenAIDevs/status/1924915341052019166) in [OpenAI](https://x.com/OpenAIDevs/status/1924915343677653014) for JSON Schema * 2025-04-11 integration [merged](https://github.com/chromium/chromium/commit/07ca6337c2f714ba0477202414bd2b1692e70594) into Chromium * 2025-03-25 integration [merged](https://github.com/vllm-project/vllm/pull/14779) into vLLM (v0.8.2) * 2025-02-26 integration [merged](https://github.com/sgl-project/sglang/pull/3298) into SGLang (v0.4.4) * 2025-02-01 integration [merged](https://github.com/ggml-org/llama.cpp/pull/10224) into llama.cpp (b4613) * 2025-01-21 [JSONSchemaBench](https://github.com/guidance-ai/jsonschemabench) released, including [paper](https://arxiv.org/abs/2501.10868) and [MaskBench](https://github.com/guidance-ai/jsonschemabench/tree/main/maskbench) * 2025-01-07 Guidance [v0.2.0](https://github.com/guidance-ai/guidance/releases/tag/0.2.0) released, using llguidance as the grammar engine --- ## About This library implements constrained decoding (also called constrained sampling or structured outputs) for Large Language Models (LLMs). It can enforce arbitrary context-free grammar on the output of LLM and is fast - on the order of 50μs of CPU time per token (for 128k tokenizer) with negligible startup costs. Following grammar formats are supported: - [a large subset](./docs/json_schema.md) of JSON schemas - regular expressions - context-free grammars in a [variation of Lark format](./docs/syntax.md); with embedded JSON schemas and regular expressions - `llguidance` - [internal (JSON-based) format](./parser/src/api.rs); slowly being deprecated in favor of the Lark-like format The internal format is most powerful (though Lark-like format is catching up, and there are plans to convert the libraries to use it) and can be generated by the following libraries: - [Guidance](https://github.com/guidance-ai/guidance) (Python) - [guidance.ts](https://github.com/mmoskal/guidance-ts) (TypeScript) - hopefully more to come! The library can be used from: - [Rust](./parser/README.md), [sample](./sample_parser/src/minimal.rs) - [C and C++](./parser/llguidance.h), [sample](./c_sample/c_sample.cpp) - [Python](./python/llguidance/_lib.pyi) ## Integrations The library is currently integrated in: - [Guidance](https://github.com/guidance-ai/guidance) - library for interacting with LLMs - [OpenAI models](https://x.com/OpenAIDevs/status/1924915343677653014) - LLGuidance powers [Structured Output](https://platform.openai.com/docs/guides/structured-outputs) (JSON Schema only) - [llama.cpp](https://github.com/ggerganov/llama.cpp/pull/10224) - available via `-DLLAMA_LLGUIDANCE=ON` option for `cmake`; llama.cpp can be also used Guidance Python package - **Chromium** - [merged](https://github.com/chromium/chromium/commit/07ca6337c2f714ba0477202414bd2b1692e70594), to be used for [JSON Schema enforcement](https://github
Excerpt of 10,428 characters
Read on GitHub
Michał Moskal · @OpenAI · United States
1.4k
77
Richard Edgar · @microsoft
40
36
16
Nicholas King · United States
6
Microsoft Open Source · Microsoft · United States
5
Nathan Goldbaum · Quansight Labs · United States
4
2
2
1
1
1
1
1
1
1
1
1
Ikko Eltociear Ashimine · Japan
1
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:063f2ebfe8b50137, llm:Repository name 'llguidance' and description 'Super-fast Structured Outputs' suggest a library for guiding LLMs to produce structured outputs; associated with Guidance AI project. Language Rust. No topics/README provided.
matched fp:063f2ebfe8b50137, llm:Repository name 'llguidance' and description 'Super-fast Structured Outputs' suggest a library for guiding LLMs to produce structured outputs; associated with Guidance AI project. Language Rust. No topics/README provided.