Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection
| Date | Stars |
|---|---|
| 2026-07-31 | 1187 |
| 2026-08-04 | 1189 |
| 2026-08-06 | 1189 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
35.0
growth rate 0.00%/day
<p align="center">
<picture>
<source media="(prefers-color-scheme: dark)" srcset="assets/images/uqlm_flow_ds_dark.png">
<source media="(prefers-color-scheme: light)" srcset="assets/images/uqlm_flow_ds.png">
<img src="assets/images/uqlm_flow_ds.png" alt="UQLM Flow Diagram" />
</picture>
</p>
<h1 align="center">uqlm: Uncertainty Quantification for Language Models</h1>
<p align="center">
<a href="https://github.com/cvs-health/uqlm/actions">
<img src="https://github.com/cvs-health/uqlm/actions/workflows/ci.yaml/badge.svg" alt="Build Status">
</a>
<a href="https://pypi.org/project/uqlm/">
<img src="https://badge.fury.io/py/uqlm.svg" alt="PyPI version">
</a>
<a href="https://cvs-health.github.io/uqlm/latest/index.html">
<img src="https://img.shields.io/badge/docs-latest-blue.svg" alt="Documentation Status">
</a>
<a href="https://pypi.org/project/uqlm/">
<img src="https://img.shields.io/badge/python-3.10%2B-blue" alt="Python Versions">
</a>
<a href="https://opensource.org/licenses/Apache-2.0">
<img src="https://img.shields.io/badge/License-Apache%202.0-blue.svg" alt="License">
</a>
<a href="https://discord.gg/RjcrAPw43H">
<img src="https://img.shields.io/badge/Discord-Join-5865F2?logo=discord&logoColor=lightgrey" alt="Discord">
</a>
<a href="https://github.com/astral-sh/uv">
<img src="https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/astral-sh/uv/main/assets/badge/v0.json" alt="uv">
</a>
<a href="https://github.com/astral-sh/ruff">
<img src="https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/astral-sh/ruff/main/assets/badge/v2.json" alt="Ruff">
</a>
</p>
<p align="center">
<a href="https://www.jmlr.org/papers/v27/25-1557.html">
<img src="https://img.shields.io/badge/JMLR-UQLM-112467?style=flat&style=for-the-badge&logo=semantic-scholar&logoColor=white" alt="JMLR Publication">
</a>
<a href="https://openreview.net/pdf?id=WOFspd4lq5">
<img src="https://img.shields.io/badge/TMLR-EnsembleUQ-4FA1CA?style=flat&logo=semantic-scholar&logoColor=white" alt="TMLR Publication">
</a>
</a>
<a href="https://openreview.net/pdf?id=gngp4Zz9Sj">
<img src="https://img.shields.io/badge/TMLR-LongTextUQ-4FA1CA?style=flat&logo=semantic-scholar&logoColor=white" alt="TMLR Publication">
</a>
</p>
UQLM is a Python library for Large Language Model (LLM) hallucination detection using state-of-the-art uncertainty quantification techniques.
## Installation
The latest version can be installed from PyPI:
```bash
pip install uqlm
```
## Hallucination Detection
UQLM provides a suite of response-level scorers for quantifying the uncertainty of Large Language Model (LLM) outputs. Each scorer returns a confidence score between 0 and 1, where higher scores indicate a lower likelihood of errors or hallucinations. We categorize these scorers into different types:
| Scorer Type | Added Latency | Added Cost | Compatibility | Off-the-Shelf / Effort |
|------------------------|----------------------------------------------------|------------------------------------------|-----------------------------------------------------------|---------------------------------------------------------|
| [Black-Box Scorers](#black-box-scorers-consistency-based) | ⏱️ Medium-High (multiple generations & comparisons) | 💸 High (multiple LLM calls) | 🌍 Universal (works with any LLM) | ✅ Off-the-shelf |
| [White-Box Scorers](#white-box-scorers-token-probability-based) | ⚡ Minimal\* (token probabilities already returned) | ✔️ None\* (no extra LLM calls) | 🔒 Limited (requires access to token probabilities) | ✅ Off-the-shelf |
| [LLM-as-a-Judge Scorers](#llm-as-a-judge-scorers) | ⏳ Low-Medium (additional Excerpt of 22,552 characters
Read on GitHub
Dylan Bouchard · United States
710
122
33
24
14
11
10
9
9
7
6
3
2
2
1
1
1
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:c84fe1994f91bf0f, topic:llm-evaluation, desc:hallucination detection
matched fp:c84fe1994f91bf0f, topic:llm
matched fp:c84fe1994f91bf0f, topic:ai-safety