Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Deliver safe & effective language models
| Date | Stars |
|---|---|
| 2026-07-31 | 562 |
| 2026-08-06 | 561 |
Today
-1 stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
<p align="center">
<img src="https://raw.githubusercontent.com/Pacific-AI-Corp/langtest/main/docs/assets/images/langtest/langtest_logo.png" alt="pacific_ai_logo" width="360" style="text-align:center;">
</p>
<div align="center">
<h1 style="text-align: center; vertical-align: middle;">LangTest: Deliver Safe & Effective Language Models</h1>
</div>
<p align="center">
<a href="https://github.com/Pacific-AI-Corp/langtest/releases">
<img alt="Release Notes" src="https://img.shields.io/github/v/release/Pacific-AI-Corp/langtest.svg">
</a>
<a href="https://www.johnsnowlabs.com/responsible-ai-blog/">
<img alt="Blog" src="https://img.shields.io/badge/Responsible AI Blogs-8A2BE2">
</a>
<a href="https://langtest.org/docs/pages/docs/install">
<img alt="Documentation" src="https://img.shields.io/website?up_message=online&url=https%3A%2F%2Flangtest.org%2F">
</a>
<a href="https://star-history.com/#Pacific-AI-Corp/langtest">
<img alt="GitHub star chart" src="https://img.shields.io/github/stars/Pacific-AI-Corp/langtest?style=social">
</a>
<a href="https://github.com/Pacific-AI-Corp/langtest/issues">
<img alt="Open Issues" src="https://img.shields.io/github/issues-raw/Pacific-AI-Corp/langtest">
</a>
<a href="https://pepy.tech/project/langtest">
<img alt="Downloads" src="https://static.pepy.tech/badge/langtest">
</a>
<a href="https://github.com/Pacific-AI-Corp/langtest/actions/workflows/build_and_test.yml">
<img alt="CI" src="https://github.com/Pacific-AI-Corp/langtest/actions/workflows/build_and_test.yml/badge.svg">
</a>
<a href="https://github.com/Pacific-AI-Corp/langtest/blob/master/LICENSE" alt="License">
<img src="https://img.shields.io/badge/License-Apache%202.0-blue.svg" />
</a>
<a href="CODE_OF_CONDUCT.md">
<img alt="Contributor Covenant" src="https://img.shields.io/badge/Contributor%20Covenant-v2.0%20adopted-ff69b4.svg">
</a>
<p align="center">
<a href="https://langtest.org/">Project's Website</a> •
<a href="#key-features">Key Features</a> •
<a href="#how-to-use">How To Use</a> •
<a href="#benchmark-datasets">Benchmark Datasets</a> •
<a href="#community-support">Community Support</a> •
<a href="#contributing-to-langtest">Contributing</a> •
<a href="#mission">Mission</a> •
<a href="#license">License</a>
</p>
## Project's Website
Take a look at our official page for user documentation and examples: [langtest.org](http://langtest.org/)
## Key Features
- Generate and execute more than 60 distinct types of tests only with 1 line of code
- Test all aspects of model quality: robustness, bias, representation, fairness and accuracy.
- Automatically augment training data based on test results (for select models)
- Support for popular NLP frameworks for NER, Translation and Text-Classifcation: Spark NLP, Hugging Face & Transformers.
- Support for testing LLMS ( OpenAI, Cohere, AI21, Hugging Face Inference API and Azure-OpenAI LLMs) for question answering, toxicity, clinical-tests, legal-support, factuality, sycophancy, summarization and other popular tests.
## Benchmark Datasets
LangTest comes with different datasets to test your models, covering a wide range of use cases and evaluation scenarios. You can explore all the benchmark datasets available [here](https://langtest.org/docs/pages/benchmarks/benchmark), each meticulously curated to challenge and enhance your language models.
Whether you're focused on Question-Answering, text summarization etc, LangTest ensures you have the right data to push your models to their limits and achieve peak performance in diverse linguistic tasks.
## How To Use
```python
# Install langtest
!pip install langtest[transformers]
# Import and create a Harness object
from langtest import Harness
h = HarnExcerpt of 17,510 characters
Read on GitHub
1.5k
1.4k
894
723
551
Luca Martial · Kaelio · United States
457
226
103
46
4
Sugato Ray · Truist · United States
3
1
1
1
1
1
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:2fbe0a01f17da1aa, topic:large-language-models, topic:llm
matched fp:2fbe0a01f17da1aa, topic:mlops
matched fp:2fbe0a01f17da1aa, topic:nlp
matched fp:2fbe0a01f17da1aa, topic:ai-safety