Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
| Date | Stars |
|---|---|
| 2026-07-24 | 916 |
| 2026-07-25 | 916 |
| 2026-07-28 | 916 |
| 2026-07-30 | 916 |
| 2026-08-06 | 916 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
# JiWER
JiWER is a simple and fast python package to evaluate an automatic speech recognition system.
It supports the following measures:
1. word error rate (WER)
2. match error rate (MER)
3. word information lost (WIL)
4. word information preserved (WIP)
5. character error rate (CER)
These measures are computed with the use of the minimum-edit distance between one or more reference and hypothesis sentences.
The minimum-edit distance is calculated using [RapidFuzz](https://github.com/maxbachmann/RapidFuzz), which uses C++ under the hood, and is therefore faster than a pure python implementation.
## Documentation
For further info, see the documentation at [jitsi.github.io/jiwer](https://jitsi.github.io/jiwer).
## Installation
You should be able to install this package using [uv](https://docs.astral.sh/uv/):
```
$ uv add jiwer
```
Or, if you prefer old-fashioned pip and you're using Python >= `3.8`:
```bash
$ pip install jiwer
```
## Usage
The most simple use-case is computing the word error rate between two strings:
```python
from jiwer import wer
reference = "hello world"
hypothesis = "hello duck"
error = wer(reference, hypothesis)
```
## A note on empty references
There is undefined behaviour when you apply an empty reference and hypothesis pair
to the WER formula, as you get a division by zero.
As of version 4.0, `jiwer` defines the behaviour as follows, and thereby also
lifts the requirement for reference strings to be non-empty.
This allows for testing whether models hallucinate on silent audio.
Note that usually, there are multiple reference and hypothesis pairs.
It now supported that one or more of these references are empty, but to test well,
most references should still be non-empty.
```python3
import jiwer
# when ref and hyp are both empty, there is no error as
# an ASR system correctly predicted silence/non-speech.
assert jiwer.wer('', '') == 0
assert jiwer.mer('', '') == 0
assert jiwer.wip('', '') == 1
assert jiwer.wil('', '') == 0
assert jiwer.cer('', '') == 0
```
When the hypothesis is non-empty, every word or character counts as an insertion:
```python3
import jiwer
assert jiwer.wer('', 'silence') == 1
assert jiwer.wer('', 'peaceful silence') == 2
assert jiwer.process_words('', 'now defined behaviour').insertions == 3
assert jiwer.cer('', 'a') == 1
assert jiwer.cer('', 'abcde') == 5
```
## Licence
The jiwer package is released under the `Apache License, Version 2.0` licence by [8x8](https://www.8x8.com/).
For further information, see [`LICENCE`](./LICENSE).
## Reference
_For a comparison between WER, MER and WIL, see: \
Morris, Andrew & Maier, Viktoria & Green, Phil. (2004). [From WER and RIL to MER and WIL: improved evaluation measures for connected speech recognition.](https://www.researchgate.net/publication/221478089_From_WER_and_RIL_to_MER_and_WIL_improved_evaluation_measures_for_connected_speech_recognition)_
Excerpt of 2,915 characters
Read on GitHub
63
4
3
Pariente Manuel · Pulse Audition
1
1
1
Neil Stoker · United Kingdom
1
1
1
Ville Vesilehto · @iceye-ltd · Finland
1
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:285cd06860922ec0, topic:speech-to-text, readme:speech recognition, desc:speech-to-text