Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Benchmarks, leaderboards, LLM-as-judge harnesses, testing and red-teaming.
Signals: benchmark, evaluation, llm-evaluation, leaderboard, llm-eval, red-teaming, testing, model-evaluation
951 results
🐙 Simple and complete Angular testing utilities that encourage good testing practices
A simple and extensible behavioural testing library for Go. You can use api test to simplify REST API, HTTP handler and e2e tests.
Mocking Entity Framework Core operations such ToListAsync, FirstOrDefaultAsync etc. Author Raman Tsitou
A collection of tools for debugging, diffing, and testing your application's data structures.
VS Code extension for Vitest
Data querying library for testing JavaScript applications.
A library that creates fully populated objects for your unit tests.
wtf is a distributed, code-coverage guided, customizable, cross-platform snapshot-based fuzzer designed for attacking user and / or kernel-mode targets running on Microsoft Windows and Linux user-mode (experimental!).
Test Kitchen is an integration tool for developing and testing infrastructure code and software on isolated target platforms
Powerful, elegant and flexible test framework for Kotlin with assertions, property testing and data driven tests.
Readymade evaluators for your LLM apps
Painless Java in Neovim
Testcontainers for Go is a Go package that makes it simple to create and clean up container-based dependencies for automated integration/smoke tests. The clean, easy-to-use API enables developers to programmatically define containers that should be run as part of a test and clean up those resources when the test is done.
The pytest framework makes it easy to write small tests, yet scales to support complex functional testing
A benchmark built to evaluate and improve agent capabilities for supporting legal work.
A library for integration-testing against docker containers from within Rust.
Generating fake data for the JVM (Java, Kotlin, Groovy) has never been easier!
:alarm_clock: :fire: A TCP proxy to simulate network and system conditions for chaos and resiliency testing
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
A reasonably complete and well-tested golang port of httpbin, with zero dependencies outside the go stdlib.
Testcontainers is a Python library that providing a friendly API to run Docker container. It is designed to create runtime environment to use during your automatic tests.
Learn Go with test-driven development
Test Automation Made Simple
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
24,535 repositories in the index in total.
