Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Benchmarks, leaderboards, LLM-as-judge harnesses, testing and red-teaming.
Signals: benchmark, evaluation, llm-evaluation, leaderboard, llm-eval, red-teaming, testing, model-evaluation
953 results
🌏 A tiny 0-dependency thread-safe Java™ lib for setting/viewing dns programmatically without touching host file, make unit/integration testing portable; and a tiny tool for setting/viewing dns of running JVM process.
A more helpful way to view differences between complex data structures in RSpec.
A library for integration-testing against docker containers from within Rust.
Displays test results from popular testing frameworks directly in GitHub
CATS is a REST API Fuzzer and negative testing tool for OpenAPI endpoints. CATS automatically generates, runs and reports tests with minimum configuration and no coding effort. Tests are self-healing and do not require maintenance.
Laravel Dusk provides simple end-to-end testing and browser automation.
Ruby Tests Profiling Toolbox
Over the wire test doubles
Mutation testing for JavaScript and friends
Ethereum smart contract fuzzer
✨ Jest matcher for image comparisons. Most commonly used for visual regression testing.
Pa11y is your automated accessibility testing pal
Full-stack testing PHP framework
A library for setting up Ruby objects as test data.
Sandbox for developing and testing UI components in isolation
Testcontainers is a Java library that supports JUnit tests, providing lightweight, throwaway instances of common databases, Selenium web browsers, or anything else that can run in a Docker container.
Foundry is a blazing fast, portable and modular toolkit for Ethereum application development written in Rust.
Generic automation framework for acceptance testing and RPA
A faster, simpler way to drive browsers supporting the Chrome DevTools Protocol.
Most popular Mocking framework for unit tests written in Java
Hurl, run and test HTTP requests with plain text.
A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
ALICE (Automated Learning and Intelligence for Causation and Economics) is a Microsoft Research project aimed at applying Artificial Intelligence concepts to economic decision making. One of its goals is to build a toolkit that combines state-of-the-art machine learning techniques with econometrics in order to bring automation to complex causal inference problems. To date, the ALICE Python SDK (econml) implements orthogonal machine learning algorithms such as the double machine learning work of Chernozhukov et al. This toolkit is designed to measure the causal effect of some treatment variable(s) t on an outcome variable y, controlling for a set of features x.
TopoBench is a Python library designed to standardize benchmarking and accelerate research in Topological Deep Learning
24,523 repositories in the index in total.
