Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Benchmarks, leaderboards, LLM-as-judge harnesses, testing and red-teaming.
Signals: benchmark, evaluation, llm-evaluation, leaderboard, llm-eval, red-teaming, testing, model-evaluation
949 results
The fastest feature-rich C++11/14/17/20/23 single-header testing framework
Code for the paper "Evaluating Large Language Models Trained on Code"
Compile Rust projects with the Android NDK without hassle
Jeff Geerling's SBC review data - Raspberry Pi, Radxa, Orange Pi, etc.
Source code for privacytests.org. Includes browser testing code and site rendering.
BDD library for the pytest runner
A benchmark for evaluating LLMs on open-ended CS problems. Exploring the Next Frontier of Computer Science.
Test LLMs on real tasks. Compare models side-by-side.
LiveBench: A Challenging, Contamination-Free LLM Benchmark
Architecture checks for Go projects
The open source visual testing platform for teams and AI agents. Review the product, not just the code.
Dear ImGui Automation Engine & Test Suite
Selects tests affected by changed files. Executes the right tests first. Continuous test runner when used with pytest-watch.
Intelligent cloud testing made easy.
The open-source Playwright library for AI browser regression testing with intelligent caching, auto-healing, and multi-model verification.
Should testing for .NET—the way assertions should be!
[ BOF-LAUNCHER ] -> an API for loading, executing and in-memory masking BOFs on Windows and Linux for use in C/Zig/Go/Rust agents/implants. [ Z-BEAC0N ] -> a custom-written stage-1 (aka pre-C2) solution engineered with a small footprint, stealth and modularity in mind.
List of papers on hallucination detection in LLMs.
Randomized Property-Based Testing Plugin for Coq
A Screenshot Testing service to tie with your existing Android, iOS and Web screenshot tests
The tool to check the availability or syntax of domain, IP or URL.
🔭 Powerful tool for testing WebHooks and more
RocketSim — 30+ tools for Xcode's iOS Simulator. Testing, debugging, network monitoring, captures, accessibility, app actions, and AI agent automation via the RocketSim CLI. Used by 80k+ developers.
SiteOne Crawler is a cross-platform website crawler and analyzer for SEO, security, accessibility, and performance optimization—ideal for developers, DevOps, QA engineers, and consultants. Supports Windows, macOS, and Linux (x64 and arm64).
24,545 repositories in the index in total.
