Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Benchmarks, leaderboards, LLM-as-judge harnesses, testing and red-teaming.
Signals: benchmark, evaluation, llm-evaluation, leaderboard, llm-eval, red-teaming, testing, model-evaluation
949 results
Android ViewServer and ADB client
👁 Visual Regression Testing for Storybook
TestNG testing framework
Over the wire test doubles
A tool for refurbishing and modernizing Python codebases
🐙 Simple and complete DOM testing utilities that encourage good testing practices.
minitest provides a complete suite of testing facilities supporting TDD, BDD, and benchmarking.
:owl: Custom jest matchers to test the state of the DOM
A library for setting up Ruby objects as test data.
Benchmarking physical understanding in generative video models
The net:cal calibration framework is a Python 3 library for measuring and mitigating miscalibration of uncertainty estimates, e.g., by a neural network.
Code for the Proceedings of the National Academy of Sciences 2020 article, "Understanding the Role of Individual Units in a Deep Neural Network"
MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvements in both training algorithms and models.
Code for "Uncertainty Estimation Using a Single Deep Deterministic Neural Network"
Learning Confidence for Out-of-Distribution Detection in Neural Networks
Codebase for testing whether hidden states of neural networks encode discrete structures.
Reproduce CKA: Similarity of Neural Network Representations Revisited
ETH Robustness Analyzer for Deep Neural Networks
A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
ExploitBench measures how far AI agents climb, from reaching vulnerable code, to triggering the bug, to building exploit primitives, to arbitrary code execution.
CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities
[ICML 2025 Oral] Official repo of EmbodiedBench, a comprehensive benchmark designed to evaluate MLLMs as embodied agents.
BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent (ACL 2026 Main)
Agent trace and tool-use safety evaluation lab.
24,545 repositories in the index in total.
