Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Benchmarks, leaderboards, LLM-as-judge harnesses, testing and red-teaming.
Signals: benchmark, evaluation, llm-evaluation, leaderboard, llm-eval, red-teaming, testing, model-evaluation
953 results
Measuring and evolving with the frontier of agent work
Complete AI governance and LLM Evals platform with support for EU AI Act, ISO 42001, NIST AI RMF and 20+ more AI frameworks and regulations. Join our Discord channel: https://discord.com/invite/d3k3E4uEpR
A modular framework for benchmarking LLMs and agentic strategies on security challenges across HackTheBox, TryHackMe, PortSwigger Labs, Cybench, picoCTF and more.
Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.
Claude-first paid-media operations skill for Claude Code across 12 ad platforms (Google, Meta, YouTube, LinkedIn, TikTok, Microsoft, Apple, Amazon, Reddit, Pinterest, Snapchat, X): source-grounded audits, deterministic scoring, versioned JSON reports, and capability-gated account changes.
The LLM Evaluation Framework
UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection
Uplift modeling and causal inference with machine learning algorithms
Evaluation and Tracking for LLM Experiments and AI Agents
Framework for evaluating and improving agents
AI Observability & Evaluation
A Security Tool for Bug Bounty, Pentest and Red Teaming.
Run your tests with randomization, splitting, and parallelization for beautiful tests.
a socket mock framework - for all kinds of socket animals, web-clients included
LISA is developed and maintained by Microsoft, to empower Linux validation.
Seamless GitHub Actions integration for .NET test runners
The Open Source Test Automation Platform.
Mockito for Scala language
A simple yet powerfull testing library for bash scripts.
Implementation of Redis API in python without having a server running. Fully compatible with using redis-py.
A Testcontainer implementation for Keycloak IAM & SSO.
The JavaScript testing framework powered by Rspack
octocov is a toolkit for collecting code metrics (code coverage, code to test ratio, test execution time and your own custom metrics).
🔥 A library based on Xcode Preview, for easy generation: Playbook view, Snapshot and Accessibility tests. SwiftUI and UIKit supported!
24,523 repositories in the index in total.
