Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Benchmarks, leaderboards, LLM-as-judge harnesses, testing and red-teaming.
Signals: benchmark, evaluation, llm-evaluation, leaderboard, llm-eval, red-teaming, testing, model-evaluation
949 results
Simple JavaScript testing framework for browsers and node.js
☕️ Classic, reliable, trusted test framework for Node.js and the browser
Code for the paper "Evaluating Large Language Models Trained on Code"
Gray box end-to-end testing and automation framework for mobile apps
Quick and Easy server testing/validation
SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
syzkaller is an unsupervised coverage-guided kernel fuzzer
An ArchLinux based distribution for penetration testers and security researchers.
openQA web-frontend, scheduler and tools.
🎯 LogCaptor captures log entries for unit and integration testing purposes
MockBukkit is a mocking framework for Bukkit/PaperMC to allow the easy unit testing of Bukkit plugins.
Jeff Geerling's SBC review data - Raspberry Pi, Radxa, Orange Pi, etc.
The open-source Playwright library for AI browser regression testing with intelligent caching, auto-healing, and multi-model verification.
Run your tests at the speed of thought
Simple benchmark to test the most popular open source and commercial LLMs with automated OpenCode
Automated testing to find logic and performance bugs in database systems
AI-native software testing platform — one YAML test language covering API, Web, mobile, messaging, data, and LLM scenarios. Self-hostable.
A huge chunk of my personal notes since I started playing CTFs and working as a Red Teamer.
:mailbox: SMTP Server + Web Interface for viewing and testing emails during development.
🔐 A CLI tool to extract server certificates
A library for integration-testing against docker containers from within Rust.
Test LLMs on real tasks. Compare models side-by-side.
Dear ImGui Automation Engine & Test Suite
SiteOne Crawler is a cross-platform website crawler and analyzer for SEO, security, accessibility, and performance optimization—ideal for developers, DevOps, QA engineers, and consultants. Supports Windows, macOS, and Linux (x64 and arm64).
24,543 repositories in the index in total.
