Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Benchmarks, leaderboards, LLM-as-judge harnesses, testing and red-teaming.
Signals: benchmark, evaluation, llm-evaluation, leaderboard, llm-eval, red-teaming, testing, model-evaluation
949 results
Generic automation framework for acceptance testing and RPA
An LLM-as-a-judge HTTP proxy to secure agents in production
A mock implementation of the AWS S3 API startable as Docker image, TestContainer, JUnit Jupiter extension or TestNG listener
✅ List of Automated Testing (TDD/BDD/ATDD/SBE) Tools and Frameworks for .NET
Broken link checker that crawls websites and validates links. Find broken links, dead links, and invalid URLs in websites, documentation, and local files. Perfect for SEO audits and CI/CD.
InSpec: Auditing and Testing Framework
Terratest is a Go library that makes it easier to write automated tests for your infrastructure code.
SkillsBench evaluates how well skills work and how effective agents are at using them.
An open-source visual programming environment for battle-testing prompts to LLMs.
⏰ A few schedulers that make working with Combine more testable and more versatile.
Put your architectural rules under test!
Pa11y is your automated accessibility testing pal
Testcontainers for Go is a Go package that makes it simple to create and clean up container-based dependencies for automated integration/smoke tests. The clean, easy-to-use API enables developers to programmatically define containers that should be run as part of a test and clean up those resources when the test is done.
A library that creates fully populated objects for your unit tests.
Flutter-first UI testing framework. Ready for action!
Bash Automated Testing System
The first open-source AI-driven tool for automatically generating system-level test cases (also known as fuzzing) for web/enterprise applications. Currently targeting whitebox and blackbox testing of Web APIs, like REST, GraphQL and RPC (e.g., gRPC and Thrift).
✔️ PHP Architecture Tester - Easy architecture testing for PHP
Can Language Models Rebuild Programs From Scratch?
ArchUnitTS is an architecture testing library. Specify and ensure architecture rules in your TypeScript app. Easy setup and pipeline integration.
Golang gRPC Middlewares: interceptor chaining, auth, logging, retries and more.
ALICE (Automated Learning and Intelligence for Causation and Economics) is a Microsoft Research project aimed at applying Artificial Intelligence concepts to economic decision making. One of its goals is to build a toolkit that combines state-of-the-art machine learning techniques with econometrics in order to bring automation to complex causal inference problems. To date, the ALICE Python SDK (econml) implements orthogonal machine learning algorithms such as the double machine learning work of Chernozhukov et al. This toolkit is designed to measure the causal effect of some treatment variable(s) t on an outcome variable y, controlling for a set of features x.
24,543 repositories in the index in total.
