Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Benchmarks, leaderboards, LLM-as-judge harnesses, testing and red-teaming.
Signals: benchmark, evaluation, llm-evaluation, leaderboard, llm-eval, red-teaming, testing, model-evaluation
951 results
An analysis tool for Python that blurs the line between testing and type systems.
☔ 敏捷开发最强大易用的接口工具，机器学习零代码测试与 AI 问答、生成代码与静态检查、生成文档与光标悬浮注释，腾讯、华为、SHEIN、传音、工行等使用 ☔ The most advanced tool for HTTP API. Machine learning no-code testing and AI assistant, generating codes and static analysis, generating comments and floating hints. Used by Tencent, Huawei, SHEIN, TRANSSION, ICBC, etc.
🦉 Simple and complete React Native testing utilities that encourage good testing practices.
PHPUnit extensions and rules for PHPStan
Put your architectural rules under test!
A GitHub Action for installing, configuring and running hardware-accelerated Android Emulators on macOS virtual machines.
A Testcontainer implementation for Keycloak IAM & SSO.
ReportGenerator converts coverage reports generated by coverlet, OpenCover, dotCover, Visual Studio, NCover, Cobertura, JaCoCo, Clover, gcov or lcov into human readable reports in various formats.
InSpec: Auditing and Testing Framework
An ansible-native testing framework for collections, playbooks, and roles with configurable workflows for testing any system or service
Quick and Easy server testing/validation
Simple benchmark to test the most popular open source and commercial LLMs with automated OpenCode
Can Language Models Rebuild Programs From Scratch?
Embedded unit testing framework for Godot 4 supporting GDScript and C#. Features test-driven development, embedded test inspector, extensive assertions, mocking, scene testing.
Testcontainers is a NodeJS library that supports tests, providing lightweight, throwaway instances of common databases, Selenium web browsers, or anything else that can run in a Docker container.
ALICE (Automated Learning and Intelligence for Causation and Economics) is a Microsoft Research project aimed at applying Artificial Intelligence concepts to economic decision making. One of its goals is to build a toolkit that combines state-of-the-art machine learning techniques with econometrics in order to bring automation to complex causal inference problems. To date, the ALICE Python SDK (econml) implements orthogonal machine learning algorithms such as the double machine learning work of Chernozhukov et al. This toolkit is designed to measure the causal effect of some treatment variable(s) t on an outcome variable y, controlling for a set of features x.
Dataset and benchmark for RAG on company internal documents.
:zombie: Inject bugs and see if your tests catch them!
A friendly substitute for .NET mocking libraries.
Ethereum smart contract fuzzer
Database Subsetting and Relational Data Browsing Tool.
Papercut SMTP -- The Simple Desktop Email Server
Terratest is a Go library that makes it easier to write automated tests for your infrastructure code.
An ArchLinux based distribution for penetration testers and security researchers.
24,535 repositories in the index in total.
