claw-eval/claw-eval
quality grade B, 73 out of 100Claw-Eval is an evaluation harness for evaluating LLM as agents. All tasks verified by humans.
- stars
- 740
- stars gained this week
- +2this week
- forks, open issues and contributors
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Released model weights, reference implementations and architecture research.
Signals: large-language-models, llm, foundation-models, transformer, gpt, llama, mistral, qwen
1,476 results
Claw-Eval is an evaluation harness for evaluating LLM as agents. All tasks verified by humans.
A fast Rust based tool to serialize text-based files in a repository or directory for LLM consumption
Prov-GigaPath: A whole-slide foundation model for digital pathology from real-world data
Official implementation of paper "VLM³: Vision Language Models Are Native 3D Learners".
[support ollama/other model]【兼容ollama和其他模型】将任何具有OpenAI API调用方法的模型集成到PotPlayer中。它使你在观看视频时能够实时翻译字幕,从而打破语言障碍,提升你的观看体验。 This real-time subtitle translation plugin integrates OpenAI's ChatGPT API (or any model with the same API calling method) into PotPlayer. It enables you to translate subtitles on-the-fly while watching videos.
AG2 Visualized - Build Multi-Agentic Apps with Drag-and-Drop.
StarWhisper astronomy LLMs, StarWhisper Telescope, and Virtual-GOTTA for AI-driven embodied telescope workflows
A list of LLMs Tools & Projects
Agent Harness for Large Language Model Agents: A Survey. Survey on LLM agentharnessengineering with a taxonomy. 110+papers, 23 systems analyzed.
This is the offical repository of paper "LAMBDA: A large Model Based Data Agent". https://www.polyu.edu.hk/ama/cmfai/lambda.html
The all-in-one RWKV runtime box with embed, RAG, AI agents, and more.
D1 Manager is a web UI and API for Cloudflare D1, a serverless SQL database. It provides a web interface for managing databases, tables, and records, as well as an AI assistant to help you write query in natural language.
End-to-end AI-powered academic paper writing system — from idea generation and literature search to experiment execution, result backfill, and LaTeX paper compilation. Supports multi-LLM routing, SSH remote training, incremental sync, and anti-AI-detection writing style.
Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. ACM Computing Surveys, 2026.
Samples showing how to build Java applications powered by Generative AI and LLMs using Spring AI and Spring Boot.
[EMNLP 2024 Demo] MarkLLM: An Open-Source Toolkit for LLM Watermarking
This is a Phi Family of SLMs book for getting started with Phi Models. Phi a family of open sourced AI models developed by Microsoft. Phi models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks
[Nature Reviews Bioengineering🔥] Application of Large Language Models in Medicine. A curated list of practical guide resources of Medical LLMs (Medical LLMs Tree, Tables, and Papers)
Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"
Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimentation and parallelization, and has demonstrated industry leading model flop utilization rates.
An open-source library built on Qiskit for quantum machine learning tasks at scale on quantum hardware and classical simulators
A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.
C# implementation of LangChain. We try to be as close to the original as possible in terms of abstractions, but are open to new entities.
A tiny, fast Rust CLI that drives a real browser over the Chrome DevTools Protocol — built for coding agents.
24,524 repositories in the index in total.