Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
SIA is a Self Improving AI framework to autonomously improve the performance of any AI system (Model / Agent) on a benchmark task.
| Date | Stars |
|---|---|
| 2026-07-31 | 2084 |
| 2026-08-02 | 2090 |
| 2026-08-06 | 2090 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
# SIA (Self-Improving AI) [](https://arxiv.org/abs/2605.27276) [](https://github.com/hexo-ai/sia/actions/workflows/ci.yml) [](https://pypi.org/project/sia-agent/) [](https://pypi.org/project/sia-agent/) [](https://opensource.org/licenses/MIT) [](https://www.python.org/downloads/) Official implementation of [**SIA: Self Improving AI with Harness & Weight Updates**](https://arxiv.org/abs/2605.27276) (Hebbar et al., 2026) — a self-improving loop where a language-model agent updates both the harness and the weights of a task-specific agent. The paper reports a 56.6% gain on LawBench, 91.9% runtime reduction on GPU kernels, and 502% improvement on single-cell RNA denoising over baseline. SIA is a Self Improving AI framework to autonomously improve the performance of any AI system (Model / Agent) on a benchmark task. > **Just want to try it?** Skip to [Run SIA locally](#run-sia-locally-with-built-in-tasks). ## Introduction Videos - [SIA setup](https://www.loom.com/share/be0534bc818d408bab937033c6457ec9) - [SIA Runs Visualizer](https://www.loom.com/share/5b1dc2dc858b4493b4b348f0b88d5b9e) ## Architecture <p align="center"><img src="docs/flow.png" alt="SIA orchestration flow" width="720"></p> <p align="center"><i>Control flow between Meta, Target, and Feedback agents over successive generations.</i></p> SIA operates by coordinating three main types of AI agents that work together to continuously improve task performance: ### Glossary 1. **Meta-Agent**: Reads the task description and generates an initial Target Agent tailored to the task. 2. **Target / Task Specific Agent**: Attempts to complete the task and records its actions and results. 3. **Feedback/Improvement Agent**: Reviews the Target Agent's performance logs, identifies improvements, and updates the Target Agent accordingly. This iterative process allows the system to autonomously refine and enhance its ability to solve scientific tasks. ## Benchmark Results <p align="center"><img src="docs/mlebench.png" alt="MLE Bench Results" width="720"><br><i>OpenAI MLE-Bench Hard: a gauntlet of real Kaggle ML competitions where agents must write, run, and iterate full ML pipelines. SIA ranks #1 across all generations tested.</i></p> <p align="center"><img src="docs/lawbench.png" alt="LawBench Results" width="720"><br><i>LawBench: predict the criminal charge from Chinese court case descriptions across 191 charge categories. SIA-W+H reaches 70.1% Top-1 accuracy, beating the prior SOTA of 45%.</i></p> <p align="center"><img src="docs/trimul_cuda.png" alt="TriMul CUDA Results" width="720"><br><i>AlphaFold-3 TriMul Triton Kernel: implement and optimize the Triangle Multiplicative Update as a Triton kernel, preserving correctness while hitting H100 latency targets. SIA-W+H achieves 14x speedup over baseline.</i></p> <p align="center"><img src="docs/denoising.png" alt="Denoising Results" width="720"><br><i>scRNA-seq Denoising: impute missing gene expression values in single-cell RNA sequencing data. SIA-W+H scores 0.289 MSE<sub>norm</sub>, surpassing the prior SOTA of 0.240.</i></p> --- ## Run SIA locally with built-in tasks SIA ships with four built-in tasks: `gpqa`, `lawbench`, `longcot-chess`, `spaceship-titanic`. ### Install Pick the agent impl that matches the LLMs you want to run. **Claude agent impl** (Claude Agent SDK, Claude models only): ```bash python3 -m venv .venv && source .venv/bin/activate pip install 'sia-agent[claude]' export ANTHROPIC_API_KEY="..." ``` **OpenHands agent impl** (multi-provider — Gemini, OpenAI, Anthropic, etc.): ```bash python3 -m venv .venv && s
Excerpt of 13,004 characters
Read on GitHub
8
4
3
3
2
1
1
1
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:b0f9a82405158088, llm:Repository description: 'SIA is a Self Improving AI framework to autonomously improve the performance of any AI system (Model / Agent) on a benchmark task.' Language: Python.
matched fp:b0f9a82405158088, llm:Repository description: 'SIA is a Self Improving AI framework to autonomously improve the performance of any AI system (Model / Agent) on a benchmark task.' Language: Python.
matched fp:b0f9a82405158088, llm:Repository description: 'SIA is a Self Improving AI framework to autonomously improve the performance of any AI system (Model / Agent) on a benchmark task.' Language: Python.