Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
[CVPR2026] Detect Anything via Next Point Prediction
| Date | Stars |
|---|---|
| 2026-07-24 | 1516 |
| 2026-07-25 | 1516 |
| 2026-07-28 | 1516 |
| 2026-07-30 | 1516 |
| 2026-08-06 | 1516 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
<div align=center>
<img src="assets/logo.png" width=600 >
</div>
<h1 align="center">Detect Anything via Next Point Prediction</h1>
<div align=center>
<p align="center">
<a href="https://rex-omni.github.io/">
<img
src="https://img.shields.io/badge/RexOmni-Website-BADFDB?style=flat-square&logo=deno&logoColor=violet&color=BADFDB"
alt="RexThinker Website"
/>
</a>
<a href="https://arxiv.org/abs/2510.12798">
<img
src="https://img.shields.io/badge/RexOmni-Paper-Red%25red?logo=arxiv&logoColor=red&color=yellow"
alt="RexThinker Paper on arXiv"
/>
</a>
<a href="https://huggingface.co/IDEA-Research/Rex-Omni-AWQ">
<img
src="https://img.shields.io/badge/RexOmni_AWQ-Weight-orange?logo=huggingface&logoColor=yellow"
alt="RexThinker weight on Hugging Face"
/>
</a>
<a href="https://huggingface.co/IDEA-Research/Rex-Omni">
<img
src="https://img.shields.io/badge/RexOmni-Weight-orange?logo=huggingface&logoColor=yellow"
alt="RexThinker weight on Hugging Face"
/>
</a>
<a href="https://huggingface.co/spaces/Mountchicken/Rex-Omni">
<img
src="https://img.shields.io/badge/RexOmni-Demo-orange?logo=huggingface&logoColor=yellow"
alt="RexThinker Demo on Hugging Face"
/>
</a>
</p>
</div>
> Rex-Omni is a 3B-parameter Multimodal Large Language Model (MLLM) that redefines object detection and a wide range of other visual perception tasks as a simple next-token prediction problem.
<p align="center"><img src="assets/teaser.png" width="95%"></p>
# News 🎉
- [2026-01-10] **Pointing Task Finetuning** is now supported! Train Rex-Omni on custom pointing datasets with SFT and GRPO. See [Fine-tuning Guide](finetuning/README.md) for details.
- [2025-10-31] We release the AWQ quantized version of Rex-Omni, which saves 50% of the storage space. [Rex-Omni-AWQ](https://huggingface.co/IDEA-Research/Rex-Omni-AWQ)
- [2025-10-29] Fine-tuning code is now [available](finetuning/README.md).
- [2025-10-17] Evaluation code and dataset is now [available](evaluation/README.md).
- [2025-10-15] Rex-Omni is released.
# Table of Contents
- [Breaking News: We've just open-sourced Resophy! 🎉](#breaking-news-weve-just-open-sourced-resophy-)
- [News 🎉](#news-)
- [Table of Contents](#table-of-contents)
- [TODO LIST 📝](#todo-list-)
- [1. Installation ⛳️](#1-installation-️)
- [2. Quick Start: Using Rex-Omni for Detection](#2-quick-start-using-rex-omni-for-detection)
- [Initialization parameters (RexOmniWrapper)](#initialization-parameters-rexomniwrapper)
- [Inference parameters (rex.inference)](#inference-parameters-rexinference)
- [3. Cookbooks](#3-cookbooks)
- [4. Applications of Rex-Omni](#4-applications-of-rex-omni)
- [5. Gradio Demo](#5-gradio-demo)
- [Quick Start](#quick-start)
- [Available Options](#available-options)
- [6. Evaluation](#6-evaluation)
- [7. Fine-tuning Rex-Omni](#7-fine-tuning-rex-omni)
- [8. LICENSE](#8-license)
- [9. Citation](#9-citation)
## TODO LIST 📝
- [x] Add Evaluation Code
- [x] Add Fine-tuning Code
- [x] Add Quantilized Rex-Omni
## 1. Installation ⛳️
```bash
git clone https://github.com/IDEA-Research/Rex-Omni.git
cd Rex-Omni
conda create -n rexomni python=3.10 -y
conda activate rexomni
pip install torch==2.7.0 torchvision --index-url https://download.pytorch.org/whl/cu128
pip install -r requirements.txt
pip install -v -e .
```
Test Installation
```bash
CUDA_VISIBLE_DEVICES=1 python tutorials/detection_example/detection_example.py
```
If the installation is successful, you will find a visualization of the detection results at `tutorials/detection_example/test_images/cafe_visualize.jpg`
## 2. Quick Start: Using Rex-Omni for Detection
Below is a minimal example showing how to run object detection using the `rex_omni` package.
```python
from PIL import Image
from rex_omni import RexOmniWrapper, RexOmniVisualize
# 1) Initialize the wrapper (model loads internally)
rex = RexOmniWExcerpt of 15,252 characters
Read on GitHubQing Jiang · China
46
十字鱼
2
1
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:97e6823d0cb8cc20, topic:object-detection, readme:object detection