Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
An unified model that seamlessly integrates multimodal understanding, text-to-image generation, and image editing within a single powerful framework.
| Date | Stars |
|---|---|
| 2026-07-24 | 450 |
| 2026-07-25 | 450 |
| 2026-07-28 | 450 |
| 2026-07-30 | 450 |
| 2026-07-31 | 450 |
| 2026-08-06 | 450 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
<p align="center"> <img src=https://cdn-uploads.huggingface.co/production/uploads/637aebed7ce76c3b834cea37/3IK823BZ8w-mz_QfeYkDn.png width="30%"/></p> <h1 align="center"> Ovis-U1: Unified Understanding, Generation, and Editing </h1> <p align="center"> <a href="https://arxiv.org/abs/2506.23044"><img src="https://img.shields.io/badge/arXiv_paper-2506.23044-b31b1b.svg" alt="arxiv"></a> <!-- <a href="https://github.com/AIDC-AI/Ovis-U1/blob/main/docs/Ovis_U1_Report.pdf"><img src="https://img.shields.io/badge/Paper-Tech_Report-b31b1b" alt="paper"></a> --> <a href="https://github.com/AIDC-AI/Ovis"><img src="https://img.shields.io/badge/GitHub-AIDC--AI/Ovis--U1-blue?style=flat&logo=github" alt="code"></a> <a href="https://huggingface.co/spaces/AIDC-AI/Ovis-U1-3B"><img src="https://img.shields.io/badge/🎨_HF_Spaces-AIDC--AI/Ovis--U1--3B-lightblack" alt="demo"></a> <a href="https://huggingface.co/AIDC-AI/Ovis-U1-3B"><img src="https://img.shields.io/badge/🤗_Model-AIDC--AI/Ovis--U1--3B-yellow" alt="model"></a> </p> <p align="left"> Building on the foundation of the Ovis series, Ovis-U1 is a 3-billion-parameter unified model that seamlessly integrates <b>multimodal understanding</b>, <b>text-to-image generation</b>, and <b>image editing</b> within a single powerful framework. </p> <p align="center"> <img src="docs/imgs/Ovis-U1.jpg" width="95%"> <br> <em>The overall architecture of Ovis-U1 (cf. Fig.2 in our report).</em> </p> ## 🏆 Highlights * **Unified Capabilities**: A single model excels at three core tasks: understanding complex scenes, generating images from text, and performing precise edits based on instructions. * **Advanced Architecture**: Ovis-U1 features a powerful diffusion-based visual decoder (MMDiT) and a bidirectional token refiner, enabling high-fidelity image synthesis and enhanced interaction between text and vision. * **Synergistic Unified Training**: Unlike models trained on single tasks, Ovis-U1 is trained on a diverse mix of understanding, generation, and editing data simultaneously. Our findings show that this approach achieves improved generalization, seamlessly handling real-world multimodal challenges with high accuracy. * **State-of-the-Art Performance**: Ovis-U1 achieves leading scores on multiple academic benchmarks, surpassing strong contemporary models in multimodal understanding (69.6 on OpenCompass), generation (83.72 on DPG-Bench), and editing (4.00 on ImgEdit-Bench). ## ✨ Showcase Here are some examples demonstrating the capabilities of Ovis-U1. <figure> <img src="docs/imgs/examples.png" alt="Ovis-U1 examples"> <figcaption style="text-align: center;"></figcaption> </figure> ## 🚀 News - [2025/11/29] 🔥 Announcing Ovis-Image ([GitHub](https://github.com/AIDC-AI/Ovis-Image), [Model](https://huggingface.co/AIDC-AI/Ovis-Image-7B), [Demo](https://huggingface.co/spaces/AIDC-AI/Ovis-Image-7B))! - [2025/6/28] Announcing Ovis-U1-3B ([Model](https://huggingface.co/AIDC-AI/Ovis-U1-3B), [Demo](https://huggingface.co/spaces/AIDC-AI/Ovis-U1-3B))! ## 📦 Installation Ovis-U1 has been tested with Python 3.10, Torch 2.4.0, Transformers 4.51.3, and DeepSpeed 0.15.4. For a full list of package dependencies, please see `requirements.txt`. ```bash git clone [email protected]:AIDC-AI/Ovis-U1.git conda create -n ovis-u1 python=3.10 -y conda activate ovis-u1 cd Ovis-U1 pip install -r requirements.txt pip install -e . ``` ## 🛠️ Inference We provide simple scripts to test the different capabilities of Ovis-U1. For single image understanding, please run ```bash python test_img_to_txt.py ``` For multi-image understanding, please run ```bash python test_multi_img_to_txt.py ``` For text-to-image, please run ```bash python test_txt_to_img.py \ --height 1024 \ --width 1024 \ --steps 50 \ --seed 42 \ --txt_cfg 5 ``` For image editing, please run ```bash python test_img_edit.py \ --steps 50 \ --img_cfg 1.5 \ --txt_cfg 6 ``` Alternatively, you can try Ovis
Excerpt of 11,455 characters
Read on GitHubWould you bet a product on this? Bounded 0–100 and slow moving.
matched fp:9ef4c9b39a34a214, topic:text-to-image, desc:text-to-image, readme:text-to-image