Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Ola: Pushing the Frontiers of Omni-Modal Language Model
| Date | Stars |
|---|---|
| 2026-07-31 | 395 |
| 2026-08-03 | 395 |
| 2026-08-06 | 395 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
<p align="center" width="100%">
<img src="https://ola-omni.github.io/static/images/ola-icon.png" alt="967023137dff29e65b21544e7620e0f7.webp" width=60%>
</p>
<div>
## Ola: Pushing the Frontiers of Omni-Modal Language Model
<p align="left">
<a href='https://github.com/liuzuyan' target='_blank'>Zuyan Liu<sup>*,1,2</sup></a> 
<a href='https://github.com/dongyh20/' target='_blank'>Yuhao Dong<sup>*,2,3</sup></a> 
Jiahui Wang<sup>1</sup></a> <br>
<a href='https://liuziwei7.github.io/' target='_blank'>Ziwei Liu<sup>3</sup></a> 
Winston Hu<sup>2</sup></a> 
<a href='https://scholar.google.com/citations?user=TN8uDQoAAAAJ' target='_blank'>Jiwen Lu<sup>1,✉</sup></a> 
<a href='https://raoyongming.github.io/' target='_blank'>Yongming Rao<sup>2,1,✉</sup></a> 
</p>
<p align="left"><sup>1</sup>Tsinghua University   <sup>2</sup>Tencent Hunyuan Research  <sup>3</sup>S-Lab, NTU  </p>
<p align="left"><sup>*</sup> Equal Contribution<sup>  ✉</sup> Corresponding Author</p>
[-blue)](https://rank.opencompass.org.cn/leaderboard-multimodal/?m=REALTIME) [](https://video-mme.github.io/home_page.html#leaderboard)
---
**Project Page:** [](https://ola-omni.github.io)
**Weights in Huggingface:** [](https://huggingface.co/THUdyh/Ola-7b) [](https://huggingface.co/THUdyh/Ola-Image) [](https://huggingface.co/THUdyh/Ola-Video)
**arXiv Paper:** [](https://arxiv.org/abs/2502.04328)
**Demo by Gradio:** [](https://huggingface.co/spaces/THUdyh/Ola)
**Training Data:** [](https://huggingface.co/datasets/THUdyh/Ola-Data)
**中文解读**: [](https://mp.weixin.qq.com/s/N4bjcHOejJudtxTFZVAXmg)
Contact: Leave an issue or contact [email protected] . We are on call to respond.
## 📢 News
- 🔥[28/2/2025] We release the intermediate model, Ola-Image and Ola-Video, try building your own omni-modal models!
- 🚀[19/2/2025] We release the huggingface demo of Ola, try the advanced omni-modal model on your own!
- 🔥[18/2/2025] The training data, training script for Ola-7b is released!
- 🎉[07/2/2025] The Ola is released! Check our [project page](https://ola-omni.github.io), [model weights](https://huggingface.co/THUdyh/Ola-7b), [arXiv paper](https://arxiv.org/pdf/2502.04328) for the strong omni-modal understanding model!
- 🔥[06/2/2025] [Ola-7b](https://huggingface.co/THUdyh/Ola-7b) achieves **Rank #1** on the OpenCompass Multi-modal Leaderboard among all the models under 15B parameters with average score of **72.6**. Check the impressive results [here](https://rank.opencompass.org.cn/leaderboard-multimodal/?m=REALTIME)!
## 🚀Coming Soon
- [x] Evaluation code on omni-modal benchmarks
- [x] Gradio Demo
- [x] Training Data (Video, Audio, Cross-Modality)
## 🌟 Introduction
### Roads to Ola
<p align="center" width="100%">
<img src="https://ola-omni.github.io/static/images/road.png" alt="road.png" width=100%>
</p>
<div>
**Ola** is an Omni-modal language model that achieves competitive performance across image, video, and audio understanding compared to specialized counterparts. We conduct a comprehensive exploration of architectural design, data curation, and training strategies essential for building a robust omni-modal model.
<p align="center" width="100%">
<img src="https://ola-omni.github.io/static/images/teaser.png" alt="teaser.png" width=100%>
</p>
<div>
### AExcerpt of 8,534 characters
Read on GitHubWould you bet a product on this? Bounded 0–100 and slow moving.
matched fp:2cf91b7dd7f98da0, llm:Repository name and description: 'Ola: Pushing the Frontiers of Omni-Modal Language Model' (Python). Indicates an omni-modal language model project (foundation model, multimodal capabilities).
matched fp:2cf91b7dd7f98da0, llm:Repository name and description: 'Ola: Pushing the Frontiers of Omni-Modal Language Model' (Python). Indicates an omni-modal language model project (foundation model, multimodal capabilities).
matched fp:2cf91b7dd7f98da0, llm:Repository name and description: 'Ola: Pushing the Frontiers of Omni-Modal Language Model' (Python). Indicates an omni-modal language model project (foundation model, multimodal capabilities).