Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.
| Date | Stars |
|---|---|
| 2026-07-31 | 1506 |
| 2026-08-05 | 1506 |
| 2026-08-06 | 1506 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
# Oryx Video-ChatGPT :movie_camera: :speech_balloon:
<p align="center">
<img src="https://i.imgur.com/waxVImv.png" alt="Oryx Video-ChatGPT">
</p>
### Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models [ACL 2024 🔥]
#### [Muhammad Maaz](https://www.mmaaz60.com)* , [Hanoona Rasheed](https://www.hanoonarasheed.com/)* , [Salman Khan](https://salman-h-khan.github.io/) and [Fahad Khan](https://sites.google.com/view/fahadkhans/home)
\* Equally contributing first authors
#### **Mohamed bin Zayed University of Artificial Intelligence**
---
#### **Diverse Video-based Generative Performance Benchmarking (VCGBench-Diverse)**
[](https://paperswithcode.com/sota/vcgbench-diverse-on-videoinstruct?p=video-chatgpt-towards-detailed-video)
#### **Video-based Generative Performance Benchmarking**
[](https://paperswithcode.com/sota/video-based-generative-performance?p=video-chatgpt-towards-detailed-video)
#### **Zeroshot Question-Answer Evaluation**
[](https://paperswithcode.com/sota/zeroshot-video-question-answer-on-msvd-qa?p=video-chatgpt-towards-detailed-video)
[](https://paperswithcode.com/sota/zeroshot-video-question-answer-on-msrvtt-qa?p=video-chatgpt-towards-detailed-video)
[](https://paperswithcode.com/sota/zeroshot-video-question-answer-on-tgif-qa?p=video-chatgpt-towards-detailed-video)
[](https://paperswithcode.com/sota/zeroshot-video-question-answer-on-activitynet?p=video-chatgpt-towards-detailed-video)
---
| Demo | Paper | Demo Clips | Offline Demo | Training | Video Instruction Data | Quantitative Evaluation | Qualitative Analysis |
| :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
| [](https://www.ival-mbzuai.com/video-chatgpt) [](https://youtu.be/fRhm---HWJY) | [](https://arxiv.org/abs/2306.05424) | [](https://youtu.be/R8qW5EJD2-k) [](https://youtu.be/ujCxqxMXLVw) [](https://youtu.be/97IWKMsbZ80) [](https://youtu.be/ZyJZfTg_Ttc) | [Offline Demo](#running-demo-offline-cd) | [Training](#training-train) | [Video Instruction Dataset](#video-instruction-dataset-open_file_folder) | [Quantitative Evaluation](#quantitative-evaluation-bar_chart) | [Qualitative Analysis](#qualitative-analysis-mag) |
---
## :loudspeaker: Latest Updates
- **Mar-28-25**: *Mobile-VideoGPT* is released. It achieves excellent results on multiple benchmarks with 2x higher throughput. Check it out [Mobile-VideoGPT](https://github.com/Amshaker/Mobile-VideoGPT) :fire::fire:
---
- **Jun-14-24**: *VideoGPT+* is released. It achieves SoTA results on multiple benchmarks. Check it out at [VideoGPT+](https://github.com/mbzuai-oryx/VideoGPT-plus) :fire::fire:
- **Jun-14-24**:Excerpt of 13,826 characters
Read on GitHubWould you bet a product on this? Bounded 0–100 and slow moving.
matched fp:3748762996fff04c, topic:llama
matched fp:3748762996fff04c, topic:clip
matched fp:3748762996fff04c, topic:chatbot
