Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
| Date | Stars |
|---|---|
| 2026-07-31 | 24957 |
| 2026-08-08 | 24972 |
| 2026-08-17 | 24983 |
| 2026-08-18 | 24988 |
| 2026-08-19 | 24987 |
| 2026-08-20 | 24990 |
| 2026-08-21 | 24995 |
| 2026-08-22 | 24998 |
| 2026-08-23 | 24999 |
| 2026-08-24 | 25000 |
| 2026-08-25 | 25002 |
| 2026-08-26 | 25001 |
| 2026-08-27 | 25004 |
| 2026-08-28 | 25005 |
| 2026-08-30 | 25006 |
| 2026-08-31 | 25009 |
| 2026-09-01 | 25010 |
| 2026-09-02 | 25012 |
| 2026-09-03 | 25011 |
| 2026-09-04 | 25014 |
| 2026-09-05 | 25015 |
| 2026-09-06 | 25014 |
| 2026-09-07 | 25014 |
| 2026-09-08 | 25013 |
| 2026-09-09 | 25012 |
| 2026-09-10 | 25017 |
| 2026-09-11 | 25017 |
| 2026-09-12 | 25019 |
| 2026-09-13 | 25018 |
| 2026-09-14 | 25020 |
| 2026-09-15 | 25023 |
| 2026-09-16 | 25023 |
| 2026-09-17 | 25024 |
| 2026-09-18 | 25026 |
| 2026-09-19 | 25029 |
| 2026-09-20 | 25030 |
| 2026-09-21 | 25031 |
| 2026-09-22 | 25035 |
| 2026-09-23 | 25036 |
| 2026-09-24 | 25038 |
| 2026-09-25 | 25039 |
| 2026-09-26 | 25040 |
| 2026-09-27 | 25043 |
| 2026-09-28 | 25045 |
| 2026-09-29 | 25045 |
| 2026-09-30 | 25049 |
| 2026-10-01 | 25052 |
| 2026-10-02 | 25056 |
| 2026-10-03 | 25056 |
| 2026-10-04 | 25057 |
| 2026-10-05 | 25058 |
| 2026-10-06 | 25057 |
| 2026-10-07 | 25060 |
| 2026-10-08 | 25058 |
| 2026-10-09 | 25056 |
| 2026-10-10 | 25057 |
| 2026-10-11 | 25058 |
| 2026-10-12 | 25061 |
| 2026-10-13 | 25064 |
| 2026-10-14 | 25067 |
| 2026-10-15 | 25067 |
| 2026-10-16 | 25068 |
| 2026-10-17 | 25070 |
| 2026-10-18 | 25071 |
| 2026-10-19 | 25074 |
| 2026-10-20 | 25075 |
| 2026-10-22 | 25074 |
| 2026-10-23 | 25072 |
| 2026-10-24 | 25076 |
| 2026-10-25 | 25078 |
| 2026-10-26 | 25078 |
| 2026-10-27 | 25076 |
| 2026-10-28 | 25075 |
| 2026-10-29 | 25078 |
| 2026-10-30 | 25079 |
| 2026-10-31 | 25080 |
| 2026-11-01 | 25081 |
| 2026-11-02 | 25080 |
| 2026-11-03 | 25082 |
| 2026-11-04 | 25077 |
Today
-5 stars today
This week
+2 stars this week
This month
+19 stars this month
Momentum
0.0
growth rate 0.01%/day
# 🌋 LLaVA: Large Language and Vision Assistant
*Visual instruction tuning towards large language and vision models with GPT-4 level capabilities.*
[📢 [LLaVA-NeXT Blog](https://llava-vl.github.io/blog/2024-01-30-llava-next/)] [[Project Page](https://llava-vl.github.io/)] [[Demo](https://llava.hliu.cc/)] [[Data](https://github.com/haotian-liu/LLaVA/blob/main/docs/Data.md)] [[Model Zoo](https://github.com/haotian-liu/LLaVA/blob/main/docs/MODEL_ZOO.md)]
🤝Community Contributions: [[llama.cpp](https://github.com/ggerganov/llama.cpp/pull/3436)] [[Colab](https://github.com/camenduru/LLaVA-colab)] [[🤗Space](https://huggingface.co/spaces/badayvedat/LLaVA)] [[Replicate](https://replicate.com/yorickvp/llava-13b)] [[AutoGen](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_lmm_llava.ipynb)] [[BakLLaVA](https://github.com/SkunkworksAI/BakLLaVA)]
**Improved Baselines with Visual Instruction Tuning** [[Paper](https://arxiv.org/abs/2310.03744)] [[HF](https://huggingface.co/papers/2310.03744)] <br>
[Haotian Liu](https://hliu.cc), [Chunyuan Li](https://chunyuan.li/), [Yuheng Li](https://yuheng-li.github.io/), [Yong Jae Lee](https://pages.cs.wisc.edu/~yongjaelee/)
**Visual Instruction Tuning** (NeurIPS 2023, **Oral**) [[Paper](https://arxiv.org/abs/2304.08485)] [[HF](https://huggingface.co/papers/2304.08485)] <br>
[Haotian Liu*](https://hliu.cc), [Chunyuan Li*](https://chunyuan.li/), [Qingyang Wu](https://scholar.google.ca/citations?user=HDiw-TsAAAAJ&hl=en/), [Yong Jae Lee](https://pages.cs.wisc.edu/~yongjaelee/) (*Equal Contribution)
<!--p align="center">
<a href="https://llava.hliu.cc/"><img src="images/llava_logo.png" width="50%"></a> <br>
Generated by <a href="https://gligen.github.io/">GLIGEN</a> via "a cute lava llama with glasses" and box prompt
</p-->
## Release
- [2024/05/10] 🔥 **LLaVA-NeXT** (Stronger) models are released, stronger LMM with support of LLama-3 (8B) and Qwen-1.5 (72B/110B). [[Blog](https://llava-vl.github.io/blog/2024-05-10-llava-next-stronger-llms/)] [[Checkpoints](https://huggingface.co/collections/lmms-lab/llava-next-6623288e2d61edba3ddbf5ff)] [[Demo](https://llava-next.lmms-lab.com/)] [[Code](https://github.com/LLaVA-VL/LLaVA-NeXT/)]
- [2024/05/10] 🔥 **LLaVA-NeXT** (Video) is released. The image-only-trained LLaVA-NeXT model is surprisingly strong on video tasks with zero-shot modality transfer. DPO training with AI feedback on videos can yield significant improvement. [[Blog](https://llava-vl.github.io/blog/2024-04-30-llava-next-video/)] [[Checkpoints](https://huggingface.co/collections/lmms-lab/llava-next-video-661e86f5e8dabc3ff793c944)] [[Code](https://github.com/LLaVA-VL/LLaVA-NeXT/)]
- [03/10] Releasing **LMMs-Eval**, a highly efficient evaluation pipeline we used when developing LLaVA-NeXT. It supports the evaluation of LMMs on dozens of public datasets and allows new dataset onboarding, making the dev of new LMMs much faster. [[Blog](https://lmms-lab.github.io/lmms-eval-blog/lmms-eval-0.1/)] [[Codebase](https://github.com/EvolvingLMMs-Lab/lmms-eval)]
- [1/30] 🔥 **LLaVA-NeXT** (LLaVA-1.6) is out! With additional scaling to LLaVA-1.5, LLaVA-NeXT-34B outperforms Gemini Pro on some benchmarks. It can now process 4x more pixels and perform more tasks/applications than before. Check out the [blog post](https://llava-vl.github.io/blog/2024-01-30-llava-next/), and explore the [demo](https://llava.hliu.cc/)! Models are available in [Model Zoo](https://github.com/haotian-liu/LLaVA/blob/main/docs/MODEL_ZOO.md). Training/eval data and scripts coming soon.
- [11/10] [LLaVA-Plus](https://llava-vl.github.io/llava-plus/) is released: Learning to Use Tools for Creating Multimodal Agents, with LLaVA-Plus (LLaVA that Plug and Learn to Use Skills). [[Project Page](https://llava-vl.github.io/llava-plus/)] [[Demo](https://llavaplus.ngrok.io/)] [[Code](https://github.com/LLaVA-VL/LLaVA-Plus-Codebase)] [[Paper](https://arxiv.org/abs/2311.05437)]
- [11/2] [LLaVA-Interactive](https://llava-vl.Excerpt of 30,070 characters
Read on GitHub
Haotian Liu · xAI · United States
360
31
Eggry Ran · Tsinghua University · China
5
Yorick · @datakami · Netherlands
5
Ikko Eltociear Ashimine · Japan
4
guanlaoda · GrowthTrack
3
Didier Durand · AWS · France
3
lionHC
2
MaoXun
2
Abdulla Al Blooshi · United Arab Emirates
2
Tim Abdulla · San Justo Research Corporation
1
Abdul Qabiz · @allies · India
1
1
Naoki Kishida
1
Leonard Salewski · University of Tübingen
1
1
Zheqi He · China
1
Simon Lund · Germany
1
yan · @brave
1
易容 (hyj1991) · China
1
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:f889456510393c6f, topic:multimodal, topic:vision-language-model, readme:multimodal
matched fp:f889456510393c6f, topic:instruction-tuning, readme:dpo, desc:instruction tuning
matched fp:f889456510393c6f, topic:foundation-models, topic:llama
matched fp:f889456510393c6f, topic:chatbot, topic:chatgpt