Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Cambrian-1 is a family of multimodal LLMs with a vision-centric design.
| Date | Stars |
|---|---|
| 2026-07-24 | 2008 |
| 2026-07-25 | 2008 |
| 2026-07-28 | 2009 |
| 2026-07-30 | 2009 |
| 2026-07-31 | 2012 |
| 2026-08-06 | 2012 |
Today
— stars today
This week
+3 stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.15%/day
<div align="center">
# 🪼 *Cambrian-1*:<br> A Fully Open, Vision-Centric Exploration of Multimodal LLMs
<p>
<img src="images/cambrian.png" alt="Cambrian" width="500" height="auto">
</p>
<a href="https://arxiv.org/abs/2406.16860" target="_blank">
<img alt="arXiv" src="https://img.shields.io/badge/arXiv-Cambrian--1-red?logo=arxiv" height="25" />
</a>
<a href="https://cambrian-mllm.github.io/" target="_blank">
<img alt="Website" src="https://img.shields.io/badge/🌎_Website-cambrian--mllm.github.io-blue.svg" height="25" />
</a>
<br>
<a href="https://huggingface.co/collections/nyu-visionx/cambrian-1-models-666fa7116d5420e514b0f23c" target="_blank">
<img alt="HF Model: Cambrian-1" src="https://img.shields.io/badge/%F0%9F%A4%97%20_Model-Cambrian--1-ffc107?color=ffc107&logoColor=white" height="25" />
</a>
<a href="https://huggingface.co/collections/nyu-visionx/cambrian-data-6667ce801e179b4fbe774e11" target="_blank">
<img alt="HF Dataset: Cambrian 10M" src="https://img.shields.io/badge/%F0%9F%A4%97%20_Data-Cambrian--10M-ffc107?color=ffc107&logoColor=white" height="25" />
</a>
<a href="https://huggingface.co/datasets/nyu-visionx/CV-Bench" target="_blank">
<img alt="HF Dataset: CV-Bench" src="https://img.shields.io/badge/%F0%9F%A4%97%20_Benchmark-CV--Bench-ffc107?color=ffc107&logoColor=white" height="25" />
</a>
<div style="font-family: charter;">
<a href="https://tsb0601.github.io/petertongsb/" target="_blank">Shengbang Tong*</a>,
<a href="https://ellisbrown.github.io/" target="_blank">Ellis Brown*</a>,
<a href="https://penghao-wu.github.io/" target="_blank">Penghao Wu*</a>,
<br>
<a href="https://sites.google.com/view/sanghyunwoo/" target="_blank">Sanghyun Woo</a>,
<a href="https://www.linkedin.com/in/manoj-middepogu/" target="_blank">Manoj Middepogu</a>,
<a href="https://www.linkedin.com/in/sai-charitha-akula-32574887/" target="_blank">Sai Charitha Akula</a>,
<a href="https://jihanyang.github.io/" target="_blank">Jihan Yang</a>,
<br>
<a href="https://github.com/vealocia" target="_blank">Shusheng Yang</a>,
<a href="https://adithyaiyer1999.github.io/" target="_blank">Adithya Iyer</a>,
<a href="https://xichenpan.com/" target="_blank">Xichen Pan</a>,
<a href="https://www.linkedin.com/in/ziteng-wang-694b8b227/" target="_blank">Austin Wang</a>,
<br>
<a href="http://cs.nyu.edu/~fergus" target="_blank">Rob Fergus</a>,
<a href="http://yann.lecun.com/" target="_blank">Yann LeCun</a>,
<a href="https://www.sainingxie.com/" target="_blank">Saining Xie</a>
</div>
</div>
<br>
> *Fun fact: vision emerged in animals during the Cambrian period! This was the inspiration for the name of our project, Cambrian.*
## Release
- [09/09/24] 🧪 We've released our MLLM evaluation suite with 26 benchmarks, supporting manual usage and parallelization using Slurm for HPC clusters. See the [`eval/`](eval/) subfolder for more details.
- [07/03/24] 🚂 We have released our targeted data engine! See the [`dataengine/`](dataengine/) subfolder for more details.
- [07/02/24] 🤗 CV-Bench is live on Huggingface! Please see here for more: https://huggingface.co/datasets/nyu-visionx/CV-Bench
- [06/24/24] 🔥 We released Cambrian-1! We also release three sizes of model (8B, 13B and 34B), training data, TPU training scripts. We will release GPU training script and evaluation code very soon.
## Contents
- [Installation](#installation)
- [Cambrian Weights](#cambrian-weights)
- [Cambrian Instruction Tuning Data](#cambrian-instruction-tuning-data)
- [Train](#train)
- [Evaluation](#evaluation)
- [Demo](#demo)
## Installation
### TPU Training
Currently, we support training on TPU using TorchXLA
1. Clone this repository and navigate to into the codebase
```bash
git clone https://github.com/cambrian-mllm/cambrian
cd cambrian
```
2. Install Packages
```Shell
conda create -n cambrian python=3.10 -y
conda activate cambrian
pip install --upgrade pip # enable PEP 660 support
pip install -e "Excerpt of 25,309 characters
Read on GitHub
Ellis Brown · @NYU · United States
37
11
Penghao Wu
8
3
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:e3dfdc98f3d72621, topic:clip, desc:multimodal, readme:multimodal
matched fp:e3dfdc98f3d72621, topic:instruction-tuning, readme:instruction tuning
matched fp:e3dfdc98f3d72621, topic:large-language-models
matched fp:e3dfdc98f3d72621, topic:computer-vision