Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Vision-language models, document understanding and any-to-any architectures.
Signals: multimodal, vision-language-model, vlm, clip, multimodal-llm, visual-question-answering, document-understanding, image-captioning
339 results
InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policy
Ptera Software is a fast, easy-to-use, and open-source software package for analyzing flapping-wing flight.
✨First Open-Source R1-like Video-LLM [2025/02/18]
[IEEE TPAMI 2026] Simulating the Real World: Survey & Resources, which contains our survey "Simulating the Real World: A Unified Survey of Multimodal Generative Models" (IEEE TPAMI, 2026) and Awesome-Text2X-Resources. Watch this repository for the latest updates! 🔥
Official repository for "VideoPrism: A Foundational Visual Encoder for Video Understanding" (ICML 2024)
[Awesome-Spatial-VLMs] This repository is the official, community-maintained resource for the survey paper: Spatial Intelligence in Vision-Language Models: A Comprehensive Survey;
The Codes and Data of A Comprehensive Benchmark for Multimodal Large Language Models in Industrial Anomaly Detection [ICLR'25]
Cell2Sentence: Teaching Large Language Models the Language of Biology
😎 up-to-date & curated list of awesome Attacks on Large-Vision-Language-Models papers, methods & resources.
This repo contains the code for "VLM2Vec / MMEB" [ICLR 2025], "VLM2Vec-V2 / MMEB-V2" [TMLR 2026], and "MMEB-V3" [COLM 2026]
a multiscale multimodal large language models for radiology report generation (RRG) tasks
Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch
Open-source multimodal retrieval engine (Morphik Core)
Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and 🔜 video, up to 5x faster than OpenAI CLIP and LLaVA 🖼️ & 🖋️
Inductive graph-based matrix completion (IGMC) from "M. Zhang and Y. Chen, Inductive Matrix Completion Based on Graph Neural Networks, ICLR 2020 spotlight".
Code for our SIGKDD'22 paper Pre-training-Enhanced Spatial-Temporal Graph Neural Network For Multivariate Time Series Forecasting.
This repository contains the code for the paper `End-to-End Multimodal Emotion Recognition using Deep Neural Networks`.
Generates poetry from images using convolutional and recurrent neural networks
[ICLR 2026] MetaSpatial leverages reinforcement learning to enhance 3D spatial reasoning in vision-language models (VLMs), enabling more structured, realistic, and adaptive scene generation for applications in the metaverse, AR/VR, and game development.
VARGPT-v1.1: Improve Visual Autoregressive Large Unified Model via Iterative Instruction Tuning and Reinforcement Learning
Swift Core ML Examples
No description
[ICLR'25 Oral] UGround: Universal GUI Visual Grounding for GUI Agents
24,545 repositories in the index in total.
