Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Vision-language models, document understanding and any-to-any architectures.
Signals: multimodal, vision-language-model, vlm, clip, multimodal-llm, visual-question-answering, document-understanding, image-captioning
344 results
VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and cloud.
Kimi-VL: Mixture-of-Experts Vision-Language Model for Multimodal Reasoning, Long-Context Understanding, and Strong Agent Capabilities
GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Models
[BIONLP@ACL 2024] XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Models.
[ECCV 2024] Official code implementation of Vary: Scaling Up the Vision Vocabulary of Large Vision Language Models.
[AAAI 2024 Oral] AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Models
Code for the Molmo2 Vision-Language Model
This repository contains the official implementation of "FastVLM: Efficient Vision Encoding for Vision Language Models" - CVPR 2025
Code for the Molmo Vision-Language Model
This repo lists relevant papers summarized in our survey paper: A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models.
A most Frontend Collection and survey of vision-language model papers, and models GitHub repository. Continuous updates.
DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding
tiny vision language model
PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"
Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"
Detects reggaeton genre with Machine Learning and sends packets to disable BT speakers (hopefully)
A python library and collection of notebooks for making art with machine learning.
Magenta.js: Music and Art Generation with Machine Learning in the browser
DeepFuze is a state-of-the-art deep learning tool that seamlessly integrates with ComfyUI to revolutionize facial transformations, lipsyncing, Face Swapping, Lipsync Translation, video generation, and voice cloning.
Use deep learning to generate and harmonize music in the style of Bach
BLOCK (AAAI 2019), with a multimodal fusion library for deep learning models
Create automatic playlists by using Deep Learning to *listen* to the music.
Fusing Histology and Genomics via Deep Learning - IEEE TMI
Using deep learning to generate music in MIDI format.
24,523 repositories in the index in total.
