Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
[ICLR 2026] Official repo for paper "Video-As-Prompt: Unified Semantic Control for Video Generation"
| Date | Stars |
|---|---|
| 2026-07-24 | 440 |
| 2026-07-25 | 442 |
| 2026-07-28 | 443 |
| 2026-07-30 | 443 |
| 2026-08-06 | 443 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
<div align="center">
# Video-As-Prompt: Unified Semantic Control for Video Generation
</div>
<div align="center">
<a href=https://bytedance.github.io/Video-As-Prompt target="_blank"><img src=https://img.shields.io/badge/Project%20Page-333399.svg?logo=homepage height=22px></a>
<a href=https://huggingface.co/collections/ByteDance/video-as-prompt target="_blank"><img src=https://img.shields.io/badge/%F0%9F%A4%97%20Models-d96902.svg height=22px></a>
<a href=https://huggingface.co/datasets/BianYx/VAP-Data target="_blank"><img src=https://img.shields.io/badge/%F0%9F%A4%97%20Dataset-276cb4.svg height=22px></a>
<a href=https://github.com/bytedance/Video-As-Prompt target="_blank"><img src= https://img.shields.io/badge/Code-black.svg?logo=github height=22px></a>
<a href=https://arxiv.org/pdf/2510.20888 target="_blank"><img src=https://img.shields.io/badge/Arxiv-b5212f.svg?logo=arxiv height=22px></a>
<!-- <a href=https://yxbian23.github.io/ target="_blank"><img src=https://img.shields.io/badge/Twitter-grey.svg?logo=x height=22px></a> -->
<!-- <a href="https://opensource.org/licenses/Apache">
<img src="https://img.shields.io/badge/License-Apache%202.0-lightgray">
</a> -->
<a href="https://www.youtube.com/watch?v=S3zpLIMOU4c" target="_blank">
<img src="https://img.shields.io/badge/%E2%96%B6%20YouTube%20Demo-FF0000.svg?logo=youtube&logoColor=white" height="24px">
</a>
</div>
<br>
## 🔥 News
- Feb 08, 2026: 🎉 Our [Video-As-Prompt](https://openreview.net/forum?id=8FihPljvWf) has been accepted by [ICLR 2026](https://iclr.cc/Conferences/2026)! See you in Brazil! 🇧🇷
- Jan 31, 2026: 🚀 Thanks to [@Artiprocher](https://github.com/Artiprocher), Video-As-Prompt has been integrated into [DiffSynth-Studio](https://github.com/modelscope/DiffSynth-Studio) ([PR #1034](https://github.com/modelscope/DiffSynth-Studio/pull/1034)) with support for Inference, Full Training, Full Training Validation, LoRA Training, and LoRA Training Validation. Check it out!
- Jan 31, 2026: 🎉 Community contribution: [@okdalto](https://github.com/okdalto) released a [ComfyUI implementation](https://github.com/okdalto/ComfyUI-Video-As-Prompt) of Video-As-Prompt!
- Oct 31, 2025: ❤️ Thanks to [@gangxu822](https://github.com/gangxu822) reminder, we managed to **lower the memory cost of both variant CogVideoX and Wan2.1 from 40GB/64GB to max around 8GB!**
- Oct 24, 2025: 📖 We release the first unified semantic video generation model, [Video-As-Prompt (VAP)](https://github.com/bytedance/Video-As-Prompt)!
- Oct 24, 2025: 🤗 We release the [VAP-Data](https://huggingface.co/datasets/BianYx/VAP-Data), the largest semantic-controlled video generation datasets with more than $100K$ samples!
- Oct 24, 2025: 👋 We present the [technical report](https://arxiv.org/pdf/2510.20888) of Video-As-Prompt, please check out the details and spark some discussion!
## 🖌️ **Video-As-Prompt**
> **Core idea:** Given a reference video with wanted semantics as a video prompt, Video-As-Prompt animate a reference image with the same semantics as the reference video.
<p align="center">
<video
controls
autoplay
playsinline
muted
loop
src="https://github.com/user-attachments/assets/2e440927-5b16-4761-ad1f-46ac93de2d8e"
width="100%"
>
Your browser does not support HTML5 video. Here is a <a href="https://github.com/user-attachments/assets/2e440927-5b16-4761-ad1f-46ac93de2d8e">link to the video</a> instead.
</video>
<br>
<em>E.g., Different Reference Videos + Same Reference Image → New Videos with Different Semantics</em>
</p>
> **Welcome to see our [project page](https://bytedance.github.io/Video-As-Prompt) for more interesting results!**
### Architecture
We introduce **Video-As-Prompt (VAP)**, a new paradigm that reframes unified and generalizable semantic-controlled video generation as in-context generation. VAP leverages a reference video as a direct semantic prompt, guiding a frozen Video Diffusion Transformer (DiT) via a plExcerpt of 19,803 characters
Read on GitHubWould you bet a product on this? Bounded 0–100 and slow moving.
matched fp:2de98113cf9c5603, topic:video-generation, desc:video generation, readme:video generation