This GitHub repository summarizes papers and resources related to the video generation task.
If you have any suggestions about this repository, please feel free to start a new issue or pull requests.
Recent news of this GitHub repo are listed as follows.
🔥 [Dec. 11th, 2025] Our paper titled "StableV2V: Stablizing Shape Consistency in Video-to-Video Editing" is accepted at TCSVT 2025!
🔥 [Nov. 19th] We have released our latest paper titled "StableV2V: Stablizing Shape Consistency in Video-to-Video Editing", with the correponding code, model weights, and a testing benchmark DAVIS-Edit open-sourced. Feel free to check them out from the links!
Click to see more information.
- [2025 May 13th] Update a new sub-task named Human Image Animation. All CVPR 2025 papers and references are updated.
- [Jun. 17th] All NeurIPS 2023 papers and references are updated.
- [Apr. 26th] Update a new direction: Personalized Video Generation.
- [Mar. 28th] The official AAAI 2024 paper list are released! Official version of PDFs and BibTeX references are updated accordingly.
- To-Do Lists
- Products
- Papers
- Datasets
- Q&A
- References
- Star History
- WeChat Group
- Latest Papers
- Update NeurIPS 2025 Papers
- Update ICCV 2025 Papers
- Update CVPR 2025 Papers
- Update ICLR 2025 Papers
- Update NeurIPS 2024 Papers
- Update ECCV 2024 Papers
- Update CVPR 2024 Papers
- Update PDFs and References of
⚠️ Papers - Update Published Versions of References
- Update PDFs and References of
- Update AAAI 2024 Papers
- Update PDFs and References of
⚠️ Papers - Update Published Versions of References
- Update PDFs and References of
- Update ICLR 2024 Papers
- Update NeurIPS 2023 Papers
- Previously Published Papers
- Update Previous CVPR papers
- Update Previous ICCV papers
- Update Previous ECCV papers
- Update Previous NeurIPS papers
- Update Previous ICLR papers
- Update Previous AAAI papers
- Update Previous ACM MM papers
- Regular Maintenance of Preprint arXiv Papers and Missed Papers
| Name | Organization | Year | Research Paper | Website | Specialties |
|---|---|---|---|---|---|
| Sora | OpenAI | 2024 | link | link | - |
| Lumiere | 2024 | link | link | - | |
| VideoPoet | 2023 | - | link | - | |
| W.A.I.T | 2023 | link | link | - | |
| Gen-2 | Runaway | 2023 | - | link | - |
| Gen-1 | Runaway | 2023 | - | link | - |
| Animate Anyone | Alibaba | 2023 | link | link | - |
| Outfit Anyone | Alibaba | 2023 | - | link | - |
| Stable Video | StabilityAI | 2023 | link | link | - |
| Pixeling | HiDream.ai | 2023 | - | link | - |
| DomoAI | DomoAI | 2023 | - | link | - |
| Emu | Meta | 2023 | link | link | - |
| Genmo | Genmo | 2023 | - | link | - |
| NeverEnds | NeverEnds | 2023 | - | link | - |
| Moonvalley | Moonvalley | 2023 | - | link | - |
| Morph Studio | Morph | 2023 | - | link | - |
| Pika | Pika | 2023 | - | link | - |
| PixelDance | ByteDance | 2023 | link | link | - |
| Podframes | Jellypod | 2026 | - | link | Open-source topic-to-podcast video pipeline with mixed TTS voices, lip-synced avatars, captions, and b-roll. |
- Year 2024
- arXiv
- Video Diffusion Models: A Survey [Paper]
- arXiv
- Year 2023
- arXiv
- A Survey on Video Diffusion Models [Paper]
- arXiv
- Year 2026
-
Year 2025
-
CVPR
- AIGV-Assessor: Benchmarking and Evaluating the Perceptual Quality of Text-to-Video Generation with LMM [Paper] [Code]
- RAPO: The Devil is in the Prompts: Retrieval-Augmented Prompt Optimization for Text-to-Video Generation [Paper] [Project] [Code]
- ByTheWay: Boost Your Text-to-Video Generation Model to Higher Quality in a Training-free Way [Paper] [Code]
- The Devil is in the Prompts: Retrieval-Augmented Prompt Optimization for Text-to-Video Generation [Paper] [Project] [Code]
- ConsistID: Identity-Preserving Text-to-Video Generation by Frequency Decomposition [Paper] [Code] [Project]
- EIDT-V: Exploiting Intersections in Diffusion Trajectories for Model-Agnostic, Zero-Shot, Training-Free Text-to-Video Generation [Paper] [Code] [Project]
- TransPixeler: Advancing Text-to-Video Generation with Transparency [Paper] [Project] [Code]
- PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generation [Paper] [Code]
- InstanceCap: Improving Text-to-Video Generation via Instance-aware Structured Caption [Paper] [Code]
- BlobGEN-Vid: Compositional Text-to-Video Generation with Blob Video Representations [Paper] [Project]
- LinGen: Towards High-Resolution Minute-Length Text-to-Video Generation with Linear Computational Complexity [Paper] [Project]
⚠️ Encapsulated Composition of Text-to-Image and Text-to-Video Models for High-Quality Video Synthesis- DynamicScaler: Seamless and Scalable Video Generation for Panoramic Scenes [Paper] [Project] [Code]
- AKiRa: Augmentation Kit on Rays for Optical Video Generation [Paper]
- Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise [Paper]
- DriveScape: High-Resolution Driving Video Generation by Multi-View Feature Fusion [Paper]
- Towards Precise Scaling Laws for Video Diffusion Transformers [Paper]
- VideoDPO: Omni-Preference Alignment for Video Diffusion Generation [Paper] [Project] [Code]
- Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model [Paper]
- Mask^2DiT: Dual Mask-based Diffusion Transformer for Multi-Scene Long Video Generation [Paper] [Project] [Code]
- Long Video Diffusion Generation with Segmented Cross-Attention and Content-Rich Video Data Curation [Paper] [Project] [Code]
- LongDiff: Training-Free Long Video Generation in One Go [Paper]
- Goku: Flow Based Video Generative Foundation Models [Paper]
- IM-Zero: Instance-level Motion Controllable Video Generation in a Zero-shot Manner [Paper]
- VideoGuide: Improving Video Diffusion Models without Training Through a Teacher's Guide [Paper] [Project] [Code]
- AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers [Paper] [Project] [Code]
- Mimir: Improving Video Diffusion Models for Precise Text Understanding [Paper]
- Optical-Flow Guided Prompt Optimization for Coherent Video Generation [Paper] [Project] [Code]
- SnapGen-V: Generating a Five-Second Video within Five Seconds on a Mobile Device [Paper] [Project]
- ShotAdapter: Text-to-Multi-Shot Video Generation with Diffusion Models [Paper] [Project]
- STDD: Spatio-Temporal Dual Diffusion for Video Generation [Paper]
- From Slow Bidirectional to Fast Autoregressive Video Diffusion Models [Paper] [Project] [Code]
- TokenMotion: Decoupled Motion Control via Token Disentanglement for Human-centric Video Generation [Paper]
- FreePCA: Integrating Consistency Information across Long-short Frames in Training-free Long Video Generation via Principal Component Analysis [Paper] [Code]
- Mind the Time: Temporally-Controlled Multi-Event Video Generation [Paper] [Project]
- Tora: Trajectory-oriented Diffusion Transformer for Video Generation [Paper] [Code]
- One-Minute Video Generation with Test-Time Training [Paper] [Project] [Code]
-
ICCV
- Unified Video Generation: Unified Video Generation via Next-Set Prediction in Continuous Domain [Paper]
- Adversarial Distribution Matching for Diffusion Distillation Towards Efficient Image and Video Synthesis [Paper]
- REDUCIO! Generating 1K Video within 16 Seconds using Extremely Compressed Motion Latents [Paper]
- MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Control [Paper]
- Decouple and Track: Benchmarking and Improving Video Diffusion Transformers For Motion Transfer [Paper]
- TokensGen: Harnessing Condensed Tokens for Long Video Generation [Paper]
- Prompt-A-Video: Prompt Your Video Diffusion Model via Preference-Aligned LLM [Paper]
- LiON-LoRA: Rethinking LoRA Fusion to Unify Controllable Spatial and Temporal Generation for Video Diffusion [Paper]
- DropletVideo: A Dataset and Approach to Explore Integral Spatio-Temporal Consistent Video Generation [Paper]
- The Best of Both Worlds: Integrating Language Models and Diffusion Models for Video Generation [Paper]
- Long Context Tuning for Video Generation [Paper]
- Dual-Expert Consistency Model for Efficient and High-Quality Video Generation [Paper]
- NoiseController: Towards Consistent Multi-view Video Generation via Noise Decomposition and Collaboration [Paper]
- InstaDrive: Instance-Aware Driving World Models for Realistic and Consistent Video Generation [Paper]
- EfficientMT: Efficient Temporal Adaptation for Motion Transfer in Text-to-Video Diffusion Models [Paper]
- DOLLAR: Few-Step Video Generation via Distillation and Latent Reward Optimization [Paper]
- GameFactory: Creating New Games with Generative Interactive Videos [Paper]
- DLFR-Gen: Diffusion-based Video Generation with Dynamic Latent Frame Rate [Paper]
- MatchDiffusion: Training-free Generation of Match-Cuts [Paper]
- QuantCache: Adaptive Importance-Guided Quantization with Hierarchical Latent and Layer Caching for Video Generation [Paper]
- Free-Form Motion Control: Controlling the 6D Poses of Camera and Objects in Video Generation [Paper]
- Causal-Entity Reflected Egocentric Traffic Accident Video Synthesis [Paper]
- FreeScale: Unleashing the Resolution of Diffusion Models via Tuning-Free Scale Fusion [Paper]
- VPO: Aligning Text-to-Video Generation Models with Prompt Optimization [Paper]
- Video-T1: Test-time Scaling for Video Generation [Paper]
- MotionShot: Adaptive Motion Transfer across Arbitrary Objects for Text-to-Video Generation [Paper]
- STIV: Scalable Text and Image Conditioned Video Generation [Paper]
- Generating, Fast and Slow: Scalable Parallel Video Generation with Video Interface Networks [Paper]
- V.I.P.: Iterative Online Preference Distillation for Efficient Video Diffusion Models [Paper]
- Synthetic Video Enhances Physical Fidelity in Video Synthesis [Paper]
- Latent-Reframe: Enabling Camera Control for Video Diffusion Models without Training [Paper]
- FullDiT: Video Generative Foundation Models with Multimodal Control via Full Attention [Paper]
- VideoAuteur: Towards Long Narrative Video Generation [Paper]
- Model Reveals What to Cache: Profiling-Based Feature Reuse for Video Diffusion Models [Paper]
- Turbo2K: Towards Ultra-Efficient and High-Quality 2K Video Synthesis [Paper]
- Adaptive Caching for Faster Video Generation with Diffusion Transformers [Paper]
- Free2Guide: Training-Free Text-to-Video Alignment using Image LVLM [Paper]
- Progressive Growing of Video Tokenizers for Temporally Compact Latent Spaces [Paper]
- From Prompt to Progression: Taming Video Diffusion Models for Seamless Attribute Transition [Paper]
- Importance-Based Token Merging for Efficient Image and Video Generation [Paper]
- TITAN-Guide: Taming Inference-Time Alignment for Guided Text-to-Video Diffusion Models [Paper]
- Training-free and Adaptive Sparse Attention for Efficient Long Video Generation [Paper]
- UniMLVG: Unified Framework for Multi-view Long Video Generation with Comprehensive Control Capabilities for Autonomous Driving [Paper]
- CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Models [Paper]
-
NeurIPS
- Stable Cinemetrics: Structured Taxonomy and Evaluation for Professional Video Generation [Paper] [Project]
- WISA: World simulator assistant for physics-aware text-to-video generation [Paper]
- VORTA: Efficient Video Diffusion via Routing Sparse Attention [Paper] [Code]
- ViewPoint: Panoramic Video Generation with Pretrained Diffusion Models [Paper]
- Inference-Time Text-to-Video Alignment with Diffusion Latent Beam Search [Paper]
-
Radial Attention:
$\mathcal{O}(n\log n)$ Sparse Attention with Energy Decay for Long Video Generation [Paper] [Code] - Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Models [Paper]
- MagCache: Fast Video Generation with Magnitude-Aware Cache [Paper]
- $\text{S}^2$Q-VDiT: Accurate Quantized Video Diffusion Transformer with Salient Data and Sparse Token Distillation [Paper] [Code]
- WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perception [Paper]
- Show-o2: Improved Native Unified Multimodal Models [Paper] [Code]
- GeoVideo: Introducing Geometric Regularization into Video Generation Model [Paper]
- Re-ttention: Ultra Sparse Visual Generation via Attention Statistical Reshape [Paper]
- Genesis: Multimodal Driving Scene Generation with Spatio-Temporal and Cross-Modal Consistency [Paper]
- Training-Free Efficient Video Generation via Dynamic Token Carving [Paper]
- Improving Video Generation with Human Feedback [Paper]
- FlowMo: Variance-Based Flow Guidance for Coherent Motion in Video Generation [Paper]
- ASDSV: Multimodal Generation Made Efficient with Approximate Speculative Diffusion and Speculative Verification [Paper]
- Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutation [Paper] [Code]
- VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Models [Paper] [Project]
- PAROAttention: Pattern-Aware ReOrdering for Efficient Sparse and Quantized Attention in Visual Generation Models [Paper]
- LeMiCa: Lexicographic Minimax Path Caching for Efficient Diffusion-Based Video Generation [Paper]
- Hierarchical Fine-grained Preference Optimization for Physically Plausible Video Generation [Paper]
- Normalized Attention Guidance: Universal Negative Guidance for Diffusion Models [Paper]
- FPSAttention: Training-Aware FP8 and Sparsity Co-Design for Fast Video Diffusion [Paper]
- PanoWan: Lifting Diffusion Video Generation Models to 360$^\circ$ with Latitude/Longitude-aware Mechanisms [Paper]
- Faster Video Diffusion with Trainable Sparse Attention [Paper] [Code]
- VETA-DiT: Variance-Equalized and Temporally Adaptive Quantization for Efficient 4-bit Diffusion Transformers [Paper] [Code]
- Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion [Paper]
- Foresight: Adaptive Layer Reuse for Accelerated and High-Quality Text-to-Video Generation [Paper]
- InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generation [Paper]
- DenseDPO: Fine-Grained Temporal Preference Optimization for Video Diffusion Models [Paper]
- Rare Text Semantics Were Always There in Your Diffusion Transformer [Paper]
-
ICLR
- OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generation [Paper] [Project] [Code] [Dataset]
- CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer [Paper]
- Pyramidal Flow Matching for Efficient Video Generative Modeling [Paper] [Project] [Code]
- ARLON: Boosting Diffusion Transformers with Autoregressive Models for Long Video Generation [Paper]
- VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control [Paper]
- Real-Time Video Generation with Pyramid Attention Broadcast [Paper]
- SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpoints [Paper]
- FreqPrior: Improving Video Diffusion Models with Frequency Filtering Gaussian Noise [Paper]
- FasterCache: Training-Free Video Diffusion Model Acceleration with High Quality [Paper]
- Lumina-T2X: Scalable Flow-based Large Diffusion Transformer for Flexible Resolution Generation [Paper]
- VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation [Paper]
- T2V-Turbo-v2: Enhancing Video Model Post-Training through Data, Reward, and Conditional Guidance Design [Paper]
- MotionAura: Generating High-Quality and Motion Consistent Videos using Discrete Diffusion [Paper]
- ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation [Paper]
- SAFREE: Training-Free and Adaptive Guard for Safe Text-to-Image And Video Generation [Paper]
- CameraCtrl: Enabling Camera Control for Video Diffusion Models [Paper]
- GameGen-X: Interactive Open-world Game Video Generation [Paper]
- IV-mixed Sampler: Leveraging Image Diffusion Models for Enhanced Video Synthesis [Paper]
- MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequences [Paper]
- Field-DiT: Diffusion Transformer on Unified Video, 3D, and Game Field Generation [Paper]
- Accelerating Diffusion Transformers with Token-wise Feature Caching [Paper]
- VSTAR: Generative Temporal Nursing for Longer Dynamic Video Synthesis [Paper]
- PT-T2I/V: An Efficient Proxy-Tokenized Diffusion Transformer for Text-to-Image/Video-Task [Paper]
-
ICML
- VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Models [Paper]
- Q-VDiT: Towards Accurate Quantization and Distillation of Video-Generation Diffusion Transformers [Paper] [Code]
- Ca2-VDM: Efficient Autoregressive Video Diffusion Model with Causal Generation and Cache Sharing [Paper] [Code]
- Diffusion Adversarial Post-Training for One-Step Video Generation [Paper]
- AsymRnR: Video Diffusion Transformers Acceleration with Asymmetric Reduction and Restoration [Paper] [Code]
- Sparse Video-Gen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity [Paper] [Code]
- Fast Video Generation with Sliding Tile Attention [Paper] [Code]
- RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformers [Paper] [Code]
-
AAAI
- Ouroboros-Diffusion: Exploring Consistent Content Generation in Tuning-free Long Video Diffusion [Paper]
- UFO: Enhancing Diffusion-Based Video Generation with a Uniform Frame Organizer [Paper]
- Modular-Cam: Modular Dynamic Camera-view Video Generation with LLM [Paper]
- AdaDiff: Adaptive Step Selection for Fast Diffusion Models [Paper]
- PanoDiT: Panoramic Videos Generation with Diffusion Transformer [Paper]
- VideoElevator: Elevating Video Generation Quality with Versatile Text-to-Image Diffusion Models [Paper]
- DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation [Paper]
- SIGGRAPH
- ACM MM
-
arXiv
- Stable Video Infinity: Infinite-Length Video Generation with Error Recycling [Paper] [Project] [Code] [Video (YouTube)] [Video (Bilibili)]
- FEAT: Full-Dimensional Efficient Attention Transformer for Medical Video Generation [Paper] [Code]
-
CVPR
-
Year 2024
-
CVPR
- Vlogger: Make Your Dream A Vlog [Paper] [Code]
- Make Pixels Dance: High-Dynamic Video Generation [Paper] [Project] [Demo]
- VGen: Hierarchical Spatio-temporal Decoupling for Text-to-Video Generation [Paper] [Code] [Project]
- GenTron: Delving Deep into Diffusion Transformers for Image and Video Generation [Paper] [Project]
- SimDA: Simple Diffusion Adapter for Efficient Video Generation [Paper] [Code] [Project]
- MicroCinema: A Divide-and-Conquer Approach for Text-to-Video Generation [Paper] [Project] [Video]
- Generative Rendering: Controllable 4D-Guided Video Generation with 2D Diffusion Models [Paper] [Project]
- PEEKABOO: Interactive Video Generation via Masked-Diffusion [Paper] [Code] [Project] [Demo]
- EvalCrafter: Benchmarking and Evaluating Large Video Generation Models [Paper] [Code] [Project]
- A Recipe for Scaling up Text-to-Video Generation with Text-free Videos [Paper] [Code] [Project]
- BIVDiff: A Training-free Framework for General-Purpose Video Synthesis via Bridging Image and Video Diffusion Models [Paper] [Project]
- Mind the Time: Scaled Spatiotemporal Transformers for Text-to-Video Synthesis [Paper] [Project]
- Animate Anyone: Consistent and Controllable Image-to-video Synthesis for Character Animation [Paper] [Code] [Project]
- MotionDirector: Motion Customization of Text-to-Video Diffusion Models [Paper] [Code]
- Hierarchical Patch-wise Diffusion Models for High-Resolution Video Generation [Paper] [Project]
- DiffPerformer: Iterative Learning of Consistent Latent Guidance for Diffusion-based Human Video Generation [Paper] [Code]
- Grid Diffusion Models for Text-to-Video Generation [Paper] [Code] [Video]
-
ECCV
- Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioning [Paper] [Project]
- W.A.L.T.: Photorealistic Video Generation with Diffusion Models [Paper] [Project]
- MoVideo: Motion-Aware Video Generation with Diffusion Models [Paper]
- DrivingDiffusion: Layout-Guided Multi-View Driving Scenarios Video Generation with Latent Diffusion Model [Paper] [Code] [Project]
- MagDiff: Multi-Alignment Diffusion for High-Fidelity Video Generation and Editing [Paper]
- HARIVO: Harnessing Text-to-Image Models for Video Generation [Paper] [Project]
- MEVG: Multi-event Video Generation with Text-to-Video Models [Paper] [Project]
- NeurIPS
- ICML
- ICLR
-
AAAI
- Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videos [Paper] [Code] [Project]
- E2HQV: High-Quality Video Generation from Event Camera via Theory-Inspired Model-Aided Deep Learning [Paper]
- ConditionVideo: Training-Free Condition-Guided Text-to-Video Generation [Paper] [Code] [Project]
- F3-Pruning: A Training-Free and Generalized Pruning Strategy towards Faster and Finer Text to-Video Synthesis [Paper]
-
arXiv
- Lumiere: A Space-Time Diffusion Model for Video Generation [Paper] [Project]
- Boximator: Generating Rich and Controllable Motions for Video Synthesis [Paper] [Project] [Video]
- World Model on Million-Length Video And Language With RingAttention [Paper] [Code] [Project]
- Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motion [Paper] [Project]
- WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokens [Paper] [Code] [Project]
- MagicVideo-V2: Multi-Stage High-Aesthetic Video Generation [Paper] [Project]
- Latte: Latent Diffusion Transformer for Video Generation [Paper] [Code] [Project]
- Mora: Enabling Generalist Video Generation via A Multi-Agent Framework [Paper] [Code]
- StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text [Paper] [Code] [Project] [Video]
- VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Models [Paper]
- StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation [Paper] [Code] [Project] [Demo]
- Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Model [Paper] [Code] [Project]
- ControlNeXt: Powerful and Efficient Control for Image and Video Generation [Paper] [Code] [Project]
- FancyVideo: Towards Dynamic and Consistent Video Generation via Cross-frame Textual Guidance [Paper] [Project]
- Factorized-Dreamer: Training A High-Quality Video Generator with Limited and Low-Quality Data [Paper] [Code]
- Fine-gained Zero-shot Video Sampling [Paper] [Project]
- Training-free Long Video Generation with Chain of Diffusion Model Experts [Paper]
- ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Model [Paper] [Code] [Project] [Video]
- ConFiner: Training-free Long Video Generation with Chain of Diffusion Model Experts [Paper] [Code]
- 3DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generation [Paper] [Code] [Project]
- DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generation [Paper] [Code] [Project]
-
Others
- Sora: Video Generation Models as World Simulators [Paper]
-
CVPR
-
Year 2023
-
CVPR
- Align your Latents: High-resolution Video Synthesis with Latent Diffusion Models [Paper] [Project] [Reproduced code]
- Text2Video-Zero: Text-to-image Diffusion Models are Zero-shot Video Generators [Paper] [Code] [Demo] [Project]
- Video Probabilistic Diffusion Models in Projected Latent Space [Paper] [Code]
- ICCV
- NeurIPS
-
ICLR
- CogVideo: Large-scale Pretraining for Text-to-video Generation via Transformers [Paper] [Code] [Demo]
- Make-A-Video: Text-to-video Generation without Text-video Data [Paper] [Project] [Reproduced code]
- Phenaki: Variable Length Video Generation From Open Domain Textual Description [Paper] [Reproduced Code]
-
arXiv
- Control-A-Video: Controllable Text-to-video Generation with Diffusion Models [Paper] [Code] [Demo] [Project]
- ControlVideo: Training-free Controllable Text-to-video Generation [Paper] [Code]
- Imagen Video: High Definition Video Generation with Diffusion Models [Paper]
- Latent-Shift: Latent Diffusion with Temporal Shift for Efficient Text-to-video Generation [Paper] [Project]
- LAVIE: High-quality Video Generation with Cascaded Latent Diffusion Models [Paper] [Code] [Project]
- Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-video Generation [Paper] [Code] [Project]
- Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets [Paper] [Code] [Project]
- VideoFactory: Swap Attention in Spatiotemporal Diffusions for Text-to-video Generation [Paper] [Dataset]
- VideoGen: A Reference-guided Latent Diffusion Approach for High Definition Text-to-video Generation [Paper] [Code]
- InstructVideo: Instructing Video Diffusion Models with Human Feedback [Paper] [Code] [Project]
- SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Prediction [Paper] [Code] [Project]
- VideoLCM: Video Latent Consistency Model [Paper]
- ModelScope Text-to-Video Technical Report [Paper] [Code]
- LAMP: Learn A Motion Pattern for Few-Shot-Based Video Generation [Paper] [Code] [Project]
- STG: Spatiotemporal Skip Guidance for Enhanced Video Diffusion Sampling [Paper] [Code] [Project]
- Motion-Zero: Zero-Shot Moving Object Control Framework for Diffusion-Based Video Generation [Paper] [Project]
- NOVA: Autoregressive Video Generation without Vector Quantization Topics [Paper] [Code] [Project]
-
CVPR
- Year 2022
- Year 2021
-
Year 2026
-
Year 2025
- CVPR
- MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generation [Paper]
- MotionPro: A Precise Motion Controller for Image-to-Video Generation [Paper] [Code]
- Through-The-Mask: Mask-based Motion Trajectories for Image-to-Video Generation [Paper]
- Extrapolating and Decoupling Image-to-Video Generation Models: Motion Modeling is Easier Than You Think [Paper]
- Taming Teacher Forcing for Masked Autoregressive Video Generation [Paper]
- Animate and Sound an Image [Paper]
- GEM: A Generalizable Ego-Vision Multimodal World Model for Fine-Grained Ego-Motion, Object Dynamics, and Scene Composition Control [Paper]
- Generative Inbetweening through Frame-wise Conditions-Driven Video Generation [Paper] [Project] [Code]
- PoseTraj: Pose-Aware Trajectory Control in Video Diffusion [Paper] [Project] [Code]
- PhysAnimator: Physics-Guided Generative Cartoon Animation [Paper] [Project]
- FloVD: Optical Flow Meets Video Diffusion Model for Enhanced Camera-Controlled Video Synthesis [Paper]
- OSV: One Step is Enough for High-Quality Image to Video Generation [Paper]
- AnimateAnything: Consistent and Controllable Animation for Video Generation [Paper] [Project] [Code]
- Track4Gen: Teaching Video Diffusion Models to Track Points Improves Video Generation [Paper] [Project]
- FlipSketch: Flipping Static Drawings to Text-Guided Sketch Animations [Paper] [Project] [Code]
- MotiF: Making Text Count in Image Animation with Motion Focal Loss [Paper] [Project]
- InterDyn: Controllable Interactive Dynamics with Video Diffusion Models [Paper] [Project]
- GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Control [Paper]
- Consistent and Controllable Image Animation with Motion Diffusion Models [Paper] [Project] [Code]
- ICCV
- AnyI2V: Animating Any Conditional Image with Motion Control [Paper] [Project] [Code]
- Versatile Transition Generation: Versatile Transition Generation with Image-to-Video Diffusion [Paper]
- TIP-I2V: A Million-Scale Real Text and Image Prompt Dataset for Image-to-Video Generation [Paper] [Project] [Code]
- LayerAnimate: Layer-level Control for Animation [Paper]
- Multi-Object Sketch Animation by Scene Decomposition and Motion Planning [Paper]
- Perception-as-Control: Fine-grained Controllable Image Animation with 3D-aware Motion Representation [Paper]
- MultiModal Action Conditioned Video Simulation [Paper]
- AID: Adapting Image2Video Diffusion Models for Instruction-guided Video Prediction [Paper]
- RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Control [Paper]
- MotionAgent: Fine-grained Controllable Video Generation via Motion Field Agent [Paper]
- Puppet-Master: Scaling Interactive Video Generation as a Motion Prior for Part-Level Dynamics [Paper]
- I2VControl: Disentangled and Unified Video Motion Synthesis Control [Paper]
- I2V3D: Controllable Image-to-video Generation with 3D Guidance [Paper]
- Mobile Video Diffusion [Paper]
- VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memory [Paper]
- Precise Action-to-Video Generation Through Visual Action Prompts [Paper]
- NeurIPS
- Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidance [Paper]
- Frame In-N-Out: Unbounded Controllable Image-to-Video Generation [Paper]
- Video World Models with Long-term Spatial Memory [Paper]
- Controllable Human-centric Keyframe Interpolation with Generative Prior [Paper]
- VideoMAR: Autoregressive Video Generation with Continuous Tokens [Paper]
- Force Prompting: Video Generation Models Can Learn And Generalize Physics-based Control Signals [Paper]
- Learning World Models for Interactive Video Generation [Paper]
- Virtual Fitting Room: Generating Arbitrarily Long Videos of Virtual Try-On from a Single Image [Paper] [Project]
- PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation [Paper]
- Image as a World: Generating Interactive World from Single Image via Panoramic Video Generation [Paper]
- MotionRAG: Motion Retrieval-Augmented Image-to-Video Generation [Paper]
- ICLR
- SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generation [Paper] [Project] [Code]
- Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolation [Paper]
- Pyramidal Flow Matching for Efficient Video Generative Modeling [Paper] [Project] [Code]
- Framer: Interactive Frame Interpolation [Paper]
- Training-free Camera Control for Video Generation [Paper]
- MotionClone: Training-Free Motion Cloning for Controllable Video Generation [Paper]
- Trajectory attention for fine-grained video motion control [Paper]
- I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strength [Paper]
- ViBiDSampler: Enhancing Video Interpolation Using Bidirectional Diffusion Sampler [Paper]
- AAAI
- Image Conductor: Precision Control for Interactive Video Synthesis [Paper]
- TIV-Diffusion: Towards Object-Centric Movement for Text-driven Image to Video Generation [Paper]
- TrackGo: A Flexible and Efficient Method for Controllable Video Generation [Paper]
- CAGE: Unsupervised Visual Composition and Animation for Controllable Video Generation [Paper]
- ICML
- SIGGRAPH
- FlexiAct: Towards Flexible Action Control in Heterogeneous Scenarios [Paper]
- MotionCanvas: Cinematic Shot Design with Controllable Image-to-Video Generation [Paper]
- Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Control [Paper]
- Reenact Anything: Semantic Video Motion Transfer Using Motion-Textual Inversion [Paper]
- Generating Past and Future in Digital Painting Processes [Paper]
- ACM MM
- CVPR
-
Year 2024
- CVPR
- ECCV
- Rethinking Image-to-Video Adaptation: An Object-centric Perspective [Paper]
- PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generation [Paper] [Code] [Project]
- MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model [Paper] [Code] [Project]
- AAAI
- Decouple Content and Motion for Conditional Image-to-Video Generation [Paper]
- NeurIPS
- ICML
- arXiv
- ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generation [Paper] [Code] [Project]
- I2V-Adapter: A General Image-to-Video Adapter for Diffusion Models [Paper] [Code]
- Follow-Your-Click: Open-domain Regional Image Animation via Short Prompts [Paper] [Code] [Project]
- AtomoVideo: High Fidelity Image-to-Video Generation [Paper] [Project] [Video]
- Pix2Gif: Motion-Guided Diffusion for GIF Generation [Paper] [Code] [Project]
- ID-Animator: Zero-Shot Identity-Preserving Human Video Generation [Paper] [Code] [Project]
- Tuning-Free Noise Rectification for High Fidelity Image-to-Video Generation [Paper] [Project]
- MegActor-Σ: Unlocking Flexible Mixed-Modal Control in Portrait Animation with Diffusion Transformer [Paper] [Code]
- LeviTor: 3D Trajectory Oriented Image-to-Video Synthesis [Paper] [Code] [Project] [Demo]
-
Year 2023
- CVPR
- arXiv
- I2VGen-XL: High-quality Image-to-video Synthesis via Cascaded Diffusion Models [Paper] [Code] [Project]
- DreamVideo: High-Fidelity Image-to-Video Generation with Image Retention and Text Guidance [Paper] [Code] [Project]
- DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors [Paper] [Project] [Code] [Video] [Demo]
- AnimateDiff: Animate Your Personalized Text-to-image Diffusion Models without Specific Tuning [Paper] [Project]
-
Year 2022
-
Year 2021
- Year 2025
- ICCV
- FixTalk: Taming Identity Leakage for High-Quality Talking Head Generation in Extreme Cases [Paper]
- FLOAT: Generative Motion Latent Flow Matching for Audio-driven Talking Portrait [Paper]
- AV-Link: Temporally-Aligned Diffusion Features for Cross-Modal Audio-Video Generation [Paper]
- Audio-visual Controlled Video Diffusion with Masked Selective State Spaces Modeling for Natural Talking Head Generation [Paper]
- DiTaiListener: Controllable High Fidelity Listener Video Generation with Diffusion [Paper]
- NeurIPS
- Audio-Sync Video Generation with Multi-Stream Temporal Control [Paper]
- ICML
- AAAI
- EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditions [Paper]
- MoDiTalker: Motion-Disentangled Diffusion Model for High-Fidelity Talking Head Generation [Paper]
- AnyTalk: Multi-modal Driven Multi-domain Talking Head Generation [Paper]
- InstructAvatar: Text-Guided Emotion and Motion Control for Avatar Generation [Paper]
- GoHD: Gaze-oriented and Highly Disentangled Portrait Animation with Rhythmic Poses and Realistic Expressions [Paper]
- ACM MM
- M2PE-Diff: Music-to-Pose Encoder for Dance Video Generation Leveraging Latent Diffusion Framework [Paper]
- ChoreoMuse: Robust Music-to-Dance Video Generation with Style Transfer and Beat-Adherent Motion [Paper]
- Ditto: Motion-Space Diffusion for Controllable Realtime Talking Head Synthesis [Paper]
- FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesis [Paper]
- Disentangle Identity, Cooperate Emotion: Correlation-Aware Emotional Talking Portrait Generation [Paper]
- FLAP: Fully-controllable Audio-driven Portrait Video Generation through 3D head conditioned diffusion model [Paper]
- SpA2V: Harnessing Spatial Auditory Cues for Audio-driven Spatially-aware Video Generation [Paper]
- ICCV
- Year 2024
- Year 2023
- Year 2025
- ICCV
- NeurIPS
- ICLR
- TweedieMix: Improving Multi-Concept Fusion for Diffusion-based Image/Video Generation [Paper]
- AAAI
- SIGGRAPH
- Dynamic Concepts Personalization from Single Videos [Paper]
- ACM MM
- Separate Motion from Appearance: Customizing Motion via Customizing Text-to-Video Diffusion Models [Paper]
- Tora2: Motion and Appearance Customized Diffusion Transformer for Multi-Entity Video Generation [Paper]
- LaVieID: Local Autoregressive Diffusion Transformers for Identity-Preserving Video Creation [Paper]
- Year 2024
- CVPR
- ICCV
- PersonalVideo: PersonalVideo: High ID‑Fidelity Video Customization without Dynamic and Semantic Degradation [Paper] [Project] [Code]
- MagicID: MagicID: Hybrid Preference Optimization for ID‑Consistent and Dynamic‑Preserved Video Customization [Paper] [Project] [Code]
- DreamRelation: DreamRelation: Relation‑Centric Video Customization [Paper] [Project]
⚠️ PERSONA: PERSONA: Personalized Whole‑Body 3D Avatar with Pose‑Driven Deformations from a Single Image
- ECCV
- arXiv
- Year 2023
- arXiv
- FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention [Paper] [Code] [Demo]
- Make-Your-Video: Customized Video Generation Using Textual and Structural Guidance [Paper] [Project]
- DreamVideo-2: Zero-Shot Subject-Driven Video Customization with Precise Motion Control [Paper] [Project]
- arXiv
- Year 2026
- Year 2025
- CVPR
- VideoDirector: Precise Video Editing via Text-to-Video Models [Paper] [Code]
- VideoMage: Multi-Subject and Motion Customization of Text-to-Video Diffusion Models [Paper] [Project]
- Visual Prompting for One-shot Controllable Video Editing without Inversion [Paper] [Project]
- SketchVideo: Sketch-based Video Generation and Editing [Paper] [Code] [Project]
- h-Edit: Effective and Flexible Diffusion-Based Editing via Doob's h-Transform [Paper] [Code] [Project]
- ObjectMover: Generative Object Movement with Video Prior [Paper] [Project]
- MatAnyone: Stable Video Matting with Consistent Memory Propagation [Paper] [Code] [Project]
- StyleMaster: Stylize Your Video with Artistic Generation and Translation [Paper] [Code] [Project]
- AudCast: Audio-Driven Human Video Generation by Cascaded Diffusion Transformers [Paper] [Project]
⚠️ FADE: Frequency-Aware Diffusion Model Factorization for Video Editing [Paper] [Code]⚠️ Align-A-Video: Deterministic Reward Tuning of Image Diffusion Models for Consistent Video Editing⚠️ Unity in Diversity: Video Editing via Gradient-Latent Purification- ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuning [Paper]
- Unboxed: Geometrically and Temporally Consistent Video Outpainting [Paper]
- Pursuing Temporal-Consistent Video Virtual Try-On via Dynamic Pose Interaction [Paper]
- VIRES: Video Instance Repainting via Sketch and Text Guided Generation [Paper] [Project] [Code]
- AniDoc: Animation Creation Made Easier [Paper]
- Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Dataset [Paper]
- Video Motion Transfer with Diffusion Transformers [Paper] [Project] [Code]
- Generative Video Propagation [Paper]
- VideoHandles: Editing 3D Object Compositions in Videos Using Video Generative Priors [Paper]
- V-Stylist: Video Stylization via Collaboration and Reflection of MLLM Agents [Paper] [Project]
- Keyframe-Guided Creative Video Inpainting [Paper]
- HomoGen: Enhanced Video Inpainting via Homography Propagation and Diffusion [Paper]
- ICCV
- VACE: All-in-One Video Creation and Editing [Paper] [Project] [Code]
- Reangle-A-Video: 4D Video Generation as Video-to-Video Translation [Paper] [Project]
- DIVE: Taming DINO for Subject-Driven Video Editing [Paper] [Project]
- DynamicFace: High-Quality and Consistent Face Swapping for Image and Video using Composable 3D Facial Priors [Paper] [Project]
- QK-Edit: Revisiting Attention-based Injection in MM-DiT for Image and Video Editing [Paper]
- Teleportraits: Training-Free People Insertion into Any Scene [Paper]
- A Unified Framework for Industrial Cel-Animation Colorization with Temporal-Structural Awareness [Paper]
- ReCamMaster: Camera-Controlled Generative Rendering from A Single Video [Paper]
- Beyond the Frame: Generating 360deg Panoramic Videos from Perspective Videos [Paper]
- FlowStyler: Artistic Video Stylization via Transformation Fields Transports [Paper]
- VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generation [Paper]
- BVINet: Unlocking Blind Video Inpainting with Zero Annotations [Paper]
- LongAnimation: Long Animation Generation with Dynamic Global-Local Memory [Paper]
- CanonSwap: High-Fidelity and Consistent Video Face Swapping via Canonical Space Modulation [Paper]
- Controllable Weather Synthesis and Removal with Video Diffusion Models [Paper]
- Light-A-Video: Training-free Video Relighting via Progressive Light Fusion [Paper]
- SUV: Suppressing Undesired Video Content via Semantic Modulation Based on Text Embeddings [Paper]
- InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Construction [Paper]
- TACO: Taming Diffusion for in-the-wild Video Amodal Completion [Paper]
- NeurIPS
- RoPECraft: Training-Free Motion Transfer with Trajectory-Guided RoPE Optimization on Diffusion Transformers [Paper]
- IllumiCraft: Unified Geometry and Illumination Diffusion for Controllable Video Generation [Paper]
- TC-Light: Temporally Coherent Generative Rendering for Realistic World Transfer [Paper]
- MiniMax-Remover: Taming Bad Noise Helps Video Object Removal [Paper] [Project]
- UniRelight: Learning Joint Decomposition and Synthesis for Video Relighting [Paper] [Project]
- Imagine360: Immersive 360 Video Generation from Perspective Anchor [Paper]
- ZeroPatcher: Training-free Sampler for Video Inpainting and Editing [Paper]
- ROSE: Remove Objects with Side Effects in Videos [Paper]
- DisMo: Disentangled Motion Representations for Open-World Motion Transfer [Paper] [Project]
- Dynamic Shadow Unveils Invisible Semantics for Video Outpainting [Paper]
- ICLR
- ICML
- AAAI
- FreeMask: Rethinking the Importance of Attention Masks for Zero-Shot Video Editing [Paper]
- Infinite-Canvas: Higher-Resolution Video Outpainting with Extensive Content Generation [Paper]
- Elevating Flow-Guided Video Inpainting with Reference Generation [Paper]
- Video Diffusion Models Are Strong Video Inpainter [Paper]
- DriveEditor: A Unified 3D Information-Guided Framework for Controllable Object Editing in Driving Scenes [Paper]
- Re-Attentional Controllable Video Diffusion Editing [Paper]
- SIGGRAPH
- ACM MM
- AnchorSync: Global Consistency Optimization for Long Video Editing [Paper]
- AnimeColor: Reference-based Animation Colorization with Diffusion Transformers [Paper] [Code]
- ColorDiffuser: Video Colorization with Pretrained Text-to-Image Diffusion Models [Paper]
- 3DV-TON: Textured 3D-Guided Consistent Video Try-on via Diffusion Models [Paper] [Code]
- Single Trajectory Distillation for Accelerating Image and Video Style Transfer [Paper]
- Learning Evidential Delta Denoising Scores for Video Editing [Paper]
- HairShifter: Consistent and High-Fidelity Video Hair Transfer via Anchor-Guided Animation [Paper]
- CVPR
- Year 2024
- CVPR
- VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models [Paper] [Code] [Project]
- Fairy: Fast Parallellized Instruction-Guided Video-to-Video Synthesis [Paper] [Project]
- CCEdit: Creative and Controllable Video Editing via Diffusion Models [Paper] [Code] [Project] [Video]
- DynVideo-E: Harnessing Dynamic NeRF for Large-Scale Motion- and View-Change Human-Centric Video Editing [Paper] [Project] [Video]
- Video-P2P: Video Editing with Cross-attention Control [Paper] [Code] [Project]
- A Video is Worth 256 Bases: Spatial-Temporal Expectation-Maximization Inversion for Zero-Shot Video Editing [Paper] [Code] [Project]
- MaskINT: Video Editing via Interpolative Non-autoregressive Masked Transformers [Paper] [Code] [Project]
- VidToMe: Video Token Merging for Zero-Shot Video Editing [Paper] [Code] [Project] [Video]
- Towards Language-Driven Video Inpainting via Multimodal Large Language Models [Paper] [Code] [Project] [Dataset]
- AVID: Any-Length Video Inpainting with Diffusion Model [Paper] [Code] [Project]
- CAMEL: CAusal Motion Enhancement tailored for Lifting Text-driven Video Editing [Paper] [Code]
- Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfer [Paper] [Code] [Project]
- FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation [Paper] [Code] [Project]
- MotionEditor: Editing Video Motion via Content-Aware Diffusion [Paper] [Code] [Project]
- ECCV
- DragVideo: Interactive Drag-style Video Editing [Paper]
- Video Editing via Factorized Diffusion Distillation [Paper]
- OCD: Object-Centric Diffusion for Efficient Video Editing [Paper] [Project]
- DreamMotion: Space-Time Self-Similarity Score Distillation for Zero-Shot Video Editing [Paper] [Project]
- WAVE: Warping DDIM Inversion Features for Zero-shot Text-to-Video Editing [Paper] [Project]
- DeCo: Decoupled Human-Centered Diffusion Video Editing with Motion Consistency [Paper]
- SAVE: Protagonist Diversification with Structure Agnostic Video Editing [Paper] [Code]
- Videoshop: Localized Semantic Video Editing with Noise-Extrapolated Diffusion Inversion [Paper] [Code] [Project]
- ICLR
- Ground-A-Video: Zero-shot Grounded Video Editing using Text-to-image Diffusion Models [Paper] [Code] [Project]
- TokenFlow: Consistent Diffusion Features for Consistent Video Editing [Paper] [Code] [Project]
- Consistent Video-to-Video Transfer Using Synthetic Dataset [Paper] [Code]
- FLATTEN: Optical FLow-guided ATTENtion for Consistent Text-to-Video Editing [Paper] [Code] [Project]
- SIGGRAPH
- arXiv
- Spectral Motion Alignment for Video Motion Transfer using Diffusion Models [Paper] [Code] [Project]
- UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editing [Paper] [Code] [Project]
- DragAnything: Motion Control for Anything using Entity Representation [Paper] [Code] [Project]
- AnyV2V: A Plug-and-Play Framework for Any Video-to-Video Editing Tasks [Paper] [Code] [Project]
- CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibility [Paper] [Code] [Project]
- VASE: Object-Centric Appearance and Shape Manipulation of Real Videos [Paper]
- StableV2V: Stablizing Shape Consistency in Video-to-Video Editing [Paper] [Code] [Project] [Dataset]
- Motion Inversion for Video Customization [Paper] [Code] [Demo]
- VideoAnydoor: High-fidelity Video Object Insertion with Precise Motion Control [Paper] [Project]
- CVPR
- Year 2023
- CVPR
- ICCV
- NeurIPS
- Towards Consistent Video Editing with Text-to-Image Diffusion Models [Paper]
- SIGGRAPH
- arXiv
- Year 2022
- Year 2026
- Year 2025
- CVPR
- X-Dyna: Expressive Dynamic Human Image Animation [Paper] [Code]
- StableAnimator: High-Quality Identity-Preserving Human Image Animation [Paper] [Project] [Code]
- MVPortrait: Text-Guided Motion and Emotion Control for Multi-view Vivid Portrait Animation [Paper]
- Synergizing Motion and Appearance: Multi-Scale Compensatory Codebooks for Talking Head Video Generation [Paper] [Project] [Code]
- High-Fidelity Relightable Monocular Portrait Animation with Lighting-Controllable Video Diffusion Model [Paper] [Project] [Code]
- HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animation [Paper] [Project] [Code]
- ICCV
- DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidance [Paper] [Project]
- Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordance [Paper] [Project] [Code]
- Multi-identity Human Image Animation: Multi-identity Human Image Animation with Structural Video Diffusion [Paper]
- OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Models [Paper] [Project]
- AdaHuman: Animatable Detailed 3D Human Generation with Compositional Multiview Diffusion [Paper] [Project]
- Ponimator: Unfolding Interactive Pose for Versatile Human-human Interaction Animation [Paper]
- X-Dancer: Expressive Music to Human Dance Video Generation [Paper]
- GReg: Geometry-Aware Region Refinement for Sign Language Video Generation [Paper]
- Democratizing High-Fidelity Co-Speech Gesture Video Generation [Paper]
- NeurIPS
- OmniSync: Towards Universal Lip Synchronization via Diffusion Transformers [Paper]
- EverybodyDance: Bipartite Graph–Based Identity Correspondence for Multi-Character Animation [Paper]
- OmniTalker: One-shot Real-time Text-Driven Talking Audio-Video Generation With Multimodal Style Mimicking [Paper]
- Let Them Talk: Audio-Driven Multi-Person Conversational Video Generation [Paper]
- Advanced Sign Language Video Generation with Compressed and Quantized Multi-Condition Tokenization [Paper] [Code]
- ICLR
- Animate-X: Universal Character Image Animation with Enhanced Motion Representation [Paper] [Project] [Code]
- CyberHost: A One-stage Diffusion Framework for Audio-driven Talking Body Generation [Paper]
- DAWN: Dynamic Frame Avatar with Non-autoregressive Diffusion Framework for Talking head Video Generation [Paper]
- Towards Multiple Character Image Animation Through Enhancing Implicit Decoupling [Paper]
- Loopy: Taming Audio-Driven Portrait Avatar with Long-Term Motion Dependency [Paper]
- Hallo2: Long-Duration and High-Resolution Audio-Driven Portrait Image Animation [Paper]
- AAAI
- SIGGRAPH
- Interspatial Attention for Efficient 4D Human Video Generation [Paper]
- ACM MM
- arXiv
- EgoControl: Controllable Egocentric Video Generation via 3D Full-Body Poses [Paper] [Project] [Code]
- UniAnimate-DiT: Human Image Animation with Large-Scale Video Diffusion Transformer [Paper] [Project] [Code]
- DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidance [Paper] [Project]
- Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordance [Paper] [Project]
- CVPR
- Year 2024
- CVPR
- ICLR
- arXiv
- MikuDance: Animating Character Art with Mixed Motion Dynamics [Paper] [Project] [Code]
- MimicMotion: High Quality Human Image Animation using Regional Supervision and Motion Blur Condition [Paper] [Code] [Project]
- VividPose: Advancing Stable Video Diffusion for Realistic Human Image Animation [Paper] [Project] [Code]
- MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modeling [Paper] [Project] [Code]
- DynamicCtrl: Rethinking the Basic Structure and the Role of Text for High-quality Human Image Animation [Paper] [Project] [Code]
- HumanDiT: Pose-Guided Diffusion Transformer for Long-form Human Motion Video Generation [Paper] [Project]
- Disentangling Foreground and Background Motion for Enhanced Realism in Human Video Generation: [Paper] [Project]
- DreamDance: Animating Human Images by Enriching 3D Geometry Cues from 2D Poses [Paper] [Project] [Code]
- [arXiv 2012] UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild [Paper] [Dataset]
- [arXiv 2017] DAVIS: The 2017 DAVIS Challenge on Video Object Segmentation [Paper] [Dataset]
- [ICCV 2019] FaceForensics++: Learning to Detect Manipulated Facial Images [Paper] [Code]
- [NeurIPS 2019] TaiChi-HD: First Order Motion Model for Image Animation [Paper] [Dataset]
- [ECCV 2020] SkyTimeLapse: DTVNet: Dynamic Time-lapse Video Generation via Single Still Image [Paper] [Code]
- [ICCV 2021] WebVid-10M: Frozen in Time: ️A Joint Video and Image Encoder for End to End Retrieval [Paper] [Dataset] [Code] [Project]
- [ICCV 2021] WebVid-10M: Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval [Paper] [Dataset] [Project]
- [ECCV 2022] ROS: Learning to Drive by Watching YouTube Videos: Action-Conditioned Contrastive Policy Pretraining [Paper] [Code] [Dataset]
- [arXiv 2023] HD-VG-130M: VideoFactory: Swap Attention in Spatiotemporal Diffusions for Text-to-video Generation [Paper] [Dataset]
- [NeurIPS 2023] FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generation [Paper] [Code]
- [ICLR 2024] InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generation [Paper] [Dataset]
- [CVPR 2024] Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers [Paper] [Dataset] [Project]
- [arXiv 2024] VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models [Paper] [Dataset]
- [CVPR 2025] HOIGen-1M: A Large-scale Dataset for Human-Object Interaction Video Generation [Paper] [Dataset]
- [CVPR 2025] VEU-Bench: Towards Comprehensive Understanding of Video Editing [Paper]
- [CVPR 2025] Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Content [Paper] [Dataset]
- [CVPR 2025] MovieBench: A Hierarchical Movie Level Dataset for Long Video Generation [Paper]
- [CVPR 2025] TASTE-Rob: Advancing Video Generation of Task-Oriented Hand-Object Interaction for Generalizable Robotic Manipulation [Paper] [Dataset]
- [CVPR 2025] OpenHumanVid: A Large-Scale High-Quality Dataset for Enhancing Human-Centric Video Generation [Paper]
- MiniMax H3 1K Prompt Curation: curated index of the MiniMax H3 1K prompt dataset (1,000 prompts + 768p videos) — 3-field prompt anatomy, 10 hand-picked reusable prompts, and a model comparison. [Curated repo] [Interactive atlas]
- [ICCV 2025] DH-FaceVid-1K: A Large-Scale High-Quality Dataset for Face Video Generation [Paper]
- [CVPR 2025] T2V-CompBench:* A Comprehensive Benchmark for Compositional Text-to-video Generation [Paper] [Project] [Code]
- [AAAI 2025] EditBoard: Towards a Comprehensive Evaluation Benchmark for Text-Based Video Editing Models [Paper]
- [ICLR 2025] Beyond FVD: An Enhanced Evaluation Metrics for Video Generation Distribution Quality [Paper]
- [ICLR 2025] VideoPhy: Evaluating Physical Commonsense for Video Generation [Paper]
- [CVPR 2025] Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generation [Paper] [Project] [Code]
- [CVPR 2025] Video-Bench: Human-Aligned Video Generation Benchmark [Paper]
- [CVPR 2025] Neuro-Symbolic Evaluation of Text-to-Video Models using Formal Verification [Paper] [Project] [Code]
- [ICML 2025] TRAJAN: Direct Motion Models for Assessing Generated Videos [Paper] [Project]
- [ICML 2025] IPV-Bench: Impossible Videos [Paper] [Project]
- [ICML 2025] How Far Is Video Generation from World Model: A Physical Law Perspective [Paper] [Project]
- [ICML 2025] Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generation [Paper]
- [ICML 2025] GRADEO: Towards Human-Like Evaluation for Text-to-Video Generation via Multi-Step Reasoning [Paper]
- [ICML 2025] WorldSimBench: Towards Video Generation Models as World Simulators [Paper]
- [ACM MM 2025] EditEval: Towards Comprehensive and Automatic Evaluation for Text-guided Video Editing [Paper]
- [ACM MM 2025] FingER: Content Aware Fine-grained Evaluation with Reasoning for AI-Generated Videos [Paper] [Code]
- [NeurIPS 2025] MJ-Video: Benchmarking and Rewarding Video Generation with Fine-Grained Video Preference [Paper]
- [arXiv 2024] Davis-Edit: Stablizing Shape Consistency in Video-to-Video Editing [Paper] [Project] [Code]
- [CVPR 2024] VBench: Comprehensive Benchmark Suite for Video Generative Models [Paper] [Code]
- [ICCV 2023] DOVER: Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectives [Paper] [Code]
- [ICLR 2019] FVD: A New Metric for Video Generation [Paper] [Code]
- [arXiv 2025] VideoScore2: Think before You Score in Generative Video Evaluation [Paper] [Project] [Code]
- [arXiv 2026] PVSync: A Unified Lip-Sync Expert for Timing and Articulation [Paper]
- [ICCV 2025] Who is a Better Talker: Subjective and Objective Quality Assessment for AI-Generated Talking Heads [Paper]
- [ICCV 2025] ETVA: Evaluation of Text-to-Video Alignment via Fine-grained Question Generation and Answering [Paper]
- [ICCV 2025] VMBench: A Benchmark for Perception-Aligned Video Motion Generation [Paper]
- [ICCV 2025] FiVE-Bench: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Models [Paper]
- Q: The conference sequence of this paper list?
- This paper list is organized according to the following sequence:
- CVPR
- ICCV
- ECCV
- NeurIPS
- ICLR
- AAAI
- ACM MM
- SIGGRAPH
- arXiv
- Others
- This paper list is organized according to the following sequence:
- Q: What does
Othersrefers to?- Some of the following studies (e.g.,
Sora) does not publish their technical report on arXiv. Instead, they tend to write a blog in their official websites. TheOtherscategory refers to such kind of studies.
- Some of the following studies (e.g.,
The reference.bib file summarizes bibtex references of up-to-date image inpainting papers, widely used datasets, and toolkits.
Based on the original references, I have made the following modifications to make their results look nice in the LaTeX manuscripts:
- Refereces are normally constructed in the form of
author-etal-year-nickname. Particularly, references of datasets and toolkits are directly constructed asnickname, e.g.,imagenet. - In each reference, all names of conferences/journals are converted into abbreviations, e.g.,
Computer Vision and Pattern Recognition -> CVPR. - The
url,doi,publisher,organization,editor,seriesin all references are removed. - The
pagesof all references are added if they are missing. - All paper names are in title case. Besides, I have added an additional
{}to make sure that the title case would also work well in some particular templates.
If you have other demands of reference formats, you may refer to the original references of papers by searching their names in DBLP or Google Scholar.
