Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
FantasyPortrait: Enhancing Multi-Character Portrait Animation with Expression-Augmented Diffusion Transformers
| Date | Stars |
|---|---|
| 2026-07-24 | 511 |
| 2026-07-25 | 511 |
| 2026-07-28 | 511 |
| 2026-07-30 | 511 |
| 2026-08-07 | 511 |
| 2026-08-15 | 509 |
| 2026-08-20 | 508 |
| 2026-08-30 | 507 |
| 2026-09-03 | 508 |
| 2026-09-14 | 509 |
| 2026-09-20 | 509 |
Today
— stars today
This week
+1 stars this week
This month
+1 stars this month
Momentum
0.0
growth rate 0.20%/day
[中文阅读](./README_zh.md) # FantasyPortrait: Enhancing Multi-Character Portrait Animation with Expression-Augmented Diffusion Transformers [](https://fantasy-amap.github.io/fantasy-portrait/) [](https://arxiv.org/abs/2507.12956) [](https://huggingface.co/datasets/acvlab/FantasyPortrait-Multi-Expr) [](https://huggingface.co/acvlab/FantasyPortrait) [](https://huggingface.co/papers/2507.12956) [](https://modelscope.cn/models/amap_cvlab/FantasyPortrait) [](https://www.modelscope.cn/datasets/amap_cvlab/FantasyPortrait-Multi-Expr) ## 🔥 Latest News!! * August 14, 2025: Our work is merged to [ComfyUI-Wan](https://github.com/kijai/ComfyUI-WanVideoWrapper/tree/main/fantasyportrait) ! Thank [kijai](https://github.com/kijai) for the update 👏! * August 12, 2025: We released the inference code, model weights and datasets. ## Demo For more interesting results, please visit our [website](https://fantasy-amap.github.io/fantasy-portrait/). |  |  | | :---: | :---: | |  |  | |  |  | ## Quickstart ### 🛠️Installation Clone the repo: ``` git clone https://github.com/Fantasy-AMAP/fantasy-portrait.git cd fantasy-portrait ``` Install dependencies: ``` apt-get install ffmpeg # Ensure torch >= 2.0.0 pip install -r requirements.txt # Note: flash attention must be installed pip install flash_attn ``` ### 📦Multi-Expr Dataset We make public the first multi-portrait facial expression video dataset **Multi-Expr Dataset**, Please download it via the [ModelScope](https://www.modelscope.cn/datasets/amap_cvlab/FantasyPortrait-Multi-Expr) or [Huggingface](https://huggingface.co/datasets/acvlab/FantasyPortrait-Multi-Expr). ### 🧱Model Download | Models | Download Link | Notes | | --------------|-------------------------------------------------------------------------------|-------------------------------| | Wan2.1-I2V-14B-720P | 🤗 [Huggingface](https://huggingface.co/Wan-AI/Wan2.1-I2V-14B-720P) 🤖 [ModelScope](https://www.modelscope.cn/models/Wan-AI/Wan2.1-I2V-14B-720P) | Base model | FantasyPortrait | 🤗 [Huggingface](https://huggingface.co/acvlab/FantasyPortrait/) 🤖 [ModelScope](https://www.modelscope.cn/models/amap_cvlab/FantasyPortrait/) | Our emo condition weights Download models using huggingface-cli: ``` sh pip install "huggingface_hub[cli]" huggingface-cli download Wan-AI/Wan2.1-I2V-14B-720P --local-dir ./models/Wan2.1-I2V-14B-720P huggingface-cli download acvlab/FantasyPortrait --local-dir ./models ``` Download models using modelscope-cli: ``` sh pip install modelscope modelscope download Wan-AI/Wan2.1-I2V-14B-720P --local_dir ./models/Wan2.1-I2V-14B-720P modelscope download amap_cvlab/FantasyPortrait --local_dir ./models ``` ### 🔑 Single-Portrait Inference ``` sh bash infer_single.sh ``` ### 🔑 Multi-Portrait Inference If you use input image and drive videos with multiple people, you can run as follows: ``` sh bash infer_multi.sh ``` If you use input image with multiple people and different multiple single-human driven videos, you can run as follows: ```sh bash infer_multi_diff.sh ``` ### 📦Speed and VRAM Usage We present a detailed table here. The model is tested on a single A100. |`torch_dtype`|`nu
Excerpt of 5,466 characters
Read on GitHub
Wang Qiang
28
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:2550004b483d0742, topic:diffusion-models
matched fp:2550004b483d0742, topic:video-generation