Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
[IJCV 2024] LaVie: High-Quality Video Generation with Cascaded Latent Diffusion Models
| Date | Stars |
|---|---|
| 2026-07-31 | 952 |
| 2026-08-06 | 952 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
# LaVie: High-Quality Video Generation with Cascaded Latent Diffusion Models
This repository is the official PyTorch implementation of [LaVie](https://arxiv.org/abs/2309.15103).
**LaVie** is a Text-to-Video (T2V) generation framework, and main part of video generation system [Vchitect](http://vchitect.intern-ai.org.cn/). You can also check our fine-tuned Image-to-Video (I2V) model [SEINE](https://github.com/Vchitect/SEINE).
[](https://arxiv.org/abs/2309.15103)
[](https://vchitect.github.io/LaVie-project/)
[](https://replicate.com/cjwbw/lavie)
[](https://huggingface.co/spaces/Vchitect/LaVie)
[](https://openxlab.org.cn/apps/detail/houshaowei/LaVie)
[](https://hits.seeyoufarm.com)
<!--
[]()
-->
## News
__[2024.07.08]__: **LaVie-2** will be released soon, stay tuned!
<video poster="https://github.com/Vchitect/LaVie/assets/7929326/f54662e9-7641-4173-99ca-db7592d086c3" preload="auto" src="https://github.com/Vchitect/LaVie/assets/7929326/196ee3ca-f106-433a-8edc-7803f2f11aa4" width="800"></video>
<!--
<img src="lavie.gif" width="800">
-->
## Installation
```
conda env create -f environment.yml
conda activate lavie
```
## Download Pre-Trained models
Download pre-trained [LaVie models](https://huggingface.co/YaohuiW/LaVie/tree/main), [Stable Diffusion 1.4](https://huggingface.co/CompVis/stable-diffusion-v1-4/tree/main), [stable-diffusion-x4-upscaler](https://huggingface.co/stabilityai/stable-diffusion-x4-upscaler/tree/main) to `./pretrained_models`. You should be able to see the following:
```
├── pretrained_models
│ ├── lavie_base.pt
│ ├── lavie_interpolation.pt
│ ├── lavie_vsr.pt
│ ├── stable-diffusion-v1-4
│ │ ├── ...
└── └── stable-diffusion-x4-upscaler
├── ...
```
Gallery:
<table class="center">
<tr>
<td><img src="assets/two_teddy_bears_playing_poker_under_water,_highly_detailed,_oil_painting_style.gif"></td>
<td><img src="assets/a_teddy_bear_skating_under_water,_highly_detailed.gif"></td>
<td><img src="assets/a_cat_reading_a_book_on_the_table,__Van_Gogh_style.gif"></td>
</tr>
<tr>
<td>two teddy bears playing poker under water, highly detailed, oil painting style</td>
<td>a teddy bear skateboarding under water, highly detailed</td>
<td>a cat reading a book on the table, Van Gogh style</td>
</tr>
<tr>
<td><img src="assets/a_cute_raccoon_playing_guitar_in_the_park_at_sunrise,_oil_painting_style.gif"></td>
<td><img src="assets/a_teddy_bear_walking_in_the_park_at_sunrise_oil_painting_style.gif"></td>
<td><img src="assets/laviea_teddy_bear_reading_a_book_near_a_small_river,_oil_painting_style-.gif"></td>
</tr>
<tr>
<td>a cute raccoon playing guitar in the park at sunrise, oil painting style</td>
<td>a teddy bear walking in the park at sunrise, oil painting style</td>
<td>a teddy bear reading a book near a small river, oil painting style</td>
</tr>
<tr>
<td><img src="assets/Elon_Musk_in_spacesuit_standing_besides_a_rocket,_high_quality05.gif"></td>
<td><img src="assets/a_teddy_bear_in_a__suit_having_dinner.gif"></td>
<td><img src="assets/Iron_Man_flying_in_the_sky.gif"></td>
</tr>
<tr>
<td>Elon Musk in a space suit standing besides a rocket, high quality</td>
<td>a teddy bear in a suit having dinner in a well-decorated house</td>
<td>Iron Man flying in the sky, 4k, high quality</td> Excerpt of 9,671 characters
Read on GitHub
111
2
Chenxi
1
Pooya Mohammadi Kazaj · Bern University, Hospital, Inselspital · Switzerland
1
1
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:c335f78b3045c219, desc:latent diffusion