Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
[TOG 2024]StyleCrafter: Enhancing Stylized Text-to-Video Generation with Style Adapter
| Date | Stars |
|---|---|
| 2026-07-31 | 272 |
| 2026-08-03 | 272 |
| 2026-08-06 | 272 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
# StyleCrafter: Enhancing Stylized Text-to-Video Generation with Style Adapter ### 🔥🔥🔥 [StyleCrafter on SDXL](https://github.com/GongyeLiu/StyleCrafter-SDXL) for stylized image generation is available! Enabling higher resolution(1024×1024) and more visually pleasing! <div align="center"> <a href='https://arxiv.org/abs/2312.00330'><img src='https://img.shields.io/badge/arXiv-2312.00330-b31b1b.svg'></a> <a href='https://gongyeliu.github.io/StyleCrafter.github.io/'><img src='https://img.shields.io/badge/Project-Page-Green'></a> <a href='https://huggingface.co/spaces/liuhuohuo/StyleCrafter'><img src='https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Demo-blue'></a> <br> <a href='https://github.com/GongyeLiu/StyleCrafter'><img src='https://img.shields.io/badge/StyleCrafter-VideoCrafter-darkcyan'></a> <a href='https://github.com/GongyeLiu/StyleCrafter-SDXL'><img src='https://img.shields.io/badge/StyleCrafter-SDXL-darkcyan'></a> _**[GongyeLiu](https://github.com/GongyeLiu), [Menghan Xia*](https://menghanxia.github.io/), [Yong Zhang](https://yzhang2016.github.io), [Haoxin Chen](https://scholar.google.com/citations?user=6UPJSvwAAAAJ&hl=zh-CN&oi=ao), [Jinbo Xing](https://doubiiu.github.io/), <br>[Xintao Wang](https://xinntao.github.io/), [Yujiu Yang*](https://scholar.google.com/citations?user=4gH3sxsAAAAJ&hl=zh-CN&oi=ao), [Ying Shan](https://scholar.google.com/citations?hl=en&user=4oXBp9UAAAAJ&view_op=list_works&sortby=pubdate)**_ <br><br> (* corresponding authors) From Tsinghua University and Tencent AI Lab. </div> ## 🔆 Introduction **TL;DR:** We propose StyleCrafter, a generic method that enhances pre-trained T2V models with style control, supporting Style-Guided Text-to-Image Generation and Style-Guided Text-to-Video Generation. <br> ### 1. ⭐⭐ Style-Guided Text-to-Video Generation. <div align="center"> <img src=docs/showcase_1.gif> <p>Style-guided text-to-video results. Resolution: 320 x 512; Frames: 16. (Compressed)</p> </div> ### 2. Style-Guided Text-to-Image Generation. <div align="center"> <img src=docs/showcase_img.jpeg> <p>Style-guided text-to-image results. Resolution: 512 x 512. (Compressed)</p> </div> ## 📝 Changelog - __[2025.02.18]__: Upload the [full test set](./eval_data/README.md). - __[2024.07.14]__: 🔥🔥 Remove watermarks! We finetune temporal blocks on non-watermark data with 500 steps, download updated checkpoints [here](https://huggingface.co/liuhuohuo/StyleCrafter/blob/main/temporal_v1_1.pth). - __[2024.06.25]__: 🔥🔥 Support [StyleCrafter on SDXL](https://github.com/GongyeLiu/StyleCrafter-SDXL)! - __[2023.12.08]__: Release the Huggingface online [demo](https://huggingface.co/spaces/liuhuohuo/StyleCrafter). - __[2023.12.05]__: Release the code and checkpoint. - __[2023.11.30]__: Release the project page. ## 🧰 Models |Base Model| Gen Type | Resolution | Checkpoint | How to run | |:---------|:---------|:--------|:--------|:--------| |VideoCrafter| Image/Video |320x512|[Hugging Face](https://huggingface.co/liuhuohuo/StyleCrafter/tree/main)| [StyleCrafter on VideoCrafter](https://github.com/GongyeLiu/StyleCrafter) |SDXL| Image |1024x1024|[Hugging Face](https://huggingface.co/liuhuohuo/StyleCrafter-SDXL)| [StyleCrafter on SDXL](https://github.com/GongyeLiu/StyleCrafter-SDXL) It takes approximately 5 seconds to generate a 512×512 image and 85 seconds to generate a 320×512 video with 16 frames using a single NVIDIA A100 (40G) GPU. A GPU with at least 16G GPU memory is required to perform the inference process. ## ⚙️ Setup ```bash conda create -n stylecrafter python=3.8.5 conda activate stylecrafter pip install -r requirements.txt ``` ## 💫 Inference 1) Download all checkpoints according to the [instructions](./checkpoints/README.md) 2) Run the commands in terminal. ```bash # style-guided text-to-image generation sh script
Excerpt of 5,601 characters
Read on GitHubWould you bet a product on this? Bounded 0–100 and slow moving.
matched fp:84e6271a8d343c60, desc:video generation, desc:text-to-video