This GitHub repository summarizes papers and resources related to the text-to-image (T2I) generation task.
Note
This document serves as the homepage of the whole GitHub repo. Papers are summarized according to different research directions, published years, and conferences.
The topics section summarizes papers that are highly related to T2I generation according to different properties, e.g., prerequisites of T2I generation, diffusion models with other techniques (e.g., Diffusion Transformer, LLMs, Mamba, etc.), and diffusion models for other tasks.
If you have any suggestions about this reåpository, please feel free to start a new issue or pull requests.
Recent news of this GitHub repo are listed as follows.
🔥 [Dec. 11th, 2025] Our paper titled "StableV2V: Stablizing Shape Consistency in Video-to-Video Editing" is accepted at TCSVT 2025!
🔥 [Nov. 19th] We have released our latest paper titled "StableV2V: Stablizing Shape Consistency in Video-to-Video Editing", with the correponding code, model weights, and a testing benchmark DAVIS-Edit open-sourced. Feel free to check them out from the links!
Click to see more information.
- [Apr. 26th] Update a new topic: Diffusion Models Meet Federated Learning. See the
topicssection for more details! - [Mar. 28th] The official AAAI 2024 paper list are released! Official version of PDFs and BibTeX references are updated accordingly.
- [Mar. 21th] The
topicssection has been updated. This section aims to offer paper lists that are summarized according to other properties of diffusion models, e.g., Diffusion Transformer-based methods, diffusion models for NLP, diffusion models integrated with LLMs, etc. The corresponding references of these papers are also concluded inreference.bib. - [Mar. 7th] All available CVPR, ICLR, and AAAI 2024 papers and references are updated.
- [Mar. 1st] Websites of the off-the-shelf text-to-image generation products and toolkits are summarized.
- Products
- To-Do Lists
- Papers
- Datasets
- Toolkits
- Q&A
- References
- Star History
- WeChat Group
- Published Papers on Conferences
- Update NeurIPS 2025 Papers
- Update ICCV 2025 Papers
- Update CVPR 2025 Papers
- Update ICLR 2025 Papers
- Update NeurIPS 2024 Papers
- Update ECCV 2024 Papers
- Update CVPR 2024 Papers
- Update
⚠️ Papers and References - Update arXiv References into the Official Version
- Update
- Update AAAI 2024 Papers
- Update
⚠️ Papers and References - Update arXiv References into the Official Version
- Update
- Update ICLR 2024 Papers
- Update NeurIPS 2023 Papers
- Regular Maintenance of Preprint arXiv Papers and Missed Papers
| Name | Year | Website | Specialties |
|---|---|---|---|
| AI Art Generator | 2025 | link | AI art generation platform with resolution presets, style transfer, upscaling, and video creation. |
| Nano Image Art | 2025 | link | Create stunning AI images — powered by Google's Nano Banana Pro for next-gen quality, smart editing, and intelligent prompts. |
| Fast Image AI | 2025 | link | Fast Image AI instantly transforms your photos into stunning styles like Ghibli, Sketch, and Pixar. Effortlessly control image elements and create amazing effects with just one click. |
| Gempix2 (Nano Banana 2) | 2025 | link | Free AI image generation platform with text-to-image, AI editing, and video generation support |
| Raphael AI | - | link | Free unlimited AI image generator (text-to-image, no signup) |
| Stable Diffusion 3 | 2024 | link | Diffusion Transformer-based Stable Diffusion |
| Stable Video | 2024 | link | High-quality high-resolution images |
| DALL-E 3 | 2023 | link | Collaborate with ChatGPT |
| Ideogram | 2023 | link | Text images |
| Playground | 2023 | link | Athestic images |
| HiDream.ai | 2023 | link | - |
| Dashtoon | 2023 | link | Text-to-Comic Generation |
| WHEE | 2023 | link | WHEE is an online AI generation tool, which can be applied for T2I generation, I2I generation, SR, inpainting, outpainting, image variation, virtural try-on, etc. |
| Vega AI | 2023 | link | Vega AI is an online AI generation tool, which can be applied for T2I generation, I2I generation, SR, T2V generation, I2V generation, etc. |
| Wujie AI | 2022 | link | The Chinese name is "无界AI", offering AIGC resources and online services |
| Midjourney | 2022 | link | Powerful close-sourced generation tool |
- Text-to-Image Generation
- Conditional Text-to-Image Generation
- Year 2024
- arXiv
- Controllable Generation with Text-to-Image Diffusion Models: A Survey [Paper]
- arXiv
- Year 2024
- Text-Guided Image Editing
- Year 2025
- CVPR
- PreciseCam: Precise Camera Control for Text-to-Image Generation [Paper] [Project] [Code]
- Type-R: Automatically Retouching Typos for Text-to-Image Generation [Paper] [Code]
- Compass Control: Multi Object Orientation Control for Text-to-Image Generation [Paper]
- Generative Photography: Scene-Consistent Camera Control for Realistic Text-to-Image Synthesis [Paper] [Project] [Code]
- One-Way Ticket: Time-Independent Unified Encoder for Distilling Text-to-Image Diffusion Models [Paper] [Code]
- Build a Text-to-Image Generator (from Scratch): Build your own vision transformer and diffusion models for text-to-image generation–from scratch! [Paid book]
- Text Embedding is Not All You Need: Attention Control for Text-to-Image Semantic Alignment with Text Self-Attention Maps [Paper]
- Towards Understanding and Quantifying Uncertainty for Text-to-Image Generation [Paper]
- Plug-and-Play Interpretable Responsible Text-to-Image Generation via Dual-Space Multi-facet Concept Control [Paper] [Project] [Code]
- Make It Count: Text-to-Image Generation with an Accurate Number of Objects [Paper] [Project] [Code]
- MCCD: Multi-Agent Collaboration-based Compositional Diffusion for Complex Text-to-Image Generation [Paper]
- Rethinking Training for De-biasing Text-to-Image Generation: Unlocking the Potential of Stable Diffusion [Paper]
- ShapeWords: Guiding Text-to-Image Synthesis with 3D Shape-Aware Prompts [Paper] [Project]
- SnapGen: Taming High-Resolution Text-to-Image Models for Mobile Devices with Efficient Architectures and Training [Paper]
- Spatial Transport Optimization by Repositioning Attention Map for Training-Free Text-to-Image Synthesis [Paper]
- Focus-N-Fix: Region-Aware Fine-Tuning for Text-to-Image Generation [Paper]
- SILMM: Self-Improving Large Multimodal Models for Compositional Text-to-Image Generation [Paper]
- Localized Concept Erasure for Text-to-Image Diffusion Models Using Training-Free Gated Low-Rank Adaptation [Paper]
- Self-Cross Diffusion Guidance for Text-to-Image Synthesis of Similar Subjects [Paper]
- Noise Diffusion for Enhancing Semantic Faithfulness in Text-to-Image Synthesis [Paper] [Code]
- Learning to Sample Effective and Diverse Prompts for Text-to-Image Generation [Paper]
- STEREO: A Two-Stage Framework for Adversarially Robust Concept Erasing from Text-to-Image Diffusion Models [Paper]
- Minority-Focused Text-to-Image Generation via Prompt Optimization [Paper] [Code]
- Scaling Down Text Encoders of Text-to-Image Diffusion Models [Paper] [Code]
- Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generation [Paper]
- Enhancing Creative Generation on Stable Diffusion-based Models [Paper]
- Aesthetic Post-Training Diffusion Models from Generic Preferences with Step-by-step Preference Optimization [Paper]
- Stretching Each Dollar: Diffusion Training from Scratch on a Micro-Budget [Paper]
- Diffusion-4K: Ultra-High-Resolution Image Synthesis with Latent Diffusion Models [Paper]
- Precise, Fast, and Low-cost Concept Erasure in Value Space: Orthogonal Complement Matters [Paper]
- T2ISafety: Benchmark for Assessing Fairness, Toxicity, and Privacy in Image Generation [Paper]
- ChatGen: Automatic Text-to-Image Generation From FreeStyle Chatting [Paper]
- Dual Diffusion for Unified Image Generation and Understanding [Paper]
- DyMO: Training-Free Diffusion Model Alignment with Dynamic Multi-Objective Scheduling [Paper]
- Erasing Undesirable Influence in Diffusion Models [Paper]
- Redefining <Creative> in Dictionary: Towards an Enhanced Semantic Understanding of Creative Generation [Paper]
- Six-CD: Benchmarking Concept Removals for Text-to-image Diffusion Models [Paper]
- NitroFusion: High-Fidelity Single-Step Diffusion through Dynamic Adversarial Training [Paper]
- ReNeg: Learning Negative Embedding with Reward Guidance [Paper]
- UniReal: Universal Image Generation and Editing via Learning Real-world Dynamics [Paper]
- OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flows [Paper]
- FAM Diffusion: Frequency and Attention Modulation for High-Resolution Image Generation with Stable Diffusion [Paper]
- DreamOmni: Unified Image Generation and Editing [Paper]
- Curriculum Direct Preference Optimization for Diffusion and Consistency Models [Paper]
- Dissecting and Mitigating Diffusion Bias via Mechanistic Interpretability [Paper]
- ACE: Anti-Editing Concept Erasure in Text-to-Image Models [Paper]
- One Diffusion to Generate Them All [Paper]
- Let's Verify and Reinforce Image Generation Step by Step [Paper]
- JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generation [Paper]
- Schedule On the Fly: Diffusion Time Prediction for Faster and Better Image Generation [Paper]
- Fine-Grained Erasure in Text-to-Image Diffusion-based Foundation Models [Paper]
- A Comprehensive Study of Decoder-Only LLMs for Text-to-Image Generation [Paper]
- Exploring Sparse MoE in GANs for Text-conditioned Image Synthesis [Paper]
- WeGen: A Unified Model for Interactive Multimodal Generation as We Chat [Paper]
- VerbDiff: Text-Only Diffusion Models with Enhanced Interaction Awareness [Paper]
- Memories of Forgotten Concepts [Paper]
- PQPP: A Joint Benchmark for Text-to-Image Prompt and Query Performance Prediction [Paper]
- Reward Fine-Tuning Two-Step Diffusion Models via Learning Differentiable Latent-Space Surrogate Reward [Paper]
- Calibrated Multi-Preference Optimization for Aligning Diffusion Models [Paper]
- InPO: Inversion Preference Optimization with Reparametrized DDIM for Efficient Diffusion Model Alignment [Paper]
- Enhancing Privacy-Utility Trade-offs to Mitigate Memorization in Diffusion Models [Paper]
- Spherical Manifold Guided Diffusion Model for Panoramic Image Generation [Paper]
- Towards Transformer-Based Aligned Generation with Self-Coherence Guidance [Paper]
- Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesis [Paper]
- Science-T2I: Addressing Scientific Illusions in Image Synthesis [Paper]
- Towards Better Alignment: Training Diffusion Models with Reinforcement Learning Against Sparse Rewards [Paper]
⚠️ The Illusion of Unlearning: The Unstable Nature of Machine Unlearning in Text-to-Image Diffusion Models [Paper]⚠️ Exploring the Deep Fusion of Large Language Models and Diffusion Transformers for Text-to-Image Synthesis [Paper]⚠️ Detect-and-Guide: Self-regulation of Diffusion Models for Safe Text-to-Image Generation via Guideline Token Optimization [Paper]⚠️ Multi-Group Proportional Representations for Text-to-Image Models [Paper]⚠️ VODiff: Controlling Object Visibility Order in Text-to-Image Generation [Paper]
- ICCV
- SANA-Sprint: One-Step Diffusion with Continuous-Time Consistency Distillation [Paper]
- Erasing More Than Intended? How Concept Erasure Degrades the Generation of Non-Target Concepts [Paper]
- Adversarial Distribution Matching for Diffusion Distillation Towards Efficient Image and Video Synthesis [Paper]
- Golden Noise for Diffusion Models: A Learning Framework [Paper]
- What Makes for Text to 360-degree Panorama Generation with Stable Diffusion? [Paper]
- EDiT: Efficient Diffusion Transformers with Linear Compressed Attention [Paper]
- TRCE: Towards Reliable Malicious Concept Erasure in Text-to-Image Diffusion Models [Paper]
- Enhancing Reward Models for High-quality Image Generation: Beyond Text-Image Alignment [Paper]
- Cycle Consistency as Reward: Learning Image-Text Alignment without Human Preferences [Paper]
- CAP: Evaluation of Persuasive and Creative Image Generation [Paper]
- FairGen: Enhancing Fairness in Text-to-Image Diffusion Models via Self-Discovering Latent Directions [Paper]
- Trade-offs in Image Generation: How Do Different Dimensions Interact? [Paper]
- TCFG: Truncated Classifier-Free Guidance for Efficient and Scalable Text-to-Image Acceleration [Paper]
- Dense2MoE: Restructuring Diffusion Transformer to MoE for Efficient Text-to-Image Generation [Paper]
- Holistic Unlearning Benchmark: A Multi-Faceted Evaluation for Text-to-Image Diffusion Model Unlearning [Paper]
- Fair Generation without Unfair Distortions: Debiasing Text-to-Image Generation with Entanglement-Free Attention [Paper]
- DIMCIM: A Quantitative Evaluation Framework for Default-mode Diversity and Generalization in Text-to-Image Generative Models [Paper]
- Rethinking Cross-Modal Interaction in Multimodal Diffusion Transformers [Paper]
- UniVG: A Generalist Diffusion Model for Unified Image Generation and Editing [Paper]
- FlowTok: Flowing Seamlessly Across Text and Image Tokens [Paper]
- From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuning [Paper]
- CuRe: Cultural Gaps in the Long Tail of Text-to-Image Systems [Paper]
- Penalizing Boundary Activation for Object Completeness in Diffusion Models [Paper]
- Decoding Correlation-Induced Misalignment in the Stable Diffusion Workflow for Text-to-Image Generation [Paper]
- Adaptive Routing of Text-to-Image Generation Requests Between Large Cloud Model and Light-Weight Edge Model [Paper]
- SuMa: A Subspace Mapping Approach for Robust and Effective Concept Erasure in Text-to-Image Diffusion Models [Paper]
- Leveraging Panoptic Scene Graph for Evaluating Fine-Grained Text-to-Image Generation [Paper]
- Meta-Unlearning on Diffusion Models: Preventing Relearning Unlearned Concepts [Paper]
- Sculpting Memory: Multi-Concept Forgetting in Diffusion Models via Dynamic Mask and Concept-Aware Optimization [Paper]
- LLM Thought Divergence and Convergence for Dialogue-Based Image Generation Control [Paper]
- Imbalance in Balance: Online Concept Balancing in Generation Models [Paper]
- Multimodal LLMs as Customized Reward Models for Text-to-Image Generation [Paper]
- The Silent Assistant: NoiseQuery as Implicit Guidance for Goal-Driven Image Generation [Paper]
- ShortFT: Diffusion Model Alignment via Shortcut-based Fine-Tuning [Paper]
- Rethinking DPO-style Diffusion Aligning Frameworks [Paper]
- VSC: Visual Search Compositional Text-to-Image Diffusion Model [Paper]
- Transformed Low-rank Adaptation via Tensor Decomposition and Its Applications to Text-to-image Models [Paper]
- InfGen: A Resolution-Agnostic Paradigm for Scalable Image Synthesis [Paper]
- FreeScale: Unleashing the Resolution of Diffusion Models via Tuning-Free Scale Fusion [Paper]
- Text Embedding Knows How to Quantize Text-Guided Diffusion Models [Paper]
- HPSv3: Towards Wide-Spectrum Human Preference Score [Paper]
- DC-AR: Efficient Masked Autoregressive Image Generation with Deep Compression Hybrid Tokenizer [Paper]
- DiTFastAttnV2: Head-wise Attention Compression for Multi-Modality Diffusion Transformers [Paper]
- IQA-Adapter: Exploring Knowledge Transfer from Image Quality Assessment to Diffusion-based Generative Models [Paper]
- Guiding Diffusion Models with Adaptive Negative Sampling Without External Resources [Paper]
- AlignGuard: Scalable Safety Alignment for Text-to-Image Generation [Paper]
- ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editing [Paper]
- X2I: Seamless Integration of Multimodal Understanding into Diffusion Transformer via Attention Distillation [Paper]
- T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generation [Paper]
- Lumina-Image 2.0: A Unified and Efficient Image Generative Framework [Paper]
- Scendi Score: Prompt-Aware Diversity Evaluation via Schur Complement of CLIP Embeddings [Paper]
- PUMA: Empowering Unified MLLM with Multi-granular Visual Generation [Paper]
- Democratizing Text-to-Image Masked Generative Models with Compact Text-Aware One-Dimensional Tokens [Paper]
- Reflect-DiT: Inference-Time Scaling for Text-to-Image Diffusion Transformers via In-Context Reflection [Paper]
- Supercharged One-step Text-to-Image Diffusion Models with Negative Prompts [Paper]
- IMG: Calibrating Diffusion Models via Implicit Multimodal Guidance [Paper]
- FairHuman: Boosting Hand and Face Quality in Human Image Generation with Minimum Potential Delay Fairness in Diffusion Models [Paper]
- Importance-Based Token Merging for Efficient Image and Video Generation [Paper]
- Scale Your Instructions: Enhance the Instruction-Following Fidelity of Unified Image Generation Model by Self-Adaptive Attention Scaling [Paper]
- Translation of Text Embedding via Delta Vector to Suppress Strongly Entangled Content in Text-to-Image Diffusion Models [Paper]
- Dual-Process Image Generation [Paper]
- LMM4LMM: Benchmarking and Evaluating Large-multimodal Image Generation with LMMs [Paper]
- Reusing Computation in Text-to-Image Diffusion for Efficient Generation of Image Sets [Paper]
- Scalable Ranked Preference Optimization for Text-to-Image Generation [Paper]
- Frequency-Aware Autoregressive Modeling for Efficient High-Resolution Image Synthesis [Paper]
- PLADIS: Pushing the Limits of Attention in Diffusion Models at Inference Time by Leveraging Sparsity [Paper]
- NeurIPS
- Rectified-CFG++ for Flow Based Models [Paper] [Code]
- Mitigating Sexual Content Generation via Embedding Distortion in Text-conditioned Diffusion Models [Paper]
- Adjusting Initial Noise to Mitigate Memorization in Text-to-Image Diffusion Models [Paper]
- Self-Supervised Direct Preference Optimization for Text-to-Image Diffusion Models [Paper]
- UltraHR-100K: Enhancing UHR Image Synthesis with A Large-Scale High-Quality Dataset [Paper] [Code]
- Localizing Knowledge in Diffusion Transformers [Paper]
- When Are Concepts Erased From Diffusion Models? [Paper]
- Towards Resilient Safety-driven Unlearning for Diffusion Models against Downstream Fine-tuning [Paper] [Code]
- Exploring Diffusion Transformer Designs via Grafting [Paper]
- Moment- and Power-Spectrum-Based Gaussianity Regularization for Text-to-Image Models [Paper]
- Scaling Diffusion Transformers Efficiently via $\mu$P [Paper]
- LightFair: Towards an Efficient Alternative for Fair T2I Diffusion via Debiasing Pre-trained Text Encoders [Paper] [Code]
- LEDiT: Your Length-Extrapolatable Diffusion Transformer without Positional Encoding [Paper] [Project]
- Fourier Token Merging: Understanding and Capitalizing Frequency Domain for Efficient Image Generation [Paper] [Code]
- Aligning Text-to-Image Diffusion Models to Human Preference by Classification [Paper]
- AR-RAG: Autoregressive Retrieval Augmentation for Image Generation [Paper]
- Unveiling Concept Attribution in Diffusion Models [Paper] [Code]
- FairImagen: Post-Processing for Bias Mitigation in Text-to-Image Models [Paper] [Code]
- Enhancing Text-to-Image Diffusion Transformer via Split-Text Conditioning [Paper]
- Inference-Time Scaling for Flow Models via Stochastic Generation and Rollover Budget Forcing [Paper]
- Towards Better & Faster Autoregressive Image Generation: From the Perspective of Entropy [Paper]
- ObCLIP: Oblivious CLoud-Device Hybrid Image Generation with Privacy Preservation [Paper]
- Ambient Diffusion Omni: Training Good Models with Bad Data [Paper]
- T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT [Paper]
- Flow-GRPO: Training Flow Matching Models via Online RL [Paper]
- RespoDiff: Dual-Module Bottleneck Transformation for Responsible & Faithful T2I Generation [Paper]
- Entropy Rectifying Guidance for Diffusion and Flow Models [Paper]
- Show-o2: Improved Native Unified Multimodal Models [Paper] [Code]
- LABridge: Text–Image Latent Alignment Framework via Mean-Conditioned OU Process [Paper]
- Re-ttention: Ultra Sparse Visual Generation via Attention Statistical Reshape [Paper]
- Ranking-based Preference Optimization for Diffusion Models from Implicit User Feedback [Paper] [Code]
- RepLDM: Reprogramming Pretrained Latent Diffusion Models for High-Quality, High-Efficiency, High-Resolution Image Generation [Paper] [Code]
- EraseFlow: Learning Concept Erasure Policies via GFlowNet-Driven Alignment [Paper]
- Speculative Jacobi-Denoising Decoding for Accelerating Autoregressive Text-to-image Generation [Paper]
- CURE: Concept Unlearning via Orthogonal Representation Editing in Diffusion Models [Paper]
- Training-Free Safe Text Embedding Guidance for Text-to-Image Diffusion Models [Paper] [Code]
- SPRO: Improving Image Generation via Self-Play [Paper]
- Continuous Concepts Removal in Text-to-image Diffusion Models [Paper] [Code]
- ASDSV: Multimodal Generation Made Efficient with Approximate Speculative Diffusion and Speculative Verification [Paper]
- SparseDiT: Token Sparsification for Efficient Diffusion Transformer [Paper] [Code]
- Diffusion Adaptive Text Embedding for Text-to-Image Diffusion Models [Paper] [Code]
- ScaleDiff: Higher-Resolution Image Synthesis via Efficient and Model-Agnostic Diffusion [Paper]
- A Gradient Guidance Perspective on Stepwise Preference Optimization for Diffusion Models [Paper] [Code]
- Compositional Discrete Latent Code for High Fidelity, Productive Diffusion Models [Paper]
- One-Step is Enough: Sparse Autoencoders for Text-to-Image Diffusion Models [Paper]
- Policy Optimized Text-to-Image Pipeline Design [Paper]
- Discovering Latent Graphs with GFlowNets for Diverse Conditional Image Generation [Paper]
- Diffusion Model as a Noise-Aware Latent Reward Model for Step-Level Preference Optimization [Paper]
- Reinforcement Learning Meets Masked Generative Models: Mask-GRPO for Text-to-Image Generation [Paper]
- Delving into RL for Image Generation with CoT: A Study on DPO vs. GRPO [Paper]
- STARFlow: Scaling Latent Normalizing Flows for High-resolution Image Synthesis [Paper] [Code]
- Transition Matching: Scalable and Flexible Generative Modeling [Paper]
- PAROAttention: Pattern-Aware ReOrdering for Efficient Sparse and Quantized Attention in Visual Generation Models [Paper]
- ALTER: All-in-One Layer Pruning and Temporal Expert Routing for Efficient Diffusion Generation [Paper]
- Training-Free Safe Denoisers for Safe Use of Diffusion Models [Paper]
- REPA Works Until It Doesn’t: Early-Stopped, Holistic Alignment Supercharges Diffusion Training [Paper]
- Normalized Attention Guidance: Universal Negative Guidance for Diffusion Models [Paper]
- PoGDiff: Product-of-Gaussians Diffusion Models for Imbalanced Text-to-Image Generation [Paper]
- MMaDA: Multimodal Large Diffusion Language Models [Paper] [Code]
- Hawk: Leveraging Spatial Context for Faster Autoregressive Text-to-Image Generation [Paper]
- On Fairness of Unified Multimodal Large Language Model for Image Generation [Paper]
- HiFlow: Training-free High-Resolution Image Generation with Flow-Aligned Guidance [Paper]
- Semantic Surgery: Zero-Shot Concept Erasure in Diffusion Models [Paper] [Code]
- Align Your Flow: Scaling Continuous-Time Flow Map Distillation [Paper]
- Pin the Tail on the Model: Blindfolded Repair of User-Flagged Failures in Text-to-Image Services [Paper]
- VETA-DiT: Variance-Equalized and Temporally Adaptive Quantization for Efficient 4-bit Diffusion Transformers [Paper] [Code]
- Shortcutting Pre-trained Flow Matching Diffusion Models is Almost Free Lunch [Paper]
- CLEAR: Conv-Like Linearization Revs Pre-Trained Diffusion Transformers Up [Paper]
- Removing Concepts from Text-to-Image Models with Only Negative Samples [Paper]
- Aligning Text to Image in Diffusion Models is Easier Than You Think [Paper]
- Vision as a Dialect: Unifying Visual Understanding and Generation via Text-Aligned Representations [Paper]
- Diffusion on Demand: Selective Caching and Modulation for Efficient Generation [Paper]
- Vinci: Deep Thinking in Text-to-Image Generation using Unified Model with Reinforcement Learning [Paper]
- Reward-Instruct: A Reward-Centric Approach to Fast Photo-Realistic Image Generation [Paper]
- InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generation [Paper]
- Rare Text Semantics Were Always There in Your Diffusion Transformer [Paper]
- ICLR
- Improving Long-Text Alignment for Text-to-Image Diffusion Models [Paper]
- Information Theoretic Text-to-Image Alignment [Paper]
- Meissonic: Revitalizing Masked Generative Transformers for Efficient High-Resolution Text-to-Image Synthesis [Paper]
- PaRa: Personalizing Text-to-Image Diffusion via Parameter Rank Reduction [Paper]
- Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokens [Paper]
- Not All Prompts Are Made Equal: Prompt-based Pruning of Text-to-Image Diffusion Models [Paper]
- Denoising Autoregressive Transformers for Scalable Text-to-Image Generation [Paper]
- Progressive Compositionality in Text-to-Image Generative Models [Paper]
- Mining your own secrets: Diffusion Classifier Scores for Continual Personalization of Text-to-Image Diffusion Models [Paper]
- Measuring And Improving Engagement of Text-to-Image Generation Models [Paper]
- Concept Pinpoint Eraser for Text-to-image Diffusion Models via Residual Attention Gate [Paper]
- Enhancing Compositional Text-to-Image Generation with Reliable Random Seeds [Paper]
- One-Prompt-One-Story: Free-Lunch Consistent Text-to-Image Generation Using a Single Prompt [Paper]
- You Only Sample Once: Taming One-Step Text-to-Image Synthesis by Self-Cooperative Diffusion GANs [Paper]
- Rethinking Artistic Copyright Infringements In the Era Of Text-to-Image Generative Models [Paper]
- Erasing Concept Combination from Text-to-Image Diffusion Model [Paper]
- Cross-Attention Head Position Patterns Can Align with Human Visual Concepts in Text-to-Image Generative Models [Paper]
- TIGeR: Unifying Text-to-Image Generation and Retrieval with Large Multimodal Models [Paper]
- DGQ: Distribution-Aware Group Quantization for Text-to-Image Diffusion Models [Paper]
- Accelerating Auto-regressive Text-to-Image Generation with Training-free Speculative Jacobi Decoding [Paper]
- PT-T2I/V: An Efficient Proxy-Tokenized Diffusion Transformer for Text-to-Image/Video-Task [Paper]
- Revisiting text-to-image evaluation with Gecko: on metrics, prompts, and human rating [Paper]
- SANA: Efficient High-Resolution Text-to-Image Synthesis with Linear Diffusion Transformers [Paper]
- Text-to-Image Rectified Flow as Plug-and-Play Priors [Paper]
- Automated Filtering of Human Feedback Data for Aligning Text-to-Image Diffusion Models [Paper]
- SAFREE: Training-Free and Adaptive Guard for Safe Text-to-Image And Video Generation [Paper]
- IterComp: Iterative Composition-Aware Feedback Learning from Model Gallery for Text-to-Image Generation [Paper]
- ScImage: How good are multimodal large language models at scientific text-to-image generation? [Paper]
- Guided Score identity Distillation for Data-Free One-Step Text-to-Image Generation [Paper]
- Evaluating Semantic Variation in Text-to-Image Synthesis: A Causal Perspective [Paper]
- Test-time Alignment of Diffusion Models without Reward Over-optimization [Paper]
- JetFormer: An autoregressive generative model of raw images and text [Paper]
- Lumina-T2X: Scalable Flow-based Large Diffusion Transformer for Flexible Resolution Generation [Paper]
- Visually Guided Decoding: Gradient-Free Hard Prompt Inversion with Language Models [Paper]
- VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation [Paper]
- HART: Efficient Visual Generation with Hybrid Autoregressive Transformer [Paper]
- A-Bench: Are LMMs Masters at Evaluating AI-generated Images? [Paper]
- Halton Scheduler for Masked Generative Image Transformer [Paper]
- EC-DIT: Scaling Diffusion Transformers with Adaptive Expert-Choice Routing [Paper]
- Fantastic Copyrighted Beasts and How (Not) to Generate Them [Paper]
- Score Forgetting Distillation: A Swift, Data-Free Method for Machine Unlearning in Diffusion Models [Paper]
- Fantastic Targets for Concept Erasure in Diffusion Models and Where To Find Them [Paper]
- ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation [Paper]
- Training-Free Diffusion Model Alignment with Sampling Demons [Paper]
- OASIS Uncovers: High-Quality T2I Models, Same Old Stereotypes [Paper]
- Accelerating Diffusion Transformers with Token-wise Feature Caching [Paper]
- SVDQuant: Absorbing Outliers by Low-Rank Component for 4-Bit Diffusion Models [Paper]
- Rare-to-Frequent: Unlocking Compositional Generation Power of Diffusion Models on Rare Concepts with LLM Guidance [Paper]
- FreCaS: Efficient Higher-Resolution Image Generation via Frequency-aware Cascaded Sampling [Paper]
- HERO: Human-Feedback Efficient Reinforcement Learning for Online Diffusion Model Finetuning [Paper]
- Show-o: One Single Transformer to Unify Multimodal Understanding and Generation [Paper]
- Efficient Diversity-Preserving Diffusion Alignment via Gradient-Informed GFlowNets [Paper]
- Exploring Local Memorization in Diffusion Models via Bright Ending Attention [Paper]
- Zigzag Diffusion Sampling: Diffusion Models Can Self-Improve via Self-Reflection [Paper]
- Growth Inhibitors for Suppressing Inappropriate Image Concepts in Diffusion Models [Paper]
- The Crystal Ball Hypothesis in diffusion models: Anticipating object positions from initial noise [Paper]
- DSPO: Direct Score Preference Optimization for Diffusion Model Alignment [Paper]
- Long-horizon Visual Instruction Generation with Logic and Attribute Self-reflection [Paper]
- Tuning Timestep-Distilled Diffusion Model Using Pairwise Sample Optimization [Paper]
- ConceptPrune: Concept Editing in Diffusion Models via Skilled Neuron Pruning [Paper]
- ICML
- SAeUron: Interpretable Concept Unlearning in Diffusion Models with Sparse Autoencoders [Paper] [Code]
- CHATS: Combining Human-Aligned Optimization and Test-Time Sampling for Text-to-Image Generation [Paper] [Code]
- EraseAnything: Enabling Concept Erasure in Rectified Flow Transformers [Paper] [Code]
- Proactive Agents for Multi-Turn Text-to-Image Generation Under Uncertainty [Paper] [Code]
- Adaptive Median Smoothing: Adversarial Defense for Unlearned Text-to-Image Diffusion Models at Inference Time [Paper]
- ZipAR: Parallel Autoregressive Image Generation through Spatial Locality [Paper] [Code]
- D-Fusion: Direct Preference Optimization for Aligning Diffusion Models with Visually Consistent Samples [Paper]
- Angle Domain Guidance: Latent Diffusion Requires Rotation Rather Than Extrapolation [Paper] [Code]
- Shielded Diffusion: Generating Novel and Diverse Images using Sparse Repellency [Paper]
- Orthus: Autoregressive Interleaved Image-Text Generation with Modality-Specific Heads [Paper]
- One Image is Worth a Thousand Words: A Usability Preservable Text-Image Collaborative Erasing Framework [Paper] [Code]
- Smoothed Preference Optimization via ReNoise Inversion for Aligning Diffusion Models with Varied Human Preferences [Paper] [Code]
- David and Goliath: Small One-step Model Beats Large Diffusion with Score Post-training [Paper] [Code]
- Preference Adaptive and Sequential Text-to-Image Generation [Paper]
- Concept Reachability in Diffusion Models: Beyond Dataset Constraints [Paper] [Code]
- Skrr: Skip and Re-use Text Encoder Layers for Memory Efficient Text-to-Image Generation [Paper]
- Inference-Time Alignment of Diffusion Models with Direct Noise Optimization [Paper] [Code]
- How to Evaluate and Mitigate IP Infringement in Visual Generative AI? [Paper]
- SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformer [Paper] [Code]
- MuLan: Adapting Multilingual Diffusion Models for Hundreds of Languages with Negligible Cost [Paper] [Code]
- Improving Compositional Generation with Diffusion Models Using Lift Scores [Paper] [Project]
- Minimalist Concept Erasure in Generative Models [Paper]
- ACM MM
- PurifyGen: A Risk-Discrimination and Semantic-Purification Model for Safe Text-to-Image Generation [Paper] [Code]
- StoryCrafter: Instance-Aligned Multi-Character Storytelling with Diffusion Policy Learning [Paper] [Code]
- Twin Co-Adaptive Dialogue for Progressive Image Generation [Paper]
- Text-to-Image Generation with Multi-modal Knowledge Graph Construction and Retrieval [Paper]
- Multi-Dimensional Text-to-Face Image Quality Assessment Using LLM: Database and Method [Paper]
- Text-Visual Semantic Constrained AI-Generated Image Quality Assessment [Paper] [Code]
- CookAnything: A Framework for Flexible and Consistent Multi-Step Recipe Image Generation [Paper]
- Set You Straight: Auto-Steering Denoising Trajectories to Sidestep Unwanted Concepts [Paper] [Code]
- Fine-tuning Bias Neurons for Fair Text-to-Image Generation [Paper]
- CoCoNO: Attention Contrast-and-Complete for Initial Noise Optimization in Text-to-Image Synthesis [Paper]
- Inversion-DPO: Precise and Efficient Post-Training for Diffusion Models [Paper] [Code]
- EmIT: Emotional Interaction control in Text-to-image diffusion models [Paper]
- MPPR: Memory-Prior-based Prompt Refinement in Continuous Space for Advanced Text-to-Image Generation [Paper]
- Color Me Correctly: Bridging Perceptual Color Spaces and Text Embeddings for Improved Diffusion Generation [Paper]
- ACE: Concept Editing in Diffusion Models without Performance Degradation [Paper] [Code]
- SafeCFG: Controlling Harmful Features with Dynamic Safe Guidance for Safe Generation [Paper]
- Bimodal Debiasing for Text-to-Image Diffusion: Adaptive Guidance in Textual and Visual Spaces [Paper]
- ICE: Intercede Concept Erasure in Text-to-Image Diffusion Models [Paper]
- CopyJudge: Automated Copyright Infringement Identification and Mitigation in Text-to-Image Diffusion Models [Paper]
- Towards Culturally Fair Multimodal Generation: Quantifying and Mitigating Orientalist Biases in Text-to-Visual Models [Paper]
- Mitigating Stereotypes in Text-to-Image Generation: A Novel Perspective of Selective Neural Suppression [Paper]
- NDM: A Noise-driven Detection and Mitigation Framework against Implicit Sexual Intentions in Text-to-Image Generation [Paper] [Code]
- Do Existing Testing Tools Really Uncover Gender Bias in Text-to-Image Models? [Paper]
- SIGGRAPH
- AAAI
- AGFSync: Leveraging AI-Generated Feedback for Preference Optimization in Text-to-Image Generation [Paper]
- Adaptive Guidance: Training-free Acceleration of Conditional Diffusion Models [Paper]
- Self-Corrected Flow Distillation for Consistent One-Step and Few-Step Image Generation [Paper]
- DuMo: Dual Encoder Modulation Network for Precise Concept Erasure [Paper]
- DiffuseHigh: Training-Free Progressive High-Resolution Image Synthesis Through Structure Guidance [Paper]
- SCott: Accelerating Diffusion Models with Stochastic Consistency Distillation [Paper]
- LLM4GEN: Leveraging Semantic Representation of LLMs for Text-to-Image Generation [Paper]
- Bridge Diffusion Model: Bridge Chinese Text-to-Image Diffusion Model with English Communities [Paper]
- Storynizor: Consistent Story Generation via Inter-Frame Synchronized and Shuffled ID Injection [Paper]
- Image Regeneration: Evaluating Text-to-Image Model via Generating Identical Image with Multimodal Large Language Models [Paper]
- Qua2SeDiMo: Quantifiable Quantization Sensitivity of Diffusion Models [Paper]
- Boosting Consistency in Story Visualization with Rich-Contextual Conditional Diffusion Models [Paper]
- ResMaster: Mastering High-Resolution Image Generation via Structural and Fine-Grained Guidance [Paper]
- Guided and Variance-Corrected Fusion with One-shot Style Alignment for Large-Content Image Generation [Paper]
- Unlearning Concepts in Diffusion Model via Concept Domain Correction and Concept Preserving Gradient [Paper]
- FreqTS: Frequency-Aware Token Selection for Accelerating Diffusion Models [Paper]
- Training-Free and Hardware-Friendly Acceleration for Diffusion Models via Similarity-based Token Pruning [Paper]
- Hand1000: Generating Realistic Hands from Text with Only 1,000 Images [Paper]
- AdaDiff: Adaptive Step Selection for Fast Diffusion Models [Paper]
- StoryWeaver: A Unified World Model for Knowledge-Enhanced Story Character Customization [Paper]
- ContextualStory: Consistent Visual Storytelling with Spatially-Enhanced and Storyline Context [Paper]
- Flash Diffusion: Accelerating Any Conditional Diffusion Model for Few Steps Image Generation [Paper]
- DiffExp: Efficient Exploration in Reward Fine-tuning for Text-to-Image Diffusion Models [Paper]
- MARS: Mixture of Auto-Regressive Models for Fine-grained Text-to-image Synthesis [Paper]
- Fair Text-to-Image Diffusion via Fair Mapping [Paper]
- Evaluating Image Hallucination in Text-to-Image Generation with Question-Answering [Paper]
- CVPR
- Year 2024
- CVPR
- DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models [Paper] [Code]
- InstanceDiffusion: Instance-level Control for Image Generation [Paper] [Code] [Project]
- ECLIPSE: A Resource-Efficient Text-to-Image Prior for Image Generations [Paper] [Code] [Project] [Demo]
- Instruct-Imagen: Image Generation with Multi-modal Instruction [Paper]
- Learning Continuous 3D Words for Text-to-Image Generation [Paper] [Code]
- HanDiffuser: Text-to-Image Generation With Realistic Hand Appearances [Paper]
- Rich Human Feedback for Text-to-Image Generation [Paper]
- MarkovGen: Structured Prediction for Efficient Text-to-Image Generation [Paper]
- Customization Assistant for Text-to-image Generation [Paper]
- ADI: Learning Disentangled Identifiers for Action-Customized Text-to-Image Generation [Paper] [Project]
- UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANs [Paper]
- Self-Discovering Interpretable Diffusion Latent Directions for Responsible Text-to-Image Generation [Paper]
- Tailored Visions: Enhancing Text-to-Image Generation with Personalized Prompt Rewriting [Paper] [Code]
- CoDi: Conditional Diffusion Distillation for Higher-Fidelity and Faster Image Generation [Paper] [Code] [Project] [Demo]
- Arbitrary-Scale Image Generation and Upsampling using Latent Diffusion Model and Implicit Neural Decoder [Paper]
- Towards Effective Usage of Human-Centric Priors in Diffusion Models for Text-based Human Image Generation [Paper]
- ElasticDiffusion: Training-free Arbitrary Size Image Generation [Paper] [Code] [Project] [Demo]
- CosmicMan: A Text-to-Image Foundation Model for Humans [Paper] [Code] [Project]
- PanFusion: Taming Stable Diffusion for Text to 360° Panorama Image Generation [Paper] [Code] [Project]
- Intelligent Grimm: Open-ended Visual Storytelling via Latent Diffusion Models [Paper] [Code] [Project]
- On the Scalability of Diffusion-based Text-to-Image Generation [Paper]
- MuLAn: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generation [Paper] [Project] [Dataset]
- Learning Multi-dimensional Human Preference for Text-to-Image Generation [Paper]
- Dynamic Prompt Optimizing for Text-to-Image Generation [Paper]
- Training Diffusion Models Towards Diverse Image Generation with Reinforcement Learning [Paper]
- Adversarial Text to Continuous Image Generation [Paper] [Project] [Video]
- EmoGen: Emotional Image Content Generation with Text-to-Image Diffusion Models [Paper] [Code]
- ECCV
- Bridging Different Language Models and Generative Vision Models for Text-to-Image Generation [Paper] [Code] [Project]
- Exploring Phrase-Level Grounding with Text-to-Image Diffusion Model [Paper] [Code]
- Getting it Right: Improving Spatial Consistency in Text-to-Image Models [Paper] [Code] [Project]
- Navigating Text-to-Image Generative Bias across Indic Languages [Paper] [Project]
- Safeguard Text-to-Image Diffusion Models with Human Feedback Inversion [Paper]
- The Fabrication of Reality and Fantasy: Scene Generation with LLM-Assisted Prompt Interpretation [Paper] [Code] [Project] [Dataset]
- Reliable and Efficient Concept Erasure of Text-to-Image Diffusion Models [Paper] [Code]
- Exploring Phrase-Level Grounding with Text-to-Image Diffusion Model [Paper] [Code]
- StyleTokenizer: Defining Image Style by a Single Instance for Controlling Diffusion Models [Paper] [Code]
- PEA-Diffusion: Parameter-Efficient Adapter with Knowledge Distillation in non-English Text-to-Image Generation [Paper] [Code]
- Skews in the Phenomenon Space Hinder Generalization in Text-to-Image Generation [Paper] [Code]
- Parrot: Pareto-optimal Multi-Reward Reinforcement Learning Framework for Text-to-Image Generation [Paper]
- Bridging Different Language Models and Generative Vision Models for Text-to-Image Generation [Paper] [Code] [Project]
- MobileDiffusion: Instant Text-to-Image Generation on Mobile Devices [Paper]
- PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation [Paper] [Code] [Project]
- CogView3: Finer and Faster Text-to-Image Generation via Relay Diffusion [Paper] [Code]
- ICLR
- Patched Denoising Diffusion Models For High-Resolution Image Synthesis [Paper] [Code]
- Relay Diffusion: Unifying diffusion process across resolutions for image synthesis [Paper] [Code]
- SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis [Paper] [Code]
- Compose and Conquer: Diffusion-Based 3D Depth Aware Composable Image Synthesis [Paper] [Code]
- PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis [Paper] [Code] [Project] [Demo]
- SIGGRAPH
- AAAI
- arXiv
- Self-Play Fine-Tuning of Diffusion Models for Text-to-Image Generation [Paper]
- RPG: Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs [Paper] [Code]
- Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generation [Paper] [Code]
- ResAdapter: Domain Consistent Resolution Adapter for Diffusion Models [Paper] [Code] [Project]
- InstantID: Zero-shot Identity-Preserving Generation in Seconds [Paper] [Code] [Project] [Demo]
- PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Models [Paper] [Code]
- ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment [Paper] [Code] [Project]
- Text2Street: Controllable Text-to-image Generation for Street Views [Paper]
- LayerDiffuse: Transparent Image Layer Diffusion using Latent Transparency [Paper] [Code]
- SD3-Turbo: Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillation [Paper]
- StreamMultiDiffusion: Real-Time Interactive Generation with Region-Based Semantic Control [Paper] [Code]
- SVGDreamer: Text Guided SVG Generation with Diffusion Model [Paper] [Code] [Project]
- PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinement [Paper]
- YOSO: You Only Sample Once: Taming One-Step Text-to-Image Synthesis by Self-Cooperative Diffusion GANs [Paper] [Code]
- SingDiffusion: Tackling the Singularities at the Endpoints of Time Intervals in Diffusion Models [Paper] [Code]
- CoMat: Aligning Text-to-Image Diffusion Model with Image-to-Text Concept Matching [Paper] [Code] [Project]
- StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation [Paper] [Code] [Project] [Demo]
- Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Control [Paper] [Project]
- LinFusion: 1 GPU, 1 Minute, 16K Image [Paper] [Code] [Project] [Demo]
- OmniGen: Unified Image Generation [Paper] [Code]
- CoMPaSS: Enhancing Spatial Understanding in Text-to-Image Diffusion Models [Paper] [Code]
- Others
- CVPR
- Year 2023
- CVPR
- GigaGAN: Scaling Up GANs for Text-to-Image Synthesis [Paper] [Reproduced Code] [Project] [Video]
- ERNIE-ViLG 2.0: Improving Text-to-Image Diffusion Model With Knowledge-Enhanced Mixture-of-Denoising-Experts [Paper]
- Shifted Diffusion for Text-to-image Generation [Paper] [Code]
- GALIP: Generative Adversarial CLIPs for Text-to-Image Synthesis [Paper] [Code]
- Specialist Diffusion: Plug-and-Play Sample-Efficient Fine-Tuning of Text-to-Image Diffusion Models to Learn Any Unseen Style [Paper] [Code]
- Toward Verifiable and Reproducible Human Evaluation for Text-to-Image Generation [Paper]
- RIATIG: Reliable and Imperceptible Adversarial Text-to-Image Generation with Natural Prompts [Paper] [Code]
- Multi-Concept Customization of Text-to-Image Diffusion [Paper] [Project] [Code]
- ICCV
- NeurIPS
- ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generation [Paper] [Code]
- RAPHAEL: Text-to-Image Generation via Large Mixture of Diffusion Paths [Paper] [Project]
- Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignment [Paper] [Code]
- DenseDiffusion: Dense Text-to-Image Generation with Attention Modulation [Paper] [Code]
- ICLR
- ICML
- StyleGAN-T: Unlocking the Power of GANs for Fast Large-Scale Text-to-Image Synthesis [Paper] [Code] [Project] [Video]
- Muse: Text-To-Image Generation via Masked Generative Transformers [Paper] [Reproduced Code] [Project]
- UniDiffusers: One Transformer Fits All Distributions in Multi-Modal Diffusion at Scale [Paper] [Code]
- ACM MM
- SIGGRAPH
- arXiv
- P+: Extended Textual Conditioning in Text-to-Image Generation [Paper]
- SDXL-Turbo: Adversarial Diffusion Distillation [Paper] [Code]
- Wuerstchen: An Efficient Architecture for Large-Scale Text-to-Image Diffusion Models [Paper] [Code]
- StreamDiffusion: A Pipeline-level Solution for Real-time Interactive Generation [Paper] [Project]
- ParaDiffusion: Paragraph-to-Image Generation with Information-Enriched Diffusion Model [Paper] [Code]
- Others
- DALL-E 3: Improving Image Generation with Better Captions [Paper]
- CVPR
- Year 2022
- CVPR
- 🔥 Stable Diffusion: High-Resolution Image Synthesis With Latent Diffusion Models [Paper] [Code] [Project]
- Vector Quantized Diffusion Model for Text-to-Image Synthesis [Paper] [Code]
- DF-GAN: A Simple and Effective Baseline for Text-to-Image Synthesis [Paper] [Code]
- LAFITE: Towards Language-Free Training for Text-to-Image Generation [Paper] [Code]
- Text-to-Image Synthesis based on Object-Guided Joint-Decoding Transformer [Paper]
- StyleT2I: Toward Compositional and High-Fidelity Text-to-Image Synthesis [Paper] [Code]
- ECCV
- Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priors [Paper] [Code] [Demo]
- Trace Controlled Text to Image Generation [Paper]
- Improved Masked Image Generation with Token-Critic [Paper]
- VQGAN-CLIP: Open Domain Image Generation and Manipulation Using Natural Language [Paper] [Code]
- TISE: Bag of Metrics for Text-to-Image Synthesis Evaluation [Paper] [Code]
- StoryDALL-E: Adapting Pretrained Text-to-image Transformers for Story Continuation [Paper] [Code] [Demo]
- NeurIPS
- CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers [Paper] [Code]
- Imagen: Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding [Paper] [Reproduced Code] [Project] [Imagen 2]
- ACM MM
- Adma-GAN: Attribute-Driven Memory Augmented GANs for Text-to-Image Generation [Paper] [Code]
- Background Layout Generation and Object Knowledge Transfer for Text-to-Image Generation [Paper]
- DSE-GAN: Dynamic Semantic Evolution Generative Adversarial Network for Text-to-Image Generation [Paper]
- AtHom: Two Divergent Attentions Stimulated By Homomorphic Training in Text-to-Image Synthesis [Paper]
- arXiv
- CVPR
- Year 2021
- ICCV
- NeurIPS
- ICML
- DALLE-1: Zero-Shot Text-to-Image Generation [Paper] [Reproduced Code]
- ACM MM
- Year 2020
- ACM MM
- Text-to-Image Synthesis via Aesthetic Layout [Paper]
- ACM MM
-
Year 2025
- CVPR
- Training-free Dense-Aligned Diffusion Guidance for Modular Conditional Image Synthesis [Paper] [Code]
- Devil is in the Detail: Towards Injecting Fine Details of Image Prompt in Image Generation via Conflict-free Guidance and Stratified Attention [Paper]
- Color Alignment in Diffusion [Paper]
- GPS as a Control Signal for Image Generation [Paper]
- ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generation [Paper]
- StyleStudio: Text-Driven Style Transfer with Selective Control of Style Elements [Paper]
- TKG-DM: Training-free Chroma Key Content Generation Diffusion Model [Paper]
- Attention Distillation: A Unified Approach to Visual Characteristics Transfer [Paper]
- PTDiffusion: Free Lunch for Generating Optical Illusion Hidden Pictures with Phase-Transferred Diffusion Model [Paper]
- Conditional Balance: Improving Multi-Conditioning Trade-Offs in Image Generation [Paper]
- UNIC-Adapter: Unified Image-instruction Adapter with Multi-modal Transformer for Image Generation [Paper]
- ROICtrl: Boosting Instance Control for Visual Generation [Paper]
- Continuous, Subject-Specific Attribute Control in T2I Models by Identifying Semantic Directions [Paper]
- ICCV
- UNO: A Universal Customization Method for Both Single and Multi‑Subject Conditioning [Paper] [Project] [Code]
- CoMPaSS: Enhancing Spatial Understanding in Text‑to‑Image Diffusion Models [Paper] [Project] [Code]
- SP‑Ctrl: Rethink Sparse Signals for Pose‑Guided Text‑to‑Image Generation [Paper] [Code]
- CompCon: Discovering Divergent Representations Between Text‑to‑Image Models [Paper] [Code]
- C2OT: The Curse of Conditions: Analyzing and Improving Optimal Transport for Conditional Flow‑Based Generation [Paper] [Project] [Code]
- RAG‑Diffusion: Region‑Aware Text‑to‑Image Generation via Hard Binding and Soft Refinement [Paper] [Project] [Code]
- CharaConsist: Fine‑Grained Consistent Character Generation [Paper] [Project] [Code]
- Shadow Director: Parametric Shadow Control for Portrait Generation in Text‑to‑Image Diffusion Models [Paper] [Project]
- ImageGen‑CoT: Enhancing Text‑to‑Image In‑Context Learning with Chain‑of‑Thought Reasoning [Paper] [Project]
- Lay2Story: Extending Diffusion Transformers for Layout-Togglable Story Generation [Paper]
- Dual Recursive Feedback on Generation and Appearance Latents for Pose-Robust Text-to-Image Diffusion [Paper]
- EmotiCrafter: Text-to-Emotional-Image Generation based on Valence-Arousal Model [Paper]
- VisualCloze: A Universal Image Generation Framework via Visual In-Context Learning [Paper]
- DreamLayer: Simultaneous Multi-Layer Generation via Diffusion Model [Paper]
- CompSlider: Compositional Slider for Disentangled Multiple-Attribute Image Generation [Paper]
- DC-ControlNet: Decoupling Inter- and Intra-Element Conditions in Image Generation with Diffusion Models [Paper]
- Wasserstein Style Distribution Analysis and Transform for Stylized Image Generation [Paper]
- Co-Painter: Fine-Grained Controllable Image Stylization via Implicit Decoupling and Adaptive Injection [Paper]
- Hybrid Layout Control for Diffusion Transformer: Fewer Annotations, Superior Aesthetics [Paper]
- Omegance: A Single Parameter for Various Granularities in Diffusion-Based Synthesis [Paper]
- LaRender: Training-Free Occlusion Control in Image Generation via Latent Rendering [Paper]
- FICGen: Frequency-Inspired Contextual Disentanglement for Layout-driven Degraded Image Generation [Paper]
- PlanGen: Towards Unified Layout Planning and Image Generation in Auto-Regressive Vision Language Models [Paper]
- UniCombine: Unified Multi-Conditional Combination with Diffusion Transformer [Paper]
- Cycle-Consistent Learning for Joint Layout-to-Image Generation and Object Detection [Paper]
- RealGeneral: Unifying Visual Generation via Temporal In-Context Learning with Video Models [Paper]
- IFAdapter: Instance Feature Control for Grounded Text-to-Image Generation [Paper]
- Preserve Anything: Controllable Image Synthesis with Object Preservation [Paper]
- EasyControl: Adding Efficient and Flexible Control for Diffusion Transformer [Paper]
- CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generation [Paper]
- LOTS of Fashion! Multi-Conditioning for Image Generation via Sketch-Text Pairing [Paper]
- DreamRenderer: Taming Multi-Instance Attribute Control in Large-Scale Text-to-Image Models [Paper]
- GeoDiffusion: A Training-Free Framework for Accurate 3D Geometric Conditioning in Image Generation [Paper]
- IntrinsicControlNet: Cross-distribution Image Generation with Real and Unreal [Paper]
- MUSE: Multi-Subject Unified Synthesis via Explicit Layout Semantic Expansion [Paper]
- Adding Additional Control to One-Step Diffusion with Joint Distribution Matching [Paper]
- MedSegFactory: Text-Guided Generation of Medical Image-Mask Pairs [Paper]
- Scene Graph Guided Generation: Enable Accurate Relations Generation in Text-to-Image Models via Textural Rectification [Paper]
- TF-TI2I: Training-Free Text-and-Image-to-Image Generation via Multi-Modal Implicit-Context Learning In Text-to-Image Models [Paper]
- PathDiff: Histopathology Image Synthesis with Unpaired Text and Mask Conditions [Paper]
- Att-Adapter: A Robust and Precise Domain-Specific Multi-Attributes T2I Diffusion Adapter via Conditional Variational Autoencoder [Paper]
- ICLR
- 3DIS: Depth-Driven Decoupled Image Synthesis for Universal Multi-Instance Generation [Paper]
- ControlAR: Controllable Image Generation with Autoregressive Models [Paper]
- Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Model [Paper]
- Build-A-Scene: Interactive 3D Layout Control for Diffusion-Based Image Generation [Paper]
- ToddlerDiffusion: Interactive Structured Image Generation with Cascaded Schrödinger Bridge [Paper]
- Hummingbird: High Fidelity Image Generation via Multimodal Context Alignment [Paper]
- UniCon: Unidirectional Information Flow for Effective Control of Large-Scale Diffusion Models [Paper]
- Less is More: Masking Elements in Image Condition Features Avoids Content Leakages in Style Transfer Diffusion Models [Paper]
- ICML
- FlexControl: Computation-Aware Conditional Control with Differentiable Router for Text-to-Image Generation [Paper]
- EcoMapper: Generative Modeling for Climate-Aware Satellite Imagery [Paper] [Code]
- UniMC: Taming Diffusion Transformer for Unified Keypoint-Guided Multi-Class Image Generation [Paper]
- Control and Realism: Best of Both Worlds in Layout-to-Image without Training [Paper]
- TextCenGen: Attention-Guided Text-Centric Background Adaptation for Text-to-Image Generation [Paper] [Code]
- RealRAG: Retrieval-augmented Realistic Image Generation via Self-reflective Contrastive Learning [Paper] [Project]
- Learning Vision and Language Concepts for Controllable Image Generation [Paper]
- SIGGRAPH
- NeurIPS
- FreeControl: Efficient, Training-Free Structural Control via One-Step Attention Extraction [Paper]
- Seg2Any: Open-set Segmentation-Mask-to-Image Generation with Precise Shape and Semantic Control [Paper]
- Conditional Panoramic Image Generation via Masked Autoregressive Modeling [Paper]
- Text to Sketch Generation with Multi-Styles [Paper] [Code]
- OmniGen-AR: AutoRegressive Any-to-Image Generation [Paper]
- SceneDecorator: Towards Scene-Oriented Story Generation with Scene Planning and Scene Consistency [Paper]
- Dimension-Reduction Attack! Video Generative Models are Experts on Controllable Image Synthesis [Paper] [Project]
- Noise Consistency Training: A Native Approach for One-step Generator in Learning Additional Controls [Paper]
- CPO: Condition Preference Optimization for Controllable Image Generation [Paper] [Project]
- AlignedGen: Aligning Style Across Generated Images [Paper] [Code]
- CSGO: Content-Style Composition in Text-to-Image Generation [Paper] [Code]
- Consistent Story Generation: Unlocking the Potential of Zigzag Sampling [Paper] [Code]
- InstanceAssemble: Layout-Aware Image Generation via Instance Assembling Attention [Paper] [Code]
- LayerCraft: Enhancing Text-to-Image Generation with CoT Reasoning and Layered Object Integration [Paper]
- SceneDesigner: Controllable Multi-Object Image Generation with 9-DoF Pose Manipulation [Paper]
- Free-Lunch Color-Texture Disentanglement for Stylized Image Generation [Paper]
- CoT-lized Diffusion: Let's Reinforce T2I Generation Step-by-step [Paper]
- ORIGEN: Zero-Shot 3D Orientation Grounding in Text-to-Image Generation [Paper]
- DISCO: DISCrete nOise for Conditional Control in Text-to-Image Diffusion Models [Paper]
- Color Conditional Generation with Sliced Wasserstein Guidance [Paper] [Code]
- AAAI
- VersaGen: Unleashing Versatile Visual Control for Text-to-Image Synthesis [Paper]
- Muses: 3D-Controllable Image Generation via Multi-Modal Agent Collaboration [Paper]
- Simplifying Control Mechanism in Text-to-Image Diffusion Models [Paper]
- Scene Graph-Grounded Image Generation [Paper]
- EMControl: Adding Conditional Control to Text-to-Image Diffusion Models via Expectation-Maximization [Paper]
- GRPose: Learning Graph Relations for Human Image Generation with Pose Priors [Paper]
- Local Conditional Controlling for Text-to-Image Diffusion Models [Paper]
- DialogDraw: Image Generation and Editing System Based on Multi-Turn Dialogue [Paper]
- ACM MM
- Position-LoRA: Enhanced Relation Customization through Structural Prior in Initial Latent Noise [Paper]
- LoCo: Training-Free Layout-to-Image Synthesis with Localized Constraints [Paper]
- AnyStyleDiffusion: Flexible Style Transfer with Consistent Content Adaptation Across Diffusion Models [Paper]
- PLATO: Generating Objects from Part Lists via Synthesized Layouts [Paper]
- ObjCtrl: Object-based Control Relaxation for Conditional Text-to-Image Generation [Paper]
- Omni²: Unifying Omnidirectional Image Generation and Editing in an Omni Model [Paper] [Code]
- Exploring Palette based Color Guidance in Diffusion Models [Paper]
- ModuleTeam: Open-Set Multi-Conditional Image Generation with Training-Free Latent Mixture of Any Control Module [Paper]
- CVPR
-
Year 2024
- CVPR
- PLACE: Adaptive Layout-Semantic Fusion for Semantic Image Synthesis [Paper]
- One-Shot Structure-Aware Stylized Image Synthesis [Paper]
- Grounded Text-to-Image Synthesis with Attention Refocusing [Paper] [Code] [Project] [Demo]
- Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesis [Paper] [Code]
- DetDiffusion: Synergizing Generative and Perceptive Models for Enhanced Data Generation and Perception [Paper]
- CAN: Condition-Aware Neural Network for Controlled Image Generation [Paper]
- SceneDiffusion: Move Anything with Layered Scene Diffusion [Paper]
- Zero-Painter: Training-Free Layout Control for Text-to-Image Synthesis [Paper] [Code]
- MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesis [Paper] [Code] [Project]
- FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Condition [Paper] [Code] [Project]
- ECCV
- NeurIPS
- ICLR
- WACV
- AAAI
- arXiv
- DEADiff: An Efficient Stylization Diffusion Model with Disentangled Representations [Paper]
- InstantStyle: Free Lunch towards Style-Preserving in Text-to-Image Generation [Paper] [Code] [Project]
- ControlNet++: Improving Conditional Controls with Efficient Consistency Feedback [Paper] [Project]
- Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understanding [Paper] [Code] [Project]
- DialogGen: Multi-modal Interactive Dialogue System for Multi-turn Text-to-Image Generation [Paper] [Code] [Project]
- ControlNeXt: Powerful and Efficient Control for Image and Video Generation [Paper] [Code] [Project]
- UniPortrait: A Unified Framework for Identity-Preserving Single- and Multi-Human Image Personalization [Paper] [Code] [Project] [Demo]
- OmniControl: Minimal and Universal Control for Diffusion Transformer [Paper] [Code] [Demo]
- UnZipLoRA: Separating Content and Style from a Single Image [Paper] [Project]
- CtrLoRA: An Extensible and Efficient Framework for Controllable Image Generation [Paper] [Code]
- Region-Aware Text-to-Image Generation via Hard Binding and Soft Refinement [Paper] [Code]
- CVPR
- Year 2023
- CVPR
- GLIGEN: Open-Set Grounded Text-to-Image Generation [Paper] [Code] [Project] [Demo] [Video]
- Autoregressive Image Generation using Residual Quantization [Paper] [Code]
- SpaText: Spatio-Textual Representation for Controllable Image Generation [Paper] [Project] [Video]
- Text to Image Generation with Semantic-Spatial Aware GAN [Paper]
- ReCo: Region-Controlled Text-to-Image Generation [Paper] [Code]
- LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation [Paper] [Code]
- ICLR
- ICCV
- ICML
- SIGGRAPH
- Sketch-Guided Text-to-Image Diffusion Models [Paper] [Reproduced Code] [Project]
- NeurIPS
- WACV
- More Control for Free! Image Synthesis with Semantic Diffusion Guidance [Paper]
- ACM MM
- LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generation [Paper]
- arXiv
- T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models [Paper] [Code] [Demo]
- BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editing [Paper] [Code]
- Late-Constraint Diffusion Guidance for Controllable Image Synthesis [Paper] [Code]
- CVPR
- Year 2022
- Year 2025
- CVPR
- SerialGen: Personalized Image Generation by First Standardization Then Personalization [Paper] [Project]
- PatchDPO: Patch-level DPO for Finetuning-free Personalized Image Generation [Paper] [Code]
- DreamCache: Finetuning-Free Lightweight Personalized Image Generation via Feature Caching [Paper]
- DiffSensei: Bridging Multi-Modal LLMs and Diffusion Models for Customized Manga Generation [Paper]
- TFCustom: Customized Image Generation with Time-Aware Frequency Feature Guidance [Paper]
- Multi-party Collaborative Attention Control for Image Customization [Paper]
- Yo'Chameleon: Personalized Vision and Language Generation [Paper]
- CustAny: Customizing Anything from A Single Example [Paper]
- PersonaHOI: Effortlessly Improving Face Personalization in Human-Object Interaction Generation [Paper]
- Visual Persona: Foundation Model for Full-Body Human Customization [Paper]
- HiFi-Portrait: Zero-shot Identity-preserved Portrait Generation with High-fidelity Multi-face Fusion [Paper]
- APT: Adaptive Personalized Training for Diffusion Models with Limited Data [Paper]
- ConceptGuard: Continual Personalized Text-to-Image Generation with Forgetting and Confusion Mitigation [Paper]
- MC^2: Multi-concept Guidance for Customized Multi-concept Generation [Paper]
- Personalized Preference Fine-tuning of Diffusion Models [Paper]
- Diffusion Self-Distillation for Zero-Shot Customized Image Generation [Paper]
- LoRACLR: Contrastive Adaptation for Customization of Diffusion Models [Paper]
- HyperLoRA: Parameter-Efficient Adaptive Generation for Portrait Synthesis [Paper]
- LaTexBlend: Scaling Multi-concept Customized Generation with Latent Textual Blending [Paper]
- DreamRelation: Bridging Customization and Relation Generation [Paper]
- Multitwine: Multi-Object Compositing with Text and Layout Control [Paper]
- Efficient Personalization of Quantized Diffusion Model without Backpropagation [Paper]
- ArtiFade: Learning to Generate High-quality Subject from Blemished Images [Paper]
- ID-Patch: Robust ID Association for Group Photo Personalization [Paper]
- Large-Scale Text-to-Image Model with Inpainting is a Zero-Shot Subject-Driven Image Generator [Paper]
- ICCV
- DrUM: Draw Your Mind: Personalized Generation via Condition‑Level Modeling in Text‑to‑Image Diffusion Models [Paper] [Code]
- PersonaCraft: Personalized and Controllable Full‑Body Multi‑Human Scene Generation Using Occlusion‑Aware 3D‑Conditioned Diffusion [Paper] [Project] [Code]
- Steering Guidance: Steering Guidance for Personalized Text‑to‑Image Diffusion Models [Paper]
- FreeCus: FreeCus: Free Lunch Subject‑Driven Customization in Diffusion Transformers [Paper] [Code]
- PromptDresser: Improving the Quality and Controllability of Virtual Try‑On via Generative Textual Prompt and Prompt‑aware Mask [Paper] [Code]
- DynamicID: Zero‑Shot Multi‑ID Image Personalization with Flexible Facial Editability [Paper] [Code]
- UniversalBooth: Model‑Agnostic Personalized Text‑to‑Image Generation
- ARBooth: Fine‑Tuning Visual Autoregressive Models for Subject‑Driven Generation [Paper] [Project] [Code]
⚠️ ConceptSplit: Decoupled Multi‑Concept Personalization of Diffusion Models via Token‑wise Adaptation and Attention Disentanglement [Code]⚠️ ObjectMate: A Recurrence Prior for Object Insertion and Subject‑Driven Generation [Project]- LoRAverse: A Submodular Framework to Retrieve Diverse Adapters for Diffusion Models [Paper]
- CSD-VAR: Content-Style Decomposition in Visual Autoregressive Models [Paper]
- ImageGem: In-the-wild Generative Image Interaction Dataset for Generative Model Personalization [Paper]
- DuoLoRA: Cycle-consistent and Rank-disentangled Content-Style Personalization [Paper]
- F-Bench: Rethinking Human Preference Evaluation Metrics for Benchmarking Face Generation, Customization, and Restoration [Paper]
- Generating Multi-Image Synthetic Data for Text-to-Image Customization [Paper]
- Contrastive Test-Time Composition of Multiple LoRA Models for Image Generation [Paper]
- LoRA.rar: Learning to Merge LoRAs via Hypernetworks for Subject-Style Conditioned Image Generation [Paper]
- Continual Personalization for Diffusion Models [Paper]
- QR-LoRA: Efficient and Disentangled Fine-tuning via QR Decomposition for Customized Generation [Paper]
- NeurIPS
- MS-Diffusion: Multi-Subject Zero-Shot Image Personalized with Layout Guidance [Paper] [Project] [Code]
- ClassDiffusion: More Aligned Personalization Tuning with Explicit Class Guidance [Paper] [Project] [Code]
- DreamBench++: A Human-Aligned Benchmark for Personalized Image Generation [Paper] [Project]
- TweedieMix: Improving Multi-Concept Fusion for Diffusion-based Image/Video Generation [Paper] [Code]
- Mind-the-Glitch: Visual Correspondence for Detecting Inconsistencies in Subject-Driven Generation [Paper]
- XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulation [Paper]
- Foundation Cures Personalization: Improving Personalized Models’ Prompt Consistency via Hidden Foundation Knowledge [Paper]
- Personalized Visual Content Generation in Conversational Systems [Paper]
- Perturb a Model, Not an Image: Towards Robust Privacy Protection via Anti-Personalized Diffusion Models [Paper] [Code]
- DEFT: Decompositional Efficient Fine-Tuning for Text-to-Image Models [Paper] [Code]
- UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokens [Paper] [Code]
- StyleGuard: Preventing Text-to-Image-Model-based Style Mimicry Attacks by Style Perturbations [Paper] [Code]
- LoRAShop: Training-Free Multi-Concept Image Generation and Editing with Rectified Flow Transformers [Paper]
- ICLR
- Cached Multi-Lora Composition for Multi-Concept Image Generation [Paper]
- DreamDistribution: Learning Prompt Distribution for Diverse In-distribution Generation [Paper]
- Storybooth: Training-Free Multi-Subject Consistency for Improved Visual Storytelling [Paper]
- DisEnvisioner: Disentangled and Enriched Visual Prompt for Customized Image Generation [Paper]
- ICML
- SIGGRAPH
- AAAI
- CustomContrast: A Multilevel Contrastive Perspective for Subject-Driven Text-to-Image Customization [Paper]
- DynASyn: Multi-Subject Personalization Enabling Dynamic Action Synthesis [Paper]
- Dis²Booth: Learning Image Distribution with Disentangled Features for Text-to-Image Diffusion Models [Paper]
- Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generation [Paper]
- PersonaMagic: Stage-Regulated High-Fidelity Face Customization with Tandem Equilibrium [Paper]
- RealisID: Scale-Robust and Fine-Controllable Identity Customization via Local and Global Complementation [Paper]
- SpotActor: Training-Free Layout-Controlled Consistent Image Generation [Paper]
- Concept Conductor: Orchestrating Multiple Personalized Concepts in Text-to-Image Synthesis [Paper]
- MagicNaming: Consistent Identity Generation by Finding a “Name Space” in T2I Diffusion Models [Paper]
- MultiBooth: Towards Generating All Your Concepts in an Image from Text [Paper]
- Harmonizing Visual and Textual Embeddings for Zero-Shot Text-to-Image Customization [Paper]
- ACM MM
- CVPR
- Year 2024
- CVPR
- Cross Initialization for Personalized Text-to-Image Generation [Paper]
- When StyleGAN Meets Stable Diffusion: a W+ Adapter for Personalized Image Generation [Paper] [Code] [Project]
- Style Aligned Image Generation via Shared Attention [Paper] [Code] [Project]
- InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuning [Paper] [Project]
- High Fidelity Person-centric Subject-to-Image Synthesis [Paper]
- RealCustom: Narrowing Real Text Word for Real-Time Open-Domain Text-to-Image Customization [Paper] [Project]
- DisenDiff: Attention Calibration for Disentangled Text-to-Image Personalization [Paper] [Code]
- FreeCustom: Tuning-Free Customized Image Generation for Multi-Concept Composition [Paper] [Code] [Project]
- Personalized Residuals for Concept-Driven Text-to-Image Generation [Paper]
- Improving Subject-Driven Image Synthesis with Subject-Agnostic Guidance [Paper]
- JeDi: Joint-Image Diffusion Models for Finetuning-Free Personalized Text-to-Image Generation [Paper]
- Countering Personalized Text-to-Image Generation with Influence Watermarks [Paper]
- PIA: Your Personalized Image Animator via Plug-and-Play Modules in Text-to-Image Models [Paper] [Project] [Code]
- SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generation [Paper] [Code]
- ECCV
- Be Yourself: Bounded Attention for Multi-Subject Text-to-Image Generation [Paper] [Project]
- Powerful and Flexible: Personalized Text-to-Image Generation via Reinforcement Learning [Paper] [Code]
- TIGC: Tuning-Free Image Customization with Image and Text Guidance [Paper] [Code] [Project]
- MasterWeaver: Taming Editability and Face Identity for Personalized Text-to-Image Generation [Paper] [Code] [Project]
- NeurIPS
- AAAI
- Decoupled Textual Embeddings for Customized Image Generation [Paper]
- arXiv
- FlashFace: Human Image Personalization with High-fidelity Identity Preservation [Paper] [Code] [Project]
- MoMA: Multimodal LLM Adapter for Fast Personalized Image Generation [Paper]
- IDAdapter: Learning Mixed Features for Tuning-Free Personalization of Text-to-Image Models [Paper]
- CoRe: Context-Regularized Text Embedding Learning for Text-to-Image Personalization [Paper]
- Imagine yourself: Tuning-Free Personalized Image Generation [Paper] [Project]
- CVPR
- Year 2023
- CVPR
- ICCV
- ICLR
- SIGGRAPH
- arXiv
- DreamTuner: Single Image is Enough for Subject-Driven Generation [Paper] [Project]
- PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding [Paper] [Code]
- IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models [Paper] [Code] [Project]
- FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention [Paper] [Code]
-
Year 2025
- CVPR
- FDS: Frequency-Aware Denoising Score for Text-Guided Latent Diffusion Image Editing [Paper]
- Reference-Based 3D-Aware Image Editing with Triplanes [Paper]
- MoEdit: On Learning Quantity Perception for Multi-object Image Editing [Paper]
- Instruction-based Image Manipulation by Watching How Things Move [Paper]
- h-Edit: Effective and Flexible Diffusion-Based Editing via Doob's h-Transform [Paper]
- Identity-preserving Distillation Sampling by Fixed-Point Iterator [Paper]
- FluxSpace: Disentangled Semantic Editing in Rectified Flow Models [Paper]
- EmoEdit: Evoking Emotions through Image Manipulation [Paper]
- ATA: Adaptive Transformation Agent for Text-Guided Subject-Position Variable Background Inpainting [Paper]
- Text-Driven Fashion Image Editing with Compositional Concept Learning and Counterfactual Abduction [Paper]
- Preserve or Modify? Context-Aware Evaluation for Balancing Preservation and Modification in Text-Guided Image Editing [Paper]
- SwiftEdit: Lightning Fast Text-Guided Image Editing via One-Step Diffusion [Paper]
- RealEdit: Reddit Edits As a Large-scale Empirical Dataset for Image Transformations [Paper]
- Instruct-CLIP: Improving Instruction-Guided Image Editing with Automated Data Refinement Using Contrastive Learning [Paper]
- Concept Lancet: Image Editing with Compositional Representation Transplant [Paper]
- TurboFill: Adapting Few-step Text-to-image Model for Fast Image Inpainting [Paper]
- InsightEdit: Towards Better Instruction Following for Image Editing [Paper]
- Style-Editor: Text-driven Object-centric Style Editing [Paper]
- MagicQuill: An Intelligent Interactive Image Editing System [Paper]
- Pathways on the Image Manifold: Image Editing via Video Generation [Paper]
- Stable Flow: Vital Layers for Training-Free Image Editing [Paper]
- Unveil Inversion and Invariance in Flow Transformer for Versatile Image Editing [Paper]
- AnyEdit: Mastering Unified High-Quality Image Editing for Any Idea [Paper]
- Improving Editability in Image Generation with Layer-wise Memory [Paper]
- PhyS-EdiT: Physics-aware Semantic Image Editing with Text Description [Paper]
- Unleashing In-context Learning of Autoregressive Models for Few-shot Image Manipulation [Paper]
- MTADiffusion: Mask Text Alignment Diffusion Model for Object Inpainting [Paper]
- FireEdit: Fine-grained Instruction-based Image Editing via Region-aware Vision Language Model [Paper]
- Towards Scalable Human-aligned Benchmark for Text-guided Image Editing [Paper]
⚠️ FeedEdit: Text-Based Image Editing with Dynamic Feedback Regulation [Paper]
- ICCV
- In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer [Paper] [Project] [Code]
- Dual‑Conditional Inversion: for Boosting Diffusion‑Based Image Editing [Paper]
- CAMILA: Context‑Aware Masking for Image Editing with Language Alignment [Paper]
- EditInfinity: Image Editing with Binary‑Quantized Generative Models [Paper]
- KRIS‑Bench: Benchmarking Knowledge‑Based Reasoning in Image Editing Systems [Paper] [Project] [Code]
- LoongX: Neural-Driven Image Editing [Paper] [Project] [Code]
- CREA: CREA: A Collaborative Multi‑Agent Framework for Creative Image Editing and Generation [Paper] [Project]
- IEAP: Image Editing As Programs with Diffusion Models [Paper] [Project] [Code]
- ArtEditor: Learning Customized Instructional Image Editor from Few-Shot Examples [Paper]
- ADIEE: Automatic Dataset Creation and Scorer for Instruction-Guided Image Editing Evaluation [Paper]
- Describe, Don't Dictate: Semantic Image Editing with Natural Language Intent [Paper]
- What Changed? Detecting and Evaluating Instruction-Guided Image Edits with Multimodal Large Language Models [Paper]
- Multi-turn Consistent Image Editing [Paper]
- LUSD: Localized Update Score Distillation for Text-Guided Image Editing [Paper]
- QK-Edit: Revisiting Attention-based Injection in MM-DiT for Image and Video Editing [Paper]
- RefEdit: A Benchmark and Method for Improving Instruction-based Image Editing Model on Referring Expressions [Paper]
- ReFlex: Text-Guided Editing of Real Images in Rectified Flow via Mid-Step Feature Extraction and Attention Adaptation [Paper]
- FreeFlux: Understanding and Exploiting Layer-Specific Roles in RoPE-Based MMDiT for Versatile Image Editing [Paper]
- Exploring Multimodal Diffusion Transformers for Enhanced Prompt-based Image Editing [Paper]
- Anchor Token Matching: Implicit Structure Locking for Training-free AR Image Editing [Paper]
- Early Timestep Zero-Shot Candidate Selection for Instruction-Guided Image Editing [Paper]
- Addressing Text Embedding Leakage in Diffusion-based Image Editing [Paper]
- EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editing [Paper]
- SuperEdit: Rectifying and Facilitating Supervision for Instruction-Based Image Editing [Paper]
- Frequency-Guided Diffusion for Training-Free Text-Driven Image Translation [Paper]
- Streamlining Image Editing with Layered Diffusion Brushes [Paper]
- InstantEdit: Text-Guided Few-Step Image Editing with Piecewise Rectified Flow [Paper]
- Training-Free Text-Guided Image Editing with Visual Autoregressive Model [Paper]
- LOCATEdit: Graph Laplacian Optimized Cross Attention for Localized Text-Guided Image Editing [Paper]
- FlowChef: Steering of Rectified Flow Models for Controlled Generations [Paper]
- PixTalk: Controlling Photorealistic Image Processing and Editing with Language [Paper]
- Pose-Star: Anatomy-Aware Editing for Open-World Fashion Images [Paper]
- UIP2P: Unsupervised Instruction-based Image Editing via Edit Reversibility Constraint [Paper]
- Edicho: Consistent Image Editing in the Wild [Paper]
- Instruction-based Image Editing with Planning, Reasoning, and Generation [Paper]
- KV-Edit: Training-Free Image Editing for Precise Background Preservation [Paper]
- NeurIPS
- AutoEdit: Automatic Hyperparameter Tuning for Image Editing [Paper]
- Precise Diffusion Inversion: Towards Novel Samples and Few-Step Models [Paper] [Code]
- DreamLight: Towards Harmonious and Consistent Image Relighting [Paper]
- Counterfactual Image Editing with Disentangled Causal Latent Space [Paper]
- CamEdit: Continuous Camera Parameter Control for Photorealistic Image Editing [Paper]
- The Promise of RL for Autoregressive Image Editing [Paper] [Code]
- DNAEdit: Direct Noise Alignment for Text-Guided Rectified Flow Editing [Paper]
- NEP: Autoregressive Image Editing via Next Editing Token Prediction [Paper]
- FSI-Edit: Frequency and Stochasticity Injection for Flexible Diffusion-Based Image Editing [Paper]
- Enhancing Consistency of Flow-Based Image Editing through Kalman Control [Paper]
- SplitFlow: Flow Decomposition for Inversion-Free Text-to-Image Editing [Paper] [Code]
- Personalized Image Editing in Text-to-Image Diffusion Models via Collaborative Direct Preference Optimization [Paper]
- ICLR
- Lightning-Fast Image Inversion and Editing for Text-to-Image Diffusion Models [Paper]
- Multi-Reward as Condition for Instruction-based Image Editing [Paper] [Code]
- HQ-Edit: A High-Quality Dataset for Instruction-based Image Editing [Paper] [Dataset] [Code]
- CLIPDrag: Combining Text-based and Drag-based Instructions for Image Editing [Paper] [Code]
- Semantic Image Inversion and Editing using Rectified Stochastic Differential Equations [Paper] [Project] [Code]
- PostEdit: Posterior Sampling for Efficient Zero-Shot Image Editing [Paper] [Code]
- OmniEdit: Building Image Editing Generalist Models Through Specialist Supervision [Paper] [Project] [Code] [Dataset]
- InstantPortrait: One-Step Portrait Editing via Diffusion Multi-Objective Distillation [Paper]
- Scaling In-the-Wild Training for Diffusion-based Illumination Harmonization and Editing by Imposing Consistent Light Transport [Paper]
- InstantSwap: Fast Customized Concept Swapping across Sharp Shape Differences [Paper]
- Add-it: Training-Free Object Insertion in Images With Pretrained Diffusion Models [Paper]
- PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructions [Paper]
- SIGGRAPH
- ICML
- Highly Compressed Tokenizer Can Generate Without Training [Paper] [Code]
- FireFlow: Fast Inversion of Rectified Flow for Image Semantic Editing [Paper] [Code]
- Editable Noise Map Inversion: Encoding Target-image into Noise For High-Fidelity Image Manipulation [Paper]
- Balancing Preservation and Modification: A Region and Semantic Aware Metric for Instruction-Based Image Editing [Paper] [Project]
- Taming Rectified Flow for Inversion and Editing [Paper] [Code]
- AAAI
- Text2Relight: Creative Portrait Relighting with Text Guidance [Paper]
- DiT4Edit: Diffusion Transformer for Image Editing [Paper]
- DesignEdit: Unify Spatial-Aware Image Editing via Training-free Inpainting with a Multi-Layered Latent Diffusion Framework [Paper]
- Move and Act: Enhanced Object Manipulation and Background Integrity for Image Editing [Paper]
- Energy-Guided Optimization for Personalized Image Editing with Pretrained Text-to-Image Diffusion Models [Paper]
- Click2Mask: Local Editing with Dynamic Mask Generation [Paper]
- FunEditor: Achieving Complex Image Edits via Function Aggregation with Diffusion Models [Paper]
- SigStyle: Signature Style Transfer via Personalized Text-to-Image Models [Paper]
- Style Nursing with Spatial and Semantic Guidance for Zero-Shot Traffic Scene Style Transfer [Paper]
- CA-Edit: Causality-Aware Condition Adapter for High-Fidelity Local Facial Attribute Editing [Paper]
- VersaFusion: A Versatile Diffusion-Based Framework for Fine-Grained Image Editing and Enhancement [Paper]
- Textualize Visual Prompt for Image Editing via Diffusion Bridge [Paper]
- ACM MM
- LMM4Edit: Benchmarking and Evaluating Multimodal Image Editing with LMMs [Paper] [Code]
- SmartFreeEdit: Mask-Free Spatial-Aware Image Editing with Complex Instruction Understanding [Paper] [Code]
- Focus Where It Matters: LLM-Guided Regional Identification for Instruction-based Image Editing [Paper]
- SSAIM: Not All Self-Attentions Contain Effective Spatial Structure in Diffusion Models for Text-to-Image Editing [Paper]
- EditMaster: Bridging Text instruction and Visual Example for Multimodal guided Image Editing [Paper]
- DiffArtist: Towards Structure and Appearance Controllable Image Stylization [Paper]
- CausalCtrl: Causality-Aware Control Framework for Text-Guided Visual Editing [Paper]
- Prompt-Softbox-Prompt: A Free-Text Embedding Control for Image Editing [Paper] [Code]
- FreeInsert: Personalized Object Insertion with Geometric and Style Control [Paper]
- SAKR-Edit: Scene-Aware Knowledge Reasoning for Text-to-Image Editing [Paper]
- MIGE: Mutually Enhanced Multimodal Instruction-Based Image Generation and Editing [Paper] [Code]
- CVPR
-
Year 2024
-
CVPR
- InfEdit: Inversion-Free Image Editing with Natural Language [Paper] [Code] [Project]
- Towards Understanding Cross and Self-Attention in Stable Diffusion for Text-Guided Image Editing [Paper]
- Doubly Abductive Counterfactual Inference for Text-based Image Editing [Paper] [Code]
- Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulation [Paper] [Code]
- Contrastive Denoising Score for Text-guided Latent Diffusion Image Editing [Paper]
- DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editing [Paper] [Code]
- DiffEditor: Boosting Accuracy and Flexibility on Diffusion-based Image Editing [Paper]
- FreeDrag: Feature Dragging for Reliable Point-based Image Editing [Paper] [Code]
- Text-Driven Image Editing via Learnable Regions [Paper] [Code] [Project] [Video]
- LEDITS++: Limitless Image Editing using Text-to-Image Models [Paper] [Code] [Project] [Demo]
- SmartEdit: Exploring Complex Instruction-based Image Editing with Large Language Models [Paper] [Code] [Project]
- Edit One for All: Interactive Batch Image Editing [Paper] [Code] [Project]
- DiffMorpher: Unleashing the Capability of Diffusion Models for Image Morphing [Paper] [Code] [Project] [Demo]
- TiNO-Edit: Timestep and Noise Optimization for Robust Diffusion-Based Image Editing [Paper] [Code]
- Person in Place: Generating Associative Skeleton-Guidance Maps for Human-Object Interaction Image Editing [Paper] [Project] [Code]
- Referring Image Editing: Object-level Image Editing via Referring Expressions [Paper]
- Prompt Augmentation for Self-supervised Text-guided Image Manipulation [Paper]
- The Devil is in the Details: StyleFeatureEditor for Detail-Rich StyleGAN Inversion and High Quality Image Editing [Paper] [Code]
-
ECCV
- RegionDrag: Fast Region-Based Image Editing with Diffusion Models [Paper] [Code] [Project] [Demo]
- TurboEdit: Instant text-based image editing [Paper] [Project]
- InstructGIE: Towards Generalizable Image Editing [Paper]
- StableDrag: Stable Dragging for Point-based Image Editing [Paper]
- Eta Inversion: Designing an Optimal Eta Function for Diffusion-based Real Image Editing [Paper] [Code] [Project]
- SwapAnything: Enabling Arbitrary Object Swapping in Personalized Image Editing [Paper] [Code] [Project]
- Guide-and-Rescale: Self-Guidance Mechanism for Effective Tuning-Free Real Image Editing [Paper]
- FreeDiff: Progressive Frequency Truncation for Image Editing with Diffusion Models [Paper] [Code]
- Lazy Diffusion Transformer for Interactive Image Editing [Paper] [Project]
- ByteEdit: Boost, Comply and Accelerate Generative Image Editing [Paper] [Project]
-
ICLR
- Guiding Instruction-based Image Editing via Multimodal Large Language Models [Paper] [Code] [Project]
- The Blessing of Randomness: SDE Beats ODE in General Diffusion-based Image Editing [Paper] [Code] [Project]
- Motion Guidance: Diffusion-Based Image Editing with Differentiable Motion Estimators [Paper] [Code] [Project]
- Object-Aware Inversion and Reassembly for Image Editing [Paper] [Code] [Project]
- Noise Map Guidance: Inversion with Spatial Context for Real Image Editing [Paper]
-
AAAI
- Tuning-Free Inversion-Enhanced Control for Consistent Image Editing [Paper]
- BARET: Balanced Attention based Real image Editing driven by Target-text Inversion [Paper]
- Accelerating Text-to-Image Editing via Cache-Enabled Sparse Diffusion Inference [Paper]
- High-Fidelity Diffusion-based Image Editing [Paper]
- AdapEdit: Spatio-Temporal Guided Adaptive Editing Algorithm for Text-Based Continuity-Sensitive Image Editing [Paper]
- TexFit: Text-Driven Fashion Image Editing with Diffusion Models [Paper]
-
arXiv
- An Item is Worth a Prompt: Versatile Image Editing with Disentangled Control [Paper] [Code]
- One-Dimensional Adapter to Rule Them All: Concepts, Diffusion Models and Erasing Applications [Paper] [Code] [Project]
- EditWorld: Simulating World Dynamics for Instruction-Following Image Editing [Paper] [Code] [Project]
- ReasonPix2Pix: Instruction Reasoning Dataset for Advanced Image Editing [Paper]
- FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Models [Paper] [Code] [Project] [Demo]
-
-
Year 2023
- CVPR
- Uncovering the Disentanglement Capability in Text-to-Image Diffusion Models [Paper] [Code]
- SINE: SINgle Image Editing with Text-to-Image Diffusion Models [Paper] [Code]
- Imagic: Text-Based Real Image Editing with Diffusion Models [Paper]
- InstructPix2Pix: Learning to Follow Image Editing Instructions [Paper] [Code] [Dataset] [Project] [Demo]
- Null-text Inversion for Editing Real Images using Guided Diffusion Models [Paper] [Code]
- ICCV
- ICLR
- CVPR
-
Year 2022
- Year 2025
- Year 2024
- Microsoft COCO: Common Objects in Context [Paper] [Dataset]
- Conceptual Captions: A Cleaned, Hypernymed, Image Alt-text Dataset For Automatic Image Captioning [Paper] [Dataset]
- LAION-5B: An Open Large-Scale Dataset for Training Next Generation Image-Text Models [Paper] [Dataset]
- PartiPrompts: Scaling Autoregressive Models for Content-Rich Text-to-Image Generation [Paper] [Dataset] [Project]
- ROVI: A VLM-LLM Re-Captioned Dataset for Open-Vocabulary Instance-Grounded Text-to-Image Generation [Paper]
| Name | Website | Description |
|---|---|---|
| Stable Diffusion WebUI | link | Built based on Gradio, deployed locally to run Stable Diffusion checkpoints, LoRA weights, ControlNet weights, etc. |
| Stable Diffusion WebUI-forge | link | Built based on Gradio, deployed locally to run Stable Diffusion checkpoints, LoRA weights, ControlNet weights, etc. |
| Fooocus | link | Built based on Gradio, offline, open source, and free. The manual tweaking is not needed, and users only need to focus on the prompts and images. |
| ComfyUI | link | Deployed locally to enable customized workflows with Stable Diffusion |
| Civitai | link | Websites for community Stable Diffusion and LoRA checkpoints |
- Q: The conference sequence of this paper list?
- This paper list is organized according to the following sequence:
- CVPR
- ICCV
- ECCV
- WACV
- NeurIPS
- ICLR
- ICML
- ACM MM
- SIGGRAPH
- AAAI
- arXiv
- Others
- This paper list is organized according to the following sequence:
- Q: What does
Othersrefers to?- Some of the following studies (e.g.,
Stable Casacade) does not publish their technical report on arXiv. Instead, they tend to write a blog in their official websites. TheOtherscategory refers to such kind of studies.
- Some of the following studies (e.g.,
The reference.bib file summarizes bibtex references of up-to-date image inpainting papers, widely used datasets, and toolkits.
Based on the original references, I have made the following modifications to make their results look nice in the LaTeX manuscripts:
- Refereces are normally constructed in the form of
author-etal-year-nickname. Particularly, references of datasets and toolkits are directly constructed asnickname, e.g.,imagenet. - In each reference, all names of conferences/journals are converted into abbreviations, e.g.,
Computer Vision and Pattern Recognition -> CVPR. - The
url,doi,publisher,organization,editor,seriesin all references are removed. - The
pagesof all references are added if they are missing. - All paper names are in title case. Besides, I have added an additional
{}to make sure that the title case would also work well in some particular templates.
If you have other demands of reference formats, you may refer to the original references of papers by searching their names in DBLP or Google Scholar.
Note
Note that references in the homepage and the topic section can be repeated in reference.bib. Personally, I recommend using "Ctrl+F" / "Command+F" to search your desired BibTeX reference.
