README.md

March 24, 2025 · View on GitHub

Diffusion-LM-Papers

  • I'm happy to see so many people showing interest in this field. At the moment, we've read and gathered hundreds of articles. If you find any mistakes or have additional information, you can contact the author by E-mail and I will take the time to update the information.

Last updated: 2025-03-24

idMethodDateAuthorCodeAcceptedPaper
1112025.2KimTrain for the Worst, Plan for the Best: Understanding Token Ordering in Masked Diffusions
110EdiText2025.2LeeEdiText: Controllable Coarse-to-Fine Text Editing with Diffusion Language Models
109TESS 22025.2TaegithubTESS 2: A Large-Scale Generalist Diffusion Language Model
108LLaDA2025.2NiegithubLarge Language Diffusion Models
107CaDDi2025.2ZhangNon-Markovian Discrete Diffusion with Causal Language Models
1062025.2FengTheoretical Benefit and Limitation of Diffusion Language Model
105SEPO2025.2ZekrigithubFine-Tuning Discrete Diffusion Models with Policy Gradient Methods
104L2D2025.1CetinLarge Language Models to Diffusion Finetuning
103TermDiffuSum2025.1DonggithubCOLING 2025TermDiffuSum: A Term-guided Diffusion Model for Extractive Summarization of Legal Documents
102CDA^22025.1XinCOLING 2025CDAˆ2: Counterfactual Diffusion Augmentation for Cross-Domain Adaptation in Low-Resource Sentiment Analysis
1022025.1AsadagithubCOLING 2025Addressing the Training-Inference Discrepancy in Discrete Diffusion for Text Generation
101DiffETM2025.1ShaoICASSP 2025DiffETM: Diffusion Process Enhanced Embedded Topic Model
100SLD2024.12ZhuSegment-Level Diffusion: A Framework for Controllable Long-Form Generation with Diffusion Language Models
99Diffusion-EAGS2024.11KohConditional [MASK] Discrete Diffusion Language Model
98DPCL-Diff2024.11CaoAAAI 2025DPCL-Diff: The Temporal Knowledge Graph Reasoning Based on Graph Node Diffusion Model with Dual-Domain Periodic Contrastive Learning
972024.10OchsgithubPrivate Synthetic Text Generation with Diffusion Models
96EDLM2024.10XuICLR 2025Energy-Based Diffusion Language Models for Text Generation
95SMDM2024.10NiegithubICLR 2025Scaling up Masked Diffusion Models on Text
942024.10RenICLR 2025How Discrete and Continuous Diffusion Meet: Comprehensive Analysis of Discrete Diffusion Models via a Stochastic Integral Framework
93MGDM2024.10YegithubICLR 2025Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning
92DiffLM2024.10ZhouDiffLM: Controllable Synthetic Data Generation via Diffusion Language Models
91DiffuLLaMA2024.10GonggithubICLR 2025Scaling Diffusion Language Models via Adaptation from Autoregressive Models
90Meta-DiffuB2024.10ChuanggithubNeurIPS 2024Meta-DiffuB: A Contextualized Sequence-to-Sequence Text Diffusion Model with Meta-Exploration
89REPA2024.10YugithubICLR 2025Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think
88DiffusionCLS2024.9ChengithubEMNLP 2024An Effective Deployment of Diffusion LM for Data Augmentation in Low-Resource Sentiment Classification
87FMSeq2024.9LiugithubEMNLP 2024Enable Fast Sampling for Seq2Seq Text Diffusion
86FHS2024.9ZhengICLR 2025Masked Diffusion Models are Secretly Time-Agnostic Masked Models and Exploit Inaccurate Categorical Sampling
85ReflectDiffu2024.9YuangithubReflectDiffu: Reflect between Emotion-intent Contagion and Mimicry for Empathetic Response Generation via a RL-Diffusion Framework
84SpecDiff2024.8ChristopherNeurIPS 2024Speculative Diffusion Decoding: Accelerating Language Generation through Diffusion
83SEDD2023.10LougithubICML 2024Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution
82DGLM2024.7LovelacegithubACL 2024Diffusion Guided Language Modeling
81GDP2024.7ZhunullACL 2024Pinpointing Diffusion Grid Noise to Enhance Aspect Sentiment Quad Prediction
80DiffusPoll2024.7ChenggithubACL 2024DiffusPoll: Conditional Text Diffusion Model for Poll Generation
792024.4ZhanggithubCOLM 2024Forcing Diffuse Distributions out of Language Models
78RADD2024.6OugithubYour Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data
77MDLM2024.6SahoogithubICML 2024Simple and Effective Masked Diffusion Language Models
76CrossMamba2024.7Discrete Diffusion Language Model for Long Text Summarization
752024.6DeschenauxPromises, Outlooks and Challenges of Diffusion Language Modeling
74DIFFGLAT2024.6QianNAACL 2024Diffusion Glancing Transformer for Parallel Sequence-to-Sequence Learning
73P3Sum2024.6LiugithubNAACL 2024P3Sum: Preserving Author’s Perspective in News Summarization with Diffusion Language Models
72DiffusionDialog2024.4XianggithubLREC-COLING 2024DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Space
71LDP2024.4ZougithubFCSEnforcing Paraphrase Generation via Controllable Latent Diffusion
70LanguageFlow2024.3ZhangNAACL 2024LanguageFlow: Advancing Diffusion Language Generation with Probabilistic Flows
69FlowSeq2024.3HugithubEACL 2024Flow Matching for Conditional Text Generation in a Few Sampling Steps
68IPED2024.3ZhaonullNAACL 2024IPED: An Implicit Perspective for Relational Triple Extraction based on Diffusion Model
67TEncDM2024.2ShabalingithubAAAI 2025TEncDM: Understanding the Properties of the Diffusion Model in the Space of Language Model Encodings
66DiffuCOMET2024.2GaogithubACL 2024DiffuCOMET: Contextual Commonsense Knowledge Diffusion
65DiffusionABSA2024.2LiugithubLREC-COLING 2024Let's Rectify Step by Step: Improving Aspect-based Sentiment Analysis with Diffusion Models
64TREC2024.2LiuAAAI 2024Text Diffusionwith Reinforced Conditioning
63Thinker-DDM2024.2NachmaniRethinking Human-like Translation Strategy: Integrating Drift-Diffusion Model with Large Language Models for Machine Translation
62QE-CDLM2024.2KanggithubQuantized Embedding Vectors for Controllable Diffusion Language Models
61DoT2024.2YegithubNeurIPS 2024Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models
60AR2Diff2024.1HanNeurIPS 2024Transfer Learning for Text Diffusion Models
59ROIC-DM2024.1YuanROIC-DM: Robust Text Inference and Classification via Diffusion Model
58LDSeq2023.12DingCSAI 2023LDSeq: Latent Diffusion Models for Sequence to Sequence Text Generation
57CodeFusion2023.12SinghgithubEMNLP 2023CodeFusion: A Pre-trained Diffusion Model for Code Generation
56DWGF2023.10ShigithubEMNLP 2023A Diffusion Weighted Graph Framework for New Intent Discovery
55ScanDL2023.10BolligergithubEMNLP 2023ScanDL: A Diffusion Model for Generating Synthetic Scanpaths on Texts
54DeTiME2023.10XugithubEMNLP 2023DeTiME: Diffusion-Enhanced Topic Modeling using Encoder-decoder based LLM
53InfoDiffusion2023.10WanggithubEMNLP 2023InfoDiffusion: Information Entropy Aware Diffusion Process for Non-Autoregressive Text Generation
52DiffuSeq-v22023.10GonggithubEMNLP 2023DiffuSeq-v2: Bridging Discrete and Continuous Text Spaces for Accelerated Seq2Seq Diffusion Models
51Diffusionllm2023.8YegithubDiffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning
50ParaGuide2023.8HorvitzgithubAAAI 2024ParaGuide: Guided Diffusion Paraphrasers for Plug-and-Play Textual Style Transfer
49Diff-KPE2023.8LuoLREC-COLING 2024Enhancing Phrase Representation by Information Bottleneck Guided Text Diffusion Process for Keyphrase Extraction
48XDLM2023.7ChengithubXDLM: Cross-lingual Diffusion Language Model for Machine Translation
472023.7WanggithubECAI 2023How Does Diffusion Influence Pretrained Language Models on Out-of-Distribution Data?
46PLANNER2023.6ZhanggithubNeurIPS 2023PLANNER: Generating Diversified Paragraph via Latent Language Diffusion Model
45PoetryDiffusion2023.6HugithubAAAI 2024PoetryDiffusion: Towards Joint Semantic and Metrical Manipulation in Poetry Generation
44DiffuDetox2023.6FlotogithubACL 2023DiffuDetox: A Mixed Diffusion Model for Text Detoxification
43BG-diffusion2023.6TanggithubACL 2023Can Diffusion Model Achieve Better Performance in Text Generation? Bridging the Gap between Training and Inference!
42DIFFUSEMP2023.6BigithubACL 2023DiffusEmp: A Diffusion Model-Based Framework with Multi-Grained Control for Empathetic Response Generation
41SIDDMs2023.6XuNeurIPS 2023Semi-Implicit Denoising Diffusion Models
402023.5ZouA Survey of Diffusion Models in Natural Language Processing
39TESS2023.5MahabadigithubEACL 2024TESS: Text-to-Text Self-Conditioned Simplex Diffusion
38Diffusion-NAT2023.5zhougithubEACL 2024Diffusion-NAT: Self-Prompting Discrete Diffusion for Non-Autoregressive Text Generation
37DiffuSum2023.5ZhanggithubACL 2023DiffuSum: Generation Enhanced Extractive Summarization with Diffusion
36AR-Diffusion2023.5WugithubNeurIPS 2023AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation
35DiffuSeq_StylePTB2023.5LyugithubACL 2023Fine-grained Text Style Transfer with Diffusion-Based Language Models
342023.5LigithubIJCAI 2023Diffusion Models for Non-autoregressive Text Generation: A Survey
33SSD-22023.5HannullNAACL 2024David helps Goliath: Inference-Time Collaboration Between Small Specialized and Large General Diffusion LMs
32Plaid2023.5GulrajanigithubNeurIPS 2023Likelihood-Based Diffusion Language Models
31GlyphDiffusion2023.4LiGlyphDiffusion: Text Generation as Image Generation
30Masked-Diffuse LM2023.4ChengithubEMNLP 2023A Cheaper and Better Diffusion Language Model with Soft-Masked Noise
29RDM2023.2ZhenggithubCOLM 2024A reparameterized discrete diffusion model for text generation
28ControlNet2023.2ZhanggithubICCV 2023Adding Conditional Control to Text-to-Image Diffusion Models
27DINOISER2023.2YegithubTACL 2024DINOISER: diffused conditional sequence learning by manipulating noises
262023.2PidstrigachJMLR 2023Infinite-Dimensional Diffusion Models
25SeqDiffuSeq2022.12YuangithubNAACL 2024Text Diffusion Model with Encoder-Decoder Transformers for Sequence-to-Sequence Generation
24LD4LG2022.12LovelacegithubNeurIPS 2023Latent Diffusion for Language Generation
23GENIE2022.12LingithubICML 2023Text Generation with Diffusion Language Models: A Pre-training Approach with Continuous Paragraph Denoise
22Difformer2022.12GaogithubNAACL 2024Empowering Diffusion Models on the Embedding Space for Text Generation
21SED2022.11StrudelgithubSelf-conditioned Embedding Diffusion for Text Generation
20DiffusionBERT2022.11HegithubACL 2023DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models
19CDCD2022.11DielemanunofficialContinuous diffusion for categorical data
18DiffusER2022.10ReidnullICLR 2023DiffusER: Discrete Diffusion via Edit-based Reconstruction
17SSD-LM2022.10HangithubACL2023Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Control
16DiffuSeq2022.10GonggithubICLR 2023DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models
152022.9YanggithubACM Computing SurveysDiffusion Models: A Comprehensive Survey of Methods and Applications
14LatentOps2022.8LiugithubEMNLP 2023Composable Text Controls in Latent Space with ODEs
13Bit Diffusion2022.8ChengithubICLR 2023Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioning
12Classifier-Free2022.7HogithubNeurIPS 2021Classifier-Free Diffusion Guidance
11Diffusion-LM2022.5LigithubNeurIPS 2022Diffusion-LM Improves Controllable Text Generation
10SUNDAE2021.12SavinovunofficialICLR 2022Step-unrolled Denoising Autoencoders for Text Generation
9LDM2021.12RombachgithubCVPR 2022High-Resolution Image Synthesis with Latent Diffusion Models
8ARDM2021.10HoogeboomgithubICLR 2022Autoregressive Diffusion Models
7VDM2021.7KingmagithubNeurIPS 2021Variational Diffusion Models
6D3PMs2021.7AustinunofficialNeurIPS 2021Structured Denoising Diffusion Models in Discrete State-Spaces
5Classifier-guidance2021.5DhariwalgithubNeurIPS 2021Diffusion Models Beat GANs on Image Synthesis
4IDDPM2021.2NicholgithubICML 2021Improved Denoising Diffusion Probabilistic Models
3Argmax Flows2021.2HoogeboomgithubNeurIPS 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions
2TimeGrad2021.1RasulgithubICML 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting
1DDIM2020.10SonggithubICLR 2021Denoising Diffusion Implicit Models
0DDPM2020.6HogithubNeurIPS 2020Denoising Diffusion Probabilistic Models