Awesome-GenAI-Unlearning

April 22, 2026 · View on GitHub

PRs Welcome Awesome

This repository contains a list of papers on Generative AI Machine Unlearning based on our survey paper: Machine Unlearning in Generative AI: A Survey (Zheyuan (Frank) Liu, Guangyao Dou, Zhaoxuan Tan, Yijun Tian and Meng Jiang). We categorize existing works based on their modality, and applications. Additionally, we include datasets and benchmarks for various unlearning scenarios.

Table of Contents

Datasets, Benchmarks:

Datasets:

Safety Alignment

  • LAION LAION-400-MILLION OPEN DATASET (code)
  • Civil Comments [CoRR 2019] Nuanced metrics for measuring unintended bias with real data for text classification (code)
  • PKU-SafeRLHF [arxiv 2310.12773] Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback (code)
  • Anthropic red team [arxiv 2204.05862] Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback (code)

Copyrights Protection

  • Harry Potter Copyright issue, cannot be disclosed.
  • Bookcorpus [arxiv 1506.06724] Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Books (code)
  • TOFU [arxiv 2401.06121] TOFU: A Task of Fictitious Unlearning for LLMs (code)

Hallucination Reduction

  • HaluEVAL [EMNLP 2023] HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models (code)
  • TruthfulQA [ACL 2023] TruthfulQA: Measuring How Models Mimic Human Falsehoods (code)
  • CounterFact [NeurIPS 2022] Locating and Editing Factual Associations in GPT (code)
  • ZsRE [CoNLL 2017] Zero-Shot Relation Extraction via Reading Comprehension (code)
  • MSCOCO [arxiv 1405.0312] Microsoft COCO: Common Objects in Context (code)

Privacy Compliance

  • Pile [arxiv 2101.00027] The Pile: An 800GB Dataset of Diverse Text for Language Modeling (code)
  • Yelp/Amazon Reviews (code)
  • SST-2 [EMNLP 2013] Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank (code)
  • PersonaChat [arxiv 1801.07243] Personalizing Dialogue Agents: I have a dog, do you have pets too? (code)
  • LEDGAR [ACL 2020] LEDGAR: A Large-Scale Multilabel Corpus for Text Classification of Legal Provisions in Contracts (code)
  • SAMsum [ACL 2019] SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarization (code)
  • IMDB (code)
  • CeleA-HQ [Neurips 2018] IntroVAE: Introspective Variational Autoencoders for Photographic Image Synthesis (code)
  • I2P Inappropriate Image Prompts (I2P) Benchmark (code)

Bias/Unfairness Alleviation

  • StereoSet [ACL 2021] StereoSet: Measuring stereotypical bias in pretrained language models (code)
  • HateXplain [AAAI 2021] HateXplain: A Benchmark Dataset for Explainable Hate Speech Detection (code)
  • CrowS Pairs [EMNLP 2021] CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models (code)

Benchmarks:

Generative Image Models

  • UnlearnCanvas [arxiv 2402.11846] UnlearnCanvas: A Stylized Image Dataaset to Benchmark Machine Unlearning for Diffusion Models (code)

VisionUnlearning (https://github.com/LeonardoSanBenitez/vision-unlearning) is a framework for unlearning algorithms, datasets, metrics, and evaluation methodologies commonly used in Machine Unlearning for vision-related tasks, such as image classification and image generation

LLMs

  • TOFU [arxiv 2401.06121] TOFU: A Task of Fictitious Unlearning for LLMs (code)
  • WMDP [arxiv 2403.03218] The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearning (code)
  • MUSE [arxiv 2407.06460] MUSE: Machine Unlearning Six-Way Evaluation for Language Models (code)

OpenUnlearning (https://github.com/locuslab/open-unlearning) is an framework that aims to unify LLM unlearning by implementing prior research in one place. It provides the TOFU, MUSE unlearning benchmarks while supporting multiple unlearning methods, datasets, evaluation metrics, and LLM architectures.

LMMs

  • FIU-Bench: Benchmarking Vision Language Model Unlearning via Fictitious Facial Identity Dataset (code)
  • MLLMU-Bench: [arxiv 2410.22108] Protecting Privacy in Multimodal Large Language Models with MLLMU-Bench (code)
  • CLEAR: [arXiv:2410.18057] CLEAR: Character Unlearning in Textual and Visual Modalities (code)
  • Object HalBench: [EMNLP 2018] Object Hallucination in Image Captioning (code)
  • MMUBench:【202405】Single Image Unlearning: Efficient Machine Unlearning in Multimodal Large Language Models (PDF)
  • MHumanEval: [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback (code)
  • LLaVA Bench: [Neurips 2023 (oral)] Visual Instruction Tuning (code)
  • MMHal-Bench: Aligning Large Multimodal Models with Factually Augmented RLHF (code)
  • POPE: [EMNLP 2023] POPE: Polling-based Object Probing Evaluation for Object Hallucination (code)

Generative Image Models:

  • 【202507】Automating Evaluation of Diffusion Model Unlearning with (Vision-) Language Model World Knowledge (PDF)
  • [CVPR 2025] The Illusion of Unlearning: The Unstable Nature of Machine Unlearning in Text-to-Image Diffusion Models (PDF)
  • [BMVC 2025] CRCE: Coreference-Retention Concept Erasure in Text-to-Image Diffusion Models (PDF)
  • [202410] Meta-Unlearning on Diffusion Models: Preventing Relearning Unlearned Concepts (PDF, code)
  • [202409] Enhancing User-Centric Privacy Protection: An Interactive Framework through Diffusion Models and Machine Unlearning (PDF)
  • [202407] Unlearning Concepts from Text-to-Video Diffusion Models (PDF)
  • [AAAI 2025] Unlearning Concepts in Diffusion Model via Concept Domain Correction and Concept Preserving Gradient (PDF, code)
  • [202401] Erasediff: Erasing data influence in diffusion models (PDF)
  • [ICLR 2024] Machine Unlearning for Image-to-Image Generative Models (PDF, code)
  • [ICLR 2024] SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation (PDF, code)
  • [MIDL 2024] Erase to Enhance: Data-Efficient Machine Unlearning in MRI Reconstruction (PDF, code)
  • [ICCV 2023] Ablating Concepts in Text-to-Image Diffusion Models (PDF, code)
  • [202312] FAST: Feature Aware Similarity Thresholding for Weak Unlearning in Black-Box Generative Models (PDF, code)
  • [202311] Receler: Reliable Concept Erasing of Text-to-Image Diffusion Models via Lightweight Erasers (PDF)
  • [202310] Feature Unlearning for Pre-trained GANs and VAEs (PDF)
  • [202310] To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Now (PDF, code)
  • [202309] Adapt then Unlearn: Exploiting Parameter Space Semantics for Unlearning in Generative Adversarial Networks (PDF)
  • [202308] Generative Adversarial Networks Unlearning (PDF)
  • [202306] Training data attribution for diffusion models (PDF, code)
  • [202305] Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models (PDF, code)
  • [202303] Erasing Concepts from Diffusion Models (PDF, code)
  • [202303] Forget-me-not: Learning to forget in text-to-image diffusion models (PDF, code)

Large Language Models (LLMs):

  • 【202604】CURE:Circuit-Aware Unlearning for LLM-based Recommendation (PDF)
  • 【202603】Simulating Novice Students Using Machine Unlearning and Relearning in Large Language Models (PDF)
  • 【202603】Attention Smoothing Is All You Need For Unlearning (PDF)
  • 【202602】REBEL: Hidden Knowledge Recovery via Evolutionary-Based Evaluation Loop (PDF, code)
  • 【202602】MeGU: Machine-Guided Unlearning with Target Feature Disentanglement (PDF)
  • 【202602】Layer-Targeted Multilingual Knowledge Erasure in Large Language Models (PDF)
  • 【202602】GONE: Structural Knowledge Unlearning via Neighborhood-Expanded Distribution Shaping (PDF)
  • 【202601】Representation-Aware Unlearning via Activation Signatures: From Suppression to Knowledge-Signature Erasure (PDF)
  • 【202601】Reinforcement Unlearning via Group Relative Policy Optimization (PDF)
  • 【202601】LLMs Can Unlearn Refusal with Only 1,000 Benign Samples (PDF, code)
  • 【202601】JPU: Bridging Jailbreak Defense and Unlearning via On-Policy Path Rectification (PDF)
  • 【202601】From Logits to Latents: Contrastive Representation Shaping for LLM Unlearning (PDF)
  • 【202601】Forgetting Similar Samples: Can Machine Unlearning Do it Better? (PDF)
  • 【202601】Evaluating Cross-Lingual Unlearning in Multilingual Language Models (PDF)
  • 【202601】Data-Free Privacy-Preserving for LLMs via Model Inversion and Selective Unlearning (PDF)
  • 【202601】Behemoth: Benchmarking Unlearning in LLMs Using Fully Synthetic Data (PDF, code)
  • 【202512】Recover-to-Forget: Gradient Reconstruction from LoRA for Efficient LLM Unlearning (PDF)
  • 【202511】DRAGON: Guard LLM Unlearning in Context via Negative Detection and Reasoning (PDF)
  • 【202511】Beyond Superficial Forgetting: Thorough Unlearning through Knowledge Density Estimation and Block Re-insertion (PDF)
  • 【202510】Uncovering the Potential Risks in Unlearning: Danger of English-only Unlearning in Multilingual LLMs (PDF)
  • 【202510】Leverage Unlearning to Sanitize LLMs (PDF)
  • 【202510】Label Smoothing Improves Gradient Ascent in LLM Unlearning (PDF)
  • 【202510】LLM Unlearning on Noisy Forget Sets: A Study of Incomplete, Rewritten, and Watermarked Data (PDF)
  • 【202510】Hierarchical Federated Unlearning for Large Language Models (PDF)
  • 【202510】(Token-Level) InfoRMIA: Stronger Membership Inference and Memorization Assessment for LLMs (PDF)
  • 【202509】Sparse-Autoencoder-Guided Internal Representation Unlearning for Large Language Models (PDF)
  • 【202509】Scalable and Robust LLM Unlearning by Correcting Responses with Retrieved Exclusions (PDF)
  • 【202509】Reveal and Release: Iterative LLM Unlearning with Self-generated Data (PDF)
  • 【202509】OFMU: Optimization-Driven Framework for Machine Unlearning (PDF)
  • 【202509】Mitigating Biases in Language Models via Bias Unlearning (PDF)
  • 【202509】Erase or Hide? Suppressing Spurious Unlearning Neurons for Robust Unlearning (PDF)
  • 【202509】Collapse of Irrelevant Representations (CIR) Ensures Robust and Non-Disruptive LLM Unlearning (PDF)
  • 【202509】Can Prompts Rewind Time for LLMs? Evaluating the Effectiveness of Prompted Knowledge Cutoffs (PDF, code)
  • 【202508】Surgical Knowledge Rewrite in Compact LLMs: An 'Unlearn-then-Learn' Strategy with (IA3IA^3) for Localized Factual Modulation and Catastrophic Forgetting Mitigation (PDF)
  • 【202508】DUP: Detection-guided Unlearning for Backdoor Purification in Language Models (PDF)
  • 【202508】CRISP: Persistent Concept Unlearning via Sparse Autoencoders (PDF)
  • 【202506】Constrained Entropic Unlearning: A Primal-Dual Framework for Large Language Models (PDF)
  • 【202503】ZJUKLAB at SemEval-2025 Task 4: Unlearning via Model Merging (PDF)
  • 【202503】Machine Unlearning in Hyperbolic vs. Euclidean Multimodal Contrastive Learning: Adapting Alignment Calibration to MERU (PDF)
  • 【202503】Deep Contrastive Unlearning for Language Models (PDF)
  • 【202503】Atyaephyra at SemEval-2025 Task 4: Low-Rank NPO (PDF)
  • 【202503】Don't Forget It! Conditional Sparse Autoencoder Clamping Works for Unlearning (PDF)
  • 【202503】SAEBench: A Comprehensive Benchmark for Sparse Autoencoders in Language Model Interpretability (PDF)
  • 【202503】GRU: Mitigating the Trade-off between Unlearning and Retention for Large Language Models (PDF)
  • 【202503】Effective Skill Unlearning through Intervention and Abstention (PDF)
  • 【202503】Cyber for AI at SemEval-2025 Task 4: Forgotten but Not Lost: The Balancing Act of Selective Unlearning in Large Language Models (PDF)
  • 【202503】UIPE: Enhancing LLM Unlearning by Removing Knowledge Related to Forgetting Targets (PDF)
  • 【202503】Improving LLM Safety Alignment with Dual-Objective Optimization (PDF)
  • 【202503】AILS-NTUA at SemEval-2025 Task 4: Parameter-Efficient Unlearning for Large Language Models using Data Chunking (PDF)
  • 【202503】CE-U: Cross Entropy Unlearning (PDF)
  • 【202502】FaithUn: Toward Faithful Forgetting in Language Models by Investigating the Interconnectedness of Knowledge (PDF)
  • 【202502】Holistic Audit Dataset Generation for LLM Unlearning via Knowledge Graph Traversal and Redundancy Removal (PDF)
  • 【202502】A General Framework to Enhance Fine-tuning-based LLM Unlearning (PDF)
  • 【202502】Erasing Without Remembering: Safeguarding Knowledge Forgetting in Large Language Models (PDF)
  • 【202502】Rethinking LLM Unlearning Objectives: A Gradient Perspective and Go Beyond (PDF)
  • 【202502】Tokens for Learning, Tokens for Unlearning: Mitigating Membership Inference Attacks in Large Language Models via Dual-Purpose Training (PDF)
  • 【202502】Soft Token Attacks Cannot Reliably Audit Unlearning in Large Language Models (PDF)
  • 【202502】CoME: An Unlearning-based Approach to Conflict-free Model Editing (PDF)
  • 【202502】LUME: LLM Unlearning with Multitask Evaluations (PDF)
  • 【202502】UPCORE: Utility-Preserving Coreset Selection for Balanced Unlearning (PDF)
  • 【202502】Obliviate: Efficient Unmemorization for Protecting Intellectual Property in Large Language Models (PDF)
  • 【202502】Beyond Single-Value Metrics: Evaluating and Enhancing LLM Unlearning with Cognitive Diagnosis (PDF)
  • 【202502】Which Retain Set Matters for LLM Unlearning? A Case Study on Entity Unlearning (PDF)
  • 【202502】ReLearn: Unlearning via Learning for Large Language Models (PDF)
  • 【202502】LUNAR: LLM Unlearning via Neural Activation Redirection (PDF)
  • 【202502】Mitigating Sensitive Information Leakage in LLMs4Code through Machine Unlearning (PDF)
  • 【202502】Towards LLM Unlearning Resilient to Relearning Attacks: A Sharpness-Aware Minimization Perspective and Beyond (PDF)
  • 【202502】Model Tampering Attacks Enable More Rigorous Evaluations of LLM Capabilities (PDF)
  • 【202502】FALCON: Fine-grained Activation Manipulation by Contrastive Orthogonal Unalignment for Large Language Model (PDF)
  • 【202502】Tool Unlearning for Tool-Augmented LLMs (PDF)
  • 【202502】ALU: Agentic LLM Unlearning (PDF)
  • 【202502】Resolving Editing-Unlearning Conflicts: A Knowledge Codebook Framework for Large Language Model Updating (PDF)
  • 【202501】Improving the Robustness of Representation Misdirection for Large Language Model Unlearning (PDF)
  • 【ICLR 2025】A Probalisitic Perspective On Unlearning And Alignment For Large Language Models (PDF)
  • 【AAAI 2025】Backdoor Token Unlearning: Exposing and Defending Backdoors in Pretrained Language Models (PDF)
  • 【202411】Towards Robust Evaluation of Unlearning in LLMs via Data Transformations (PDF)
  • 【202410】Position: LLM Unlearning Benchmarks are Weak Measures of Progress (PDF)
  • 【202410】Erasing Conceptual Knowledge from Language Models (PDF, Code)
  • 【202410】Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearning (PDF, Code)
  • 【202410】A Closer Look at Machine Unlearning for Large Language Models (PDF, Code)
  • 【202409】Alternate Preference Optimization for Unlearning Factual Knowledge in Large Language Models (PDF)
  • 【202409】LLM Surgery: Efficient Knowledge Unlearning and Editing in Large Language Models (PDF)
  • 【202409】An Adversarial Perspective on Machine Unlearning for AI Safety (PDF)
  • 【202408】Forget to Flourish: Leveraging Machine-Unlearning on Pretrained Language Models for Privacy Leakage (PDF)
  • 【202408】On Effects of Steering Latent Representation for Large Language Model Unlearning (PDF)
  • 【202408】Towards Robust and Cost-Efficient Knowledge Unlearning for Large Language Models (PDF)
  • 【202407】Practical Unlearning for Large Language Models (PDF)
  • 【202407】Towards Transfer Unlearning: Empirical Evidence of Cross-Domain Bias Mitigation (PDF)
  • 【202407】Safe Unlearning: A Surprisingly Effective and Generalizable Solution to Defend Against Jailbreak Attacks [PDF, code]
  • 【202406】Towards Reliable Empirical Machine Unlearning Evaluation: A Game-Theoretic View (PDF)
  • 【202406】SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning (PDF, code)
  • 【202406】Large Language Model Unlearning via Embedding-Corrupted Prompts [PDF, code]
  • 【202406】REVS: Unlearning Sensitive Information in Language Models via Rank Editing in the Vocabulary Space [PDF, code]
  • 【202406】Soft Prompting for Unlearning in Large Language Models (PDF, code)
  • 【202406】Avoiding Copyright Infringement via Machine Unlearning (PDF, code)
  • 【202405】Large Scale Knowledge Washing [PDF, code]
  • 【202405】Machine Unlearning in Large Language Models [PDF]
  • 【202404】Offset Unlearning for Large Language Models [PDF]
  • 【202404】Exact and Efficient Unlearning for Large Language Model-based Recommendation [PDF]
  • 【202404】Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning [PDF]
  • 【202404】Eraser: Jailbreaking Defense in Large Language Models via Unlearning Harmful Knowledge [PDF]
  • 【202404】Digital Forgetting in Large Language Models: A Survey of Unlearning Methods [PDF]
  • 【202403】The Frontier of Data Erasure: Machine Unlearning for Large Language Models [PDF]
  • 【ICML 2024】Larimar: Large Language Models with Episodic Memory Control. (PDF, code)
  • 【202403】Second-Order Information Matters: Revisiting Machine Unlearning for Large Language Models [PDF]
  • 【202403】Dissecting Language Models: Machine Unlearning via Selective Pruning (PDF, code)
  • 【202403】Guardrail Baselines for Unlearning in LLMs [PDF]
  • 【202403】Towards Efficient and Effective Unlearning of Large Language Models for Recommendation [PDF]
  • 【202403】The WMDP Benchmark: Measuring and Reducing Malicious Use with Unlearning [PDF]
  • 【202402】Deciphering the Impact of Pretraining Data on Large Language Models through Machine Unlearning (PDF)
  • 【202402】Eight Methods to Evaluate Robust Unlearning in LLMs [PDF]
  • 【ACL 2024】Machine Unlearning of Pre-trained Large Language Models [PDF]
  • 【202402】EFUF: Efficient Fine-grained Unlearning Framework for Mitigating Hallucinations in Multimodal Large Language Models [PDF]
  • 【202402】Unmemorization in Large Language Models via Self-Distillation and Deliberate Imagination [PDF]
  • 【ACL 2024】Towards Safer Large Language Models through Machine Unlearning [PDF, code]
  • 【202402】Rethinking Machine Unlearning for Large Language Models [PDF]
  • 【202402】Selective Forgetting: Advancing Machine Unlearning Techniques and Evaluation in Language Models [PDF]
  • 【202401】Unlearning Reveals the Influential Training Data of Language Models [PDF]
  • 【202401】TOFU: A Task of Fictitious Unlearning for LLMs [PDF]
  • 【202312】Learning and Forgetting Unsafe Examples in Large Language Models [PDF]
  • 【NeurIPS2023 Workshop】FAIRSISA: ENSEMBLE POST-PROCESSING TO IMPROVE FAIRNESS OF UNLEARNING IN LLMS [PDF]
  • 【202311】Knowledge Unlearning for LLMs: Tasks, Methods, and Challenges [PDF]
  • 【202311】Forgetting before Learning: Utilizing Parametric Arithmetic for Knowledge Updating in Large Language Models [PDF]
  • 【202311】Making Harmful Behaviors Unlearnable for Large Language Models [PDF]
  • 【EMNLP 2023】Preserving Privacy Through Dememorization: An Unlearning Technique For Mitigating Memorization Risks In Language Models (PDF)
  • 【EMNLP 2023】Unlearn What You Want to Forget: Efficient Unlearning for LLMs [PDF]
  • 【202310】DEPN: Detecting and Editing Privacy Neurons in Pretrained Language Models (PDF)
  • 【202310】Large Language Model Unlearning (PDF, code)
  • 【202310】In-Context Unlearning: Language Models as Few Shot Unlearners (PDF, code)
  • 【202310】Who’s Harry Potter? Approximate Unlearning in LLMs (PDF)
  • 【202309】 Forgetting Private Textual Sequences in Language Models via Leave-One-Out Ensemble (PDF)
  • 【202309】Neural Code Completion Tools Can Memorize Hard-coded Credentials (PDF, code)
  • 【202308】Separate the Wheat from the Chaff: Model Deficiency Unlearning via Parameter-Efficient Module Operation (PDF, code)
  • 【202307】Make Text Unlearnable: Exploiting Effective Patterns to Protect Personal Data (PDF)
  • 【202307】What can we learn from Data Leakage and Unlearning for Law? (PDF)
  • 【202306】Composing Parameter-Efficient Modules with Arithmetic Operations (PDF)
  • 【202305】KGA: A General Machine Unlearning Framework Based on Knowledge Gap Alignment (PDF)
  • 【202305】Right to be Forgotten in the Era of Large Language Models: Implications, Challenges, and Solutions (PDF)
  • 【202302】Knowledge Unlearning for Mitigating Privacy Risks in Language Models (PDF, code)
  • 【ACL2023】Unlearning Bias in Language Models by Partitioning Gradients (PDF, code)
  • 【202212】Privacy Adhering Machine Un-learning in NLP (PDF)
  • 【NeurIPS 2022】Quark: Controllable Text Generation with Reinforced Unlearning (PDF)
  • 【ACL 2022】Knowledge Neurons in Pretrained Transformers (PDF, code)
  • 【NeurIPS 2022】Editing Models with Task Arithmetic (PDF, code)
  • 【CCS 2020】Analyzing Information Leakage of Updates to Natural Language Models (PDF)

Large Multimodal Models (LMMs):

  • 【202512】Robust MLLM Unlearning via Visual Knowledge Distillation (PDF)
  • 【202512】Hierarchy-Aware Multimodal Unlearning for Medical AI (PDF)
  • 【202510】Approximate Domain Unlearning for Vision-Language Models (PDF)
  • 【202503】SAUCE: Selective Concept Unlearning in Vision-Language Models with Sparse Autoencoders (PDF)
  • 【202503】PEBench: A Fictitious Dataset to Benchmark Machine Unlearning for Multimodal Large Language Models (PDF)
  • 【202503】Hyperbolic Safety-Aware Vision-Language Models (PDF)
  • 【202503】Safety Mirage: How Spurious Correlations Undermine VLM Safety Fine-tuning (PDF)
  • 【202502】SAFEERASER: Enhancing Safety in Multimodal Large Language Models through Multimodal Machine Unlearning (PDF)
  • 【202502】Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language Models (PDF)
  • 【202503】MMUNLEARNER: Reformulating Multimodal Machine Unlearning in the Era of Multimodal Large Language Models (PDF)
  • 【202410】NegMerge: Consensual Weight Negation for Strong Machine Unlearning (PDF, code)
  • 【202407】Direct Unlearning Optimization for Robust and Safe Text-to-Image Models (PDF)
  • 【202406】Alignment Calibration: Machine Unlearning for Contrastive Learning under Auditing (PDF)
  • 【202406】MU-Bench: A Multitask Multimodal Benchmark for Machine Unlearning (PDF, code)
  • 【202405】Cross-Modal Safety Alignment: Is textual unlearning all you need? [PDF]
  • 【202405】Single Image Unlearning: Efficient Machine Unlearning in Multimodal Large Language Models (PDF)
  • 【202403】Unlearning Backdoor Threats: Enhancing Backdoor Defense in Multimodal Contrastive Learning via Local Token Unlearning (PDF)
  • 【202402】EFUF: Efficient Fine-grained Unlearning Framework for Mitigating Hallucinations in Multimodal Large Language Models (PDF)
  • 【202311】MultiDelete for Multimodal Machine Unlearning (PDF)

Applications:

Safety Alignment:

  • 【202601】LLMs Can Unlearn Refusal with Only 1,000 Benign Samples (PDF, code)
  • 【202601】JPU: Bridging Jailbreak Defense and Unlearning via On-Policy Path Rectification (PDF)
  • 【202310】Large Language Model Unlearning (PDF, code)
  • 【202404】Eraser: Jailbreaking Defense in Large Language Models via Unlearning Harmful Knowledge [PDF]
  • 【202401】Unlearning Reveals the Influential Training Data of Language Models [PDF]
  • 【ICLR 2024】 SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation (PDF, code)
  • 【202305】 Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models (PDF, code)
  • 【202401】 Erasediff: Erasing data influence in diffusion models (PDF)
  • 【202303】 Erasing Concepts from Diffusion Models (PDF, code)
  • 【202312】Learning and Forgetting Unsafe Examples in Large Language Models [PDF]
  • 【202311】 Receler: Reliable Concept Erasing of Text-to-Image Diffusion Models via Lightweight Erasers (PDF)
  • 【EMNLP 2023】Unlearn What You Want to Forget: Efficient Unlearning for LLMs [PDF]
  • 【ACL 2024】Towards Safer Large Language Models through Machine Unlearning [PDF, code]
  • 【NeurIPS 2022】Editing Models with Task Arithmetic (PDF, code)
  • 【202308】Separate the Wheat from the Chaff: Model Deficiency Unlearning via Parameter-Efficient Module Operation (PDF, code)
  • 【202306】Composing Parameter-Efficient Modules with Arithmetic Operations (PDF)
  • 【202309】 Adapt then Unlearn: Exploiting Parameter Space Semantics for Unlearning in Generative Adversarial Networks (PDF)
  • 【202406】Avoiding Copyright Infringement via Machine Unlearning (PDF, code)
  • 【202302】Knowledge Unlearning for Mitigating Privacy Risks in Language Models (PDF, code)
  • 【202310】Large Language Model Unlearning (PDF, code)
  • 【202310】Who’s Harry Potter? Approximate Unlearning in LLMs (PDF)
  • 【202303】Forget-me-not: Learning to forget in text-to-image diffusion models (PDF, code)

Hallucination Reduction:

  • 【202310】Large Language Model Unlearning (PDF, code)
  • 【202311】MultiDelete for Multimodal Machine Unlearning (PDF)
  • 【202401】Unlearning Reveals the Influential Training Data of Language Models [PDF]
  • 【202402】EFUF: Efficient Fine-grained Unlearning Framework for Mitigating Hallucinations in Multimodal Large Language Models (PDF)
  • 【202405】Large Scale Knowledge Washing [PDF, code]
  • 【202308】Separate the Wheat from the Chaff: Model Deficiency Unlearning via Parameter-Efficient Module Operation (PDF, code)
  • 【ICML 2024】Larimar: Large Language Models with Episodic Memory Control. (PDF, code)

Privacy Compliance:

  • 【202601】Data-Free Privacy-Preserving for LLMs via Model Inversion and Selective Unlearning (PDF)
  • 【202510】(Token-Level) InfoRMIA: Stronger Membership Inference and Memorization Assessment for LLMs (PDF)
  • 【202311】 MultiDelete for Multimodal Machine Unlearning (PDF)
  • 【202302】Knowledge Unlearning for Mitigating Privacy Risks in Language Models (PDF, code)
  • 【202310】Large Language Model Unlearning (PDF, code)
  • 【202404】Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning [PDF]
  • 【202403】Second-Order Information Matters: Revisiting Machine Unlearning for Large Language Models [PDF]
  • 【202307】Make Text Unlearnable: Exploiting Effective Patterns to Protect Personal Data (PDF)
  • 【202305】 Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models (PDF, code)
  • 【ICLR 2024】Machine Unlearning for Image-to-Image Generative Models (PDF, code)
  • 【202308】Generative Adversarial Networks Unlearning (PDF)
  • 【202309】Adapt then Unlearn: Exploiting Parameter Space Semantics for Unlearning in Generative Adversarial Networks (PDF)
  • 【202310】Feature Unlearning for Pre-trained GANs and VAEs (PDF)
  • 【EMNLP 2023】Preserving Privacy Through Dememorization: An Unlearning Technique For Mitigating Memorization Risks In Language Models (PDF)
  • 【202303】Forget-me-not: Learning to forget in text-to-image diffusion models (PDF, code)
  • 【202402】Selective Forgetting: Advancing Machine Unlearning Techniques and Evaluation in Language Models [PDF]
  • 【NeurIPS 2022】Quark: Controllable Text Generation with Reinforced Unlearning (PDF)
  • 【202402】Unmemorization in Large Language Models via Self-Distillation and Deliberate Imagination [PDF]
  • 【202404】Offset Unlearning for Large Language Models [PDF]
  • 【202305】KGA: A General Machine Unlearning Framework Based on Knowledge Gap Alignment (PDF)
  • 【202309】Forgetting Private Textual Sequences in Language Models via Leave-One-Out Ensemble (PDF)
  • 【202306】Training data attribution for diffusion models (PDF, code)
  • 【EMNLP 2023】Unlearn What You Want to Forget: Efficient Unlearning for LLMs [PDF]
  • 【202212】Privacy Adhering Machine Un-learning in NLP (PDF)
  • 【202311】 Receler: Reliable Concept Erasing of Text-to-Image Diffusion Models via Lightweight Erasers (PDF)
  • 【202310】In-Context Unlearning: Language Models as Few Shot Unlearners (PDF, code)

Bias/Unfairness Alleviation:

  • 【202509】Mitigating Biases in Language Models via Bias Unlearning (PDF)
  • 【ACL2023】Unlearning Bias in Language Models by Partitioning Gradients (PDF, code)
  • 【202401】Unlearning Reveals the Influential Training Data of Language Models [PDF]
  • 【NeurIPS2023 Workshop】FAIRSISA: ENSEMBLE POST-PROCESSING TO IMPROVE FAIRNESS OF UNLEARNING IN LLMS [PDF]

Other Surveys:

  • Open Problems in Machine Unlearning for AI Safety (PDF)
  • A Comprehensive Survey of Machine Unlearning Techniques for Large Language Models (PDF)
  • Machine Unlearning Doesn’t Do What You Think: Lessons for Generative AI Policy, Research, and Practice (PDF)
  • Position: LLM Unlearning Benchmarks are Weak Measures of Progress (PDF)
  • Preserving Privacy in Large Language Models: A Survey on Current Threats and Solutions (PDF)
  • Eight Methods to Evaluate Robust Unlearning in LLMs (PDF)
  • Rethinking Machine Unlearning for Large Language Models. (PDF)
  • Digital Forgetting in Large Language Models: A Survey of Unlearning Methods. (PDF)
  • Knowledge unlearning for llms: Tasks, methods, and challenges. (PDF)
  • Copyright Protection in Generative AI: A Technical Perspective. (PDF)
  • Machine Unlearning for Traditional Models and Large Language Models: A Short Survey. (PDF)
  • Right to be forgotten in the era of large language models: Implications, challenges, and solutions. (PDF)
  • Threats, attacks, and defenses in machine unlearning: A survey. (PDF)
  • On the Limitations and Prospects of Machine Unlearning for Generative AI (PDF)

Contributing:

👍 Contributions to this repository are welcome! We will try to make this list updated. If you find any error or any missed paper, please don't hesitate to open an issue or pull request.