README.md

---

🙋 Please let us know if you find out a mistake or have any suggestions!

🌟 If you find this resource helpful, please consider to star this repository and cite our research:

@article{cheng2025survey,
  title={A Survey on Knowledge-Oriented Retrieval-Augmented Generation},
  author={Mingyue Cheng and Yucong Luo and Jie Ouyang and Qi Liu and Huijie Liu and Li Li and Shuo Yu and Bohou Zhang and Jiawei Cao and Jie Ma and Daoyu Wang and Enhong Chen},
  journal={arXiv preprint arXiv:2503.10677},
  year={2025}
}

Updates/News:

🚩 News (Oct. 2024): The preparatory phase was completed, including contributor confirmation and task allocation.

🚩 News (Jan. 2025): The main content of the survey was completed, with further refinements ongoing.

🚩 News (Mar. 2025): The final version of the survey was polished and successfully submitted to arXiv.

Introduction

This repository is dedicated to collecting and categorizing papers on Knowledge-Oriented Retrieval-Augmented Generation (RAG) based on our survey paper: A Survey on Knowledge-Oriented Retrieval-Augmented Generation. Given the rapid advancements in this field, we will continue to update both the paper and this repository.

• RAG consists of three main components: (1) A query is processed by an LLM with its internal knowledge, (2) External knowledge is retrieved based on the query, and (3) Knowledge integration combines both internal and external knowledge to generate the final answer.

Basic RAG Approaches

1. User Intent Understanding

   • Query2doc: Query Expansion with Large Language Models

   • Tree of Clarifications: Answering Ambiguous Questions with Retrieval-Augmented Large Language Models

   • Precise Zero-Shot Dense Retrieval without Relevance Labels

   • RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generation

   • Dynamic Contexts for Generating Suggestion Questions in RAG Based Conversational Systems

2. Knowledge Source and Parsing

   • LESS: selecting influential data for targeted instruction tuning

   • Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models

   • Telco-RAG: Navigating the challenges of retrieval-augmented language models for telecommunications

3. Knowledge Embedding

   • C-Pack: Packaged Resources To Advance General Chinese Embedding

   • BGE M3-Embedding: Multi-Lingual, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation

   • LM-Cocktail: Resilient Tuning of Language Models via Model Merging

4. Knowledge Indexing

   • PineCone

   • LlamaIndex

   • RAPTOR: RECURSIVE ABSTRACTIVE PROCESSING FOR TREE-ORGANIZED RETRIEVAL

5. Knowledge Retrieval

   • Query Expansion by Prompting Large Language Models

   • Rat: Retrieval augmented thoughts elicit context-aware reasoning in long-horizon generation

   • React: Synergizing reasoning and acting in language models

6. Knowledge Integration

   • Chain-of-thought prompting elicits reasoning in large language models

   • Large Language Models Know Your Contextual Search Intent: A Prompting Framework for Conversational Search

   • ACTIVERAG: Revealing the Treasures of Knowledge via Active Learning

7. Answer Generation

   • Prompt Engineering Guide

   • Take a Step Back: Evoking Reasoning via Abstraction in Large Language Models

   • Active Prompting with Chain-of-Thought for Large Language Models

8. Knowledge Citation

   • Citation-Enhanced Generation for LLM-based Chatbot

   • KAUCUS: Knowledge Augmented User Simulators for Training Language Model Assistants

Advanced RAG Approaches

1. RAG Training

   • Improving Language Models by Retrieving from Trillions of Tokens

   • When Language Model Meets Private Library

   • CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis

2. Multimodal RAG

   • Make-an-audio: Text-to-audio generation with prompt-enhanced diffusion models

   • Retrievegan: Image synthesis via differentiable patch retrieval

   • Re-imagen: Retrievalaugmented text-to-image generator

3. Memory RAG

   • Memorizing transformers

   • Memory-driven text-to-image generation

   • Mention memory: incorporating textual knowledge into transformers through entity mention attention

4. Agentic RAG

   • Retrieve Anything To Augment Large Language Models

   • Replug: Retrieval-augmented black-box language models

   • When Language Model Meets Private Library

RAG Applications

1. RAG for Text

   • Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering

   • REALM: Retrieval-Augmented Language Model Pre-Training

   • Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-training

2. RAG for Code

   • Retrieval-Based Neural Code Generation

   • Retrieval Augmented Code Generation and Summarization

   • When Language Model Meets Private Library

3. RAG for Audio

   • Retrieval-Augmented Text-to-Audio Generation

   • Large-Scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentation

   • Make-an-audio: Text-to-audio generation with prompt-enhanced diffusion models

4. RAG for Image

   • Retrievegan: Image synthesis via differentiable patch retrieval

   • Instance-conditioned gan

   • Memory-driven text-to-image generation

5. RAG for Video

   • Incorporating Background Knowledge into Video Description Generation

   • Retrieval Augmented Convolutional Encoder-decoder Networks for Video Captioning

   • Concept-Aware Video Captioning: Describing Videos With Effective Prior Information

6. RAG for 3D

   • ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model

   • AMD: Anatomical Motion Diffusion with Interpretable Motion Decomposition and Fusion

   • Retrieval-Augmented Score Distillation for Text-to-3D Generation

7. RAG for Knowledge

   • ReTraCk: A Flexible and Efficient Framework for Knowledge Base Question Answering

   • Unseen Entity Handling in Complex Question Answering over Knowledge Base via Language Generation

   • Case-based Reasoning for Natural Language Queries over Knowledge Bases

8. RAG for Science

   • Retrieval-based controllable molecule generation

   • Prompt-based 3d molecular diffusion models for structure-based drug design

   • PoET: A generative model of protein families as sequences-of-sequences

Benchmark

Benchmarking Large Language Models in Retrieval-Augmented Generation

CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models

ARES: An Automated Evaluation Framework for Retrieval-AugmentedGeneration Systems

RAGAS: Automated Evaluation of Retrieval Augmented Generation

KILT: a Benchmark for Knowledge Intensive Language Tasks

Contact

If you have any questions or suggestions, feel free to contact our team:

Current:

• Mingyue Cheng (mycheng@ustc.edu.cn)
• Yucong Luo (prime666@mail.ustc.edu.cn)
• Jie Ouyang (ouyang_jie@mail.ustc.edu.cn)