RAGHub: A Directory of Tools for Retrieval-Augmented Generation (RAG)
June 20, 2026 · View on GitHub
Welcome to RAGHub, a living collection of new and emerging frameworks, projects, and resources in the Retrieval-Augmented Generation (RAG) ecosystem. This is a community-driven project for r/RAG, where we aim to catalog the rapid growth of RAG tools and projects that are pushing the boundaries of the field.
Each day, it feels like a new tool or framework emerges, and choosing the right one is becoming more of an art than a science. Is the framework from three months ago still relevant? Or was it just hype, rehashing old concepts with a fresh look? RAGHub exists to help you stay ahead of these changes, providing a platform for the latest innovations in RAG.
How to Contribute
This is a community project, and we welcome contributions from everyone! If you’d like to add a new framework, project, or resource, please check out our Contribution Guidelines for details on how to get started.
Table of Contents
FAQ
What is RAG (Retrieval-Augmented Generation)?
RAG is a technique that enhances Large Language Model (LLM) responses by retrieving relevant information from external knowledge sources before generating answers. This approach reduces hallucinations and provides more accurate, contextually relevant responses based on actual data.
How do I choose the right RAG framework?
Consider these factors when selecting a framework:
| Factor | Consideration |
|---|---|
| Use Case | Chatbot, search engine, or document QA? |
| Scale | Enterprise-scale needs vs. prototyping |
| Complexity | LangChain/LlamaIndex (full-featured) vs. LightRAG (simple) |
| Integration | Does it support your vector DB and LLM provider? |
| Language | Python (LangChain/LlamaIndex) vs. TypeScript vs. Rust |
What's the difference between RAG Frameworks and RAG Engines?
- Frameworks (e.g., LangChain, LlamaIndex): Libraries you integrate into your code to build custom RAG pipelines
- Engines (e.g., RAGFlow, Dify): Standalone platforms providing ready-to-use RAG functionality
Do I need a vector database for RAG?
Yes, vector databases store document embeddings for semantic search. Popular options:
| Database | Best For |
|---|---|
| ChromaDB | Prototyping, easy setup |
| Qdrant | Production, high performance |
| Pinecone | Enterprise, managed service |
| Weaviate | Hybrid search, GraphQL |
How do I evaluate my RAG system?
Use evaluation frameworks listed in this directory:
- ragas: Measures faithfulness, answer relevancy, context precision
- Trulens: Feedback functions for quality assessment
- Phoenix: Observability and troubleshooting tools
- Deepchecks: Continuous validation and drift detection
What are common RAG challenges and solutions?
| Challenge | Solution |
|---|---|
| Poor retrieval quality | Optimize chunking strategy and embeddings |
| Context window limits | Use reranking to reduce retrieved content |
| Hallucinations | Ensure retrieved context is properly used by LLM |
| Latency | Optimize retrieval indexing, use streaming |
Can I use RAG with local/self-hosted models?
Yes! Many frameworks support local LLMs:
| Method | Description |
|---|---|
| Ollama | Easy local model deployment |
| vLLM | High-performance local inference |
| LM Studio | User-friendly local model management |
| LocalAI | OpenAI-compatible local API |
How can I contribute to RAGHub?
We welcome contributions! To add a new framework, project, or resource:
- Fork the repository
- Add your entry to the relevant section
- Follow the existing table format
- Submit a Pull Request
See CONTRIBUTING.md for detailed guidelines.
RAG Frameworks
| Name | Description | Website | Github | Stars | Activity |
|---|---|---|---|---|---|
| Dcup Open-Source RAG-as-a-Service | Connect your app to user data in minutes with self-hostable RAG pipelines. | Website | Github |  | 1h ago |
| LangChain | Building applications with LLMs | Website | Github |  | 9h ago |
| Scout | Building apps with LLMs/vector databases/web scraping | Website | Github |  | 1h ago |
| Semantica | Open-source framework for Context Graphs, GraphRAG, Decision Intelligence, Explainable Reasoning, Provenance, and AI Governance. | Website | GitHub |  | 1d ago |
| Haystack | A framework for building search engines using neural networks | Website | Github |  | Last week |
| LlamaIndex | A framework for building data-driven LLM applications | Website | Github |  | 7h ago |
| BentoML | Build Inference APIs, LLM apps, Multi-model chains, RAG | Website | Github |  | 1h ago |
| Contextual AI | End-to-end RAG including document understanding, retrieval, grounded generation, and evaluation | Website | GitHub |  | -- |
| LightRAG | Simple and fast Retrieval-Augmented Generation | Website | Github |  | 1d ago |
| Swarm by OpenAI | Educational framework for lightweight multi-agent orchestration | - | Github |  | 1d ago |
| Langroid | Python framework to easily build LLM-powered applications | Website | Github |  | 10h ago |
| NeMo-Guardrails | Add programmable guardrails to LLM-based applications | Website | Github |  | Last week |
| Swiftide | A Rust library for building fast, streaming applications with LLMs | Website | GitHub |  | 1h ago |
| Korvus | The entire RAG pipeline in a single database query | Website | GitHub |  | Last month |
| semantic-router | A framework for routing LLM requests using semantic vectors | Website | GitHub |  | 4h ago |
| AWS Bedrock Knowledge Bases | Service to build, scale, and deploy RAG-powered applications | Website | - | - | 1h ago |
| langflow | Build, scale, and deploy RAG and multi-agent AI apps | Website | GitHub |  | 1h ago |
| dspy | Build language model apps with modular programming | Website | GitHub |  | 13h ago |
| mem0 | The Memory layer for your AI apps | Website | GitHub |  | 2h ago |
| RAGLite | A Python package for building RAG applications | Website | GitHub |  | 18h ago |
| cognee | Memory framework for building GraphRAG applications | Website | GitHub |  | 2h ago |
| ragbits | Building blocks for rapid development of GenAI applications | Website | GitHub |  | 1h ago |
| Interchange | End-to-end API for RAG, from document upload to search | Website | GitHub |  | 1h ago |
| ZeroEntropy | Rerankers, embeddings and end-to-end retrieval API | Website | GitHub | - | 1h ago |
| memori | Multi-Agent Memory Engine that gives your AI agents human-like memory | Website | GitHub |  | 3d ago |
| ZettelForge | Agentic memory for CTI — entity extraction, knowledge graphs, STIX ontology | Website | GitHub |  | 1h ago |
RAG Evaluation and Optimization Frameworks
| Name | Description | Website | GitHub | Stars | Activity |
|---|---|---|---|---|---|
| Trulens | Measures and enhance LLM app quality with feedback functions for scalable evaluation | Website | GitHub |  | 11h ago |
| Phoenix | AI observability platform designed for experimentation, evaluation, and troubleshooting | Website | GitHub |  | 1d ago |
| ragas | Evaluates and quantifies the performance of RAG pipelines that enhance LLM context with external data | Website | GitHub |  | 3h ago |
| LMUnit | Language model optimized for evaluating natural language unit tests | Website | - | - | -- |
| Deepchecks | Continuous validation of AI & ML models, detecting data drift and model issues | Website | GitHub |  | 8m ago |
| AutoRAG | End-to-end RAG optimization: parsing, chunking, evaluation dataset creation, and pipeline deployment | Website | GitHub |  | 1h ago |
| evalmy.ai | Fine-tuned lightweight RAG evaluation service + Python client library | Website | GitHub |  | -- |
| TextGrad | A framework for LLM-based text optimization, focusing on reducing hallucinations and improving prompts | Website | GitHub |  | 24h ago |
| langfuse | Traces, evals, prompt management, and metrics to debug and improve your LLM application. | Website | GitHub |  | 1h ago |
| Vectara HHEM | Hallucination evaluation model for RAG | Huggingface | -- | -- | -- |
| StepsTrack | An Observability tool built to track, inspect, and visualize every steps in a pipeline | - | GitHub |  | 15h ago |
| syftr | Multi-objective end-to-end agentic RAG optimization. | - | GitHub |  | 1h ago |
| zbench | Annotation and evaluation framework for retrieval and reranking | Website | GitHub | - | 1h ago |
| rag-select | End-to-end RAG architecture evaluation/optimization across RAG tool offerings. | Website | GitHub |  | 1h ago |
| Raggit | Monitor RAG production queries, write evals against the queries that matter, re-run on model swaps | Website | GitHub |  | 1h ago |
RAG Engines
| Name | Description | Website | GitHub | Stars | Activity |
|---|---|---|---|---|---|
| Agentset | Open-source agentic RAG platform. | Website | GitHub |  | 1d ago |
| Engramic | RAG engine focused on long-term memory and advanced context management | Website | Github |  | 2h ago |
| TrustGraph | LLM Agnostic Agent Development Platform | Website | GitHub |  | 2d ago |
| R2R | The Elasticsearch for RAG, helps you quickly build and launch scalable RAG solutions | Website | GitHub |  | 6h ago |
| RAGFlow | Open-source RAG engine based on deep document understanding | Website | GitHub |  | 1h ago |
| Liquid Index | The Unified RAG Platform. One API. Every Tool You Need | Website | - | - | 1h ago |
| Vertex AI Knowledge Engine | A data framework for context-augmented LLM applications | Website | - | - | 1d ago |
| Embedchain | Open Source Framework for personalizing LLM responses under 10 lines of code | Website | GitHub | | Last week |
| txtai | All-in-one embeddings database for semantic search, LLM orchestration, and RAG workflows | Website | GitHub |  | Last week |
| dsRAG | High-performance retrieval engine for unstructured data | - | GitHub |  | Last week |
| Flash-Rank | Use Pairwise or Listwise rerankers to improve search accuracy before passing to LLMs. | - | GitHub |  | 2w ago |
| Graphlit | API-first platform for building knowledge-driven AI applications and agents | Website | GitHub |  | 8h ago |
| rag-citation | Combines RAG with automatic citation generation to enhance content credibility | Website | GitHub |  | Last week |
| PostgresML | Postgres + GPUs with functions for chunking, embedding, transforming and ranking | Website | GitHub |  | Yesterday |
| chainlit | Build production-ready Conversational AI applications in minutes, not weeks | Website | GitHub |  | 24h ago |
| pathway | Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG. | Website | GitHub |  | 7h ago |
| cognita | RAG framework for modular, open-source production apps. | Website | GitHub |  | 2 days ago |
| FlashRAG | A Python Toolkit for Efficient RAG Research | - | GitHub |  | 3h ago |
| RAGatouille | Easily train and use advanced retrieval methods in any RAG pipeline. | - | GitHub |  | 4 months ago |
| pgai | A suite of tools to develop RAG, semantic search, and other AI applications just in PostgreSQL | Website | GitHub |  | 10h ago |
| Vectara | The trusted RAG platform for quickly building AI assistants and agents. | Website | GitHub | - | - |
| mode | RAG framework with expert models, smart clustering,and efficient retrieval for small datasets. | - | GitHub |  | 2 days ago |
| haiku.rag | Open-Source RAG framework with monitoring, CLI, search, Q/A, MCP support on SQLite. | - | Github |  | 3h ago |
| ZeroEntropy AI | Open-Weight Rerankers, Embeddings and End-to-End Retrieval API | Website | Github | - | 3h ago |
RAG Data Preparation Frameworks
| Name | Description | Website | GitHub | Stars | Activity |
|---|---|---|---|---|---|
| CocoIndex | ETL framework to build fresh index | Website | Github |  | 1h ago |
| Gitana.io | Content platform for editorial approval and scheduled deployment of trained data sets to RAG vector DBs | Website | - | - | - |
| Chonkie | No-nonsense, lightweight and fast RAG chunking library | Website | GitHub |  | 1h ago |
| pdfmux | PDF-to-Markdown extraction with per-page confidence scoring and self-healing fallback. Built-in MCP server, LangChain + LlamaIndex loaders. #2 on opendataloader-bench. | Website | GitHub |  | 1d ago |
RAG Projects
| Name | Description | Website | GitHub | Stars | Activity |
|---|---|---|---|---|---|
| RAG-LCC | Hybrid RAG lab: Vector/BM25/Graph retrieval, multilingual, web search fallback | - | GitHub |  | - |
| LlamaParse | GenAI-native document parsing platform | Website | GitHub |  | 2d ago |
| Langchain-extract | Web server to extract information from text and files using LLMs | Website | GitHub |  | 4m ago |
| Needle | Production-ready RAG pipelines out of the box. | Website | GitHub |  | 1h ago |
| Unstructured.io | Build custom preprocessing pipelines for labeling, training, or production ML | Website | GitHub |  | 3d ago |
| Verba | RAG chatbot powered by Weaviate | Website | GitHub |  | 2w ago |
| Unstract | No-code platform to launch APIs and ETL Pipelines to structure unstructured documents | Website | GitHub |  | 4h ago |
| Humata.ai | Ask questions across all of your document files | Website | - | - | 4h ago |
| Kiln | Build AI systems with evals, RAG, agents, fine-tuning, and synthetic data | Website | GitHub |  | 12h ago |
| Ragie.ai | Fully managed RAG-as-a-Service for developers. | Website | GitHub | - | 12h ago |
| Reducto | Parses complex documents and creates LLM-ready inputs | Website | GitHub | - | 2w ago |
| Midship | Extract document data straight into your spreadsheet/ERP/CRM | Website | - | - | - |
| DocuPanda | Convert documents into a structured, standard set of fields and values | Website | - | - | - |
| contextual-doc-retrieval-opneai-reranker | Using GPT-4 and Cohere for query expansion and re-ranking with BM25 | - | GitHub |  | Last week |
| Raggenie | Low-code platform to build custom RAG-based AI applications | Website | GitHub |  | 10h ago |
| Chunkr | Vision model-based PDF chunking and OCR, optimized for fast processing of large datasets | Website | GitHub |  | 11h ago |
| tldw | Open-source project similar to NotebookLM | Website | GitHub |  | Yesterday |
| Cerbos | Access control for RAG and LLMs. | Website | GitHub |  | 14h ago |
| extractous | Extremely fast data extraction for your AI applications | Website | GitHub |  | - |
| SWIRL | AI search & RAG for your workplace. Get AI insights from your company's knowledge instantly. | Website | GitHub |  | 2w ago |
| ChatDOC PDF Parser | Precision PDF parsing that transforms documents into flawless structured data for RAG systems. | Website | - | - | - |
| Gurubase | Create AI-powered Q&A assistants by indexing websites, PDF documents, YouTube videos, and GitHub code repositories. | Website | GitHub |  | 1d ago |
| Archive Agent | Open-source semantic file tracker with OCR + AI search. Smart indexer with RAG engine. | - | GitHub |  | - |
| MidrasAI | Simple API for Colpali, a multi-modal retrieval model. | - | Github |  | 6m ago |
| EmbeddingBridge | Version control and migration tool for embeddings | - | Github |  | - |
| Stream-Rag-Agent | Streaming RAG Agent for Kafka | - | Github | - | |
| zchunk | Open-Source efficient LLM-based chunking | Website | Github | - | 2h ago |
| hydrot | A production-ready Retrieval-Augmented Generation (RAG) system designed for enterprise documentation, with first-class support for markdown content. Built with a microservices architecture for horizontal scaling and flexibility. | - | Github |  | - |
| Tensorlake | Document parsing for citable, traceable RAG systems. Extracts text, tables, and images while maintaining complex layouts, attaching bounding box coordinates, and supporting structured output | Website | Github |  | 2d ago |
RAG Resources and Sites
| Site/Article | Description | Link |
|---|---|---|
| Contextual Retrieval | Anthropic introducing Contextual Retrieval | Website |
| Open-RAG | Enhanced Retrieval-Augmented Reasoning with Open-Source Large Language Models | Website |
| ColPali | Efficient Document Retrieval with Vision Language Models | Website |
| RAG_Techniques | Showcases various advanced techniques for RAG systems | Website |
| GenAI_Agents | Tutorials and implementations for various AI Agent techniques | Website |
| RAG From Scratch | Official LangChain guide for building a RAG pipeline from scratch | Website |
Model LeaderBoards
| Name | Description | Link |
|---|---|---|
| Artificial Analysis | LLM Comparison | Website |
| HuggingFace/mteb | Embedding models leaderboard | Website |
| Vectara Hallucination Leaderboard | Hallucination leaderboard for LLMs | Website |
If you're looking for mainstream RAG frameworks and techniques, check out the excellent repository by Nir Diamant: RAG Techniques. This repository focuses on more established tools and methods that have already gained traction in the community.
License
This project is licensed under the MIT License. See the LICENSE file for details.
Join the Conversation
This project is part of the r/RAG community. Have feedback or suggestions? Feel free to open an issue, start a discussion, or join the conversation on our Discord server! We want to make this repository a valuable resource for everyone exploring the RAG ecosystem, and your input is crucial.