Jump-start your LLM project by starting from an app, not a framework. This repository aggregates high-quality, functioning web applications for use cases including Chatbots, Natural Language Interfaces, Assistants, and Question Answering Systems. It compares projects along important dimensions for these use cases, to help you choose the right starting point for your application.

To ensure the utmost quality and usability, projects must adhere to the following criteria to be included:

• Licensed under Open Source terms 💸
• Actively Maintained, meaning updated within the past month or under active monitoring 🚨

The projects span a wide range of complexity, from straightforward API wrappers to production-ready systems with multi-source RAG backends, conversation logging, and authentication/user management. There should be something for almost every need.

Project Submissions

Contributions are the backbone of this list! If you're aware of a project that meets our criteria but isn't listed, we'd love to hear about it. Please also notify us if any of the listed projects becomes unmaintained or changes its licensing. Additionally, if there's a project detail that you'd like to compare that's not currently tracked, submit an issue for it. Finally, if you're the maintainer of a project that's already listed and would like to update or modify the listing, submit it again with the desired modifications.

To submit a project:

1. Create an issue.
2. Ensure your submission adheres to the listed criteria and includes all relevant details.
3. Submissions will be reviewed and the projects list will be updated within a day.

If you'd like to help maintain this project, contact clharman via email.

Currently seeking submissions for:

• Lightweight chatbots
• Projects with advanced prompting
• Non-chatbot interfaces (question answering, etc)
• Projects with image support
• Projects in different languages e.g. Python only

Project Table

Project	Demo	Brief Description	Conversation Context Carry	Conversation History	Authentication	Model Support	Rich Text Support	Image Support	(RAG) Search Engine	(RAG) Show Sources	(RAG) Data ingestion	Quick Deploy	Other Features
Hugging Face Chat UI	🟢 Link	Full featured chat interface	🟢	🟢	🟢 OpenID	Hugging Face Inference API, local, Amazon SageMaker	🟢	🔴	🟢 Google search	🟢	🔴	🟢 Hugging Face Spaces	Theme configuration
Weaviate Verba	🟢 Link	Chat interface for RAG applications	🔴	🔴	🔴	OpenAI	🟢	🔴	🟢 Weaviate	🟢	🟢 Via CLI	🟢 Docker	Semantic caching
Microsoft Azure Chat	🔴	Azure-based private chat tenant over data and files	🟢	🟢	🟢 NextAuth	OpenAI	🟢	🔴	🟢 Azure Cognitive Search	🔴	🟢 UI single-file upload	🟢 Azure
AWS GenAI LLM Chatbot	🔴	AWS-based chatbot with RAG and selectable LLMs	🟢	🟢	🟢 Amazon Cognito	Bedrock, SageMaker, Hugging Face Inference Endpoints, OpenAI, Anthropic, AI21, Cohere	🔴	🔴	🟢 Postgres/ Kendra/ OpenSearch	🟢	🟢 UI file upload	🟢 AWS	User-selectable model and search backend
PrivateGPT	🔴	API, pipeline, and UI for RAG applications. Supports private models.	🟢	🔴	🔴	Local, OpenAI, Sagemaker	🔴	🔴	🟢 Qdrant, Chroma	🟢	🟢 UI file upload	🔴
Open WebUI	🔴	ChatGPT clone focused on locally hosted models	🟢	🟢	🟢	Ollama, OpenAI	🟢	🟢	🟢 Various	🔴	🟢 UI file upload	🟢 Docker
Azure GPT-RAG	🔴	Enterprise-ready RAG framework	🟢	🟢	🟢 Azure Active Directory	OpenAI	🟢	🔴	🟢 Azure Cognitive Search	🟢	🟢 Data source connections	🟢 Azure	Microsoft Teams bot integration, costs estimator
Danswer	🔴	Full featured RAG system with prebuilt data connectors for many source systems	🟢	🟢	🟢	OpenAI, Local	🟢	🔴	🟢 Vespa	🟢	🟢 Selection of data connectors	🟢 Docker Compose, Kubernetes	Slack bot
LLM Answer Engine	🔴	Perplexity style answer engine with web search	🟢	🔴	🔴	Mixtral, Ollama, OpenAI	🔴	🔴	🟢 Brave, Serper	🟢	🔴 Web search, not ingestion	🔴
Dify	🔴	App development platform for GenAI	🟢	🟢	🟢	Various	🟢	🟢	🟢 Various	🟢	🟢 UI file upload	🟢 AWS, Kubernetes	Agents, observability
Flowise	🔴	Drag-and-drop LLM flow builder	🟢	🟢	🟢	Various	🔴	🔴	🟢 Various	🟢	🟢 UI file upload	🟢 AWS, Kubernetes	GUI/no-code LLM app logic builder
LibreChat	🔴	Full featured ChatGPT clone	🟢	🟢	🟢	Various	🟢	🟢	🟢 Various	🔴	🟢 UI file upload	🟢 Docker Compose	Assistants support

Star History