AI Agent Toolkit

September 11, 2025 · View on GitHub

Here we will keep track of the latest AI Agent Toolkit, including AI Agent Framework, Memory, Tool, MCP, Prompt, Context Engineering, Code, Deep Research, Eval, Benchmark, Security, Monitor, Traces and Agent Reinforcement. 🎆

Table of Contents

Project List

AI Agent Framework

SourceDescriptionCodePaper
AdalaAdala is an Autonomous DAta (Labeling) Agent framework.GitHub
AgencyA fast and minimal framework for building agent-integrated systems.GitHub
AgentBoardAn Analytical Evaluation Board of Multi-turn LLM Agents.GitHub
Agent Group ChatAn Interactive Group Chat Simulacra For Better Eliciting Collective Emergent Behavior.GitHubarXiv
Agent KAn autoagentic AGI that is self-evolving and modular.GitHub
AgentKitAgentKit: Flow Engineering with Graphs, not Coding.GitHub
AgentKitAgentKit: rapidly build high quality Agent apps.GitHub
AgentLabsOpen-Source Universal AI Agent Frontend.GitHub
Agent ProtocolOpen interface for AI agent communication.GitHub
AgentsAn Open-source Framework for Autonomous Language Agents.GitHubarXiv
AgentScopeStart building LLM-empowered multi-agent applications in an easier way.GitHub
AgentsflowDrag & drop UI to build and run a flow of autogen AI agents.GitHub
agentUniverseagentUniverse is a LLM multi-agent framework that allows developers to easily build multi-agent applications.GitHub
AgentVerseAgentVerse is designed to facilitate the deployment of multiple LLM-based agents in various applications.GitHubarXiv
AIOSLLM Agent Operating System.GitHub
Atomic AgentsThe Atomic Agents framework is designed to be modular, extensible, and easy to use.GitHub
AutoAgentsA Framework for Automatic Agent Generation.GitHubarXiv
AutoGenAutoGen is a framework that enables the development of LLM applications using multiple agents that can converse with each other to solve tasks.GitHubarXiv
AutoGPTBuild & Use AI Agents.GitHub
Buffer of ThoughtsThought-Augmented Reasoning with Large Language Models.GitHubarXiv
Byzer-AgentEasy, fast, and distributed agent framework for everyone.GitHub
CAMELCommunicative Agents for “Mind” Exploration of Large Scale Language Model Society.GitHubarXiv
Character-LLMA Trainable Agent for Role-Playing.GitHubarXiv
ChatDevCommunicative Agents for Software Development.GitHub
CogAgentA Visual Language Model for GUI Agents.GitHubarXiv
crewAIFramework for orchestrating role-playing, autonomous AI agents.GitHub
DB-GPTDB-GPT is an open-source framework designed for the realm of large language models (LLMs) within the database field.GitHubarXiv
DifyDify is an open-source LLM app building platform.GitHub
Digital Life ProjectAutonomous 3D Characters with Social Intelligence.arXiv
DSPyDSPy is the framework for solving advanced tasks with language models (LMs) and retrieval models (RMs).GitHubarXiv
everything-aiYour fully proficient, AI-powered and local chatbot assistant🤖.GitHub
fabricfabric is an open-source framework for augmenting humans using AI.GitHub
FastGPTFastGPT is a knowledge-based platform built on the LLM.GitHub
fastRAGEfficient Retrieval Augmentation and Generation Framework.GitHub
FineAutomate software development with AI Agents.GitHub
FlowiseBuild LLM Apps Easily.GitHub
GraphRAGA modular graph-based Retrieval-Augmented Generation (RAG) system.GitHub
KwaiAgentsA generalized information-seeking agent system with Large Language Models (LLMs).GitHubarXiv
LagentA lightweight framework for building LLM-based agents.GitHub
LangChainGet your LLM application from prototype to production.GitHub
LangflowLangflow is a UI for LangChain, designed with react-flow to provide an effortless way to experiment and prototype flows.GitHub
LangGraphBuilding language agents as graphs.GitHub
LangGraph StudioLangGraph Studio offers a new way to develop LLM applications by providing a specialized agent IDE that enables visualization, interaction, and debugging of complex agentic applications.GitHub
LangroidMulti-Agent Framework.GitHub
Lepton AIA Pythonic framework to simplify AI service building.GitHub
LlamaIndexLlamaIndex is a simple, flexible data framework for connecting custom data sources to large language models.GitHub
LLMStackOpen-source platform to build AI Agents, workflows and applications with your data.GitHub
MarvinThe AI Engineering Framework.GitHub
MetaGPTThe Multi-Agent Framework.GitHub
MindSearchMindSearch: Mimicking Human Minds Elicits Deep AI Searcher.GitHub
Mixture of Agents (MoA)Mixture-of-Agents Enhances Large Language Model Capabilities.GitHubarXiv
Mobile-AgentAutonomous Multi-Modal Mobile Device Agent with Visual Perception.GitHubarXiv
Multi-LLM Agentα-UMi: Small LLMs Are Weak Tool Learners.GitHubarXiv
OpenAgentsAn Open Platform for Language Agents in the Wild.GitHubarXiv
OpenGPTsA framework for creating agent runtimes.GitHub
OpenPaLBuilding Open-Ended Embodied Agent via Language-Policy Bidirectional Adaptation.GitHubarXiv
PhidataBuild AI Assistants using function calling.GitHub
PipecatOpen Source framework for voice and multimodal conversational AI.GitHub
PR-AgentAn AI-Powered 🤖 Tool for Automated Pull Request Analysis, Feedback, Suggestions and More!GitHub
ProAgentFrom Robotic Process Automation to Agentic Process Automation.GitHubarXiv
Qwen-AgentQwen-Agent is a framework for developing LLM applications based on the instruction following, tool usage, planning, and memory capabilities of Qwen.GitHub
RagasRagas is a framework that helps you evaluate your Retrieval Augmented Generation (RAG) pipelines.GitHub
RAGoonImprove Large Language Models retrieval using dynamic web-search ⚡.GitHub
ReWOODecoupling Reasoning from Observations for Efficient Augmented Language Models.GitHub
Search with LeptonBuilding a quick conversation-based search demo with Lepton AI.GitHub
SuperagentThe open framework for building AI Assistants.GitHub
SuperAGISuperAGI - A dev-first open source autonomous AI agent framework.GitHub
SWE-agentAgent Computer Interfaces Enable Software Engineering Language Models.GitHub
TaskGenA Task-based agentic framework building on StrictJSON outputs by LLM agents.GitHub
TaskingAIThe open source platform for AI-native application development.GitHub
TaskWeaverA Code-First Agent Framework.GitHubarXiv
ToRAToRA: A Tool-Integrated Reasoning Agent.GitHubarXiv
Translation AgentAgentic translation using reflection workflow.GitHub
UFOA UI-Focused Agent for Windows OS Interaction.GitHub
VannaVanna helps you generate and run accurate SQL for your database using LLMs via Retrieval-Augmented Generation.GitHub
WebDesignAgentAn agent used for webdesign.GitHub
XAgentAn Autonomous Agent for Complex Task Solving.GitHub
X-Force IDEX-Force IDE is a low-code, agent-as-a-service UI framework.GitHub

^ Back to Contents ^

Memory

SourceDescriptionCodePaper
ChromaChroma - the AI-native open-source embedding database.GitHub
LanceDBLanceDB is a developer-friendly, open source database for AI.GitHub
MilvusA cloud-native vector database, storage for next generation AI applications.GitHub
PineconePinecone serverless lets you deliver remarkable GenAI applications faster, at up to 50x lower cost.
WeaviateThe AI-native database for a new generation of software.GitHub

^ Back to Contents ^

Prompt & Context Engineering

SourceDescriptionCodePaper
DSPyDSPy: The framework for programming—not prompting—language models.GitHub

^ Back to Contents ^

Security

SourceDescriptionCodePaper
E2BCloud Runtime for AI Agents.GitHub

^ Back to Contents ^