Awesome Agentic Reasoning Papers

March 9, 2026 Β· View on GitHub

Awesome arXiv Coverage Hugging Face #1 Paper of the Day

License: MIT Contributions Welcome Last Commit Visitors

This repository organizes research by thematic areas that integrate reasoning with action, including planning, tool use, search, self-evolution through memory and feedback, multi-agent systems, and real-world applications and benchmarks.

πŸ“„ Based on the survey: Agentic Reasoning for Large Language Models: A Survey

Framework overview

πŸ”” News

[03/09/26] πŸ“Š Slides are now available to provide a clearer overview of the survey and highlight key insights. We will continue updating the paper with further improvements.

[01/21/26] πŸš€ We have released a comprehensive survey on Agentic Reasoning for Large Language Models! The paper is now available on arxiv and HuggingFace. We welcome contributions from the community to help expand and improve our survey πŸ€—!

πŸ“‹ Table of Contents


🌟 Introduction

Bridging thought and action through autonomous agents that reason, act, and learn via continual interaction with their environments. The goal is to enhance agent capabilities by grounding reasoning in action.

We organize agentic reasoning into three layers, each corresponding to a distinct reasoning paradigm under different environmental dynamics:

πŸ”Ή Foundational Reasoning. Core single-agent abilities (planning, tool-use, search) in environments

πŸ”Ή Self-Evolving Reasoning. Adaptation through feedback, memory, and learning in dynamic settings

πŸ”Ή Collective Reasoning. Multi-agent coordination, role specialization, and collaborative intelligence

Across these layers, we further identify complementary reasoning paradigms defined by their optimization settings.

πŸ”Έ In-Context Reasoning. Test-time scaling through structured orchestration and adaptive workflows

πŸ”Έ Post-Training Reasoning. Behavior optimization via RL and supervised fine-tuning

🀝 Contributing

This collection is an ongoing effort. We are actively expanding and refining its coverage, and welcome contributions from the community. You can:

We regularly update the repository to include new research works on agentic reasoning.

πŸ“ Citation

If you find this repository or paper useful, please consider citing the survey paper:

@article{wei2026agentic,
  title={Agentic Reasoning for Large Language Models},
  author={Wei, Tianxin and Li, Ting-Wei and Liu, Zhining and Ning, Xuying and Yang, Ze and Zou, Jiaru and Zeng, Zhichen and Qiu, Ruizhong and Lin, Xiao and Fu, Dongqi and others},
  journal={arXiv preprint arXiv:2601.12538},
  year={2026}
}

πŸ—οΈ Foundational Agentic Reasoning

πŸ—ΊοΈ Planning Reasoning

plan

In-context Planning

Workflow Design
PaperYear
LLM+P: Empowering Large Language Models with Optimal Planning Proficiency2023
PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about ChangeNeurIPS 2023 DB Track
ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Models2023
LLM Reasoners: New Evaluation, Library, and Analysis of Step-by-Step Reasoning with Large Language Models2024
Least-to-Most Prompting Enables Complex Reasoning in Large Language ModelsICLR 2023
Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language ModelsACL 2023
Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language ModelsICML 2024
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face2023
Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agents2023
PERIA: Perceive, Reason, Imagine, Act via Holistic Language and Vision Planning for Manipulation2024
Plan-and-Act: Improving Planning of Agents for Long-Horizon Tasks2025
CodePlan: Repository-level Coding using LLMs and PlanningFSE 2024
ReAct: Synergizing Reasoning and Acting in Language ModelsICLR 2023
Mind2Web: Towards a Generalist Agent for the WebNeurIPS 2023
WILBUR: Adaptive In-Context Learning for Robust and Accurate Web Agents2024
Executable Code Actions Elicit Better LLM AgentsICML 2024
Gorilla: Large Language Model Connected with Massive APIs2023
Reflexion: Language Agents with Verbal Reinforcement Learning2023
CodeNav: Beyond Tool-Use to Using Real-World Codebases with LLM AgentsACL 2024
MARCO: Multi-Agent Code Optimization with Real-Time Knowledge Integration for High-Performance Computing2025
Enhancing LLM Reasoning with Multi-Path Collaborative Reactive and Reflection Agents2025
Pre-Act: Multi-Step Planning and Reasoning Improves Acting in LLM Agents2025
REST meets ReAct: Self-Improvement for Multi-Step Reasoning LLM Agent2023
Self-Planning Code Generation with Large Language ModelsTOSEM 2023
LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and ActionCoRL 2022
Tree Search / Algorithm Simulation
PaperYear
Tree of Thoughts: Deliberate Problem Solving with Large Language ModelsNeurIPS 2023
Tree Search for Language Model Agents2024
Tree-Planner: Efficient Planning with Large Language ModelsICLR 2024
Q*: Improving Multi-step Reasoning for LLMs with Deliberative Planning2024
LLM-A*: Large Language Model Enhanced Incremental Heuristic Search on Path Planning2024
Multimodal Chain-of-Thought Reasoning in Language Models2023
Reasoning with Language Model is Planning with World ModelNeurIPS 2023
Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents2024
Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learning2024
Prompt-Based Monte-Carlo Tree Search for Goal-Oriented Dialogue Policy Planning2023
Large Language Models as Tool MakersICLR 2024
Everything of Thoughts: Defying the Law of Penrose Triangle for Thought Generation2023
Alphazero-like Tree-Search can Guide Large Language Model Decoding and Training2023
Broaden your SCOPE! Efficient Multi-turn Conversation Planning for LLMs with Semantic Space2025
Self-Evaluation Guided Beam Search for ReasoningNeurIPS 2023
PathFinder: Multimodal Multi-Agent Medical Diagnosis Framework2025
Discriminator-Guided Embodied Planning for LLM AgentICLR 2025
Stream of Search (SoS): Learning to Search in Language2024
System-1.x: Learning to Balance Fast and Slow Planning with Language Models2024
Agent-E: From Autonomous Web Navigation to Foundational Design Principles in Agentic Systems2024
Intelligent Virtual Assistants with LLM-based Process Automation2023
Agent S: An Open Agentic Framework that Uses Computers Like a Human2024
HyperTree Planning: Enhancing LLM Reasoning via Hierarchical Thinking2025
Tree-of-Code: A Tree-Structured Exploring Framework for End-to-End Code Generation and Execution in Complex Task HandlingACL 2025
Enhancing LLM-Based Agents via Global Planning and Hierarchical Execution2025
Divide and Conquer: Grounding LLMs as Efficient Decision-Making Agents via Offline Hierarchical Reinforcement Learning2025
SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative RefinementICLR 2025
BTGenBot: Behavior Tree Generation for Robotic Tasks with Lightweight LLMs2024
Do As I Can, Not As I Say: Grounding Language in Robotic AffordancesCoRL 2022
Inner Monologue: Embodied Reasoning through Planning with Language ModelsCoRL 2022
Process Formalization
PaperYear
Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task PlanningNeurIPS 2023
Leveraging Environment Interaction for Automated PDDL Translation and Planning with Large Language ModelsNeurIPS 2024
Thought of Search: Planning with Language Models Through The Lens of EfficiencyNeurIPS 2024
CodePlan: Repository-level Coding using LLMs and PlanningFSE 2024
Planning Anything with Rigor: General-Purpose Zero-Shot Planning with LLM-based Formalized Programming2024
From An LLM Swarm To A PDDL-Empowered HIVE: Planning Self-Executed Instructions In A Multi-Modal Jungle2024
Decoupling / Decomposition
PaperYear
ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language ModelsNeurIPS 2023
DiffuserLite: Towards Real-time Diffusion Planning2024
Goal-Space Planning with Subgoal ModelsJMLR 2024
Agent-Oriented Planning in Multi-Agent Systems2024
GoPlan: Goal-Conditioned Offline Reinforcement Learning by Planning with Learned Models2023
RetroInText: A Multimodal Large Language Model Enhanced Framework for Retrosynthetic Planning via In-Context Representation LearningICLR 2025
HyperTree Planning: Enhancing LLM Reasoning via Hierarchical Thinking2025
VisualPredicator: Learning Abstract World Models with Neuro-Symbolic Predicates for Robot Planning2024
Beyond Autoregression: Discrete Diffusion for Complex Reasoning2024
PlanAgent: A Multi-modal Large Language Agent for Vehicle Motion Planning2024
LLaMAR: Long-Horizon Planning for Multi-Agent Robots in Partially Observable Environments2024
External Aid / Tool Use
PaperYear
Plan-on-Graph: Self-Correcting Adaptive Planning on Knowledge GraphsNeurIPS 2024
Hierarchical Planning for Complex Tasks with Knowledge Graph-RAG and Symbolic Verification2025
TeLoGraF: Temporal Logic Planning via Graph-encoded Flow Matching2025
FlexPlanner: Flexible 3D Floorplanning via Deep Reinforcement Learning in Hybrid Action Space with Multi-Modality RepresentationNeurIPS 2024
Exploratory Retrieval-Augmented Planning For Continual Embodied Instruction FollowingNeurIPS 2024
Benchmarking Multimodal Retrieval Augmented Generation with Dynamic VQA Dataset and Self-adaptive Planning Agent2024
RAG over Tables: Hierarchical Memory Index, Multi-Stage Retrieval, and Benchmarking2025
Reasoning with Language Model is Planning with World ModelNeurIPS 2023
Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task PlanningNeurIPS 2023
Agent Planning with World Knowledge ModelNeurIPS 2024
BehaviorGPT: Smart Agent Simulation for Autonomous Driving with Next-Patch PredictionNeurIPS 2024
DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning2024
FLIP: Flow-Centric Generative Planning as General-Purpose Manipulation World Model2024
Continual Reinforcement Learning by Planning with Online World Models2025
AdaWM: Adaptive World Model based Planning for Autonomous Driving2025
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face2023
Tool-Planner: Task Planning with Clusters across Multiple Tools2024
RetroInText: A Multimodal Large Language Model Enhanced Framework for Retrosynthetic Planning via In-Context Representation LearningICLR 2025

Post-training Planning

PaperYear
Reflexion: Language Agents with Verbal Reinforcement LearningNeurIPS 2023
Reflect-then-Plan: Offline Model-Based Planning through a Doubly Bayesian Lens2025
Rational Decision-Making Agent with Internalized Utility Judgment2023
Scaling Autonomous Agents via Automatic Reward Modeling2025
Strategic Planning: A Top-Down Approach to Option Generation2025
Non-myopic Generation of Language Models for Reasoning and Planning2024
Physics-informed Temporal Difference Metric Learning for Robot Motion Planning2025
Generalizable Motion Planning via Operator Learning2024
ToolOrchestra: Elevating Intelligence via Efficient Model and Tool Orchestration2025
Latent Diffusion Planning for Imitation Learning2025
SafeDiffuser: Safe Planning with Diffusion Probabilistic ModelsICLR 2023
ContraDiff: Planning Towards High Return States via Contrastive LearningICLR 2025
Amortized Planning with Large-Scale Transformers: A Case Study on ChessNeurIPS 2024
GOPlan: Goal-conditioned Offline Reinforcement Learning by Planning with Learned Models2023
A Goal Without a Plan Is Just a Wish: Efficient and Effective Global Planner Training for Long-Horizon Agent Tasks2025

πŸ› οΈ Tool-Use Optimization

tool

In-Context Tool-Integration

Interleaving Reasoning and Tool Use
PaperYear
Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsNeurIPS 2022
ChatCoT: Tool-Augmented Chain-of-Thought Reasoning on Chat-based Large Language ModelsEMNLP 2023
MultiTool-CoT: GPT-3 Can Use Multiple External Tools with Chain of Thought PromptingACL 2023
Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step QuestionsACL 2023
ReAct: Synergizing Reasoning and Acting in Language ModelsICLR 2023
Toward PDDL Planning Copilot2025
ART: Automatic Multi-step Reasoning and Tool-use for Large Language Models2023
Optimizing Context for Tool Interaction
PaperYear
Tool Documentation Enables Zero-Shot Tool-Usage with Large Language Models2023
EASYTOOL: Enhancing LLM-based Agents with Concise Tool InstructionNAACL 2025
GEAR: Augmenting Language Models with Generalizable and Efficient Tool ResolutionEACL 2024
AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive ReasoningNeurIPS 2024

Post-training Tool-Integration

Bootstrapping of Tool Use via SFT
PaperYear
Toolformer: Language Models Can Teach Themselves to Use ToolsNeurIPS 2023
ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIsICLR 2024
ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Cases2023
Chameleon: Plug-and-Play Compositional Reasoning with Large Language ModelsNeurIPS 2023
RestGPT: Connecting Large Language Models with Real-World RESTful APIs2023
ADaPT: As-Needed Decomposition and Planning with Language Models2023
Agent Lumos: Unified and Modular Training for Open-Source Language Agents2023
Learning to Use Tools via Cooperative and Interactive Agents2024
Understanding the Effects of RLHF on LLM Generalisation and Diversity2023
Preserving Diversity in Supervised Fine-Tuning of Large Language Models2024
Attribute Controlled Fine-tuning for Large Language Models: A Case Study on DetoxificationEMNLP 2024
Transformer Copilot: Learning from The Mistake Log in LLM Fine-tuning2025
iTool: Reinforced Fine-Tuning with Dynamic Deficiency Calibration for Advanced Tool Use2025
START: Self-taught Reasoner with Tools2025
Mastery of Tool Use via RL
PaperYear
Tool-integrated Reinforcement Learning for Repo Deep SearchICSE 2026
SoRFT: Issue Resolving with Subtask-oriented Reinforced Fine-TuningACL 2025
SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution2025
SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinement2024
ToolRL: Reward is All Tool Learning Needs2025
RLVMR: Reinforcement Learning with Verifiable Meta-Reasoning Rewards for Robust Long-Horizon Agents2025
Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning2025
AutoTool: Dynamic Tool Selection and Integration for Agentic Reasoning2025
ReSearch: Learning to Reason with Search for LLMs via Reinforcement Learning2025
Agentic Reinforced Policy Optimization2025
Agentic Entropy-Balanced Policy Optimization2025
Tool-Star: Empowering LLM-Brained Multi-Tool Reasoner via Reinforcement Learning2025
DeepAgent: A General Reasoning Agent with Scalable Toolsets2025
Toward Effective Tool-Integrated Reasoning via Self-Evolved Preference Learning2025
Demystifying Reinforcement Learning in Agentic Reasoning2025
Reinforcement Pre-Training2025
ReTool: Reinforcement Learning for Strategic Tool Use in LLMs2025
ZeroSearch: Incentivize the Search Capability of LLMs Without Searching2025
Kimi k1.5: Scaling Reinforcement Learning with LLMs2025
Gemini 2.5: Pushing the Frontier with Advanced Reasoning and Next Generation Agentic Capabilities2025
Kimi k2: Open Agentic Intelligence2025
GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models2025
Learning How to Use Tools, Not Just When: Pattern-Aware Tool-Integrated Reasoning2025
SCRIBE: Structured Mid-Level Supervision for Tool-Using Language Models2026
TaTToo: Tool-Grounded Thinking PRM for Test-Time Scaling in Tabular Reasoning2025

Orchestration-based Tool-Integration

Agentic Pipelines for Tool Orchestration
PaperYear
ToolPlanner: A Tool Augmented LLM for Multi Granularity Instructions with Path Planning and Feedback2025
Advancing Tool-Augmented Large Language Models via Meta-Verification and Reflection LearningKDD 2025
OctoTools: An Agentic Framework with Extensible Tools for Complex Reasoning2025
Chain-of-Tools: Utilizing Massive Unseen Tools in the CoT Reasoning of Frozen Language Models2025
PyVision: Agentic Vision with Dynamic Tooling2025
Learning to Use Tools via Cooperative and Interactive Agents2024
El Agente: An Autonomous Agent for Quantum Chemistry2025
Tool Representations for Orchestration
PaperYear
ToolExpNet: Optimizing Multi-Tool Selection in LLMs with Similarity and Dependency-Aware Experience NetworksACL (Findings) 2025
T^2Agent: A Tool-augmented Multimodal Misinformation Detection Agent with Monte Carlo Tree Search2025
ToolChain*: Efficient Action Space Navigation in Large Language Models with A* Search2023
ToolRerank: Adaptive and Hierarchy-Aware Reranking for Tool RetrievalCOLING 2024

search

PaperYear
ReAct: Synergizing Reasoning and Acting in Language ModelsICLR 2023
Measuring and Narrowing the Compositionality Gap in Language Models2022
Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions2022
Self-RAG: Learning to Retrieve, Generate, and Critique through Self-ReflectionNeurIPS Workshop 2023
Benchmarking Multimodal Retrieval Augmented Generation with Dynamic VQA Dataset and Self-Adaptive Planning Agent2024
DeepRAG: Thinking to Retrieve Step by Step for Large Language Models2025
MC-Search: Benchmarking Multimodal Agentic RAG with Structured Reasoning ChainsNeurIPS Workshop 2025
PaperYear
Agent-G: An Agentic Framework for Graph Retrieval Augmented Generation2025
MC-Search: Benchmarking Multimodal Agentic RAG with Structured Reasoning ChainsNeurIPS Workshop 2025
GeAR: Graph-Enhanced Agent for Retrieval-Augmented Generation2024
Learning to Retrieve and Reason on Knowledge Graph through Active Self-Reflection2025

Post-Training Search

PaperYear
Toolformer: Language Models Can Teach Themselves to Use ToolsNeurIPS 2023
INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning2024
RAG-Studio: Towards In-Domain Adaptation of Retrieval Augmented Generation through Self-AlignmentEMNLP (Findings) 2024
RAFT: Adapting Language Model to Domain Specific RAG2024
Search-o1: Agentic search-enhanced large reasoning models2025
RA-DIT: Retrieval-Augmented Dual Instruction TuningICLR 2023
SFR-RAG: Towards Contextually Faithful LLMs2024
PaperYear
WebGPT: Browser-assisted question-answering with human feedback2021
RAG-RL: Advancing Retrieval-Augmented Generation via RL and Curriculum Learning2025
Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning2025
KBQA-R1: Reinforcing Large Language Models for Knowledge Base Question Answering2025
DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-World Environments2025
ReSearch: Learning to Reason with Search for LLMs via Reinforcement Learning2025
ReARTeR: Retrieval-Augmented Reasoning with Trustworthy Process Rewarding2025

🧬 Self-evolving Agentic Reasoning

πŸ”„ Agentic Feedback Mechanisms

feed

Reflective Feedback

PaperYear
Reflexion: Language Agents with Verbal Reinforcement LearningNeurIPS 2023
Self-Refine: Iterative Refinement with Self-FeedbackNeurIPS 2023
Enable Language Models to Implicitly Learn Self-Improvement From DataICLR 2024
A Survey of Self-Evolving Agents: What, When, How, and Where to EvolveTMLR 2025
Tree of Thoughts: Deliberate Problem Solving with Large Language ModelsNeurIPS 2023
Graph of Thoughts: Solving Elaborate Problems with Large Language ModelsAAAI 2024
Zero-Shot Verification-Guided Chain of Thoughts2025
ReAct: Synergizing Reasoning and Acting in Language ModelsICLR 2023
WebGPT: Browser-assisted Question-Answering with Human Feedback2021
MemGPT: Towards LLMs as Operating Systems2023
Voyager: An Open-Ended Embodied Agent with Large Language Models2023

Parametric Adaptation

PaperYear
AgentTuning: Enabling Generalized Agent Abilities for LLMs2023
ReST meets ReAct: Self-Improvement for Multi-Step Reasoning LLM Agent2023
Re-ReST: Reflection-Reinforced Self-Training for Language Agents2024
Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes2023
Deep Reinforcement Learning from Human PreferencesNeurIPS 2017
Direct Preference Optimization: Your Language Model is Secretly a Reward ModelNeurIPS 2023
Constitutional AI: Harmlessness from AI Feedback2022
ReflectEvo: Improving Meta Introspection of Small LLMs by Learning Self-ReflectionACL (Findings) 2025

Validator-Driven Feedback

PaperYear
ReZero: Enhancing LLM search ability by trying one-more-time2025
Are Retrials All You Need? Enhancing Large Language Model Reasoning Without Verbalized Feedback2025
CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning2022
LEVER: Learning to Verify Language-to-Code Generation with ExecutionICML 2023
SWE-bench: Can Language Models Resolve Real-world Github Issues?ICLR 2024
Do As I Can, Not As I Say: Grounding Language in Robotic AffordancesCoRL 2022
PaLM-E: An Embodied Multimodal Language ModelICML 2023
Reflect, Retry, Reward: Self-Improving LLMs via Reinforcement Learning2025

🧠 Agentic Memory

mem

Agentic Use of Flat Memory

Factual Memory
PaperYear
Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksNeurIPS 2020
Self-RAG: Learning to Retrieve, Generate, and Critique through Self-ReflectionICLR 2024
MemoryBank: Enhancing Large Language Models with Long-Term Memory2023
LlamaIndex2022
MemGPT: Towards LLMs as Operating Systems2023
RET-LLM: Towards a General Read-Write Memory for Large Language Models2023
SCM: Enhancing Large Language Model with Self-Controlled Memory Framework2023
Evaluating Very Long-Term Conversational Memory of LLM Agents2024
LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory2024
SELFGOAL: Your Language Agents Already Know How to Achieve High-level GoalsNAACL 2025
FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Design2023
A-mem: Agentic memory for llm agents2025
In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agents2025
Zep: A Temporal Knowledge Graph Architecture for Agent Memory2025
MIRIX: Multi-Agent Memory System for LLM-Based Agents2025
MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Models2025
LightMem: Lightweight and Efficient Memory-Augmented Generation2025
Nemori: Self-Organizing Agent Memory Inspired by Cognitive Science2025
Experience Memory
PaperYear
Agent Workflow Memory2024
Sleep-time Compute: Beyond Inference Scaling at Test-time2025
Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory2025
Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models2025
ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memory2025
Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memory2025

Structured Use of Memory

PaperYear
RepoGraph: Enhancing AI Software Engineering with Repository-level Code Graph2024
From Local to Global: A Graph RAG Approach to Query-Focused Summarization2024
Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory2025
Zep: A Temporal Knowledge Graph Architecture for Agent Memory2025
From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMs2024
AutoFlow: Automated Workflow Generation for Large Language Model Agents2024
AFlow: Automating Agentic Workflow GenerationICLR 2025
FlowMind: Automatic Workflow Generation with LLMs2024
Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memory (M3-Agent)2025
Agent-ScanKit: Unraveling Memory and Reasoning of Multimodal Agents via Sensitivity Perturbations2025
Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon TasksNeurIPS 2024
RAP: Retrieval-Augmented Planning with Contextual Memory for Multimodal LLM Agents2024

Post-training Memory Control

PaperYear
MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agent2025
MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agents2025
Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learning2025
Mem-alpha: Learning Memory Construction via Reinforcement Learning2025
Memory as Action: Autonomous Context Curation for Long-Horizon Agentic Tasks2025
Agent Learning via Early Experience2025
Agentic Memory: Learning Unified Long-Term and Short-Term Memory Management for Large Language Model Agents2026
MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memory2026

πŸš€ Evolving Foundational Agentic Capabilities

mem

Self-evolving Planning

PaperYear
Self-challenging language model agents2025
Self-rewarding language modelsICML 2024
RLSR: Reinforcement Learning from Self Reward2025
Self: Self-evolution with language feedback2023
Training language models to self-correct via reinforcement learning2024
TextGrad: Differentiable Text Feedback for Language Models2024
AutoRule: Reasoning Chain-of-thought Extracted Rule-based Rewards Improve Preference Learning2025
AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generation2024
Reflexion: Language agents with verbal reinforcement learningNeurIPS 2023
Adaplanner: Adaptive planning from feedback with language modelsNeurIPS 2023
Self-refine: Iterative refinement with self-feedbackNeurIPS 2023
A self-improving coding agent2025
Ragen: Understanding self-evolution in llm agents via multi-turn reinforcement learning2025
DYSTIL: Dynamic Strategy Induction with Large Language Models for Reinforcement Learning2025

Self-evolving Tool-use

PaperYear
Large Language Models as Tool MakersICLR 2024
CRAFT: Customizing LLMs by Creating and Retrieving from Specialized ToolsetsICLR 2024
CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language ModelsEMNLP 2023
LLM Agents Making Agent Tools2025

Self-evolving Search for Memory Retrieval

PaperYear
Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksNeurIPS 2020
Self-RAG: Learning to Retrieve, Generate, and Critique through Self-ReflectionICLR 2024
MemoryBank: Enhancing Large Language Models with Long-Term Memory2023
MemGPT: Towards LLMs as Operating Systems2023
Agent Workflow Memory2024
Dynamic Cheatsheet: Test-time learning with adaptive memory2025
Reflexion: Language agents with verbal reinforcement learningNeurIPS 2023
ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memory2025
Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models2025
AutoFlow: Automated Workflow Generation for Large Language Model Agents2024
AFlow: Automating Agentic Workflow GenerationICLR 2025
FlowMind: Automatic Workflow Generation with LLMs2024
RepoGraph: Enhancing AI Software Engineering with Repository-level Code Graph2024
From Local to Global: A Graph RAG Approach to Query-Focused Summarization2024
Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory2025
Zep: A Temporal Knowledge Graph Architecture for Agent Memory2025
MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Models2025
Memory as Action: Autonomous Context Curation for Long-Horizon Agentic Tasks2025

πŸ‘₯ Collective Multi-agent Reasoning

mem

🀝 Collaboration and Division of Labor

collab

In-context Collaboration

Manually Crafted Pipelines
PaperYear
AgentOrchestra: A Hierarchical Multi-Agent Framework for General-Purpose Task Solving2025
MetaGPT: Meta Programming for A Multi-Agent Collaborative FrameworkICLR 2024
SurgRAW: Multi-agent workflow with chain-of-thought reasoning for surgical intelligence2025
Collab-RAG: Boosting retrieval-augmented generation for complex question answering via white-box and black-box llm collaboration2025
MA-RAG: Multi-Agent Retrieval-Augmented Generation via Collaborative Chain-of-Thought Reasoning2025
Chain of Agents: Large Language Models Collaborating on Long-Context TasksNeurIPS 2024
AutoAgents: a framework for automatic agent generationIJCAI 2024
RAG-KG-IL: A Multi-Agent Hybrid Framework for Reducing Hallucinations and Enhancing LLM Reasoning2025
SMoA: Improving Multi-agent Large Language Models with Sparse Mixture-of-Agents2024
MDocAgent: A multi-modal multi-agent framework for document understanding2025
LLM-Driven Pipelines
PaperYear
AutoML-Agent: A multi-agent llm framework for full-pipeline automl2024
Magentic-One: A generalist multi-agent system for solving complex tasks2024
MAS-GPT: Training LLMs to build LLM-based multi-agent systems2025
MetaAgent: Automatically Constructing Multi-Agent Systems Based on Finite State Machines2025
Agent-oriented planning in multi-agent systems2024
AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answering2025
Talk to Right Specialists: Routing and planning in multi-agent system for question answering2025
Theory-of-Mind-Augmented Collaboration
PaperYear
Theory of mind for multi-agent collaboration via large language models2023
Hypothetical Minds: Scaffolding theory of mind for multi-agent tasks with large language models2024
MindForge: Empowering Embodied Agents with Theory of Mind for Lifelong Collaborative Learning2024
How large language models encode theory-of-mind: a study on sparse parameter patternsnpj Artificial Intelligence 2025
Large Language Models as Theory of Mind Aware Generative Agents with Counterfactual Reflection2025
BeliefNest: A Joint Action Simulator for Embodied Agents with Theory of Mind2025

Post-training Collaboration

Multi-agent Prompt Optimization
PaperYear
AutoAgents: A Framework for Automatic Agent GenerationIJCAI 2024
Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-CollaborationNAACL 2024
DSPy Assertions: Computational Constraints for Self-Refining Language Model Pipelines2023
Multi-agent Design: Optimizing Agents with Better Prompts and Topologies2025
Automatic Prompt Optimization with "Gradient Descent" and Beam Search2023
Graph-based Topology Generation
PaperYear
Learning Multi-Agent Communication from Graph Modeling Perspective2024
G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks2024
Graph Diffusion for Robust Multi-Agent CoordinationICML 2025
Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems2024
Adaptive Graph Pruning for Multi-Agent Communication2025
G-Safeguard: A Topology-Guided Security Lens and Treatment on LLM-based Multi-Agent Systems2025
AFlow: Automating Agentic Workflow GenerationICLR 2025
Multi-agent Design: Optimizing Agents with Better Prompts and Topologies2025
Multi-Agent Architecture Search via Agentic Supernet2025
DynaSwarm: Dynamically Graph Structure Selection for LLM-based Multi-Agent System2025
GPTSwarm: Language Agents as Optimizable GraphsICML 2024
Policy-based Topology Generation
PaperYear
MASRouter: Learning to Route LLMs for Multi-Agent Systems2025
RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory2025
xRouter: Training Cost-Aware LLMs Orchestration System via Reinforcement Learning2025
Optimal-Agent-Selection: State-Aware Routing Framework for Efficient Multi-Agent Collaboration2025
LLM Collaboration with Multi-Agent Reinforcement Learning2025
Heterogeneous Group-Based Reinforcement Learning for LLM-based Multi-Agent Systems2025
Enhancing Multi-Agent Systems via Reinforcement Learning with LLM-based Planner and Graph-based Policy2025
LAMARL: LLM-Aided Multi-Agent Reinforcement Learning for Cooperative Policy GenerationIEEE RA-L 2025
MAPoRL: Multi-Agent Post-Co-Training for Collaborative Large Language Models with Reinforcement Learning2025
Reflective Multi-Agent Collaboration Based on Large Language ModelsNeurIPS 2024
Sirius: Self-Improving Multi-Agent Systems via Bootstrapped Reasoning2025
Multiagent Finetuning: Self Improvement with Diverse Reasoning Chains2025
M3HF: Multi-Agent Reinforcement Learning from Multi-Phase Human Feedback of Mixed Quality2025
O-MAPL: Offline Multi-Agent Preference Learning2025

🌱 Multi-Agent Memory and Evolution

mem

From Single-Agent Evolution to Multi-Agent Evolution

Intra-test-time Evolution
PaperYear
Reflexion: Language Agents with Verbal Reinforcement LearningNeurIPS 2023
Self-Refine: Iterative Refinement with Self-FeedbackNeurIPS 2023
AdaPlanner: Adaptive Planning from Feedback with Language ModelsNeurIPS 2023
TrustAgent: Towards Safe and Trustworthy LLM-based Agents through Agent ConstitutionTiFA 2024
Self-Adapting Language Models2025
TTRL: Test-Time Reinforcement Learning2025
Ladder: Self-Improving LLMs through Recursive Problem Decomposition2025
Inter-test-time Evolution
PaperYear
Self: Self-Evolution with Language Feedback2023
STaR: Bootstrapping Reasoning with ReasoningNeurIPS 2022
Reasoning Beyond Limits: Advances and Open Problems for LLMs2025
RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learning2025
DYSTIL: Dynamic Strategy Induction with Large Language Models for Reinforcement Learning2025
WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learning2024
Why do animals need shaping? A theory of task composition and curriculum learning2024
SAGE: Self-evolving Agents with Reflective and Memory-augmented AbilitiesNeurocomputing 2025
MemInsight: Autonomous Memory Augmentation for LLM Agents2025
Agent Workflow Memory2024
Multi-agent Evolution
PaperYear
Self: Self-Evolution with Language Feedback2023
Training Language Models to Self-Correct via Reinforcement Learning2024
TextGrad: Automatic "Differentiation" via Text2024
REMA: Learning to Meta-Think for LLMs with Multi-Agent Reinforcement Learning2025
Group-in-Group Policy Optimization for LLM Agent Training2025
Agent Workflow Memory2024
MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Models2025
Multi-agent Design: Optimizing Agents with Better Prompts and Topologies2025
AFlow: Automating Agentic Workflow GenerationICLR 2025
Testing Advanced Driver Assistance Systems Using Multi-Objective Search and Neural NetworksASE 2016
Latent Collaboration in Multi-Agent Systems2025

Multi-agent Memory Management for Evolution

PaperYear
G-Memory: Tracing Hierarchical Memory for Multi-Agent Systems2025
Intrinsic Memory Agents: Heterogeneous Multi-Agent LLM Systems through Structured Contextual Memory2025
LLM-Powered Decentralized Generative Agents with Adaptive Hierarchical Knowledge Graph for Cooperative Planning2025
SEDM: Scalable Self-Evolving Distributed Memory for Agents2025
Collaborative Memory: Multi-User Memory Sharing in LLM Agents with Dynamic Access Control2025
Memory Sharing for Large Language Model based Agents2024
MIRIX: Multi-Agent Memory System for LLM-Based Agents2025
LEGOMem: Modular Procedural Memory for Multi-agent LLM Systems for Workflow Automation2025
MAPLE: Multi-Agent Adaptive Planning with Long-Term Memory for Table ReasoningALTA 2025
Lyfe Agents: Generative agents for low-cost real-time social interactions2023
Agent KB: Leveraging Cross-Domain Experience for Agentic Problem Solving2025

Training Multi-agent to Evolve

PaperYear
Multi-Agent Evolve: LLM Self-Improve through Co-evolution2025
CoMAS: Co-Evolving Multi-Agent Systems via Interaction Rewards2025
MARFT: Multi-Agent Reinforcement Fine-Tuning2025
Stronger-MAS: Multi-Agent Reinforcement Learning for Collaborative LLMs2025
MAPoRL: Multi-Agent Post-Co-Training for Collaborative Large Language Models with Reinforcement Learning2025
MALT: Multi-Agent Learning from Trajectories2025
MARS: Optimizing Dual-System Deep Research via Multi-Agent Reinforcement Learning2025
Preference-Based Multi-Agent Reinforcement Learning: Data Coverage and Algorithmic Techniques2024
The Alignment Waltz: Jointly Training Agents to Collaborate for Safety2025

🎨 Applications

app

πŸ’» Math Exploration & Vibe Coding Agents

Foundational Agentic Reasoning

PaperYear
Advancing mathematics by guiding human intuition with AINature 2021
Solving olympiad geometry without human demonstrationsNature 2024
Mathematical discoveries from program search with large language modelsNature 2024
Mathematical Exploration and Discovery at Scale2025
Advancing geometry with AI: Multi-agent generation of polytopes2025
Towards Robust Mathematical ReasoningEMNLP 2025
CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modulesICLR 2024
Executable Code Actions Elicit Better LLM AgentsICML 2024
Knowledge-Aware Code Generation with Large Language ModelsICPC 2024
CodePlan: Repository-level Coding using LLMs and PlanningFSE 2024
Multi-stage guided code generation for Large Language ModelsEng. App. AI 2025
CodeTree: Agent-Guided Tree Search for Code Generation with Large Language Models2024
DotaMath: Decomposition of Thought with Code Assistance and Self-correction for Mathematical Reasoning2024
Tree-of-Code: A Self-Growing Tree Framework for End-to-End Code Generation and Execution in Complex TasksACL 2025
CoRT: Code-integrated Reasoning within Thinking2025
DARS: Dynamic Action Re-Sampling to Enhance Coding Agent Performance by Adaptive Tree Traversal2025
Generating Code World Models with Large Language Models Guided by Monte Carlo Tree SearchNeurIPS 2024
VerilogCoder: Autonomous Verilog Coding Agents with Graph-based PlanningAAAI 2025
Guided Search Strategies in Non-Serializable Environments with Applications to Software Engineering AgentsICML 2025
An In-Context Learning Agent for Formal Theorem-ProvingCOLM 2024
Formal Mathematical Reasoning: A New Frontier in AI2024
Generative Modelling for Mathematical Discovery2025
Toolformer: Language Models Can Teach Themselves to Use ToolsNeurIPS 2023
ToolCoder: Teach Code Generation Models to use API search tools2023
ToolGen: Unified Tool Retrieval and Calling via GenerationICLR 2025
CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding ChallengesACL 2024
ROCODE: Integrating Backtracking Mechanism and Program Analysis in Large Language Models for Code GenerationICSE 2025
CodeTool: Enhancing Programmatic Tool Invocation of LLMs via Process Supervision2025
RepoHyper: Better Context Retrieval is All You Need for Repository-Level Code Completion2024
CodeNav: Beyond Tool-Use to Using Real-World Codebases with LLM AgentsICLR 2024
Optimizing Code Runtime Performance Through Context-Aware Retrieval-Augmented GenerationICPC 2025
Knowledge Graph Based Repository-Level Code GenerationLLM4Code 2025
cAST: Enhancing Code Retrieval-Augmented Generation with Structural Chunking via Abstract Syntax Tree2025

Self-evolving Agentic Reasoning

PaperYear
Evaluating Language Models for Mathematics through InteractionsPNAS 2024
CLCL: Non-compositional Expression Detection with Contrastive Learning and Curriculum LearningACL 2023
Is Self-Repair a Silver Bullet for Code Generation?2024
LeDeX: Learning to Debug with Execution FeedbackNeurIPS 2024
Self-Refine: Iterative Refinement with Self-FeedbackNeurIPS 2023
A Self-Iteration Code Generation Method Based on Large Language ModelsICPADS 2023
Teaching Large Language Models to Self-DebugICLR 2024
Self-Collaboration Code Generation via ChatGPTTOSEM 2024
L2MAC: Large Language Model Automatic Computer for Extensive Code Generation2023
Cogito, Ergo Sum: A Neurobiologically-Inspired Cognition-Memory-Growth System for Code Generation2025

Collective Multi-agent Reasoning

PaperYear
AgentCoder: Multi-Agent-Based Code Generation with Iterative Testing and Optimisation2023
A Pair Programming Framework for Code Generation via Multi-Plan Exploration and Feedback-Driven RefinementASE 2024
SOEN-101: Code Generation by Emulating Software Process Models Using Large Language Model AgentsICSE 2025
Self-Organized Agents: A LLM Multi-Agent Framework toward Ultra Large-Scale Code Generation and Optimization2024
MapCoder: Multi-Agent Code Generation for Competitive Problem Solving2024
AutoSafeCoder: A Multi-Agent Framework for Securing LLM Code Generation through Static Analysis and Fuzz Testing2024
QualityFlow: An Agentic Workflow for Program Synthesis Controlled by LLM Quality Checks2025
SEW: Self-Evolving Agentic Workflows for Automated Code Generation2025
Self-Evolving Multi-Agent Collaboration Networks for Software Development2024
Lingma SWE-GPT: An Open Development-Process-Centric Language Model for Automated Software Improvement2024
CodeCoR: An LLM-based Self-Reflective Multi-Agent Framework for Code Generation2025
SyncMind: Measuring Agent Out-of-Sync Recovery in Collaborative Software EngineeringICML 2025
Hallucination to Consensus: Multi-Agent LLMs for End-to-End Test Generation2025

πŸ”¬ Scientific Discovery Agents

Here are the extracted citation tables grouped by their respective sections.

Foundational Agentic Reasoning

PaperYear
ProtAgents: Protein discovery via large language model multi-agent collaborations combining physics and machine learningDigital Discovery 2024
Agent-based learning of materials datasets from the scientific literatureDigital Discovery 2024
ReAct: Synergizing Reasoning and Acting in Language ModelsICLR 2023
Biomni: A General-Purpose Biomedical AI AgentbioRxiv 2025
SciAgent: Tool-augmented Language Models for Scientific Reasoning2024
Chemcrow: Augmenting large-language models with chemistry tools2023
CACTUS: Chemistry Agent Connecting Tool-Usage to ScienceACS Omega 2024
ChemToolAgent: The Impact of Tools on Language Agents for Chemistry Problem Solving2024
CheMatAgent: Enhancing LLMs for Chemistry and Materials Science through Tree-Search Based Tool Learning2025
TxAgent: An AI Agent for Therapeutic Reasoning Across a Universe of Tools2025
AgentMD: Empowering language agents for risk prediction with large-scale clinical tool learningNature Communications 2025
LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval and Distillation2024
HoneyComb: A Flexible LLM-Based Agent System for Materials Science2024
CRISPR-GPT for Agentic Automation of Gene-editing Experiments2024
PharmAgents: Building a Virtual Pharma with Large Language Model Agents2025
ORGANA: A robotic assistant for automated chemistry experimentation and characterizationMatter 2025
AtomAgents: Alloy design and discovery through physics-aware multi-modal multi-agent artificial intelligence2024
Chemist-X: Large Language Model-empowered Agent for Reaction Condition Recommendation in Chemical Synthesis2024
LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discovery2024
CellAgent: LLM-Driven Multi-Agent Framework for Natural Language-Based Single-Cell AnalysisBioRxiv 2024
BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments2024
DrugAgent: Multi-Agent Large Language Model-Based Reasoning for Drug-Target Interaction Prediction2024
Accelerating Scientific Research Through a Multi-LLM Framework2025
The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search2025
Large Language Models are Zero Shot Hypothesis Proposers2023
PaperQA: Retrieval-Augmented Generative Agent for Scientific Research2023
Language agents achieve superhuman synthesis of scientific knowledge2024
LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval and Distillation2024

Self-evolving Agentic Reasoning

PaperYear
ChemAgent: Self-updating Library in Large Language Models Improves Chemical Reasoning2025
Accelerated Inorganic Materials Design with Generative AI Agents2025
LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discovery2024
ChemReasoner: Heuristic Search over a Large Language Model's Knowledge Space using Quantum-Chemical Feedback2024
LLMatDesign: Autonomous Materials Discovery with Large Language Models2024
Hypothesis Generation for Materials Discovery and Design Using Goal-Driven and Constraint-Guided LLM Agents2025

Collective multi-agent reasoning

PaperYear
ProtAgents: protein discovery via large language model multi-agent collaborations combining physics and machine learningDigital Discovery 2024
PiFlow: Principle-aware Scientific Discovery with Multi-Agent Collaboration2025
AtomAgents: Alloy design and discovery through physics-aware multi-modal multi-agent artificial intelligence2024
CellAgent: LLM-Driven Multi-Agent Framework for Natural Language-Based Single-Cell AnalysisBioRxiv 2024
Accelerating Scientific Research Through a Multi-LLM Framework2025
Toward a team of ai-made scientists for scientific discovery from gene expression data2024
The virtual lab: Ai agents design new sars-cov-2 nanobodies with experimental validationbioRxiv 2024

πŸ€– Embodied Agents

Foundational Agentic Reasoning

PaperYear
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances2022
SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planning2023
EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of ThoughtNeurIPS 2023
Context-Aware Planning and Environment-Aware Memory for Instruction Following Embodied AgentsECCV 2024
Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task AgentsNeurIPS 2023
Robotic Control via Embodied Chain-of-Thought Reasoning2024
Fast ECoT: Fast Embodied Chain-of-Thought for Vision-Language-Action Models2025
Cosmos-Reason1: Physical Commonsense with Multimodal Chain of Thought Reasoning2025
CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models2025
Emma-X: An Embodied Multimodal Action Model with Chain of Thought Reasoning2024
Robot-R1: Reinforcement Learning Enhanced Large Vision-Language Models for Robotic Manipulation2025
ManipLVM-R1: Learning to Reason for Robotic Manipulation via Reinforcement Learning2025
Embodied-R: Emergent Spatial Reasoning in Robotics via Multi-Agent Reinforcement Learning2025
VIKI-R: A VLM-Based Reinforcement Learning Approach for Heterogeneous Multi-Agent Cooperation2025
GSCE: A Prompt Framework for Enhanced Logical Reasoning in LLM-Based Drone Control2025
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale KnowledgeNeurIPS 2022
Physical AI Agents: Integrating Generative AI, Symbolic AI and Robotics2025
Chat with the Environment: Interactive Multimodal Perception using Large Language ModelsIROS 2023
An embodied generalist agent in 3d worldICML 2024
Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Models2025
Gemini Robotics: Bringing AI to the Physical World2025
Octopus: Embodied Vision-Language Programmer from Environmental FeedbackECCV 2024
CaPo: Cooperative Plan Optimization for Multi-Agent Collaboration2024
COHERENT: Collaboration of Heterogeneous Multi-Robot System with Large Language ModelsICRA 2025
MP5: A Multi-modal Open-ended Embodied System in Minecraft via Active PerceptionCVPR 2024
LLM-Planner: Few-Shot Grounded High-Level Planning for Embodied Agents with Large Language ModelsICCV 2023
EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of ThoughtNeurIPS 2023
L3MVN: Leveraging Large Language Models for Visual Target Navigation2023
SayNav: Grounding Large Language Models for Dynamic Planning to Navigation in New EnvironmentsICAPS 2023
SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task PlanningCoRL 2023
ReMEmbR: Building and Reasoning with Long-Horizon Spatio-Temporal Memory for Embodied Agents2025
Embodied-RAG: General Non-parametric Embodied Memory for Retrieval-Augmented GenerationNeurIPS Workshop AFM 2024
Retrieval-Augmented Embodied Agents2024
MLLM as Retriever: Interactively Learning Multimodal Retrieval for Embodied Agents2024

Self-evolving Agentic Reasoning

PaperYear
LLM-Empowered Embodied Agent for Memory-Augmented Task Planning in Household Robotics2024
Optimus-1: Hybrid Multimodal Memory Empowered Agents for Long-Horizon Tasks in Minecraft2024
Open-Ended Instructable Embodied Agents with Memory-Augmented Large Language ModelsEMNLP 2023
Endowing Embodied Agents with Spatial Reasoning Capabilities for Vision-and-Language Navigation2025
Context-Aware Planning and Environment-Aware Memory for Instruction Following Embodied Agents2024
Ella: Embodied Social Agents with Lifelong Memory2025
Chat with the Environment: Interactive Multimodal Perception using Large Language ModelsIROS 2023
From Strangers to Assistants: Fast Desire Alignment for Embodied Agent-User Adaptation2025
Robots That Ask For Help: Uncertainty Alignment for Large Language Model PlannersCoRL 2023
Octopus: Embodied Vision-Language Programmer from Environmental FeedbackECCV 2024
MindForge: Empowering Embodied Agents with Theory of Mind for Lifelong Collaborative Learning2024
Towards Efficient LLM Grounding for Embodied Multi-Agent Collaboration2024
EMAC+: Embodied Multimodal Agent for Collaborative Planning with VLM+LLM2025
Voyager: An Open-Ended Embodied Agent with Large Language Models2023

Collective multi-agent reasoning

PaperYear
Smart-LLM: Smart Multi-Agent Robot Task Planning with Large Language Models2024
CaPo: Cooperative Plan Optimization for Multi-Agent Collaboration2024
COHERENT: Collaboration of Heterogeneous Multi-Robot System with Large Language ModelsICRA 2025
Theory of mind for multi-agent collaboration via large language models2023
How large language models encode theory-of-mind: a study on sparse parameter patternsnpj Artificial Intelligence 2025
Hypothetical Minds: Scaffolding theory of mind for multi-agent tasks with large language models2024
MindForge: Empowering Embodied Agents with Theory of Mind for Lifelong Collaborative Learning2024
EMAC+: Embodied Multimodal Agent for Collaborative Planning with VLM+LLM2025
COMBO: Compositional World Models for Embodied Multi-Agent Cooperation2025
VIKI-R: A VLM-Based Reinforcement Learning Approach for Heterogeneous Multi-Agent Cooperation2025
RoCo: Dialectic Multi-Robot Collaboration with Large Language Models2024

πŸ₯ Healthcare & Medicine Agents

Foundational agentic reasoning

PaperYear
Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncologyNature Medicine 2024
EHRAgent: Code Empowers Large Language Models for Complex Tabular Reasoning on Electronic Health Records2024
PathFinder: A Multi-Modal Multi-Agent System for Medical Diagnostic Decision-Making Applied to Histopathology2025
MedAgent-Pro: Towards Evidence-based Multi-modal Medical Diagnosis via Reasoning Agentic Workflow2025
MedOrch: Medical Diagnosis with Tool-Augmented Reasoning Agents for Flexible Extensibility2025
ClinicalAgent: Clinical Trial Multi-Agent System with Large Language Model-based Reasoning2024
DynamiCare: A Dynamic Multi-Agent Framework for Interactive and Open-Ended Medical Decision-Making2025
TxAgent: An AI Agent for Therapeutic Reasoning Across a Universe of Tools2025
AgentMD: Empowering language agents for risk prediction with large-scale clinical tool learningNature Communications 2025
Large language model agents can use tools to perform clinical calculationsNPJ Digital Medicine 2025
MeNTi: Bridging Medical Calculator and LLM Agent with Nested Tool Calling2024
MMedAgent: Learning to Use Medical Tools with Multi-modal Agents2024
VoxelPrompt: A Vision Agent for End-to-End Medical Image Analysis2024
Enhancing Surgical Robots with Embodied Intelligence for Autonomous Ultrasound Scanning2024
Adaptive Reasoning and Acting in Medical Language Agents2024
MedRAX: Medical Reasoning Agent for Chest X-ray2025
Conversational Health Agents: A Personalized LLM-Powered Agent Framework2023
MedAgentGym: A Scalable Agentic Training Environment for Code-Centric Reasoning in Biomedical Data Science2025
Simulated patient systems powered by large language model-based AI agents offer potential for transforming medical education2024
Self-Evolving Multi-Agent Simulations for Realistic Clinical InteractionsMICCAI 2025
RAG-Enhanced Collaborative LLM Agents for Drug Discovery2025
MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphs2025

Self-evolving agentic reasoning

PaperYear
Epidemic Modeling with Generative Agents2023
Self-Evolving Multi-Agent Simulations for Realistic Clinical InteractionsMICCAI 2025
EHRAgent: Code Empowers Large Language Models for Complex Tabular Reasoning on Electronic Health Records2024
LLMs Can Simulate Standardized Patients via Agent Coevolution2024
Simulated patient systems powered by large language model-based AI agents offer potential for transforming medical education2024
MedOrch: Medical Diagnosis with Tool-Augmented Reasoning Agents for Flexible Extensibility2025
DynamiCare: A Dynamic Multi-Agent Framework for Interactive and Open-Ended Medical Decision-Making2025
MedAgentGym: A Scalable Agentic Training Environment for Code-Centric Reasoning in Biomedical Data Science2025
EHRAgent: Code Empowers Large Language Models for Complex Tabular Reasoning on Electronic Health Records2024
MeNTi: Bridging Medical Calculator and LLM Agent with Nested Tool Calling2025
Large language model agents can use tools to perform clinical calculationsNPJ Digital Medicine 2025

Collective multi-agent reasoning

PaperYear
MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Making2024
DoctorAgent-RL: A Multi-Agent Collaborative Reinforcement Learning System for Multi-Turn Clinical Dialogue2025
Beyond Direct Diagnosis: LLM-based Multi-Specialist Agent Consultation for Automatic Diagnosis2024
ClinicalAgent: Clinical Trial Multi-Agent System with Large Language Model-based Reasoning2024
PathFinder: A Multi-Modal Multi-Agent System for Medical Diagnostic Decision-Making Applied to Histopathology2025
Self-Evolving Multi-Agent Simulations for Realistic Clinical InteractionsMICCAI 2025
LLMs Can Simulate Standardized Patients via Agent Coevolution2024
DynamiCare: A Dynamic Multi-Agent Framework for Interactive and Open-Ended Medical Decision-Making2025
MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoning2024
RAG-Enhanced Collaborative LLM Agents for Drug Discovery2025
GMAI-VL-R1: Harnessing Reinforcement Learning for Multi-Modal Medical Reasoning2025

🌐 Autonomous Web Exploration & Research Agents

Foundational agentic reasoning

PaperYear
Agent Laboratory: Using LLM Agents as Research Assistants2025
GPT Researcher2023
Accelerating Scientific Research Through a Multi-LLM Framework2025
Video-Browser: Towards Agentic Open-web Video Browsing2025
InternAgent: When Agent Becomes the Scientist -- Building Closed-Loop System from Hypothesis to Verification2025
WebGPT: Browser-assisted question-answering with human feedback2021
Language Models are Few-Shot LearnersNeurIPS 2020
GPT-4V(ision) is a Generalist Web Agent, if GroundedICML 2024
AutoWebGLM: A Large Language Model-based Web Navigating Agent2024
Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents2024
WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learning2024
WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learning2025
Navigating WebAI: Training Agents to Complete Web Tasks with Large Language Models and Reinforcement Learning2024
DeepDiver: Adaptive Search Intensity Scaling via Open-Web Reinforcement Learning2025
EvolveSearch: An Iterative Self-Evolving Search Agent2025
WebEvolver: Enhancing Web Agent Self-Improvement with Coevolving World Model2025
ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RLICLR 2025
Proposer-Agent-Evaluator(PAE): Autonomous Skill Discovery For Foundation Model Internet Agents2024
WebSeer: Training Deeper Search Agents through Reinforcement Learning with Self-Reflection2025
ZeroSearch: Incentivize the Search Capability of LLMs Without Searching2025
StepSearch: Igniting LLMs Search Ability via Step-Wise Proximal Policy Optimization2025
How to Train Your LLM Web Agent: A Statistical Diagnosis2025
Agent S: An Open Agentic Framework that Uses Computers Like a Human2024
InfiGUIAgent: A Multimodal Generalist GUI Agent with Native Reasoning and Reflection2025
MobA: Multifaceted Memory-Enhanced Adaptive Planning for Efficient Mobile Task Automation2024
PC-Agent: A Hierarchical Multi-Agent Collaboration Framework for Complex Task Automation on PC2025
UItron: Foundational GUI Agent with Advanced Perception and Planning2025
ARPO:End-to-End Policy Optimization for GUI Agents with Experience Replay2025
ComputerRL: Scaling End-to-End Online Reinforcement Learning for Computer Use Agents2025
UI-R1: Enhancing Action Prediction of GUI Agents by Reinforcement Learning2025
GUI-R1: A Generalist R1-Style Vision-Language Action Model For GUI Agents2025
InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasoners2025
UI-S1: Advancing GUI Automation via Semi-online Reinforcement Learning2025
GUI-Bee: Align GUI Action Grounding to Novel Environments via Autonomous ExplorationEMNLP 2025
Learning GUI Grounding with Spatial Reasoning from Visual Feedback2025
GUI-Shift: Enhancing VLM-Based GUI Agents through Self-supervised Reinforcement Learning2025
UI-AGILE: Advancing GUI Agents with Effective Reinforcement Learning and Precise Inference-Time Grounding2025
ZeroGUI: Automating Online GUI Learning at Zero Human Cost2025
AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning2025
AutoGLM: Autonomous Foundation Agents for GUIs2024
Mobile-Agent-v3: Fundamental Agents for GUI Automation2025
WebVoyager: Building an End-to-End Web Agent with Large Multimodal ModelsACL 2024
BrowserAgent: Building Web Agents with Human-Inspired Web Browsing Actions2025
WALT: Web Agents that Learn Tools2025
WebDancer: Towards Autonomous Information Seeking Agency2025
WebShaper: Agentically Data Synthesizing via Information-Seeking Formalization2025
AutoDroid: LLM-powered Task Automation in AndroidMobiCom 2024
MobileExperts: A Dynamic Tool-Enabled Agent Team in Mobile Devices2024
AgentStore: Scalable Integration of Heterogeneous Agents As Specialized Generalist Computer Assistant2024
OS-Copilot: Towards Generalist Computer Agents with Self-Improvement2024
OSCAR: Operating System Control via State-Aware Reasoning and Re-Planning2024
OS-ATLAS: A Foundation Action Model for Generalist GUI Agents2024
SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents2024
Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Tools2025
Agent Laboratory: Using LLM Agents as Research Assistants2025
MLR-Copilot: Autonomous Machine Learning Research based on Large Language Model Agents2024
Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback2025
The AI Scientist: Fully Automated Open-Ended Scientific Discovery2024
The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search2025
WebExplorer: Explore and Evolve for Training Long-Horizon Web Agents2025
WebSailor: Navigating Super-human Reasoning for Web Agent2025
RaDA: Retrieval-augmented Web Agent Planning with LLMs2024
Synapse: Trajectory-as-Exemplar Prompting with Memory for Computer ControlICLR 2024
LearnAct: Few-Shot Mobile GUI Agent with a Unified Demonstration Benchmark2025
Explore, Select, Derive, and Recall: Augmenting LLM with Human-like Memory for Mobile Task Automation2023
Retrieval-augmented GUI Agents with Generative Guidelines2025
WebThinker: Empowering Large Reasoning Models with Deep Research Capability2025
DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environments2025
PaperQA: Retrieval-Augmented Generative Agent for Scientific Research2023
Language agents achieve superhuman synthesis of scientific knowledge2024
Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents2024
Scideator: Human-LLM Scientific Idea Generation Grounded in Research-Paper Facet Recombination2024

Self-evolving agentic reasoning

PaperYear
Agent Workflow Memory2024
VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought2024
BrowserAgent: Building Web Agents with Human-Inspired Web Browsing Actions2025
AutoWebGLM: A Large Language Model-based Web Navigating Agent2024
AgentOccam: A Simple Yet Strong Baseline for LLM-Based Web Agents2024
LiteWebAgent: The Open-Source Suite for VLM-Based Web-Agent Applications2025
WebDancer: Towards Automated Web Information Seeking with Large Language Model Agents2025
WebShaper: Agentically Data Synthesizing via Information-Seeking Formalization2025
Explore, Select, Derive, and Recall: Augmenting LLM with Human-like Memory for Mobile Task Automation2023
MobA: Multifaceted Memory-Enhanced Adaptive Planning for Efficient Mobile Task Automation2024
Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks2025
Agent Laboratory: Using LLM Agents as Research Assistants2025
GPT Researcher2023
Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents2024
The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search2025
Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents2024
Reflection-Based Memory For Web navigation Agents2025
Agent-E: From Autonomous Web Navigation to Foundational Design Principles in Agentic Systems2024
Recon-Act: A Self-Evolving Multi-Agent Browser-Use System via Web Reconnaissance, Tool Generation, and Task Execution2025
WINELL: Wikipedia Never-Ending Updating with LLM Agents2025
WebSeer: Training Deeper Search Agents through Reinforcement Learning with Self-Reflection2025
GUI-Reflection: Empowering Multimodal GUI Models with Self-Reflection Behavior2025
History-Aware Reasoning for GUI Agents2025
MobileUse: A GUI Agent with Hierarchical Reflection for Autonomous Mobile Operation2025
InfiGUIAgent: A Multimodal Generalist GUI Agent with Native Reasoning and Reflection2025
Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks2025
CycleResearcher: Improving Automated Research via Automated Review2024
MLR-Copilot: Autonomous Machine Learning Research based on Large Language Model Agents2024
Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback2025
DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environments2025

Collective multi-agent reasoning

PaperYear
WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Exploration2024
WINELL: Wikipedia Never-Ending Updating with LLM Agents2025
Recon-Act: A Self-Evolving Multi-Agent Browser-Use System via Web Reconnaissance, Tool Generation, and Task Execution2025
Proposer-Agent-Evaluator(PAE): Autonomous Skill Discovery For Foundation Model Internet Agents2024
Agent-E: From Autonomous Web Navigation to Foundational Design Principles in Agentic Systems2024
Plan-and-Act: Improving Planning of Agents for Long-Horizon Tasks2025
Agentic Web: Weaving the Next Web with AI Agents2025
CoLA: Collaborative Low-Rank Adaptation2025
Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent CollaborationACL 2024
Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks2025
Mobile-Agent-V: A Video-Guided Approach for Effortless and Efficient Operational Knowledge Injection in Mobile Automation2025
MobileExperts: Orchestrating Tool-Capable Specialists for Mobile Automation2024
Synthetic Data Generation & Multi-Step RL for Reasoning & Tool Use2025
PC-Agent: A Hierarchical Multi-Agent Collaboration Framework for Complex Task Automation on PC2025
AgentRxiv: Towards Collaborative Autonomous Research2025
Accelerating Scientific Research Through a Multi-LLM Framework2025
Large Language Models are Zero-Shot ReasonersNeurIPS 2022
Emergent autonomous scientific research capabilities of large language modelsNature 2023
Toward a Team of AI-made Scientists for Scientific Discovery from Gene Expression Data2024

πŸ“Š Benchmarks

bench

βš™οΈ Core Mechanisms of Agentic Reasoning

Tool Use

Single-Turn Tool Use
PaperYear
ToolQA: A Dataset for LLM Question Answering with External ToolsNeurIPS 2023
Gorilla: Large Language Model Connected with Massive APIs2023
ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIsICLR 2024
MetaTool: A Benchmark for Controlling Special-purpose Large Language ModelsICLR 2024
T-Eval: Evaluating the Tool Utilization Capability of Large Language Models Step by StepACL 2024
GTA: A Benchmark for General Tool AgentsNeurIPS 2024
Retrieval Models Aren't Tool-Savvy: Benchmarking Tool Retrieval for Large Language Models2025
Multi-Turn Tool Use
PaperYear
ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Cases2023
On the Tool Manipulation Capability of Open-source Large Language Models2023
API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMsEMNLP 2023
Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex ScenariosACL 2024
MTU-Bench: A Multi-granularity Tool-Use Benchmark for Large Language ModelsICLR 2025

Memory and Planning

Long-Horizon Episodic Memory
PaperYear
PerLTQA: A Persona-based Long-term Memory Benchmark for RAG2024
ELITR-Bench: A Meeting Assistant Benchmark for Long-Context LLMs2024
Multi-IF: A Benchmark for Multi-turn Instruction Following2024
MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMs2025
TurnBench-MS: A Benchmark for Evaluating Multi-Turn, Multi-Step Reasoning in Large Language Models2025
StoryBench: A Dynamic Benchmark for Evaluating Long-Term Memory with Multi Turns2025
MMRC: A Large-Scale Benchmark for Understanding Multimodal Large Language Model in Real-World Conversation2025
Multi-session Recall
PaperYear
Evaluating Very Long-Term Conversational Memory of LLM Agents2024
MemSim: A Bayesian Simulator for Evaluating Memory of LLM-based Personal Assistants2024
LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory2024
REALTALK: A 21-Day Real-World Dataset for Long-Term Conversation2025
Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions2025
Mem-Gallery: Benchmarking Multimodal Long-Term Conversational Memory for MLLM Agents2026
Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memory2025
Planning and Feedback
PaperYear
ALFWorld: Aligning Text and Embodied Environments for Interactive LearningICLR 2021
PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about ChangeNeurIPS 2022
ACPBench: Reasoning about Action, Change, and Planning2024
Text2World: Benchmarking Large Language Models for Symbolic World Model GenerationACL 2025
REALM-Bench: A Benchmark for Evaluating Multi-Agent Systems on Real-world, Dynamic Planning and Scheduling Tasks2025
TravelPlanner: A Benchmark for Real-World Planning with Language AgentsICML 2024
FlowBench: Revisiting and Benchmarking Workflow-Guided Planning for LLM-based Agents2024
UrbanPlanBench: A Comprehensive Urban Planning Benchmark for Evaluating Large Language Models2025

Multi-Agent System

Game-based reinforcement learning evaluation
PaperYear
MAgent: A Many-Agent Reinforcement Learning Platform for Artificial Collective IntelligenceAAAI 2018
Pommerman: A Multi-Agent Playground2018
The StarCraft Multi-Agent ChallengeNeurIPS 2019
MineLand: Simulating Large-Scale Multi-Agent Interactions with Limited Multimodal Senses and Physical Needs2024
TeamCraft: A Benchmark for Multi-Modal Multi-Agent Systems in Minecraft2024
Scalable Evaluation of Multi-Agent Reinforcement Learning with Melting PotICML 2021
BenchMARL: Benchmarking Multi-Agent Reinforcement Learning2023
Arena: A General Evaluation Platform and Building Toolkit for Multi-Agent IntelligenceAAAI 2020

Simulation-centric real-world assessment

PaperYear
SMARTS: Scalable Multi-Agent Reinforcement Learning Training School for Autonomous DrivingCoRL 2020
Nocturne: a scalable driving benchmark for bringing multi-agent learning one step closer to the real worldNeurIPS 2022
A Versatile Multi-Agent Reinforcement Learning Benchmark for Inventory Management2023
IMP-MARL: a Suite of Environments for Infrastructure Management Planning with Multi-Agent Reinforcement LearningNeurIPS 2023
POGEMA: Partially Observable Grid Environment for Multiple AgentsArxiv 2022
IntersectionZoo: Eco-driving for Benchmarking Multi-Agent Contextual Reinforcement LearningNeurIPS 2024
REALM-Bench: A Benchmark for Evaluating Multi-Agent Systems on Real-world, Dynamic Planning and Scheduling Tasks2025

Language, Communication, and Social Reasoning

PaperYear
LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language Models2023
AvalonBench: Evaluating LLMs Playing the Game of Avalon2023
Welfare Diplomacy: Benchmarking Language Model Cooperation2023
MAgIC: Investigation of Large Language Model Powered Multi-Agent in Cognition, Adaptability, Rationality and CollaborationEMNLP 2024
BattleAgentBench: A Benchmark for Evaluating Cooperation and Competition Capabilities of Language Models in Multi-Agent Systems2024
COMMA: A Benchmark for Inter-Agent Communication in Multi-Agent Systems2024
IntellAgent: A Benchmark for Evaluating Conversational Agents in Realistic Scenarios2025
MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents2025

🎯 Applications of Agentic Reasoning

Embodied Agents

PaperYear
Agent-X: Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks2025
BALROG: Benchmarking Agentic LLM and VLM Reasoning On GamesNeurIPS 2024
ALFWorld: Aligning Text and Embodied Environments for Interactive LearningICLR 2021
Understanding the Weakness of Large Language Model Agents within a Complex Android Environment2024
MindAgent: Emergent Gaming Interaction2023
Playing repeated games with Large Language Models2023
OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer EnvironmentsNeurIPS 2024

Scientific Discovery Agents

PaperYear
DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery AgentsNeurIPS 2024
ScienceWorld: Is your Agent Smarter than a 5th Grader?EMNLP 2022
ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific DiscoveryNeurIPS 2024
The AI Scientist: Fully Automated Open-Ended Scientific Discovery2024
LAB-Bench: Measuring Capabilities of Language Models for Biology Research2024
MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation2023

Autonomous Research Agents

PaperYear
WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?ICML 2024
WorkArena++: Towards Agents that Act Like Employees2024
OfficeBench: Benchmarking Language Agents across Multiple Applications for Office Automation2024
PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about ChangeNeurIPS 2022
FlowBench: Revisiting and Benchmarking Workflow-Guided Planning for LLM-based Agents2024
ACPBench: Reasoning about Action, Change, and Planning2024
TRAIL: Trace Reasoning and Agentic Issue Localization2025
CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and GeneralizationNeurIPS 2023
Agent-as-a-Judge: Evaluate Agents with Agents2024
InfoDeepSeek: Benchmarking Agentic Information Seeking for Retrieval-Augmented Generation2025

Medical and Clinical Agents

PaperYear
AgentClinic: a multimodal agent benchmark for clinical environmentsNeurIPS 2024
MedAgentBench: A Virtual EHR Environment to Benchmark Medical LLM AgentsNEJM AI 2025
EHRAgent: Code Empowers Large Language Models for Complex Tabular Reasoning on Electronic Health Records2024
MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoning2023
GuardAgent: Safeguard LLM Agents by a Guard Agent via Knowledge-Enabled Reasoning2024

Web Agents

PaperYear
WebShop: Towards Scalable Real-World Web Interaction with Grounded Language AgentsNeurIPS 2022
WebArena: A Realistic Web Environment for Building Autonomous AgentsICLR 2024
OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer EnvironmentsNeurIPS 2024
AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding AgentsACL 2024
WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?2024
VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web TasksNeurIPS 2024
WebVoyager: Building an End-to-End Web Agent with Large Multimodal ModelsACL 2024
Mind2Web: Towards a Generalist Agent for the WebNeurIPS 2023
Mind2Web 2: Evaluating Agentic Search with Agent-as-a-Judge2025
WebCanvas: Benchmarking Web Agents in Online CanvasNeurIPS 2024
Web-Bench: A LLM Code Benchmark Based on Web Standards and Frameworks2025
VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?2024
WebLINX: Real-World Website Navigation with Multi-Turn DialogueCVPR 2024
LASER: LLM Agent with State-Space Exploration for Web NavigationNeurIPS 2023
AutoWebGLM: Bootstrap And Reinforce A Large Language Model-based Agent for Automated Web Navigation2024
OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web2024
BEARCUBS: A benchmark for computer-using web agents2025
BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agents2025
BrowseComp-ZH: Benchmarking Web Browsing Ability of Large Language Models in Chinese2025
Video-Browser: Towards Agentic Open-web Video Browsing2025

General Tool-Use Agents

PaperYear
GTA: A Benchmark for General Tool AgentsNeurIPS 2024
NESTFUL: A Benchmark for Evaluating LLMs on Nested Sequences of API Calls2024
Executable Code Actions Elicit Better LLM AgentsICML 2024
RestGPT: Connecting Large Language Models with Real-World RESTful APIs2023
Search-o1: Agentic Search-Enhanced Large Reasoning Models2025
Agentic Reasoning and Tool Integration for LLMs via Reinforcement Learning2025
ActionReasoningBench: Reasoning about Actions with and without Ramification Constraints2024
R-Judge: Benchmarking Safety-Critical Decision Making for LLM Agents2024

License

This repository is licensed under the MIT License.


Star History

Star History Chart