WebExplorer: Explore and Evolve for Training Long-Horizon Web Agents

September 29, 2025 Β· View on GitHub

Paper Model Dataset License

WebExplorer is a collaboration between HKUST and MiniMax.

Abstract

WebExplorer introduces a systematic approach for training long-horizon web agents through model-based exploration and iterative query evolution. Our method generates challenging query-answer pairs requiring multi-step reasoning and complex web navigation, achieving state-of-the-art performance at 8B parameter scale.

WebExplorer Pipeline

WebExplorer-QA Construction Pipeline

πŸ”₯ News

  • [2025/09/22] :fire: We released the inference code and evaluation framework.

  • [2025/09/08] :fire: We released our model WebExplorer-8B and dataset WebExplorer-QA with 100 high-quality query-answer pairs!

πŸ“Š Key Results

Performance Comparison

Performance comparison of WebExplorer-8B across different benchmarks

ModelBC-enBC-zhGAIAWebWalkerQAFRAMESXbench-DSHLE
OpenAI-o3†50.958.170.5†71.784.066.720.2
Claude-4-Sonnet†12.229.168.3†61.780.764.620.3
GLM-4.526.437.566.0†65.6†78.9†70.0†21.2†
DeepSeek-V3.130.049.263.1†61.2†83.771.229.8
Kimi-K2†14.128.857.763.072.050.018.1
================================
WebShaper-72B--60.052.2---
WebShaper-32B (QwQ)--53.349.7---
WebShaper-32B--52.451.4---
WebSailor-72B12.030.155.4--55.0-
WebSailor-32B10.525.553.2--53.3-
WebSailor-7B6.714.233.0--34.3-
ASearcher-Web-QwQ5.215.652.834.370.942.112.5
AFM-32B11.1-55.363.0--18.0
AFM-7B5.8-40.855.6--15.6
WebThinker-32B2.8-48.546.5--15.8
MiroThinker-32B-DPO-v0.113.017.057.349.371.7-11.8
MiroThinker-8B-DPO-v0.18.713.646.645.764.4--
WebExplorer-8B (SFT)7.921.343.759.872.647.516.0
WebExplorer-8B (RL)15.732.050.062.775.753.717.3

Accuracy (%) of web agents on information-seeking benchmarks. BC-en and BC-zh denote BrowseComp-en and BrowseComp-zh respectively. XBench-DS refers to XBench-DeepSearch. Bold indicates the best performance among open-source models < 100B, while underlined values represent the best performance among models < 10B parameters. All scores of WebExplorer-8B are computed as Avg@4 using LLM-as-Judge. Entries marked with a dagger (†) were reproduced by us under our scaffold: on model name = entire row; on a number = that entry only.

✨ Key Features

  • 🌐 Long-horizon Reasoning: Supports up to 128K context length and 100 tool calling turns
  • πŸ› οΈ Tool Utilization: Masters search and browse functionalities
  • πŸ† State-of-the-art Performance: Achieves best-in-class results among models under 10B parameters

πŸš€ Resources

πŸ€— Models

Model NameSizeDescriptionLink
WebExplorer-8B8BLong-horizon web agent trained on WebExplorer-QAπŸ€— HuggingFace

πŸ“š Datasets

Dataset NameSizeDescriptionLink
WebExplorer-QA100 samplesHigh-quality query-answer pairs for web agent trainingπŸ€— HuggingFace

πŸ› οΈ Tool Schema

WebExplorer-8B supports two tools for web interaction:

1. Browse Tool

{
    "name": "browse",
    "type": "function",
    "description": "Extract specific information from a webpage",
    "parameters": {
        "type": "object",
        "properties": {
            "url": {
                "type": "string",
                "description": "Target URL to browse. The webpage content will be processed by the LLM for information extraction."
            },
            "query": {
                "type": "string",
                "description": "Specific query about the webpage content. The LLM will analyze the content to answer this query."
            }
        },
        "required": ["url", "query"]
    }
}

2. Search Tool

{
    "name": "search",
    "type": "function",
    "description": "Perform web search queries",
    "parameters": {
        "type": "object",
        "properties": {
            "queries": {
                "type": "array",
                "items": {
                    "type": "string"
                },
                "description": "List of search queries. Returns search results containing title, URL, and snippet for each query."
            }
        },
        "required": ["queries"]
    }
}

πŸ“ Citation

If you find our work useful, please consider citing:

@misc{liu2025webexplorer,
      title={WebExplorer: Explore and Evolve for Training Long-Horizon Web Agents}, 
      author={Junteng Liu and Yunji Li and Chi Zhang and Jingyang Li and Aili Chen and Ke Ji and Weiyu Cheng and Zijia Wu and Chengyu Du and Qidi Xu and Jiayuan Song and Zhengmao Zhu and Wenhu Chen and Pengyu Zhao and Junxian He},
      year={2025},
      eprint={2509.06501},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2509.06501}, 
}