README.md

March 25, 2026 ยท View on GitHub

Your Models Have Thought Enough: Training Large Reasoning Models to Stop Overthinking

๐Ÿ“ข Latest News

  • 2026-03: OpenPangu-Embedded-7B was tested on NPU using JET method for mathematical reasoning tasks. Our approach reduced token length by 12% while maintaining accuracy, even for simple problems.
  • 2026-02: JET has won the Huawei Spark Award! ๐Ÿ†
  • 2026-02: Our paper "Your Models Have Thought Enough: Training Large Reasoning Models to Stop Overthinking" has been accepted by ICLR 2026! ๐ŸŽ‰

๐Ÿ“– Background

JET (Just-Enough-Think) is an innovative reinforcement learning (RL) method that trains large language models to proactively terminate unnecessary thinking while maintaining reasoning accuracy. JET addresses the critical issue of overthinking in large reasoning models through two key components:

Key Innovations

  1. Trajectory Truncation: During RL rollout, JET dynamically truncates reasoning trajectories to expose the model to paths of varying lengths, ensuring alignment with natural generation patterns.

  2. Quality-Controlled Length Reward: A novel reward mechanism that identifies the shortest correct trajectory as a baseline and penalizes longer correct reasoning paths, effectively guiding the model towards efficient reasoning.

JET Training Process Overview

๐Ÿš€ QuickStart

Prerequisites

This repository is built on top of VeRL and Lighteval, requiring two separate conda environments.

# Create and activate training environment
conda env create -f environment/verl_env.yaml
conda activate verl_env

# Create and activate evaluation environment (optional)
conda env create -f environment/lighteval_env.yaml
conda activate lighteval_env

Training

# Step 1: Start training
conda activate verl_env
cd Just-Enough-Think/EasyR1/examples
bash run.sh

# Step 2: Merge checkpoints after training completes
conda activate verl_env
cd Just-Enough-Think/EasyR1/
python scripts/model_merger.py --local_dir your_ckp_path/global_step_70/actor

Evaluation

# Step 3: Evaluate the trained model
conda activate lighteval_env
cd Just-Enough-Think
bash eval/eval.sh

๐Ÿ“Š Datasets

We provide comprehensive training and testing datasets:

  • Training Data: data/training/training_cleaned.json
  • Test Data: data/test/

๐Ÿ“ˆ Main Results

Performance Comparison on Reasoning Tasks

Performance on GSM8K8k (NPU Test)

We also tested OpenPangu-Embedded-7B on NPU using the JET method for mathematical reasoning tasks. The results demonstrate significant token length reduction while maintaining high accuracy.

ModelsACCAverage Token Length
Base94.77%1662
JET94.69%1462๏ผˆ-12%๏ผ‰

๐Ÿ™ Acknowledgement

We thank the VeRL team for providing the excellent open-source RL infrastructure that served as the foundation for our work.

๐Ÿ“š Citations

If you find our work useful, please consider citing our paper:

@misc{han-JET,
      title={Your Models Have Thought Enough: Training Large Reasoning Models to Stop Overthinking}, 
      author={Jinyi Han and Ying Huang and Ying Liao and Zishang Jiang and Xikun Lu and Haiquan Zhao and Xinyi Wang and Guanghao Zhou and Sihang Jiang and Jiaqing Liang and Weikang Zhou and Zeye Sun and Fei Yu and Yanghua Xiao},
      year={2025},
      eprint={2509.23392},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2509.23392}, 
}