PhoneBuddy

August 24, 2026 Β· View on GitHub

PhoneBuddy logo

PhoneBuddy

Training Open Phone-Use Agents with Real-App and Mock-App RL

PhoneBuddy PhoneBuddy Β β€’Β  🌍 PhoneWorld Β β€’Β  πŸ› οΈ PhoneHarness Β β€’Β  πŸ” PhonePrivacy Β β€’Β  πŸ›‘οΈ PhoneSafety

PhoneBuddy trains open phone-use agents that learn from both real phone execution and scalable PhoneWorld-style mock-app environments. The core result: real-app RL gives realism; mock-app RL gives resettable, verifiable interaction scale.

🧠 Open phone-use models Β β€’Β  πŸ“² real-phone evaluation Β β€’Β  πŸ§ͺ mock-app RL Β β€’Β  βœ… verifier-backed tasks


🚨 News

  • 2026-08-24: 🌍 PhoneWorld is now publicly released for research, including the benchmark runner, 120 evaluation tasks, 300 verified training tasks, and the Research Source Edition for 34 mock apps. Research APKs are available through the gated Hugging Face dataset.
  • 2026-06-26: πŸ“„ arXiv preprint is live: arXiv:2606.23049.
  • 2026-06-15: πŸ€— PhoneBuddy models are public on Hugging Face: PhoneBuddy-4B, PhoneBuddy-4B-RealApp, and PhoneBuddy-0.8B.
  • 2026-06-12: 🌐 Project page launched: phonebuddyai.github.io.
  • 2026-06-11: πŸ“„ Paper snapshot and result figures added to the project page.
  • 2026-06-10: 🧭 The project page now connects the five-work phone-agent research line listed above.

✨ What Is PhoneBuddy?

Most mobile agents are evaluated as GUI controllers: observe a screen, tap, type, swipe, repeat. PhoneBuddy studies a training recipe for open phone-use models that can improve under real execution feedback while also benefiting from scalable mock-app supervision.

PhoneBuddy compares a shared SFT checkpoint, real-app RL, and mixed real+mock RL. The mixed recipe uses PhoneWorld-style mock apps as resettable environments with automatic verifiers, then evaluates whether this scalable signal transfers back to real-phone tasks and AndroidWorld.


🌍 Get PhoneWorld

PhoneWorld is the environment stack behind PhoneBuddy's mock-app training. Its public research release includes the evaluation runner, task definitions and verifiers, 120 benchmark tasks, 300 verified training tasks, and the Research Source Edition for all 34 mock Android apps.

Please follow the PhoneWorld repository's research license, APK access terms, and benchmark reporting guidance.


πŸ€— Model Zoo

ModelStatusTraining RecipeNotes
PhoneBuddy-4BHF ModelReal+Mock RLMain checkpoint used for the headline release.
PhoneBuddy-4B-RealAppHF ModelReal-only RLAblation checkpoint without mock-app RL.
PhoneBuddy-0.8BHF ModelReal+Mock RLSmaller checkpoint for lightweight experiments.

The public model release follows the Qwen-style XML tool-call format defined in the model chat_template.jinja. Dataset artifacts are not planned for public release at this stage.


πŸ“Š Results Snapshot

ModelSingle-AppCross-AppWeChat Mini-AppAndroidWorldAvg.
PhoneBuddy-4B-SFT34.022.054.060.342.6
PhoneBuddy-4B-Real54.020.048.077.249.8
PhoneBuddy-4B-Real+Mock62.018.056.083.254.8

Takeaway. Real-app RL substantially improves over SFT. Adding mock-app RL further improves the average result, with the strongest gains on single-app tasks and AndroidWorld.

PhoneBuddy benchmark coverage

PhoneBuddy RL delta


PhoneBuddy is one piece of a larger phone-agent stack: environments, training, runtime, privacy, and safety.

TagProjectLinksRole
[Training]PhoneBuddy PhoneBuddyCode Β· Project Β· Paper Β· 4B Β· 4B-RealApp Β· 0.8BTrains open phone-use models with real-app RL and mock-app RL.
[Environment]🌍 PhoneWorldCode Β· APKs Β· Paper Β· δΈ­ζ–‡ BlogConverts real GUI trajectories into scalable phone-use environments, tasks, verifiers, and rollouts.
[Runtime]πŸ› οΈ PhoneHarnessCode Β· Project Β· Dataset Β· Paper Β· δΈ­ζ–‡ BlogMixed-action phone-agent harness and benchmark across CLI, GUI, and MCP tools with trace-backed verification.
[Privacy]πŸ” PhonePrivacyCode Β· Paper Β· δΈ­ζ–‡ BlogVerifiable privacy benchmark for phone-use agents.
[Safety]πŸ›‘οΈ PhoneSafetyCode Β· PaperSafety evaluation for phone-use agents, separating safety from incapability.

πŸ—‚οΈ Repository Layout

phonebuddy/
β”œβ”€β”€ assets/
β”‚   β”œβ”€β”€ figures/      # Paper and project figures
β”‚   └── paper.pdf     # Current paper snapshot
β”œβ”€β”€ docs/             # Public documentation drafts
└── README.md

πŸ“Œ Release Plan

  • βœ… Project page and paper snapshot
  • 🚧 PhoneBuddy-4B model release
  • 🚧 Lightweight and ablation checkpoints
  • 🚧 Code release and evaluation documentation
  • ❌ No public dataset release planned at this stage

πŸ“š Citation

@misc{tang2026phonebuddytrainingopenmodels,
      title={PhoneBuddy: Training Open Models for Agentic Phone Use},
      author={Zhengyang Tang and Xin Lai and Pengyuan Lyu and Xinyuan Wang and Tianyi Bai and Chenxin Li and Yiduo Guo and Huawen Shen and Yuxuan Liu and Junyi Li and Zhengyao Fang and Yang Ding and Yi Zhang and Weinong Wang and Xingran Zhou and Liang Wu and Fei Tang and Sunqi Fan and Shangpin Peng and Zheng Ruan and Anran Zhang and Benyou Wang and Ji-Rong Wen and Rui Yan and Chengquan Zhang and Han Hu},
      year={2026},
      eprint={2606.23049},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2606.23049},
}

Made for open phone-use agents. Follow updates at phonebuddyai.github.io.