AssistGUI: Task-Oriented Desktop Graphical User Interface Automation

Difei Gao, Lei Ji, Zechen Bai, Mingyu Ouyang, Peiran Li, Dongxing Mao, Qinchen Wu, Weichen Zhang, Peiyi Wang, Xiangwu Guo, Hengxu Wang, Luowei Zhou, Mike Zheng Shou

:rocket: Introduction

AssistGUI is an LLM-based GUI assistant designed to automate operations within desktop productivity software. It achieves this by monitoring the user's screen and executing commands to control the mouse and keyboard, thereby enhancing efficiency and streamlining tasks.

:newspaper: News

The code will be released soon.