LeZO

Project for "SIMULTANEOUS COMPUTATION AND MEMORY EFFICIENT ZEROTH-ORDER OPTIMIZER FOR FINE-TUNING LARGE LANGUAGE MODELS." We will upload the code simultaneously with the publication of the paper.

For early access to a preliminary version of the code, please contact ft_feiw@mail.scut.edu.cn.