README.md

Basic Configuration

# set arguments
pn=1M
model_type=infinity_2b
infinity_model_path=[infinity_model_path]
out_dir_root=[out_dir_root]
vae_type=32
vae_path=[vae_path]
cfg=4
tau=1
text_encoder_ckpt=[text_encoder_ckpt]
text_channels=2048
sub_fix=cfg${cfg}_tau${tau}

ImageReward

ImageReward is a metric for evaluating the human preference score of generated images. It learns human preference through fine-tuning CLIP model with 137K human ranked image pairs.

out_dir=${out_dir_root}/image_reward_${sub_fix}
infer_eval_image_reward

HPS v2.1

HPSv2.1 is a metric for evaluating the human preference score of generated images. It learns human preference through fine-tuning CLIP model with 798K human ranked image pairs. The human ranked image pairs are from human experts.

out_dir=${out_dir_root}/hpsv21_${sub_fix}
infer_eval_hpsv21

GenEval

GenEval is an object-focused framework for evaluating Text-to-Image alignment.

rewrite_prompt=0
out_dir=${out_dir_root}/gen_eval_${sub_fix}
test_gen_eval

MJHQ30K

python mjhq30k_fid_clip.py