🔧 Installation

If you only need to infer / evaluate:

pip install -e .

For training, you need to further install additional dependencies as follows:

pip install -e ".[train]"
pip install flash_attn --no-build-isolation

Training, Inference & Evaluation

💪 Preprocess

The APDD dataset has been processed APDD/apdd_score.json. If you use the Score-Based Distribution Estimation algorithm (§3.2) for your dataset, you can use the example script.

🔥 Training

Fine-tuning needs to download the mPLUG-Owl2 weights as in Pretrained Weights. Put it under the ModelZoo folder.

• Only 2 RTX3090 GPUs are required.

sh train.sh

🚀 Inference

After training, you can infer with:

sh infer.sh $ONE_GPU_ID

🔍 Evaluation

After inference, you can evaluate SRCC / PLCC for quality score.

sh eval.sh