README.txt
July 16, 2022 ยท View on GitHub
########## The codes are to reproduce our reported results on the NTU-60 dataset.
########## Prerequisites: python-3.8 pytorch-1.7.0 pyyaml numpy tensorboardx
########## Data Preparation
- Download the NTU-60 3D skeleton data from its official website, and unzip the downloaded data to './data'.
- run 'python data_process/NTU_RGBD/prepare_NTU_60.py' to pre-process the data for action recognition.
- run 'python data_process/NTU_RGBD/split_to_single_person.py' to pre-process the data for pre-training.
########## Pre-training
- run " CUDA_VISIBLE_DEVICES=0,1,2,3 python pretrain_on_NTU.py --cfg_pth 'cfg/NTU/pretrain/cfg.yaml' " to pre-train the Hi-TRS (our pre-trained checkpoint under the xsub setting is provided at './checkpoint')
########## Fine-tuning
- run "CUDA_VISIBLE_DEVICES=0,1 python train_on_NTU_AR.py --ft_cfg_pth 'cfg/NTU/AR/cfg.yaml'" to fine-tune the pre-trained Hi-TRS for action recognition under the supervised setting.
- set the data_part in 'cfg/NTU/AR/cfg.yaml' file to 'ten' (10%), 'five' (5%) and 'one' (1%) and run the previous command to conduct the experiments the semi-supervised setting.
- set the linear, data_part, lr as 1, 'all', 0.01 in the 'cfg/NTU/AR/cfg.yaml' to run our experiments under the linear setting.