Vision-Language SAM

Installation

1. Create a virtual environment conda create -n medsam python=3.10 -y and activate it conda activate VLSAM
2. Install Pytorch 2.0
3. Or install the same environment as https://github.com/bowang-lab/MedSAM

Model Training

Data preprocessing

Download SAM checkpoint and place it at work_dir/SAM/sam_vit_b_01ec64.pth .

Training on one GPU

python train.py

Inference

python Inference_vlsam.py

Reference