Train GeoSynth

April 22, 2024 ยท View on GitHub

๐Ÿง‘โ€๐Ÿ’ป Setting up environment

Create a conda environment:

conda env create -f environment.yaml
conda activate control

๐Ÿ’ฌ Extracting LLaVA Captions

We use LLaVA-7b for automatically captioning each satellite image. Run the following command to get captions corresponding to each satellite image:

python get_llava_captions.py

๐Ÿ›ฐ๏ธ Extracting SatCLIP Embeddings

Execute the following command to get all the geographic location embeddings:

python get_satclip_embeds.py

๐Ÿ”ฅ Training

Setup all parameters of interest in train.py, then run:

python train.py