Efficient Retrieval Using Hand Demonstrations

June 7, 2025 ยท View on GitHub

Setup

git clone https://github.com/handretrieval/hand
cd p-llm-hf
git submodule update --init --recursive
pip3 install -e robot_learning

Install Grounded SAM2 and CoTracker for Flow

# install CoTracker
git clone https://github.com/facebookresearch/co-tracker
cd co-tracker
pip install -e .
pip install matplotlib flow_vis tqdm tensorboard

# install Grounded SAM2
git clone https://github.com/IDEA-Research/Grounded-SAM-2.git 
cd Grounded-SAM-2
pip install -e .

Install CALVIN

git clone --recurse-submodules https://github.com/mees/calvin.git
export CALVIN_ROOT=$(pwd)/calvin
cd calvin/calvin_env
pip install -e .
cd tacto
pip install -e .

GMFlow

git clone git@github.com:lihenglin/gmflow_as_a_package.git

Install pre-trained models

https://github.com/autonomousvision/unimatch/blob/master/MODEL_ZOO.md