Zero-Shot Surgical Tool Segmentation in Monocular Video Using Segment Anything Model 2

🚨 News

The paper is available: Arxiv

🧐 Installation & Usage

Directly use .ipynb file

🎯 Example Cases

EndoNeRF Dataset

Prompt (first frame)	Video segmentation

EndoVis'17 Segmentation Dataset

Prompt (first frame)	Video segmentation

SurgToolLoc Dataset

Prompt (first frame)	Video segmentation

Cochlear Implant Dataset (We focus more on the insertion and drilling tools)

Prompt (first frame)	Video segmentation

📝 Cite

@misc{lou2024zeroshotsurgicaltoolsegmentation,
     title={Zero-Shot Surgical Tool Segmentation in Monocular Video Using Segment Anything Model 2}, 
     author={Ange Lou and Yamin Li and Yike Zhang and Robert F. Labadie and Jack Noble},
     year={2024},
     eprint={2408.01648},
     archivePrefix={arXiv},
     primaryClass={eess.IV},
     url={https://arxiv.org/abs/2408.01648}, 
}