README.md

October 24, 2024 ยท View on GitHub

Efficiently Adapting Vision Foundational Models on 3D Medical Image Segmentation ๐Ÿš€

Official PyTorch implementation for our works on the topic of efficiently adapting the pre-trained Vision Foundational Models (VFM) on 3D Medical Image Segmentation task.

[1] "Tri-Plane Mamba: Efficiently Adapting Segment Anything Model for 3D Medical Images" (MICCAI 2024)

๐ŸŒŠ๐ŸŒŠ๐ŸŒŠ News

๐Ÿ’ง [2024-10-22] Re-organize and Upload partial core codes.

๐Ÿ”ฅ๐Ÿ”ฅ๐Ÿ”ฅ Contributions

We foucs on proposing more advanced adapters or training algorithms to adapt the pre-trained VFM (both natural and medical-specific models) on 3d medical image segmentation.

๐Ÿ”ฅ Data-Efficient: Use less data to achieve more competitive performance, such as semi-supervised, few-shot, zero-shot, and so on.

๐Ÿ”ฅ Parameter-Efficient: Enhance the representation by lightweight adapters, such as local-feature, global-feature, or other existing adapters.

๐Ÿงฐ Installation

๐Ÿ”จ TODO

โญโญโญ Usage

๐Ÿ’ก Supported Adapters

NameTypeSupported
Baseline (Frozen SAM)Noneโœ”๏ธ
LoRApixel-independentโœ”๏ธ
SSFpixel-independentTODO
multi-scale convlocalโœ”๏ธ
PPMlocalTODO
MambaglobalTODO
Linear AttentionglobalTODO

๐Ÿ“‹ Results and Models

๐Ÿ“Œ TODO

๐Ÿ“š Citation

If you think our paper helps you, please feel free to cite it in your publications.

๐Ÿ“— TP-Mamba

@InProceedings{Wan_TriPlane_MICCAI2024,
        author = { Wang, Hualiang and Lin, Yiqun and Ding, Xinpeng and Li, Xiaomeng},
        title = { { Tri-Plane Mamba: Efficiently Adapting Segment Anything Model for 3D Medical Images } },
        booktitle = {proceedings of Medical Image Computing and Computer Assisted Intervention -- MICCAI 2024},
        year = {2024},
        publisher = {Springer Nature Switzerland},
        volume = {LNCS 15009},
        month = {October},
        page = {pending}
}

๐Ÿป Acknowledge

We sincerely appreciate these precious repositories ๐ŸบMONAI and ๐ŸบSAM.