README.md
June 4, 2025 · View on GitHub
StarRipple
This is the official repository of "StarRipple".
🆕 News
- [December 2024] Our paper 《Pulsar Candidate Classification with Multimodal Large Language Models》 has been accepted to NeurIPS 2024 Workshop Foundation Models for Science: Progress, Opportunities, and Challenges (FM4Science).
- [August 2024] We have released the first version 1.0 and are very excited to share our research and insights into Pulsar Candidate Classification!
🚀 Usage
We strongly recommend using SWIFT from the modelscope community to reproduce or use our model, which runs in a Python environment. Please ensure that your Python version is higher than 3.8.
- Install SWIFT using the pip command:
# all
pip install 'ms-swift[all]' -U
# only LLM
pip install 'ms-swift[llm]' -U
If you wish to reproduce the corresponding PICS-ResNet or HCCNN on the HTRU Medlat dataset, you may need to use the training and evaluation codes under the 'pics_ccnn_model' file.
At the same time, you will need to install the corresponding PyTorch environment. If you wish to reproduce our feature selection process, please use the code under the 'feature_choose' file.
Download papers and datasets
V1 version
Paper link:Pulsar Candidate Classification with Multimodal Large Language Models
Overall framework:

Due to the large size of some weights, experimental data, and inference results, we have placed the complete experimental content on Hugging Face storage. It can be accessed through the following link:
- Download the train and test dataset train_and test dataset
- Download some of the best model weights mentioned in the paper. If you need any other model weights mentioned in the paper, please feel free to contact us. some_best_result_mode
- Download the experimental results records mentioned in the paper. experiment_infer_result
💡 Prompt
Below are the prompts we use in traditional task.
📖 Experiment Results
We fine-tuned all layers of the MLLM, optimizing both its textual and visual elements, to effectively address the multimodal demands of radio signal classification. You can find detailed experimental information in the table below.
🤗 Citation
If you find the code and testset are useful in your research, please consider citing
@inproceedings{zhao2024pulsar,
title={Pulsar Candidate Classification with Multimodal Large Language Models},
author={Zhao, Fuyong and Li, Yuyang and Wang, Yanhao and Li, Hui and Chen, Mei and Chen, Panfeng and Sun, Ningchen and Wang, Cunshi and Liu, Jifeng},
booktitle={Neurips 2024 Workshop Foundation Models for Science: Progress, Opportunities, and Challenges}
}
🤗 Contact us
Fuyong Zhao: gs.fyzhao24@gzu.edu.cn
Yuyang Li: liyuyang22@mails.ucas.ac.cn
License
The dataset is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.