README.md

📢 Paper Accepted to TOSEM

🎉 The paper corresponding to this repository has been accepted by ACM Transactions on Software Engineering and Methodology (TOSEM).

📄 Publication Information

• Title: A First Look at Bugs in LLM Inference Engines
• Authors: Mugeng Liu, Siqi Zhong, Weichen Bi, Yixuan Zhang, Zhiyang Chen, Zhenpeng Chen, Xuanzhe Liu, Yun Ma
• Journal: ACM Transactions on Software Engineering and Methodology (TOSEM)
• DOI: https://doi.org/10.1145/3788873

---

📦 About This Repository

This repository contains the dataset and supplementary materials for the TOSEM paper “A First Look at Bugs in LLM Inference Engines.”

We systematically studied 929 real-world bugs collected from five widely used LLM inference engines, analyzed their root causes, symptoms, and impacts, and derived actionable insights for improving the reliability of LLM inference systems.

The resources in this repository are intended to support reproducibility and future research on LLM inference engine reliability.

---

📊 Dataset

• dataset.csv: The curated dataset of LLM inference engine bugs, including metadata and classification labels used in the paper.

---

🔗 Links

• Published Version (ACM DOI): https://doi.org/10.1145/3788873
• arXiv Preprint: https://arxiv.org/abs/2506.09713
• GitHub Repository: https://github.com/infbug/bugs-in-LLM-inference-engines

---

📖 Citation

If you use this dataset or repository in your research, please cite our TOSEM paper:

@article{10.1145/3788873,
  author = {Liu, Mugeng and Zhong, Siqi and Bi, Weichen and Zhang, Yixuan and Chen, Zhiyang and Chen, Zhenpeng and Liu, Xuanzhe and Ma, Yun},
  title = {A First Look at Bugs in LLM Inference Engines},
  year = {2026},
  publisher = {Association for Computing Machinery},
  doi = {10.1145/3788873},
  journal = {ACM Trans. Softw. Eng. Methodol.}
}

---

🙏 Acknowledgments

We thank the open-source community and all contributors whose bug reports made this study possible.