🧑‍💻 BigO(Bench) Website 👩‍💻

🔎 Sample Explorer _⁽back to root)

The following code allows to deploy the website of BigO(Bench). Notice that changing the data in ./data can allow you to review some data provided by some models, or ground truth answers as annotated by the framework. The framework is directly usable as a review platform (though it can not collect any data). When navigating the examples, feel free to use the keys to navigate across problems and corresponding classes of complexity.

License _⁽back to root)

The majority of BigO(Bench) is licensed under CC-BY-NC (see LICENCE), however portions of the project are available under separate license terms: https://github.com/pberkes/big_O is licensed under the BSD-3 license.

📝 Citation _⁽back to root)

If you find this repository useful, please cite this as

@misc{chambon2025bigobenchllmsgenerate,
      title={BigO(Bench) -- Can LLMs Generate Code with Controlled Time and Space Complexity?}, 
      author={Pierre Chambon and Baptiste Roziere and Benoit Sagot and Gabriel Synnaeve},
      year={2025},
      eprint={2503.15242},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2503.15242}, 
}