Additional Anserini Documentation
June 7, 2026 ยท View on GitHub
๐ More Guides
The experiments described below are not associated with rigorous end-to-end reproduction testing and thus provide a lower standard of reproducibility. For the most part, manual copying and pasting of commands into a shell is required to reproduce our results.
MS MARCO V1
- Reproducing BM25 baselines for MS MARCO Passage Ranking
- Reproducing BM25 baselines for MS MARCO Document Ranking
- Reproducing baselines for the MS MARCO Document Ranking Leaderboard
- Reproducing doc2query results (MS MARCO Passage Ranking and TREC-CAR)
- Reproducing docTTTTTquery results (MS MARCO Passage and Document Ranking)
- Notes about reproduction issues with MS MARCO Document Ranking w/ docTTTTTquery
MS MARCO V2
- Reproducing BM25 baselines on the MS MARCO V2 Collections
TREC-COVID and CORD-19
- Indexing AI2's COVID-19 Open Research Dataset
- Baselines for the TREC-COVID Challenge
- Baselines for the TREC-COVID Challenge using doc2query
Other Experiments and Features
- Working with the 20 Newsgroups Dataset
- Guide to BM25 baselines for the FEVER Fact Verification Task
- Guide to reproducing "Neural Hype" Experiments
- Guide to running experiments on the AI2 Open Research Corpus
- Experiments from Yang et al. (JDIQ 2018)
- Runbooks for TREC 2018: [Anserini group] [h2oloo group]
- Runbook for ECIR 2019 paper on axiomatic semantic term matching
- Runbook for ECIR 2019 paper on cross-collection relevance feedback
- Support for approximate nearest-neighbor search on dense vectors with inverted indexes
๐๏ธ Release History
- v2.2.0: June 7, 2026 [Release Notes]
- v2.1.1: May 16, 2026 [Release Notes]
- v2.1.0: May 14, 2026 [Release Notes]
- v2.0.0: April 14, 2026 [Release Notes]
- v1.7.1: March 24, 2026 [Release Notes]
- v1.7.0: March 21, 2026 [Release Notes]
- v1.6.0: February 24, 2026 [Release Notes]
- v1.5.0: January 9, 2026 [Release Notes]
- v1.4.0: December 2, 2025 [Release Notes]
- v1.3.0: September 14, 2025 [Release Notes]
- v1.2.2: September 2, 2025 [Release Notes]
- v1.2.1: August 20, 2025 [Release Notes]
- v1.2.0: August 12, 2025 [Release Notes]
- v1.1.1: July 1, 2025 [Release Notes]
- v1.1.0: July 1, 2025 [Release Notes] [Known Issues]
- v1.0.0: April 25, 2025 [Release Notes]
- v0.39.0: January 12, 2025 [Release Notes]
- v0.38.0: September 6, 2024 [Release Notes]
- v0.37.0: August 22, 2024 [Release Notes]
- v0.36.1: May 23, 2024 [Release Notes]
- v0.36.0: April 28, 2024 [Release Notes]
- v0.35.1: April 24, 2024 [Release Notes]
- v0.35.0: April 3, 2024 [Release Notes]
- v0.25.0: March 27, 2024 [Release Notes]
- v0.24.2: February 27, 2024 [Release Notes]
- v0.24.1: January 27, 2024 [Release Notes]
- v0.24.0: December 28, 2023 [Release Notes]
- v0.23.0: November 16, 2023 [Release Notes]
- v0.22.1: October 18, 2023 [Release Notes]
- v0.22.0: August 28, 2023 [Release Notes]
- v0.21.0: March 31, 2023 [Release Notes]
- v0.20.0: January 20, 2023 [Release Notes]
- v0.16.2: December 12, 2022 [Release Notes]
- v0.16.1: November 2, 2022 [Release Notes]
- v0.16.0: October 23, 2022 [Release Notes]
- v0.15.0: September 22, 2022 [Release Notes]
- v0.14.4: July 31, 2022 [Release Notes]
- v0.14.3: May 9, 2022 [Release Notes]
- v0.14.2: March 24, 2022 [Release Notes]
- v0.14.1: February 27, 2022 [Release Notes]
- v0.14.0: January 10, 2022 [Release Notes]
- v0.13.5: November 2, 2021 [Release Notes]
- v0.13.4: October 22, 2021 [Release Notes]
- v0.13.3: August 22, 2021 [Release Notes]
- v0.13.2: July 20, 2021 [Release Notes]
- v0.13.1: June 29, 2021 [Release Notes]
- v0.13.0: June 22, 2021 [Release Notes]
- v0.12.0: April 29, 2021 [Release Notes]
- v0.11.0: February 13, 2021 [Release Notes]
- v0.10.1: January 8, 2021 [Release Notes]
- v0.10.0: November 25, 2020 [Release Notes]
- v0.9.4: June 25, 2020 [Release Notes]
- v0.9.3: May 26, 2020 [Release Notes]
- v0.9.2: May 14, 2020 [Release Notes]
- v0.9.1: May 6, 2020 [Release Notes]
- v0.9.0: April 18, 2020 [Release Notes]
- v0.8.1: March 22, 2020 [Release Notes]
- v0.8.0: March 11, 2020 [Release Notes]
- v0.7.2: January 25, 2020 [Release Notes]
- v0.7.1: January 9, 2020 [Release Notes]
- v0.7.0: December 13, 2019 [Release Notes]
- v0.6.0: September 6, 2019 [Release Notes] [Known Issues]
- v0.5.1: June 11, 2019 [Release Notes]
- v0.5.0: June 5, 2019 [Release Notes]
- v0.4.0: March 4, 2019 [Release Notes]
- v0.3.0: December 16, 2018 [Release Notes]
- v0.2.0: September 10, 2018 [Release Notes]
- v0.1.0: July 4, 2018 [Release Notes]
๐๏ธ Historical Notes
- Anserini was upgraded to Lucene 10.4.0 at
c6eed6(2026/04/12) as part of v2.0.0. Lucene 9 indexes remain readable, but older code is unable to read indexes generated by Lucene 10. - Anserini was upgraded from JDK 11 to JDK 21 at commit
272565(2024/04/03), which corresponds to the release of v0.35.0. - Anserini was upgraded to Lucene 9.3 at commit
272565(8/2/2022): this upgrade created backward compatibility issues, see #1952. Anserini will automatically detect Lucene 8 indexes and disable consistent tie-breaking to avoid runtime errors. However, Lucene 9 code running on Lucene 8 indexes may give slightly different results than Lucene 8 code running on Lucene 8 indexes. Lucene 8 code will not run on Lucene 9 indexes. Pyserini has also been upgraded and similar issues apply: Lucene 9 code running on Lucene 8 indexes may give slightly different results than Lucene 8 code running on Lucene 8 indexes. - Anserini was upgraded to Java 11 at commit
17b702d(7/11/2019) from Java 8. Maven 3.3+ is also required. - Anserini was upgraded to Lucene 8.0 as of commit
75e36f9(6/12/2019); prior to that, the toolkit uses Lucene 7.6. Based on preliminary experiments, query evaluation latency has been much improved in Lucene 8. As a result of this upgrade, results of all reproductions have changed slightly. To reproducible old results from Lucene 7.6, use v0.5.1.
๐ Acknowledgments
This research is supported in part by the Natural Sciences and Engineering Research Council (NSERC) of Canada. Previous support came from the U.S. National Science Foundation under IIS-1423002 and CNS-1405688. Any opinions, findings, and conclusions or recommendations expressed do not necessarily reflect the views of the sponsors.