OSIRRC 2019 Image Library
July 7, 2019 ยท View on GitHub
This repo catalogs the images that have been submitted to the SIGIR 2019 Open-Source IR Replicability Challenge (OSIRRC 2019). The actual raw runs are held in a separate repository.
- Anserini
- Anserini-bm25prf
- ATIRE
- Birch
- Elastirini
- EntityRetrieval
- Galago
- ielab
- Indri
- IRC-CENTRE2019
- JASS
- JASSv2
- NVSM
- OldDog
- PISA
- Solrini
- Terrier
Anserini
Execution log:
| Output | Date | Collection | Host | Jig | Image |
|---|---|---|---|---|---|
| [link] | 2019/06/28 | core18 | Standard_D64s_v3 | v0.1.1 | v0.1.1 |
| [link] | 2019/06/28 | core17 | Standard_D64s_v3 | v0.1.1 | v0.1.1 |
| [link] | 2019/06/28 | robust04 | Standard_D64s_v3 | v0.1.1 | v0.1.1 |
| [link] | 2019/06/18 | core18 | Standard_D64s_v3 | v0.1.0 | v0.1.1 |
| [link] | 2019/06/18 | core17 | Standard_D64s_v3 | v0.1.0 | v0.1.1 |
| [link] | 2019/06/17 | robust04 | Standard_D64s_v3 | v0.1.0 | v0.1.1 |
| [link] | 2019/05/27 | robust04 | Standard_D64s_v3 | 2307f2c | dd4fbde |
Anserini-bm25prf
Execution log:
| Output | Date | Collection | Host | Jig | Image |
|---|---|---|---|---|---|
| [link] | 2019/06/28 | robust04 | Standard_D64s_v3 | v0.1.1 | v0.2.2 |
| [link] | 2019/06/21 | robust04 | Standard_D64s_v3 | v0.1.0 | v0.2.2 |
ATIRE
Execution log:
| Output | Date | Collection | Host | Jig | Image |
|---|---|---|---|---|---|
| [link] | 2019/06/28 | core17 | Standard_D64s_v3 | v0.1.1 | v0.1.1 |
| [link] | 2019/06/28 | robust04 | Standard_D64s_v3 | v0.1.1 | v0.1.1 |
| [link] | 2019/06/18 | core17 | Standard_D64s_v3 | v0.1.0 | 0.1.0 |
| [link] | 2019/06/17 | robust04 | Standard_D64s_v3 | v0.1.0 | 0.1.0 |
| [link] | 2019/05/27 | robust04 | Standard_D64s_v3 | 2307f2c | ebdc076 |
Birch
Execution log:
| Output | Date | Collection | Host | Jig | Image |
|---|---|---|---|---|---|
| [link] | 2019/06/28 | robust04 | Standard_D64s_v3 | v0.1.1 | v0.1.0 |
| [link] | 2019/06/17 | robust04 | Standard_D64s_v3 | v0.1.0 | v0.1.0 |
Elastirini
Elastirini is configured to produce the same exact batch runs as Anserini, but provides an additional interact hook starts up Elasticsearch to support interactive querying.
EntityRetrieval
Execution log:
| Output | Date | Collection | Host | Jig | Image |
|---|---|---|---|---|---|
| [link] | 2019/06/29 | robust04 | Standard_D64s_v3 | v0.1.1 | v0.1.1 |
Galago
Execution log:
| Output | Date | Collection | Host | Jig | Image |
|---|---|---|---|---|---|
| [link] | 2019/06/28 | robust04 | Standard_D64s_v3 | v0.1.1 | v0.0.2 |
ielab
Execution log:
| Output | Date | Collection | Host | Jig | Image |
|---|---|---|---|---|---|
| [link] | 2019/06/28 | robust04 | Standard_D64s_v3 | v0.1.1 | v0.0.1 |
Indri
Execution log:
| Output | Date | Collection | Host | Jig | Image |
|---|---|---|---|---|---|
| [link] | 2019/06/28 | robust04 | Standard_D64s_v3 | v0.1.1 | v0.2.1 |
| [link] | 2019/06/17 | robust04 | Standard_D64s_v3 | v0.1.0 | v0.1.0 |
IRC-CENTRE2019
Execution log:
| Output | Date | Collection | Host | Jig | Image |
|---|---|---|---|---|---|
| [link] | 2019/06/28 | core17 | Standard_D64s_v3 | v0.1.1 | v0.1.3 |
| [link] | 2019/06/24 | core17 | Standard_D64s_v3 | v0.1.0 | v0.1.3 |
JASS
Execution log:
| Output | Date | Collection | Host | Jig | Image |
|---|---|---|---|---|---|
| [link] | 2019/06/28 | core17 | Standard_D64s_v3 | v0.1.1 | v0.1.1 |
| [link] | 2019/06/28 | robust04 | Standard_D64s_v3 | v0.1.1 | v0.1.1 |
| [link] | 2019/06/18 | core17 | Standard_D64s_v3 | v0.1.0 | 0.1.0 |
| [link] | 2019/06/17 | robust04 | Standard_D64s_v3 | v0.1.0 | 0.1.0 |
| [link] | 2019/05/27 | robust04 | Standard_D64s_v3 | 2307f2c | 16480cf |
JASSv2
Execution log:
| Output | Date | Collection | Host | Jig | Image |
|---|---|---|---|---|---|
| [link] | 2019/06/28 | core17 | Standard_D64s_v3 | v0.1.1 | v0.1.1 |
| [link] | 2019/06/28 | robust04 | Standard_D64s_v3 | v0.1.1 | v0.1.1 |
| [link] | 2019/06/18 | core17 | Standard_D64s_v3 | v0.1.0 | 0.1.0 |
| [link] | 2019/06/17 | robust04 | Standard_D64s_v3 | v0.1.0 | 0.1.0 |
| [link] | 2019/05/27 | robust04 | Standard_D64s_v3 | 2307f2c | 018981e |
NVSM
Execution log:
| Output | Date | Collection | Host | Jig | Image |
|---|---|---|---|---|---|
| [link] | 2019/06/24 | robust04 | Standard_D64s_v3 | v0.1.0 | v0.1.0 |
OldDog
Execution log:
| Output | Date | Collection | Host | Jig | Image |
|---|---|---|---|---|---|
| [link] | 2019/06/28 | core18 | Standard_D64s_v3 | v0.1.1 | v1.0.0 |
| [link] | 2019/06/28 | robust04 | Standard_D64s_v3 | v0.1.1 | v1.0.0 |
| [link] | 2019/06/17 | robust04 | Standard_D64s_v3 | v0.1.0 | v0.2.0 |
| [link] | 2019/05/27 | robust04 | Standard_D64s_v3 | 2307f2c | dd8b230 |
PISA
Execution log:
| Output | Date | Collection | Host | Jig | Image |
|---|---|---|---|---|---|
| [link] | 2019/06/28 | core18 | Standard_D64s_v3 | v0.1.1 | v0.1.3 |
| [link] | 2019/06/28 | core17 | Standard_D64s_v3 | v0.1.1 | v0.1.3 |
| [link] | 2019/06/28 | robust04 | Standard_D64s_v3 | v0.1.1 | v0.1.3 |
| [link] | 2019/06/18 | core18 | Standard_D64s_v3 | v0.1.0 | v0.1.2 |
| [link] | 2019/06/18 | core17 | Standard_D64s_v3 | v0.1.0 | v0.1.2 |
| [link] | 2019/06/17 | robust04 | Standard_D64s_v3 | v0.1.0 | v0.1.2 |
| [link] | 2019/05/27 | robust04 | Standard_D64s_v3 | 2307f2c | 095e9ce |
Solrini
Solrini is configured to produce the same exact batch runs as Anserini, but provides an additional interact hook starts up Solr to support interactive querying.
Terrier
Execution log:
| Output | Date | Collection | Host | Jig | Image |
|---|---|---|---|---|---|
| [link] | 2019/06/28 | core18 | Standard_D64s_v3 | v0.1.1 | v0.1.7 |
| [link] | 2019/06/28 | robust04 | Standard_D64s_v3 | v0.1.1 | v0.1.7 |
| [link] | 2019/06/20 | core18 | Standard_D64s_v3 | v0.1.0 | v0.1.7 |
| [link] | 2019/06/20 | robust04 | Standard_D64s_v3 | v0.1.0 | v0.1.7 |