MAVEN dataset
January 5, 2022 ยท View on GitHub
Each .jsonl file is a subset of MAVEN and each line in the files is a json string for a document. For the train.jsonl and valid.jsonl the json format is as below:
{
"id": "6b2e8c050e30872e49c2f46edb4ac044", // an unique string for each document
"title": "Selma to Montgomery marches", // the tiltle of the document
"content": [ // the content of the document. A list, each item is a dict for a sentence
{
"sentence": "...", // a string, the plain text of the sentence
"tokens": ["...", "..."] // a list, tokens of the sentence
}
],
"events":[ // a list for annotated events, each item is a dict for an event
{
"id": "75343904ec49aefe12c5749edadb7802", // an unique string for the event
"type": "Arranging", // the event type
"type_id": 70, // the numerical id for the event type
"mention":[ // a list for the event mentions of the event, each item is a dict
{
"id": "2db165c25298aefb682cba50c9327e4f", // an unique string for the event mention
"trigger_word": "organized", // a string of the trigger word or phrase
"sent_id": 1, // the index of the corresponding sentence, strates with 0
"offset": [3, 4], // the offset of the trigger words in the tokens list
}
]
},
],
"negative_triggers":[ // a list for negative instances, each item is a dict for a negative mention
{
"id": "46348f4078ae8460df4916d03573b7de",
"trigger_word": "desire",
"sent_id": 1,
"offset": [10, 11],
},
]
}
For the test.jsonl, the format is almost the same but we hide the golden labels:
{
"id": "6b2e8c050e30872e49c2f46edb4ac044", // an unique string for each document
"title": "Selma to Montgomery marches", // the tiltle of the document
"content": [ // the content of the document. A list, each item is a dict for a sentence
{
"sentence": "...", // a string, the plain text of the sentence
"tokens": ["...", "..."] // a list, tokens of the sentence
}
],
"candidates":[ // a list for trigger candidiates, each item is a dict for a trigger or a negative instance, you need to classify the type for each candidate
{
"id": "46348f4078ae8460df4916d03573b7de",
"trigger_word": "desire",
"sent_id": 1,
"offset": [10, 11],
}
]
}
You can submit the prediction results for the test set to CodaLab to get the test results. You need to name your result file as results.jsonl and compress it into a .zip file for submission.
Each line in the results.jsonl should be a json string encoding the prediction results for one document. The json format is as below:
{
"id": "6b2e8c050e30872e49c2f46edb4ac044", // id for the document
"predictions":[ // a list, prediction results for the provided candidates
{
"id": "46348f4078ae8460df4916d03573b7de", // id for the candidate
"type_id": 10, // integer id for the predicted type, 0 for the negative instances
},
]
}