NIST TAC Belief and Sentiment (BeSt) Track
Participants can obtain data from LDC after they finish registration, the available data sets are listed in the evaluation license.
The relevant data sets are as follows:
Core data (this is what the test data looks like):
LDC2016E27 DEFT English Belief and Sentiment Annotation
More data to be release for English, as well as for Chinese and Spanish in
Note that this release includes the gold ERE annotation. The predicted ERE
for the BeSt corpora will also be released in July or August.
files from RPI
with help from
UIUC and Stanford
(thanks!) can be found here.
Background data (can be used by evaluation participants but is not in the
output format required for the evaluation and/or does not include
annotations of the content which is being evaluated):
LDC2009T23 FactBank 1.0
LDC2014E55 DEFT Committed Belief Annotation R1
LDC2014E106 DEFT Committed Belief Annotation R2
LDC2014E125 DEFT Committed Belief Annotation Self-Evaluation Package
LDC2015E85 DEFT Chinese Committed Belief Sample Annotation
LDC2015E99 DEFT Chinese Committed Belief Annotation
LDC2015E109 DEFT Spanish Committed Belief Sample Annotation