FANDOM


FactBank Edit

Model CT+ CT− PR+ PS+ Uu Macro-A Micro-A Ref
De Facto

(Sauri and Pustejovsky, 2012)[1]

Precision 0.81 0.89 0.80 0.54 0.86 0.78 0.82 Sauri and Pustejovsky (2012)[1]
Recall 0.89 0.65 0.32 0.67 0.66 0.64 0.79
F1 0.85 0.75 0.46 0.59 0.75 0.70 0.80

EVALITA 2016 Edit

task system polarity certainty time 3 attributes Factuality Value Ref
main baseline 0.94 0.86 0.71 0.67 0.67 Minard et al. (2016)[2]
main FactPro 0.92 0.83 0.74 0.69 0.72 Minard et al. (2016)[2]

References Edit

  1. 1.0 1.1 Saurí, R., & Pustejovsky, J. (2012). Are You Sure That This Happened? Assessing the Factuality Degree of Events in Text. Computational Linguistics, 38(2), 261–299. http://doi.org/10.1162/COLI_a_00096
  2. 2.0 2.1 Minard, A., Speranza, M., Caselli, T., & Kessler, F. B. (2016). The EVALITA 2016 Event Factuality Annotation Task (FactA). In Proceedings of Third Italian Conference on Computational Linguistics (CLiC-it 2016) & Fifth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian.