Natural Language Understanding Wiki


SemEval-2016 Task 12 statistics (Bethard et al. 2016)

  • TODO
  • TimeBank (Pustejovsky et al., 2006)[1]
  • Causal TimeBank (Mirza et al. 2014)[2]
  • Styler et al. (2014)[3]?
    • Notice: from Lin et al. (2016)[4]: "only CONTAINS and NONE relations due to the very low interannotator agreement for the other relation types in our evaluation corpus"
  • Clinical TempEval 2015
  • SemEval-2016 Task 12 (Bethard et al. 2016)[5]

Source code[]


  1. James Pustejovsky, Jessica Littman, Roser Saur´ı, and Marc Verhagen. 2006. Timebank 1.2 documentation. Technical report, Brandeis University, April.
  2. Paramita Mirza, Rachele Sprugnoli, Sara Tonelli and Manuela Speranza. 2014. Annotating causality in the TempEval-3 corpus. In Proceedings of the EACL 2014 Workshop on Computational Approaches to Causality in Language (CAtoCL), pages 10–19, Gothenburg, Sweden, April. Association for Computational Linguistics.
  3. William Styler, Steven Bethard, Sean Finan, Martha Palmer, Sameer Pradhan, Piet de Groen, Brad Erickson, Timothy Miller, Chen Lin, Guergana Savova, and James Pustejovsky. 2014. Temporal annotation in the clinical domain. Transactions of the Association for Computational Linguistics, 2:143–154
  4. Lin, Chen, Timothy Miller, Dmitriy Dligach, Steven Bethard, and Guergana Savova. "Improving Temporal Relation Extraction with Training Instance Augmentation." ACL 2016 (2016): 108.
  5. Bethard, Steven, Guergana Savova, Wei-Te Chen, Leon Derczynski, James Pustejovsky, and Marc Verhagen. "Semeval-2016 task 12: Clinical tempeval." Proceedings of SemEval (2016): 1052-1062.
  6. Leeuwenberg, A., & Moens, M.-F. (2017). Structured Learning for Temporal Relation Extraction from Clinical Records. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics. Valencia, Spain: Association for Computational Linguistics.