Natural Language Understanding Wiki
(diff. in test data)
Tags: Visual edit apiedit
(Adding categories)
Tag: categoryselect
Line 11: Line 11:
 
<references/>
 
<references/>
 
[[Category:Implicit semantic role labeling]]
 
[[Category:Implicit semantic role labeling]]
  +
[[Category:Corpus]]

Revision as of 22:22, 18 October 2016

Reference: Ruppenhofer et al. (2010)[1]

Warning

The number of frame types is wrong in the original paper and some following papers (e.g. Gorinski et al., 2013[2]). Test set is not any more diverse than training set in terms of frame types. See discussion.

There are some unexpected differences between (A) (no null instatiation) test data and (B) gold data:

  • A has no coreference annotation while B does.
  • Some overt roles are missing in A, e.g. sentence 163, token 17, A misses frame assistance.01 and two overt roles (A0 and A1)

References

  1. Ruppenhofer, J., Sporleder, C., Morante, R., Baker, C., & Palmer, M. (2010). SemEval-2010 Task 10: Linking Events and Their Participants in Discourse. In Proceedings of the 5th International Workshop on Semantic Evaluation, ACL 2010 (pp. 45–50). Uppsala, Sweden.
  2. Gorinski, P., Ruppenhofer, J., & Sporleder, C. (2013). Towards Weakly Supervised Resolution of Null Instantiations. Proceedings of IWCS, 1–11.