Natural Language Understanding Wiki
Advertisement

This is the output of jackknifing WSJ part of PTB using nndep-torch.

$ grep -A 1 "Total sentences" output/*
output/jackknife-00.out:Total sentences right: 2171 (54.492972%); wrong: 1813 (45.507028%).
output/jackknife-00.out-Total tags right: 93096 (97.079158%); wrong: 2801 (2.920842%).
--
output/jackknife-01.out:Total sentences right: 2178 (54.668675%); wrong: 1806 (45.331325%).
output/jackknife-01.out-Total tags right: 93892 (97.158468%); wrong: 2746 (2.841532%).
--
output/jackknife-02.out:Total sentences right: 2212 (55.522088%); wrong: 1772 (44.477912%).
output/jackknife-02.out-Total tags right: 92761 (97.187909%); wrong: 2684 (2.812091%).
--
output/jackknife-03.out:Total sentences right: 2247 (56.400602%); wrong: 1737 (43.599398%).
output/jackknife-03.out-Total tags right: 94436 (97.361720%); wrong: 2559 (2.638280%).
--
output/jackknife-04.out:Total sentences right: 2227 (55.898594%); wrong: 1757 (44.101406%).
output/jackknife-04.out-Total tags right: 89806 (97.042456%); wrong: 2737 (2.957544%).
--
output/jackknife-05.out:Total sentences right: 2323 (58.308233%); wrong: 1661 (41.691767%).
output/jackknife-05.out-Total tags right: 91794 (97.400365%); wrong: 2450 (2.599635%).
--
output/jackknife-06.out:Total sentences right: 2113 (53.037149%); wrong: 1871 (46.962851%).
output/jackknife-06.out-Total tags right: 91692 (96.969056%); wrong: 2866 (3.030944%).
--
output/jackknife-07.out:Total sentences right: 2218 (55.672691%); wrong: 1766 (44.327309%).
output/jackknife-07.out-Total tags right: 91412 (97.187875%); wrong: 2645 (2.812125%).
--
output/jackknife-08.out:Total sentences right: 2225 (55.848394%); wrong: 1759 (44.151606%).
output/jackknife-08.out-Total tags right: 92877 (97.241184%); wrong: 2635 (2.758816%).
--
output/jackknife-09.out:Total sentences right: 2188 (55.030181%); wrong: 1788 (44.969819%).
output/jackknife-09.out-Total tags right: 91436 (97.128714%); wrong: 2703 (2.871286%).
--
output/jackknife-test.err:Total sentences right: 1393 (57.657285%); wrong: 1023 (42.342715%).
output/jackknife-test.err-Total tags right: 55221 (97.419025%); wrong: 1463 (2.580975%).
--
output/jackknife-valid.err:Total sentences right: 915 (53.823529%); wrong: 785 (46.176471%).
output/jackknife-valid.err-Total tags right: 38896 (96.956403%); wrong: 1221 (3.043597%).
Advertisement