OVERALL ACC: (BEFORE OUTPUT FORMATTER) 114 / 208 = 0.5480769230769231 -------------------------------------------------------------------------------- OVERALL ACC: (AFTER OUTPUT FORMATTER) 112 / 208 = 0.5384615384615384 -------------------------------------------------------------------------------- AGGREGATOR PERFORMANCE: EASY: 113 / 113 = 1.0 HARD: 1 / 41 = 0.024390243902439025 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN CORRECTLY ACTIVATED): ACC Single-Span-Extraction 62 / 133 = 0.4662 Single-Span-Multi-Hop-Extraction 83 / 133 = 0.6241 Multi-Spans-Extraction 0 / 25 = 0.0000 YesNo 18 / 20 = 0.9000 Arithmetic-Operations 1 / 1 = 1.0000 Counting 0 / 3 = 0.0000 Date-Duration 3 / 12 = 0.2500 Kinship 12 / 13 = 0.9231 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN WRONGLY ACTIVATED): ACC Single-Span-Extraction 0 / 22 = 0.0000 Single-Span-Multi-Hop-Extraction 0 / 22 = 0.0000 Multi-Spans-Extraction 0 / 133 = 0.0000 YesNo 0 / 13 = 0.0000 Arithmetic-Operations 2 / 36 = 0.0556 Counting 1 / 18 = 0.0556 Date-Duration 72 / 127 = 0.5669 Kinship 0 / 13 = 0.0000 --------------------------------------------------------------------------------