OVERALL ACC: (BEFORE OUTPUT FORMATTER) 122 / 217 = 0.5622119815668203 -------------------------------------------------------------------------------- OVERALL ACC: (AFTER OUTPUT FORMATTER) 120 / 217 = 0.5529953917050692 -------------------------------------------------------------------------------- AGGREGATOR PERFORMANCE: EASY: 121 / 121 = 1.0 HARD: 1 / 36 = 0.027777777777777776 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN CORRECTLY ACTIVATED): ACC Single-Span-Extraction 79 / 148 = 0.5338 Single-Span-Multi-Hop-Extraction 87 / 148 = 0.5878 Multi-Spans-Extraction 1 / 19 = 0.0526 YesNo 25 / 26 = 0.9615 Arithmetic-Operations 0 / 1 = 0.0000 Counting 0 / 2 = 0.0000 Date-Duration 1 / 12 = 0.0833 Kinship 4 / 5 = 0.8000 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN WRONGLY ACTIVATED): ACC Single-Span-Extraction 0 / 22 = 0.0000 Single-Span-Multi-Hop-Extraction 0 / 22 = 0.0000 Multi-Spans-Extraction 0 / 144 = 0.0000 YesNo 0 / 5 = 0.0000 Arithmetic-Operations 1 / 44 = 0.0227 Counting 1 / 11 = 0.0909 Date-Duration 88 / 146 = 0.6027 Kinship 0 / 20 = 0.0000 --------------------------------------------------------------------------------