OVERALL ACC: (BEFORE OUTPUT FORMATTER) 17 / 50 = 0.34 -------------------------------------------------------------------------------- OVERALL ACC: (AFTER OUTPUT FORMATTER) 18 / 50 = 0.36 -------------------------------------------------------------------------------- AGGREGATOR PERFORMANCE: EASY: 17 / 17 = 1.0 HARD: 0 / 10 = 0.0 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN CORRECTLY ACTIVATED ACCORDING TO THE DISPATCHER): ACC Single-Span-Extraction 17 / 31 = 0.5484 Single-Span-Multi-Hop-Extraction 15 / 31 = 0.4839 Multi-Spans-Extraction 0 / 13 = 0.0000 YesNo 0 / 0 = NaN Arithmetic-Operations 0 / 1 = 0.0000 Counting 0 / 1 = 0.0000 Date-Duration 0 / 1 = 0.0000 Kinship 1 / 3 = 0.3333 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN WRONGLY ACTIVATED ACCORDING TO THE DISPATCHER): ACC Single-Span-Extraction 0 / 19 = 0.0000 Single-Span-Multi-Hop-Extraction 0 / 19 = 0.0000 Multi-Spans-Extraction 13 / 37 = 0.3514 YesNo 0 / 50 = 0.0000 Arithmetic-Operations 0 / 49 = 0.0000 Counting 0 / 49 = 0.0000 Date-Duration 10 / 49 = 0.2041 Kinship 0 / 47 = 0.0000 --------------------------------------------------------------------------------