OVERALL ACC: (BEFORE OUTPUT FORMATTER) 16 / 50 = 0.32 -------------------------------------------------------------------------------- OVERALL ACC: (AFTER OUTPUT FORMATTER) 18 / 50 = 0.36 -------------------------------------------------------------------------------- AGGREGATOR PERFORMANCE: EASY: 16 / 16 = 1.0 HARD: 0 / 9 = 0.0 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN CORRECTLY ACTIVATED ACCORDING TO THE DISPATCHER): ACC Single-Span-Extraction 7 / 22 = 0.3182 Single-Span-Multi-Hop-Extraction 10 / 22 = 0.4545 Multi-Spans-Extraction 0 / 9 = 0.0000 YesNo 4 / 7 = 0.5714 Arithmetic-Operations 0 / 0 = NaN Counting 0 / 0 = NaN Date-Duration 0 / 8 = 0.0000 Kinship 1 / 4 = 0.2500 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN WRONGLY ACTIVATED ACCORDING TO THE DISPATCHER): ACC Single-Span-Extraction 0 / 28 = 0.0000 Single-Span-Multi-Hop-Extraction 0 / 28 = 0.0000 Multi-Spans-Extraction 3 / 41 = 0.0732 YesNo 0 / 43 = 0.0000 Arithmetic-Operations 2 / 50 = 0.0400 Counting 0 / 50 = 0.0000 Date-Duration 10 / 42 = 0.2381 Kinship 0 / 46 = 0.0000 --------------------------------------------------------------------------------