OVERALL ACC: (BEFORE OUTPUT FORMATTER) 18 / 50 = 0.36 -------------------------------------------------------------------------------- OVERALL ACC: (AFTER OUTPUT FORMATTER) 18 / 50 = 0.36 -------------------------------------------------------------------------------- AGGREGATOR PERFORMANCE: EASY: 18 / 18 = 1.0 HARD: 0 / 12 = 0.0 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN CORRECTLY ACTIVATED ACCORDING TO THE DISPATCHER): ACC Single-Span-Extraction 10 / 25 = 0.4000 Single-Span-Multi-Hop-Extraction 11 / 25 = 0.4400 Multi-Spans-Extraction 0 / 7 = 0.0000 YesNo 2 / 4 = 0.5000 Arithmetic-Operations 0 / 1 = 0.0000 Counting 0 / 3 = 0.0000 Date-Duration 0 / 4 = 0.0000 Kinship 5 / 6 = 0.8333 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN WRONGLY ACTIVATED ACCORDING TO THE DISPATCHER): ACC Single-Span-Extraction 0 / 25 = 0.0000 Single-Span-Multi-Hop-Extraction 0 / 25 = 0.0000 Multi-Spans-Extraction 2 / 43 = 0.0465 YesNo 0 / 46 = 0.0000 Arithmetic-Operations 0 / 49 = 0.0000 Counting 0 / 47 = 0.0000 Date-Duration 10 / 46 = 0.2174 Kinship 0 / 44 = 0.0000 --------------------------------------------------------------------------------