OVERALL ACC: (BEFORE OUTPUT FORMATTER) 16 / 50 = 0.32 -------------------------------------------------------------------------------- OVERALL ACC: (AFTER OUTPUT FORMATTER) 17 / 50 = 0.34 -------------------------------------------------------------------------------- AGGREGATOR PERFORMANCE: EASY: 16 / 16 = 1.0 HARD: 0 / 19 = 0.0 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN CORRECTLY ACTIVATED ACCORDING TO THE DISPATCHER): ACC Single-Span-Extraction 15 / 25 = 0.6000 Single-Span-Multi-Hop-Extraction 6 / 25 = 0.2400 Multi-Spans-Extraction 0 / 7 = 0.0000 YesNo 2 / 4 = 0.5000 Arithmetic-Operations 0 / 1 = 0.0000 Counting 0 / 3 = 0.0000 Date-Duration 0 / 4 = 0.0000 Kinship 5 / 6 = 0.8333 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN WRONGLY ACTIVATED ACCORDING TO THE DISPATCHER): ACC Single-Span-Extraction 1 / 25 = 0.0400 Single-Span-Multi-Hop-Extraction 1 / 25 = 0.0400 Multi-Spans-Extraction 3 / 43 = 0.0698 YesNo 0 / 46 = 0.0000 Arithmetic-Operations 8 / 49 = 0.1633 Counting 8 / 47 = 0.1702 Date-Duration 18 / 46 = 0.3913 Kinship 7 / 44 = 0.1591 --------------------------------------------------------------------------------