OVERALL ACC: (BEFORE OUTPUT FORMATTER) 485 / 752 = 0.6449468085106383 -------------------------------------------------------------------------------- OVERALL ACC: (AFTER OUTPUT FORMATTER) 488 / 752 = 0.648936170212766 -------------------------------------------------------------------------------- AGGREGATOR PERFORMANCE: EASY: 483 / 487 = 0.9917864476386037 HARD: 2 / 114 = 0.017543859649122806 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN CORRECTLY ACTIVATED): ACC Single-Span-Extraction 315 / 496 = 0.6351 Single-Span-Multi-Hop-Extraction 334 / 496 = 0.6734 Multi-Spans-Extraction 0 / 72 = 0.0000 YesNo 64 / 71 = 0.9014 Arithmetic-Operations 2 / 6 = 0.3333 Counting 0 / 11 = 0.0000 Date-Duration 7 / 26 = 0.2692 Kinship 57 / 62 = 0.9194 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN WRONGLY ACTIVATED): ACC Single-Span-Extraction 5 / 83 = 0.0602 Single-Span-Multi-Hop-Extraction 2 / 83 = 0.0241 Multi-Spans-Extraction 0 / 506 = 0.0000 YesNo 0 / 56 = 0.0000 Arithmetic-Operations 1 / 110 = 0.0091 Counting 3 / 36 = 0.0833 Date-Duration 302 / 498 = 0.6064 Kinship 0 / 30 = 0.0000 --------------------------------------------------------------------------------