OVERALL ACC: (BEFORE OUTPUT FORMATTER)
	13 / 50 = 0.26
--------------------------------------------------------------------------------
OVERALL ACC: (AFTER OUTPUT FORMATTER)
	14 / 50 = 0.28
Formatter Errors:
	[]
--------------------------------------------------------------------------------
AGGREGATOR PERFORMANCE:
	EASY: 13 / 13 = 1.0
	HARD: 0 / 10 = 0.0
--------------------------------------------------------------------------------
ANSWER MODULE STATS (WHEN CORRECTLY ACTIVATED ACCORDING TO THE DISPATCHER):
                                 ACC
Single-Span-Extraction           15 / 31 = 0.4839
Single-Span-Multi-Hop-Extraction 10 / 31 = 0.3226
Multi-Spans-Extraction           0 / 13 = 0.0000
YesNo                            0 / 0 = NaN
Arithmetic-Operations            0 / 1 = 0.0000
Counting                         0 / 1 = 0.0000
Date-Duration                    0 / 1 = 0.0000
Kinship                          1 / 3 = 0.3333
--------------------------------------------------------------------------------
ANSWER MODULE STATS (WHEN WRONGLY ACTIVATED ACCORDING TO THE DISPATCHER):
                                ACC
Single-Span-Extraction           0 / 19 = 0.0000
Single-Span-Multi-Hop-Extraction 0 / 19 = 0.0000
Multi-Spans-Extraction           6 / 37 = 0.1622
YesNo                            0 / 50 = 0.0000
Arithmetic-Operations            0 / 49 = 0.0000
Counting                         0 / 49 = 0.0000
Date-Duration                    9 / 49 = 0.1837
Kinship                          0 / 47 = 0.0000
--------------------------------------------------------------------------------
ANSWER MODULE ERROR SAMPLES (WHEN CORRECTLY ACTIVATED):
Single-Span-Extraction:
['D031Q01', 'D033Q02', 'D033Q04', 'D048Q05', 'D049Q07', 'D069Q05', 'D071Q02', 'D082Q07', 'D083Q05', 'D095Q05', 'D105Q03', 'D108Q01', 'D138Q02', 'D248Q02', 'D248Q07', 'D309Q02']

Single-Span-Multi-Hop-Extraction:
['D031Q01', 'D033Q02', 'D033Q04', 'D048Q05', 'D049Q07', 'D069Q05', 'D071Q02', 'D082Q07', 'D083Q05', 'D083Q06', 'D093Q06', 'D095Q05', 'D105Q03', 'D108Q01', 'D138Q02', 'D179Q06', 'D238Q02', 'D248Q02', 'D248Q07', 'D309Q02', 'D312Q07']

Multi-Spans-Extraction:
['D013Q02', 'D015Q04', 'D037Q05', 'D046Q01', 'D049Q02', 'D062Q04', 'D073Q10', 'D082Q03', 'D087Q03', 'D092Q01', 'D120Q02', 'D215Q07', 'D322Q02']

YesNo:
[]

Arithmetic-Operations:
['D113Q06']

Counting:
['D069Q13']

Date-Duration:
['D076Q01']

Kinship:
['D036Q15', 'D036Q18']

--------------------------------------------------------------------------------