[Most-ai-contest] Partial Error Analysis

kysu kysu於iis.sinica.edu.tw
Tue 12月 24 20:39:23 CST 2019


Thanks for your quick response and action. According to Dr. JJ Fan, there are some cases which we are able to know that the currently extracted answers are wrong (by checking them with the given answer-types). Dr. JJ Fan will call you to explain the details to you.

 

KY

 

From: 郭家銍 [mailto:jerrykuo7727 at gmail.com] 
Sent: Tuesday, December 24, 2019 6:38 PM
To: kysu <kysu at iis.sinica.edu.tw>
Cc: Most-ai Contest <Most-ai-contest at iis.sinica.edu.tw>
Subject: Re: [Most-ai-contest] Partial Error Analysis

 

蘇老師您好:

 

針對D076Q01川普年齡的題目

rules已新增僅有出生而無死亡日期的pattern,能順利回答

 

而D069Q05李安唸大學幾年的題目

因題目問的是「幾年」,而抽取出的span之單位已經是年了,才會直接採用

目前模型抽取的N-best年份,依序為"六年"、"1984年"、"1981年",作年份相減也無法算得答案

(後兩個年份的出處:「李安繼續在1981年至紐約大學就讀電影製作研究所,於1984年取得碩士學位」)

 

我會爭取在這兩天,對模型作ensemble

看看能否進一步提高模型的準確度

 

Respectfully yours,

郭家銍

 

kysu <kysu at iis.sinica.edu.tw <mailto:kysu at iis.sinica.edu.tw> > 於 2019年12月24日 週二 下午5:29寫道:

Enclosed please find the error analysis for Multi-Space-Extraction and Date-Duration (extracted from week-3 only). Please check all the errors reported in three weeks. We still have two days. Please do your best to analyze the error and find a way to improve them (either rule-based or DNN-based approach is OK).

 

KY

_______________________________________________
Most-ai-contest mailing list
Most-ai-contest at iis.sinica.edu.tw <mailto:Most-ai-contest at iis.sinica.edu.tw> 
https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.iis.sinica.edu.tw/pipermail/most-ai-contest/attachments/20191224/37a5d502/attachment-0001.html>


More information about the Most-ai-contest mailing list