<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:新細明體;
panose-1:2 2 5 0 0 0 0 0 0 0;}
@font-face
{font-family:細明體;
panose-1:2 2 5 9 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"\@新細明體";
panose-1:2 1 6 1 0 1 1 1 1 1;}
@font-face
{font-family:"\@細明體";
panose-1:2 1 6 9 0 1 1 1 1 1;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"新細明體",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML 預設格式 字元";
margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:細明體;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"新細明體",serif;}
span.HTML
{mso-style-name:"HTML 預設格式 字元";
mso-style-priority:99;
mso-style-link:"HTML 預設格式";
font-family:"Courier New";}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=ZH-TW link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif'>></span>狀況會是前者，例如以下例子：問題問的是「哪一年」，答案的計算公式為「<span lang=EN-US style='font-family:"Arial",sans-serif'>1057</span>年<span lang=EN-US style='font-family:"Arial",sans-serif'> - 20</span>歲<span lang=EN-US style='font-family:"Arial",sans-serif'> = 1037</span>年」<span lang=EN-US><o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>Thanks for detailed explanation. Maybe we can create a compatible-set {</span><span style='color:#1F497D'>年</span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>,</span><span lang=EN-US style='font-family:"Arial",sans-serif'> </span>歲<span style='font-family:"Calibri",sans-serif;color:#1F497D'> <span lang=EN-US>}, and slightly revise your current restriction-rule to allow both “</span></span><span style='color:#1F497D'>年</span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>” and “</span>歲<span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>” in the equation.<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>KY<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'>From:</span></b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'> </span><span style='font-size:11.0pt'>郭家銍</span><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'> [mailto:jerrykuo7727@gmail.com] <br><b>Sent:</b> Wednesday, December 25, 2019 10:44 PM<br><b>To:</b> kysu <kysu@iis.sinica.edu.tw><br><b>Cc:</b> Most-ai Contest <Most-ai-contest@iis.sinica.edu.tw>; </span><span style='font-size:11.0pt'>范正忠</span><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'> <jjfan@iis.sinica.edu.tw><br><b>Subject:</b> Re: [Most-ai-contest] Ensemble analysis of date-duration questions<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p><div><p class=MsoNormal>蘇老師好：<span lang=EN-US><o:p></o:p></span></p><div><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p></div><div><p class=MsoNormal>狀況會是前者，例如以下例子：<span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal>問題問的是「哪一年」，答案的計算公式為「<span lang=EN-US style='font-family:"Arial",sans-serif'>1057</span>年<span lang=EN-US style='font-family:"Arial",sans-serif'> - 20</span>歲<span lang=EN-US style='font-family:"Arial",sans-serif'> = 1037</span>年」<span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p></div><div><p class=MsoNormal>文章：<span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>嘉佑二年（</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>1057</span><span style='color:black'>年），苏轼才</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>20</span><span style='color:black'>岁，与弟弟苏辙一同进京参加会考，苏轼中进士第</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>2</span><span style='color:black'>名。当时主试官是欧阳修，苏轼以一篇《刑赏忠厚之至论》的论文得到考官梅尧臣的青睐，并推荐给主试官欧阳修。欧阳修亦十分赞赏，原本欲拔擢为第一，但又怕该文为自己的门生曾巩所作，为了避嫌，列为第二。结果试卷拆封后才发现该文为苏轼所作，而取为第一的是曾巩，正是阴错阳差，弄巧成拙。到了礼部复试时，苏轼再以《春秋对义》居曾巩之前，中乙科。</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>\n</span><span style='color:black'>治平三年（</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>1066</span><span style='color:black'>年），父苏洵过世，苏轼回蜀守丧，英宗怜之，同意以官船载运苏轼一家。</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>\n</span><span style='color:black'>熙宁二年（</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>1069</span><span style='color:black'>年），任祠部员外郎，反对王安石变法中的一些作为，王安石于是屡次在神宗面前诋毁苏轼，司马光、范镇举荐苏轼作谏官，王安石力反之，神宗想让苏轼写起居注，王安石向神宗进言，说苏轼在回家守丧时，乘机贩运苏木（一种染料），最后神宗放弃这个任命。三年，因为苏轼一直反对王安石，王安石门下的御史谢景温又诬陷苏轼贩卖私盐，范镇极辩苏轼贩盐之诬，并愿意退休负责。</span><span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>題目：</span><span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal>苏东坡出生于哪一年<span lang=EN-US>?<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p></div><div><p class=MsoNormal>答案：<span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US>1037</span>年<span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US>Respectfully yours,<o:p></o:p></span></p></div><div><p class=MsoNormal>郭家銍<span lang=EN-US><o:p></o:p></span></p></div></div><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p><div><div><p class=MsoNormal><span lang=EN-US>kysu <<a href="mailto:kysu@iis.sinica.edu.tw">kysu@iis.sinica.edu.tw</a>> </span>於<span lang=EN-US> 2019</span>年<span lang=EN-US>12</span>月<span lang=EN-US>25</span>日 週三 下午<span lang=EN-US>10:09</span>寫道：<span lang=EN-US><o:p></o:p></span></p></div><blockquote style='border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm'><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US>></span>因為<span lang=EN-US>AMODE</span>是<span lang=EN-US>date-duration</span>的問題，計算時的單位常常與問題不一致<span lang=EN-US><o:p></o:p></span></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'> </span><span lang=EN-US><o:p></o:p></span></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>Do you mean that the desired math-formula will include a unit which is inconsistent with that is asked in the question? Or, an incorrect answer is generated due to involving two quantities with unmatched units? If it is the latter case, maybe we can add a checking-procedure to filter out those unmatched candidates. Could you please give an example with more details? Thanks.</span><span lang=EN-US><o:p></o:p></span></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'> </span><span lang=EN-US><o:p></o:p></span></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>KY</span><span lang=EN-US><o:p></o:p></span></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'> </span><span lang=EN-US><o:p></o:p></span></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'>From:</span></b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'> </span><span style='font-size:11.0pt'>郭家銍</span><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'> [mailto:<a href="mailto:jerrykuo7727@gmail.com" target="_blank">jerrykuo7727@gmail.com</a>] <br><b>Sent:</b> Wednesday, December 25, 2019 9:32 PM<br><b>To:</b> Most-ai Contest <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank">Most-ai-contest@iis.sinica.edu.tw</a>>; kysu <<a href="mailto:kysu@iis.sinica.edu.tw" target="_blank">kysu@iis.sinica.edu.tw</a>><br><b>Subject:</b> [Most-ai-contest] Ensemble analysis of date-duration questions</span><span lang=EN-US><o:p></o:p></span></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US> <o:p></o:p></span></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>蘇老師您好：<span lang=EN-US><o:p></o:p></span></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US> <o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>目前在<span lang=EN-US>date-duration</span>上實驗了用三個不同的模型作<span lang=EN-US>ensemble<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>對於<span lang=EN-US>AMODE</span>是<span lang=EN-US>date-duration</span>的問題，<span lang=EN-US>EM</span>會從<span lang=EN-US>42.0</span>下降到<span lang=EN-US>39.1<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>對於<span lang=EN-US>ATYPE</span>是<span lang=EN-US>date-duration</span>的<span lang=EN-US>single-span</span>問題，<span lang=EN-US>EM</span>則從<span lang=EN-US>57.0</span>上升到<span lang=EN-US>60.7<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US> <o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>初步的分析，是因為<span lang=EN-US>ensemble</span>會讓模型預測的答案與問題更加吻合<span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US>(e.g. question</span>問「幾年」，則<span lang=EN-US>ensemble</span>後的<span lang=EN-US>N-best</span>預測幾乎都是「<span lang=EN-US>XX</span>年」<span lang=EN-US>)<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US> <o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>這對<span lang=EN-US>single-span</span>問題有正面效益，但對<span lang=EN-US>AMODE</span>是<span lang=EN-US>date-duration</span>時卻有害<span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>因為<span lang=EN-US>AMODE</span>是<span lang=EN-US>date-duration</span>的問題，計算時的單位常常與問題不一致<span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>以問題問「幾年？」的例子來說，可能出現以下的計算形式：<span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US>1037</span>年<span lang=EN-US> + 20</span>歲<span lang=EN-US> = 1057</span>年<span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US>24</span>歲<span lang=EN-US> - 18</span>歲<span lang=EN-US> = 6</span>年<span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US> <o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US>Respectfully yours,<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>郭家銍<span lang=EN-US><o:p></o:p></span></p></div></div></div></div></blockquote></div></div></body></html>