On the Power of Adaptivity in Data Analysis
- 講者Thomas Steinke 先生 (Computer Science Theory Group, Harvard University)
邀請人：鐘楷閔 - 時間2015-08-25 (Tue.) 10:00 ~ 12:00
- 地點資訊所新館106演講廳
摘要
If a dataset is only used once, a rich theory exists for ensuring that the conclusions are valid. But what happens if the same dataset is reused for multiple analyses? Since each analysis may now depend on the outcome of previous analyses, the danger of overfitting the dataset is increased. For example, if the same dataset is used to select a model and then fit that model, the resulting model may appear to explain the data better than it should.
In this talk, I will discuss a recent line of research on adaptive data analysis. I will show that there are sophisticated techniques that enable us to ensure that adaptive analysis provides sound conclusions. I will also show that such techniques are in fact necessary and that adaptive data analysis is inherently more powerful than non-adaptive data analysis.