Gateway to Think Tanks
来源类型 | Working Paper |
规范类型 | 报告 |
DOI | 10.3386/w23544 |
来源ID | Working Paper 23544 |
Split-Sample Strategies for Avoiding False Discoveries | |
Michael L. Anderson; Jeremy Magruder | |
发表日期 | 2017-07-03 |
出版年 | 2017 |
语种 | 英语 |
摘要 | Preanalysis plans (PAPs) have become an important tool for limiting false discoveries in field experiments. We evaluate the properties of an alternate approach which splits the data into two samples: An exploratory sample and a confirmation sample. When hypotheses are homogeneous, we describe an improved split-sample approach that achieves 90% of the rejections of the optimal PAP without requiring preregistration or constraints on specification search in the exploratory sample. When hypotheses are heterogeneous in priors or intrinsic interest, we find that a hybrid approach which prespecifies hypotheses with high weights and priors and uses a split-sample approach to test additional hypotheses can have power gains over any pure PAP. We assess this approach using the community-driven development (CDD) application from Casey et al. (2012) and find that the use of a hybrid split-sample approach would have generated qualitatively different conclusions. |
主题 | Econometrics ; Estimation Methods ; Data Collection ; Experimental Design ; Development and Growth ; Development |
URL | https://www.nber.org/papers/w23544 |
来源智库 | National Bureau of Economic Research (United States) |
引用统计 | |
资源类型 | 智库出版物 |
条目标识符 | http://119.78.100.153/handle/2XGU8XDN/581223 |
推荐引用方式 GB/T 7714 | Michael L. Anderson,Jeremy Magruder. Split-Sample Strategies for Avoiding False Discoveries. 2017. |
条目包含的文件 | ||||||
文件名称/大小 | 资源类型 | 版本类型 | 开放类型 | 使用许可 | ||
w23544.pdf(644KB) | 智库出版物 | 限制开放 | CC BY-NC-SA | 浏览 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。