G2TT
来源类型Working Paper
规范类型报告
DOI10.3386/w26562
来源IDWorking Paper 26562
Factorial Designs, Model Selection, and (Incorrect) Inference in Randomized Experiments
Karthik Muralidharan; Mauricio Romero; Kaspar Wüthrich
发表日期2019-12-16
出版年2019
语种英语
摘要Factorial designs are widely used for studying multiple treatments in one experiment. While t-tests based on the “long” model (including main and interaction effects) provide valid inferences against “business-as-usual” counterfactuals, “short” model t-tests (that ignore interactions) yield higher power if the interactions are zero, but incorrect inferences otherwise. Out of 27 factorial experiments published in top-5 journals in 2007–2017, 19 use the short model. We reanalyze these experiments, and show that over half of their published results lose significance when interactions are included. We show that testing the interactions using the long model and presenting the short model if the interactions are not significantly different from zero leads to incorrect inference due to the implied data-dependent model selection. Based on recent econometric advances, we show that local power improvements over the long model are possible. However, if the main effects are of primary interest, leaving the interaction cells empty yields valid inferences and global power improvements. In addition, the sample size needed to detect interactions is substantially larger than that required to detect main effects, resulting in most experiments being under-powered to detect interactions. Thus, using factorial designs to explore whether interactions are meaningful can be problematic because interaction estimates are likely to considerably overestimate the magnitude of the true effect conditional on being significant.
主题Econometrics ; Estimation Methods ; Experimental Design
URLhttps://www.nber.org/papers/w26562
来源智库National Bureau of Economic Research (United States)
引用统计
资源类型智库出版物
条目标识符http://119.78.100.153/handle/2XGU8XDN/584236
推荐引用方式
GB/T 7714
Karthik Muralidharan,Mauricio Romero,Kaspar Wüthrich. Factorial Designs, Model Selection, and (Incorrect) Inference in Randomized Experiments. 2019.
条目包含的文件
文件名称/大小 资源类型 版本类型 开放类型 使用许可
w26562.pdf(598KB)智库出版物 限制开放CC BY-NC-SA浏览
个性服务
推荐该条目
保存到收藏夹
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Karthik Muralidharan]的文章
[Mauricio Romero]的文章
[Kaspar Wüthrich]的文章
百度学术
百度学术中相似的文章
[Karthik Muralidharan]的文章
[Mauricio Romero]的文章
[Kaspar Wüthrich]的文章
必应学术
必应学术中相似的文章
[Karthik Muralidharan]的文章
[Mauricio Romero]的文章
[Kaspar Wüthrich]的文章
相关权益政策
暂无数据
收藏/分享
文件名: w26562.pdf
格式: Adobe PDF
此文件暂不支持浏览

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。