G2TT
来源类型Publication
Beyond “Treatment Versus Control”: How Bayesian Analysis Makes Factorial Experiments Feasible in Education Research
Daniel Kassler; Ira Nichols-Barrer; and Mariel Finucane
发表日期2019-01-10
出版者Evaluation Review (online ahead of print)
出版年2019
语种英语
概述Researchers often wish to test a large set of related interventions or approaches to implementation. A factorial experiment accomplishes this by examining not only basic treatment–control comparisons but also the effects of multiple implementation “factors” such as different dosages or implementation strategies and the interactions between these factor levels. ",
摘要

Background. Researchers often wish to test a large set of related interventions or approaches to implementation. A factorial experiment accomplishes this by examining not only basic treatment–control comparisons but also the effects of multiple implementation “factors” such as different dosages or implementation strategies and the interactions between these factor levels. However, traditional methods of statistical inference may require prohibitively large sample sizes to perform complex factorial experiments.

Objectives. We present a Bayesian approach to factorial design. Through the use of hierarchical priors and partial pooling, we show how Bayesian analysis substantially increases the precision of estimates in complex experiments with many factors and factor levels, while controlling the risk of false positives from multiple comparisons.

Research design. Using an experiment we performed for the U.S. Department of Education as a motivating example, we perform power calculations for both classical and Bayesian methods. We repeatedly simulate factorial experiments with a variety of sample sizes and numbers of treatment arms to estimate the minimum detectable effect (MDE) for each combination.

Results. The Bayesian approach yields substantially lower MDEs when compared with classical methods for complex factorial experiments. For example, to test 72 treatment arms (five factors with two or three levels each), a classical experiment requires nearly twice the sample size as a Bayesian experiment to obtain a given MDE.

Conclusions. Bayesian methods are a valuable tool for researchers interested in studying complex interventions. They make factorial experiments with many treatment arms vastly more feasible.

URLhttps://www.mathematica.org/our-publications-and-findings/publications/ja-beyond-treatment-versus-control-how-bayesian-analysis-makes-factorial-experiments-feasible
来源智库Mathematica Policy Research (United States)
资源类型智库出版物
条目标识符http://119.78.100.153/handle/2XGU8XDN/489471
推荐引用方式
GB/T 7714
Daniel Kassler,Ira Nichols-Barrer,and Mariel Finucane. Beyond “Treatment Versus Control”: How Bayesian Analysis Makes Factorial Experiments Feasible in Education Research. 2019.
条目包含的文件
条目无相关文件。
个性服务
推荐该条目
保存到收藏夹
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Daniel Kassler]的文章
[Ira Nichols-Barrer]的文章
[and Mariel Finucane]的文章
百度学术
百度学术中相似的文章
[Daniel Kassler]的文章
[Ira Nichols-Barrer]的文章
[and Mariel Finucane]的文章
必应学术
必应学术中相似的文章
[Daniel Kassler]的文章
[Ira Nichols-Barrer]的文章
[and Mariel Finucane]的文章
相关权益政策
暂无数据
收藏/分享

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。