Reproducibility of Hypothesis Testing and Confidence Interval

作者: Myung-Hoe Huh

DOI: 10.5351/KJAS.2014.27.4.645

关键词:

摘要: Abstract P -value is the probability of observing a current sample and possibly other samples departing equally ormore extremely from null hypothesis toward postulated alternative hypothesis. When p less thana certain level called (= 0 : 05), researchers claim that supported empirically.Unfortunately, some findings discovered in way are not reproducible, partly because itself isa statistic vulnerable to random variation. Boos Stefanski (2011) suggests calculating upper limitof testing, using bootstrap predictive distribution. To determine sizeof replication study, this study proposes thought experiments by simulating boosted samplesof different sizes given observations. The method illustrated for cases two-group comparisonand multiple linear regression. This also addresses reproducibility points 95%confidence interval. Numerical examples show center point covered 95% confidence intervalsgenerated resamples. However, end with 50% chance. Hence studydraws graph rate each parameter interval.Keywords: Reproducibility,

参考文章(5)
Dennis D. Boos, Leonard A. Stefanski, P-Value Precision and Reproducibility The American Statistician. ,vol. 65, pp. 213- 221 ,(2011) , 10.1198/TAS.2011.10129
John M Hoenig, Dennis M Heisey, The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis The American Statistician. ,vol. 55, pp. 19- 24 ,(2001) , 10.1198/000313001300339897
Jun Shao, Shein-Chung Chow, Reproducibility probability in clinical trials Statistics in Medicine. ,vol. 21, pp. 1727- 1742 ,(2002) , 10.1002/SIM.1177
Bradley Efron, Better Bootstrap Confidence Intervals Journal of the American Statistical Association. ,vol. 82, pp. 171- 185 ,(1987) , 10.1080/01621459.1987.10478410
Steven N. Goodman, A comment on replication, p-values and evidence. Statistics in Medicine. ,vol. 11, pp. 875- 879 ,(1992) , 10.1002/SIM.4780110705