Understanding and Addressing the Unbounded “Likelihood” Problem

作者: Shiyao Liu , Huaiqing Wu , William Q. Meeker

DOI: 10.1080/00031305.2014.1003968

关键词: MathematicsEstimation theoryLikelihood-ratio testMarginal likelihoodStatisticsRestricted maximum likelihoodMaximum likelihood sequence estimationExpectation–maximization algorithmLikelihood principleApplied mathematicsLikelihood function

摘要: The joint probability density function, evaluated at the observed data, is commonly used as likelihood function to compute maximum estimates. For some models, however, there exist paths in parameter space along which this density-approximation goes infinity and estimation breaks down. In all applications, data are really discrete due round-off or grouping error of measurements. “correct likelihood” based on interval censoring can eliminate problem an unbounded likelihood. This article categorizes models leading likelihoods into three groups illustrates breakdown with specific examples. Although it usually possible infer how given were rounded, when not possible, one must choose width for censoring, so we study effect estimation. We also give sufficient conditions provide same likel...

参考文章(36)
Stuart G. Coles, Mark J. Dixon, Likelihood-Based Inference for Extreme Value Models Extremes. ,vol. 2, pp. 5- 23 ,(1999) , 10.1023/A:1009905222644
G. E. P. Box, D. R. Cox, An Analysis of Transformations Journal of the Royal Statistical Society: Series B (Methodological). ,vol. 26, pp. 211- 243 ,(1964) , 10.1111/J.2517-6161.1964.TB00553.X
George A. Barnard, The use of the likelihood function in statistical practice Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Statistics. ,(1967)
Likelihood‐Based Inference John Wiley & Sons, Inc.. pp. 23- 29 ,(2006) , 10.1002/047005588X.CH3
Walter Zucchini, Iain L. MacDonald, Roland Langrock, Hidden Markov Models for Time Series: An Introduction Using R ,(2009)
Richard E. Quandt, A New Approach to Estimating Switching Regressions Journal of the American Statistical Association. ,vol. 67, pp. 306- 310 ,(1972) , 10.1080/01621459.1972.10482378
Michael D. Intriligator, Mathematical optimization and economic theory ,(1971)
Oscar Kempthorne, Some Aspects of Experimental Inference Journal of the American Statistical Association. ,vol. 61, pp. 11- 34 ,(1966) , 10.1080/01621459.1966.10502007
Lea Friedman, Ilya B. Gertsbakh, Maximum Likelihood Estimation in a Mininum-Type Model with Exponential and Weibull Failure Modes Journal of the American Statistical Association. ,vol. 75, pp. 460- 465 ,(1980) , 10.1080/01621459.1980.10477495