Bias reduction of a conditional maximum likelihood estimator for a Gaussian second-order moving average model        
        
    
        Volume 8, Issue 4 (2021), pp. 435–463
            
    
                    Pub. online: 4 August 2021
                    
        Type: Research Article
            
                
             Open Access
Open Access
        
            
    
                Received
8 December 2020
                                    8 December 2020
                Revised
8 July 2021
                                    8 July 2021
                Accepted
8 July 2021
                                    8 July 2021
                Published
4 August 2021
                    4 August 2021
Abstract
In this study, we consider a bias reduction of the conditional maximum likelihood estimators for the unknown parameters of a Gaussian second-order moving average (MA(2)) model. In many cases, we use the maximum likelihood estimator because the estimator is consistent. However, when the sample size n is small, the error is large because it has a bias of $O({n^{-1}})$. Furthermore, the exact form of the maximum likelihood estimator for moving average models is slightly complicated even for Gaussian models. We sometimes rely on simpler maximum likelihood estimation methods. As one of the methods, we focus on the conditional maximum likelihood estimator and examine the bias of the conditional maximum likelihood estimator for a Gaussian MA(2) model. Moreover, we propose new estimators for the unknown parameters of the Gaussian MA(2) model based on the bias of the conditional maximum likelihood estimators. By performing simulations, we investigate properties of this bias, as well as the asymptotic variance of the conditional maximum likelihood estimators for the unknown parameters. Finally, we confirm the validity of the new estimators through this simulation study.
            References
 Bao, Y.: A general result on the estimation bias of ARMA models. J. Stat. Plan. Inference 197, 107–125 (2018). MR3799026. https://doi.org/10.1016/j.jspi.2018.01.001
 Bao, Y., Ullah, A.: The second-order bias and mean squared error of estimators in time-series models. J. Econom. 140, 650–669 (2007). MR2408921. https://doi.org/10.1016/j.jeconom.2006.07.007
 Bao, Y., Ullah, A.: Expectation of quadratic forms in normal and nonnormal variables with applications. J. Stat. Plan. Inference 140, 1193–1205 (2010). MR2581122. https://doi.org/10.1016/j.jspi.2009.11.002
 Barndorff-Nielsen, O.E., Cox, D.R.: Inference and Asymptotics. Chapman & Hall/CRC (1994). MR1317097. https://doi.org/10.1007/978-1-4899-3210-5
 Brockwell, P.J., Davis, R.A.: Time Series: Theory and Methods. Springer (1991). MR2839251
 Cheang, W.K., Reinsel, G.C.: Bias reduction of autoregressive estimates in time series regression model through restricted maximum likelihood. J. Am. Stat. Assoc. 95, 1173–1184 (2000). MR1804241. https://doi.org/10.2307/2669758
 Cordeiro, G.M., Klein, R.: Bias correction in ARMA models. Stat. Probab. Lett. 19, 169–176 (1994). MR1278646. https://doi.org/10.1016/0167-7152(94)90100-7
 Giummolé, F., Vidoni, P.: Improved prediction limits for a general class of Gaussian models. J. Time Ser. Anal. 31, 483–493 (2010). MR2732602. https://doi.org/10.1111/j.1467-9892.2010.00680.x
 Hamilton, J.D.: Time Series Analysis. Princeton University Press (1994). MR1278033
 Hillmer, S.C., Tiao, G.C.: Likelihood function of stationary multiple autoregressive moving average models. J. Am. Stat. Assoc. 74(367), 652–660 (1979). MR0548261
 Kurosawa, T., Noguchi, K., Honda, F.: Bias reduction of the maximum likelihood estimator for a conditional Gaussian MA(1) model. Commun. Stat., Theory Methods 31(17), 8588–8602 (2017). MR3680779. https://doi.org/10.1080/03610926.2016.1185119
 Tanaka, K.: Asymptotic expansions associated with the AR(1) model with unknown mean. Econometrica 51, 1221–1231 (1983). MR0710228. https://doi.org/10.2307/1912060
 Tanaka, K.: An asymptotic expansion associated with the maximum likelihood estimators in ARMA models. J. R. Stat. Soc. B 46, 58–67 (1984). MR0745216
 The Federal Reserve Bank of St. Louis. http://research.stlouisfed.org/
 Wilson, G.T.: The estimation of parameters in multivariate time series models. J. R. Stat. Soc. 35(367), 76–85 (1973). MR0339421
 
            