HANDLING HETEROSCEDASTICITY IN LINEAR MODELS: HUBER-WHITE STANDARD ERRORS VS BOOTSTRAP CONFIDENCE INTERVALS

Authors

  • Zarrukh Rakhimov Westminster International University in Tashkent, Tashkent, Uzbekistan Author

DOI:

https://doi.org/10.7251/ZREFIS2429011R

Keywords:

heteroscedasticity, homoscedasticity, linear model, confidence Interval, bootstrap, Huber-White, residuals, accuracy

Abstract

Heteroscedasticity are one of the several violations of the assumptions of OLS. If no remedy applied, residuals with non-constant variance can lead to inaccurate and biased results. Academia has suggested a wide range of remedies to tackle with heteroscedastic residuals. In this study, we suggest another approach, bootstrapping of dataset to construct our confidence intervals. In order to compare the outcome, we look at Huber-White method and look at its performance against bootstrap intervals. Results indicate that bootstrap intervals perform equally well as Huber-White based confidence intervals. This indicates that bootstrap method, similar to Huber-White approach, can be a good remedy for heteroscedasticity.

References

Cameron, A. Colin, and Pravin K. Trivedi. 2005. Microeconometrics: Methods and Applications. Cambridge: Cambridge University Press.

Chernick, Michael R., and Robert A. LaBudde. 2014. An Introduction to Bootstrap Methods with Applications to R. Hoboken, NJ: John Wiley & Sons.

Chernozhukov, Victor, and Han Hong. 2003. "An MCMC Approach to Classical Estimation." Journal of Econometrics 115 (2): 293–346.

Davidson, Russell, and James G. MacKinnon. 2004. Econometric Theory and Methods. New York: Oxford University Press, 2004.

Davison, Anthony C., and David V. Hinkley. 1997. Bootstrap Methods and Their Applications. Cambridge: Cambridge University Press.

DiCiccio, Thomas, and Bradley Efron. 1992. "More Accurate Confidence Intervals in Exponential Families." Biometrika 79: 231–45.

Efron, Bradley. 1982. The Jackknife, the Bootstrap and Other Resampling Plans. Philadelphia: SIAM.

Efron, Bradley, and Robert Tibshirani. 1986. "Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy." Statistical Science 1: 54–77.

Efron, Bradley. 1979. "Bootstrap Methods: Another Look at the Jackknife." The Annals of Statistics 7(1): 1–26.

Fan, Yanqin, and Qi Li. 2004. "A Consistent Model Specification Test Based on the Kernel Density Estimation." Econometrica 72 (6): 1845–58.

Flachaire, Emmanuel. 2005. "Bootstrapping Heteroscedastic Regression Models: Wild Bootstrap vs Pairs Bootstrap." Computational Statistics and Data Analysis 49 (2): 361–76.

Freedman, David A. 1981. "Bootstrapping Regression Models." The Annals of Statistics 9: 1218–22.

Greene, William H. 2021. Econometric Analysis. 8th ed. Hoboken, NJ: Pearson.

Gujarati, Damodar N., Dawn C. Porter, and Sangeetha Gunasekar. 2012. Basic Econometrics. New York: McGraw-Hill Higher Education.

Horowitz, Joel L., and Marianthi Markatou. 1996. "Semiparametric Estimation of Regression Models for Panel Data." Review of Economic Studies 63(1): 145–68.

Huber, Peter J. 1967. "The Behavior of Maximum Likelihood Estimates Under Nonstandard Conditions." In Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, 1:221–33. Berkeley, CA: University of California Press.

James, Gareth, Daniela Witten, Trevor Hastie, and Robert Tibshirani. 2023. An Introduction to Statistical Learning. 2nd ed. New York: Springer.

Lind, Douglas A., William G. Marchal, and Samuel A. Wathen. 1967. Statistical Techniques in Business and Economics. 2nd ed. New York: McGraw-Hill.

Liu, Runze Y. 1988. "Bootstrap Procedures Under Some Non-i.i.d. Models." The Annals of Statistics 16: 1696–1708.

Long, J. Scott, and Laurie H. Ervin. 2000. "Using Heteroscedasticity-Consistent Standard Errors in the Linear Regression Model." The American Statistician 54(3): 217–24.

MacKinnon, James G., and Halbert White. 1985. "Some Heteroskedasticity-Consistent Covariance Matrix Estimators with Improved Finite Sample Properties." Journal of Econometrics 29(3): 305–25.

Politis, Dimitris, and Joseph Romano. 1994. "The Stationary Bootstrap." Journal of the American Statistical Association 89 (428): 1303–12.

White, Halbert. 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity." Econometrica 48 (4): 817–38.

Wu, C. F. Jeff. 1986. "Jackknife, Bootstrap, and Other Resampling Plans in Regression Analysis (with Discussion)." The Annals of Statistics 14: 1261–1350.

Downloads

Published

2024-12-15

Issue

Section

Original scientific paper

How to Cite

HANDLING HETEROSCEDASTICITY IN LINEAR MODELS: HUBER-WHITE STANDARD ERRORS VS BOOTSTRAP CONFIDENCE INTERVALS. (2024). Zbornik Radova Ekonomskog Fakulteta U Istočnom Sarajevu, 29, 11-22. https://doi.org/10.7251/ZREFIS2429011R