Simultaneously Addressing Collinearity and Outliers: A Robust Two-Parameter Estimation Approach
DOI:
https://doi.org/10.54536/ajase.v5i2.7268Keywords:
Liu Estimator, Mean Squared Error, Multicollinearity, Ridge Estimator, Robust Regression, Shrinkage EstimationAbstract
Multicollinearity and outliers remain two major challenges in linear regression modeling, often occurring simultaneously in practical applications and leading to instability, inflated variance, and unreliable inference. Although shrinkage estimators such as ridge and Liu estimators effectively address multicollinearity, but are still sensitive to outliers. Conversely, robust estimators mitigate the influence of outliers but do not adequately resolve collinearity. This study proposes a new robust two-parameter shrinkage estimator (Rprop1) designed to simultaneously handle multicollinearity and outliers within the classical linear regression framework. The estimator is derived in canonical form, and its statistical properties are established through mean squared error (MSE) analysis. A comprehensive Monte Carlo simulation study is conducted across varying sample sizes, error variances, correlation levels, numbers of explanatory variables, and outlier magnitudes. The performance of the proposed estimator is compared with existing robust and shrinkage-based estimators, including robust ridge, robust Liu, and robust Kibra Lukman estimators. Simulation results consistently demonstrate that the proposed estimator achieves superior MSE performance across moderate to severe multicollinearity and outliers’ magnitudes and it’s also supported by the real life dataset. The findings suggest that the proposed method provides a more stable and efficient alternative for regression modeling in the presence of simultaneous collinearity and outliers.
Downloads
References
Akdeniz, F., & Kaçiranlar, S. (1995). On the almost unbiased generalized Liu estimator and unbiased estimation of the bias and MSE. Communications in Statistics—Theory and Methods, 24(7), 1789–1797.
Alpu, O., & Samkar, H. (2010). Liu estimator based on an M-estimator. Turkiye Klinikleri Journal of Biostatistics, 2(2), 49–53.
Arkin, R. G., & Montgomery, D. C. (1980). Augmented robust estimators. Technometrics, 22(3), 333–341.
Arslan, O., & Billor, N. (2000). Robust Liu estimator for regression based on an M-estimator. Journal of Applied Statistics, 27(1), 39–47.
Awwad, F. A., Dawoud, I., & Abonazel, M. R. (2022). Development of robust Özkale–Kaçiranlar and Yang–Chang estimators for regression models in the presence of multicollinearity and outliers. Concurrency and Computation: Practice and Experience, 34(6), e6779.
Eledum, H. Y. A., & Alkhalifa, A. A. (2012). Generalized two-stage ridge regression estimator (GTR) for multicollinearity and autocorrelated errors. Canadian Journal on Science and Engineering Mathematics, 3(3), 79–83.
Fayose, T. S., Ayinde, K., Alabi, O. O., & Bello, A. H. (2023). Robust weighted ridge regression based on S-estimator. African Scientific Reports, 126–126.
Gujarati, D. N. (2003). Basic econometrics (4th ed.). Tata McGraw-Hill.
Holland, P. W. (1973). Weighted ridge regression: Combining ridge and robust regression methods (Working Paper No. 0011). National Bureau of Economic Research.
Hoerl, A. E., & Kennard, R. W. (1970). Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12(1), 55–67.
Huber, P. J. (1992). Robust estimation of a location parameter. In S. Kotz & N. L. Johnson (Eds.), Breakthroughs in statistics: Methodology and distribution (pp. 492–518). Springer.
Idowu, J. I., Oladapo, O. J., Owolabi, A. T., & Ayinde, K. (2022). On the biased two-parameter estimator to combat multicollinearity in linear regression model. African Scientific Reports, 188–204.
Idowu, J. I., Oladapo, O. J., Owolabi, A. T., Ayinde, K., & Akinmoju, O. (2023). Combating multicollinearity: A new two-parameter approach. Nicel Bilimler Dergisi, 5(1), 90–116.
Joel, A. T., Kayode, A., Ibukun, O. A., A., A., Abosede, O. O., & Olawale, K. S. (2024). Robust M Kibria–Lukman estimator for linear regression model with outliers in the X-direction: Simulations and applications. Science World Journal, 19(2), 440–454.
Kejian, L. (1993). A new class of biased estimate in linear regression. Communications in Statistics—Theory and Methods, 22(2), 393–402.
Kibria, B. G., & Lukman, A. F. (2020). A new ridge-type estimator for the linear regression model: Simulations and applications. Scientifica, 2020, Article 9758378.
Lukman, A. F., Arowolo, O., & Ayinde, K. (2014). Some robust ridge regression for handling multicollinearity and outliers. International Journal of Sciences: Basic and Applied Research, 16(2), 192–202.
Majid, A., Ahmad, S., Aslam, M., & Kashif, M. (2023). A robust Kibria–Lukman estimator for linear regression model to combat multicollinearity and outliers. Concurrency and Computation: Practice and Experience, 35(4), e7533.
Montgomery, D. C., Peck, E. A., & Vining, G. G. (2021). Introduction to linear regression analysis (6th ed.). John Wiley & Sons.
Oladapo, O. J., Alabi, O. O., & Ayinde, K. (2024). Another new two-parameter estimator in dealing with multicollinearity in the logistic regression model. International Journal of Mathematical Sciences and Optimization: Theory and Applications, 10(2), 22–35.
Oladapo, O. J., Alabi, O. O., & Ayinde, K. (2024). [Title not specified]. Iraqi Journal of Statistical Sciences, 21(1), 1–11.
Oladapo, O. J., Idowu, J. I., Owolabi, A. T., Ayinde, K., & Adejumo, T. J. (2024). A new ridge-type estimator in the logistic regression model with correlated regressors. WSEAS Transactions on Business and Economics, 21, 2528–2541. https://doi.org/10.37394/23207.2024.21.208
Oladapo, O. J., Owolabi, A. T., Idowu, J. I., & Ayinde, K. (2022). A new modified Liu ridge-type estimator for the linear regression model: Simulation and application. International Journal of Clinical Biostatistics and Biometrics, 8, 048.
Owolabi, A. T., Ayinde, K., Idowu, J. I., Oladapo, O. J., & Lukman, A. F. (2022). A new two-parameter estimator in the linear regression model with correlated regressors. Journal of Statistics Applications & Probability, 11(2), 499–512.
Rousseeuw, P. J., & Van Driessen, K. (1998). A fast algorithm for the minimum covariance determinant estimator. Technical Report, University of Antwerp.
Rousseeuw, P., & Yohai, V. J. (1984). Robust regression by means of S-estimators. In J. Franke, W. Härdle, & R. D. Martin (Eds.), Robust and nonlinear time series analysis (pp. 256–272). Springer.
Silvapulle, M. J. (1991). Robust ridge regression based on an M-estimator. Australian Journal of Statistics, 33(3), 319–333.
Simpson, J. R., & Montgomery, D. C. (1996). A biased-robust regression technique for the combined outlier–multicollinearity problem. Journal of Statistical Computation and Simulation, 56(1), 1–22.
Stein, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate normal distribution. In Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability (Vol. 1, pp. 197–207). University of California Press.
Yohai, V. J. (1987). High breakdown-point and high efficiency robust estimates for regression. The Annals of Statistics, 15(2), 642–656.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Seno Ofonmbuk Albert, Samuel Olayemi Olanrewaju, Emmanuel Segun Oguntade
This work is licensed under a Creative Commons Attribution 4.0 International License.
