Novel Neural Network State Switching Models for Returns Predicting with Regime Switching: A Monte Carlo’s Simulation Approach
DOI:
https://doi.org/10.54536/ajase.v4i1.5514Keywords:
Markov Process, MLP, Neural Network, Regime Switching, ReturnsAbstract
This study proposes new neural network state switching models that will improve the regime predictive performance of nonlinear time series returns, in small sample size contexts. In this study, we developed four new neural network state switching models namely Recurrent Neural Network State Switching Model (RNNSSM), Generalized Regression Neural Network State Switching Model (GRNNSSM), Radial Basis Function Network State Switching Model (RBFSSM) and Multilayer Perceptrons State Switching Model (MLPSSM). The study presents comparative results of the estimations of the novel models alongside the traditional Markov state switching model as well as the regime prediction performances of the models using the Akaike Information Criterion (AIC), Log-likelihood and prediction accuracy measures under a Monte Carlo simulation study. Evidence from the models’ estimation results particularly the AIC and Log-likelihood statistics established the novel Multilayer Perceptrons State Switching Model (MLPSSM) as the parsimonious model for the simulated returns at small sample sizes. Results from the models’ regime predictions evaluation, precisely the RMSE and MAE, evidently affirmed the novel MLPSSM model as superior in its ability to predict or forecast market returns, particularly the bull and bear regimes, at small sample sizes. Therefore, this study concludes that the novel MLPSSM is the best-fitted model for market returns at small sample sizes with excellent ability of market returns’ regimes/states (i.e., bull and bear) prediction. This study recommends adoption of the novel Multilayer Perceptrons State Switching Model in modelling and regime predictions of time series returns.
Downloads
References
Adejumo, O. A., Albert, S., & Asemota, O. J. (2020). An Analysis of Stock Market Returns in Nigeria. CBN Journal of Applied Statistics, 11(2).
Aliyu, S. U. R. & Wambai, A. A. (2018). Economic regimes and stock market performance in Nigeria: Evidence from regime switching model. Munich Personal RePEc Archive MPRA, 91430. Retrieve from https://mpra.ub.uni-muenchen.de/91430/
Al-Sulaiman, T. (2024). Review of Recent Research Directions and Practical Implementation of Low-Frequency Algorithmic Trading. American Journal of Financial Technology and Innovation, 2(1), 1-14.
Altuğ, S., & Bildirici, M. (2010). Business cycles around the globe: A regime switching approach (Working Paper No. 1009).
Antulov-Fantulin, N., Cauderan, A., & Kolm, P. N. (2024). A Dynamic Regime-Switching Model Using Gated Recurrent Straight-Through Units. Journal of Financial Data Science, 6(4).
Becker-Ehmck, P., Karl, M., Peters, J., & van der Smagt, P. (2020). Learning to fly via deep model-based reinforcement learning. arXiv preprint arXiv:2003.08876.
Bekaert, G., & Hodrick, R. J. (1992). Characterizing predictable components in excess returns on equity and foreign exchange markets. The Journal of Finance, 47(2), 467-509.
Bollen, N. P., Gray, S. F., & Whaley, R. E. (2000). Regime switching in foreign exchange rates:: Evidence from currency option prices. Journal of Econometrics, 94(1-2), 239-276.
Bollerslev, T. (1986). Generalized autoregressive conditional heteroskedasticity. Journal of econometrics, 31(3), 307-327.
Chen, L., M. Pelger, & J. Zhu (2019). Deep learning in asset pricing. Available at SSRN3350138
Chow, S. M., & Zhang, G. (2013). Nonlinear regime-switching state-space (RSSS) models. Psychometrika, 78(4), 740-768.
Christensen, K., Siggaard, M., & Veliyev, B. (2023). A machine learning approach to volatility forecasting. Journal of Financial Econometrics, 21(5), 1680-1727.
Cont, R. (2007). Long memory in economics. In Returns clustering in financial markets: Empirical facts and agent-based models (pp. 289–309). Springer.
Dong, H., Chen, L., Zhang, X., Failler, P., & Xu, S. (2020). The asymmetric effect of volatility spillover in global virtual financial asset markets: the case of Bitcoin. Emerging Markets Finance and Trade, 56(6), 1293-1311.
Engle, R. F. (1982). Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation. Econometrica: Journal of the econometric society, 987–1007. https://doi.org/10.2307/1912773
Farnoosh, A., Azari, B., & Ostadabbas, S. (2021, May). Deep switching auto-regressive factorization: Application to time series forecasting. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 35, No. 8, pp. 7394–7403). AAAI Press.
Frömmel, M., MacDonald, R., & Menkhoff, L. (2005). Markov switching regimes in a monetary exchange rate model. Economic Modelling, 22(3), 485-502.
Gu, S., Kelly, B., & Xiu, D. (2020). Empirical asset pricing via machine learning. The Review of Financial Studies, 33(5), 2223–2273.
Hamilton, J. D. (1989). A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle. Econometrica, 57(2), 357–384
Johnson, P., Szabó, D. Z., & Duck, P. (2024). Optimal trading with regime switching: Numerical and analytic techniques applied to valuing storage in an electricity balancing market. European Journal of Operational Research, 319(2), 611-624.
Kurle, R., Rangapuram, S. S., de Bézenac, E., Günnemann, S., & Gasthaus, J. (2020). Deep rao-blackwellised particle filters for time series forecasting. Advances in Neural Information Processing Systems, 33, 15371-15382.
Liao, R., Yamaka, W., & Sriboonchitta, S. (2020). Exchange rate volatility forecasting by hybrid neural network Markov switching Beta-t-EGARCH. IEEE Access, 8, 207563-207574.
Maheu, J. M., & McCurdy, T. H. (2002). Nonlinear features of realized FX returns. Rev. Econ. Statist., 84(4), 668-681.
Mari, C., & Mari, E. (2023). Deep learning based regime-switching models of energy commodity prices. Energy Systems, 14(4), 913-934.
Nassar, J., Linderman, S. W., Bugallo, M., & Park, I. M. (2018). Tree-structured recurrent switching linear dynamical systems for multi-scale modeling. arXiv.
Nelson, D. B. (1992). Filtering and forecasting with misspecified ARCH models I. Journal of Econometrics, 52(1–2), 61–90.
Nelson, D. M. Q., Pereira, A. C. M., & De Oliveira, R. A. (2017). Stock market’s price movement prediction with LSTM neural networks. International Joint Conference on Neural Networks (IJCNN. https://doi.org/10.1109/ijcnn.2017.7966019
Nguyen, L. H., Chao, D., Lim, J. K., Ayoub, W., & Nguyen, M. H. (2014). Histologic changes in liver tissue from patients with chronic hepatitis B and minimal increases in levels of alanine aminotransferase: a meta-analysis and systematic review. Clinical gastroenterology and hepatology, 12(8), 1262-1266.
Owyang, M. T., & Ramey, G. (2004). Regime switching and monetary policy measurement. Journal of Monetary Economics, 51(8), 1577-1597.
Roy, G., & Sarkar, P. (2024). A Systematic Review on Impact of Political Crisis and Election on Capital Market Returns. Available at SSRN 4939289.
Rydén, T. (2008). EM versus Markov chain Monte Carlo for estimation of hidden Markov models: A computational perspective.
Shah, D., Campbell, W., & Zulkernine, F. H. (2018). A comparative study of LSTM and DNN for stock market forecasting. In 2018 IEEE International Conference on Big Data (Big Data) (pp. 4148–4155). IEEE. https://doi.org/10.1109/BigData.2018.8622462
Sims, C. A., & Zha, T. (2006). Were there regime switches in US monetary policy?. American Economic Review, 96(1), 54-81.
Sunny, M. A. I., Maswood, M. M. S., &Alharbi, A. G. (2020). Deep learning-based stock price prediction using LSTM and bi-directional LSTM model. 2020 2nd Novel Intelligent and Leading Emerging Sciences Conference (NILES), 87–92. https://doi .org/10.1109/NILES50944.2020.9257950
Valente, G. (2003). Monetary policy rules and regime shifts. Applied Financial Economics, 13(7), 525-535.
Xiuqin, X., Hanqiu, P., & Ying, C. (2023). Deep switching state space model (DSSSM) for nonlinear time series forecasting with regime switching. arXiv preprint arXiv:2106.02329. https://arxiv.org/abs/2106.02329
Yao, S., Luo, L., &Peng, H. (2018). High-frequency stock trend forecast using LSTM model. 13th International Conference on Computer Science & Education (ICCSE), 1–4. https://doi.org/10.1109/ICCSE.2018.8468703
Zucchini, W., & MacDonald, I. L. (2009). Hidden Markov models for time series: An introduction using R. Chapman and Hall/CRC.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Oluwasegun Agbailu Adejumo, Omorogbe Joseph Asemota, Samuel Olayemi Olanrewaju

This work is licensed under a Creative Commons Attribution 4.0 International License.