Identification of the Optimal Neural Network Architecture for Prediction of Bitcoin Return
Pub. online: 9 July 2024
Type: Research Article
Open Access
Open Access
Received
1 February 2024
1 February 2024
Accepted
1 June 2024
1 June 2024
Published
9 July 2024
9 July 2024
Abstract
Neural networks (NNs) are well established and widely used in time series forecasting due to their frequent dominance over other linear and nonlinear models. Thus, this paper does not question their appropriateness in forecasting cryptocurrency prices; rather, it compares the most commonly used NNs, i.e. feedforward neural networks (FFNNs), long short-term memory (LSTM) and convolutional neural networks (CNNs). This paper contributes to the existing literature by defining the appropriate NN structure comparable across different NN architectures, which yields the optimal NN model for Bitcoin return forecasting. Moreover, by incorporating turbulent events such as COVID and war, this paper emerges as a stress test for NNs. Finally, inputs are carefully selected, mostly covering macroeconomic and market variables, as well as different attractiveness measures, the importance of which in cryptocurrency forecasting is tested. The main results indicate that all NNs perform the best in an environment of bullish market, where CNNs stand out as the optimal models for continuous dataset, and LSTMs emerge as optimal in direction forecasting. In the downturn periods, CNNs stand out as the best models. Additionally, Tweets, as an attractiveness measure, enabled the models to attain superior performance.
References
Abu Bakar, N., Rosbi, S. (2017). Autoregressive integrated moving average (ARIMA) model for forecasting cryptocurrency exchange rate in high volatility environment: a new insight of bitcoin transaction. International Journal of Advanced Engineering Research and Scinece, 4(11), 130–137. https://doi.org/10.22161/ijaers.4.11.20.
Aljinović, Z., Marasović, B., Šestanović, T. (2021). Cryptocurrency portfolio selection—a multicriteria approach. Mathematics, 9(14), 1677. https://doi.org/10.3390/math9141677.
Aljinović, Z., Šestanović, T., Škrabić Perić, B. (2022). A new evidence of the relationship between cryptocurrencies and other assets from the covid-19 crisis. Journal of Economics / Ekonomicky casopis, 70(7–8), 603–621. https://doi.org/10.31577/ekoncas.2022.07-8.03.
Azari, A. (2019). Bitcoin Price Prediction: An ARIMA Approach. arXiv:1904.05315.
Bai, J., Perron, P. (1998). Estimating and testing linear models with multiple structural changes. Econometrica, 66, 47–78. http://www.jstor.org/stable/2998540.
Bao, W., Yue, J., Rao, Y. (2017). A deep learning framework for financial time series using stacked autoencoders and long-short term memory. PLoS ONE, 12(7), e0180944. https://doi.org/10.1371/journal.pone.0180944.
Cavalli, S., Amoretti, M. (2021). Cnn-based multivariate data analysis for bitcoin trend prediction. Applied Soft Computing, 101, 107065. https://doi.org/10.1016/j.asoc.2020.107065.
Chen, Z., Li, C., Sun, W. (2020). Bitcoin price prediction using machine learning: an approach to sample dimension engineering. Journal of Computational and Applied Mathematics, 365, 112395. https://doi.org/10.1016/j.cam.2019.112395.
Čorić, R., Matijević, D., Marković, D. (2023). PollenNet – a deep learning approach to predicting airborne pollen concentrations. Croatian Operational Research Review, 14(1), 1–13. https://doi.org/10.17535/crorr.2023.0001.
Diebold, F., Mariano, R. (1995). Comparing predictive accuracy. Journal of Business Economic Statistics, 13, 253–263. https://doi.org/10.1080/07350015.1995.10524599.
Fahmi, A., Samsudin, N., Mustapha, A., Razali, N., Ahmad Khalid, S.K. (2018). Regression based analysis for bitcoin price prediction. International Journal of Engineering & Technology, 7(4.38), 1070–1073. https://doi.org/10.14419/ijet.v7i4.38.27642.
Fawaz, H.I., Forestier, G., Weber, J., Idoumghar, L., Muller, P.A. (2019). Deep learning for time series classification: a review. Data Mining and Knowledge Discovery, 33, 917–963. https://doi.org/10.1007/s10618-019-00619-1.
Franses, P.H., van Dijk, D. (2003). Non-Linear Time Series Models in Empirical Finance. Cambridge University Press. https://doi.org/10.1017/CBO9780511754067.
Greaves, A., Au, B. (2015). Using the bitcoin transaction graph to predict the price of bitcoin. http://snap.stanford.edu/class/cs224w-2015/projects_2015/Using_the_Bitcoin_Transaction_Graph_to_Predict_the_Price_of_Bitcoin.pdf. [29.3.2021].
Han, L.H.N., Hien, N.L.H., Huy, L V., Hieu, N.V. (2024). A deep learning model for multi-domain MRI synthesis using generative adversarial networks. Informatica, 35(2), 283–309. https://doi.org/10.15388/24-INFOR556.
Hegde, J., Rokseth, B. (2020). Applications of machine learning methods for engineering risk assessment – a review. Safety Science, 122, 104492. https://doi.org/10.1016/j.ssci.2019.09.015.
Hornik, K., Stinchcombe, M., White, H. (1989). Multilayer feedforward networks are universal approximators. Neural Networks, 2(5), 359–366. https://doi.org/10.1016/0893-6080(89)90020-8.
Hwarng, H. (2001). Insights into neural-network forecasting of time series corresponding to ARMA(p, q) structures. Omega, 29(3), 273–289. https://doi.org/10.1016/S0305-0483(01)00022-6.
Indera, N., Yassin, I., Zabidi, A., Rizman, Z. (2017). Non-linear autoregressive with exogeneous input (NARX) bitcoin price prediction model using pso and moving average technical indicators. Journal of Fundamental and Applied Sciences, 9(3S), 791–808. https://doi.org/10.4314/jfas.v9i3s.61.
Jang, H., Lee, J. (2017). An empirical study on modeling and prediction of bitcoin prices with bayesian neural networks based on blockchain information. IEEE Access, 6, 5427–5437. https://doi.org/10.1109/ACCESS.2017.2779181.
Jaquart, P., Köpke, S., Weinhardt, C. (2022). Machine learning for cryptocurrency market prediction and trading. The Journal of Finance and Data Science, 8, 331–352. https://doi.org/10.1016/j.jfds.2022.12.001.
Ji, S., Kim, J., Im, H. (2019). A comparative study of bitcoin price prediction using deep learning. Mathematics, 7(10), 898. https://doi.org/10.3390/math7100898.
Kalinić Milićević, T., Marasović, B. (2023). What factors influence bitcoin’s daily price direction from the perspective of machine learning classifiers? Croatian Operational Research Review, 14(2), 163–177. https://doi.org/10.17535/crorr.2023.0014.
Lahmiri, S., Bekiros, S. (2019). Cryptocurrency forecasting with deep learning chaotic neural networks. Chaos, Solitons & Fractals, 118, 35–40. https://doi.org/10.1016/j.chaos.2018.11.014.
Li, Y., Dai, W. (2020). Bitcoin price forecasting method based on CNN-LSTM hybrid neural network model. The Journal of Engineering, 2020(13), 344–347. https://doi.org/10.1049/joe.2019.1203.
Liu, Y., Tsyvinski, A. (2020). Risks and returns of cryptocurrency. The Review of Financial Studies, 34(6), 2689–2727. https://doi.org/10.1093/rfs/hhaa113.
Livieris, I.E., Kiriakidou, N., Stavroyiannis, S., Pintelas, P. (2021). An advanced CNN-LSTM model for cryptocurrency forecasting. Electronics, 10(3), 287. https://doi.org/10.3390/electronics10030287. https://www.mdpi.com/2079-9292/10/3/287.
Madaeni, F., Chokmani, K., Lhissou, R., Homayouni, S., Gauthier, Y., Tolszczuk-Leclerc, S. (2022). Convolutional neural network and long shortterm memory models for ICE-JAM predictions. The Cryosphere, 16(4), 1447–1468. https://doi.org/10.5194/tc-16-1447-2022.
Moshiri, S., Cameron, N. (2000). Neural network versus econometric models in forecasting inflation. Journal of Forecasting, 19(3), 201–217. https://doi.org/10.1002/(sici)1099-131x(200004)19:3lt; 201::aid-for753gt;3.0.co;2-4.
Pabuccu, H., Ongan, S., Ongan, A. (2020). Forecasting the movements of bitcoin prices: an application of machine learning algorithms. Quantitative Finance and Economics, 4(4), 679–692. https://doi.org/10.3934/qfe.2020031.
Paranhos, L. (2021). Predicting Inflation with Neural Networks. arXiv:2104.03757.
Polasik, M., Piotrowska, A.I., Wisniewski, T.P., Kotkowski, R., Lightfoot, G. (2015). Price fluctuations and the use of bitcoin: an empirical inquiry. International Journal of Electronic Commerce, 20(1), 9–49. https://doi.org/10.1080/10864415.2016.1061413.
Poyser, O. (2017). Exploring the Determinants of Bitcoin’s Price: An Application of Bayesian Structural Time Series. arXiv:1706.01437.
Purwandari, K., Sigalingging, J.W.C., Cenggoro, T.W., Pardamean, B. (2021). Multi-class weather forecasting from twitter using machine learning aprroaches. Procedia Computer Science, 179, 47–54. https://doi.org/10.1016/j.procs.2020.12.006.
Sezer, O.B., Gudelek, M.U., Ozbayoglu, A.M. (2020). Financial Time Series Forecasting with Deep Learning: A Systematic Literature Review: 2005–2019. arXiv:1911.13288.
Šestanović, T. (2024). A comprehensive approach to Bitcoin forecasting using neural networks. Ekonomski pregled, 75(1), 62–85. https://doi.org/10.32910/ep.75.1.3.
Šestanović, T., Arnerić, J. (2020). Neural network structure identification in inflation forecasting. Journal of Forecasting, 40(1), 62–79. https://doi.org/10.1002/for.2698.
Trimborn, S., Li, M., Härdle, W.K. (2019). Investing with cryptocurrencies – a liquidity constrained investment approach. Journal of Financial Econometrics, 18(2), 280–306. https://doi.org/10.1093/jjfinec/nbz016.
Uras, N., Marchesi, L., Marchesi, M., Tonelli, R. (2020). Forecasting bitcoin closing price series using linear regression and neural networks models. PeerJ Computer Science, 6, e279. https://doi.org/10.7717/peerj-cs.279.
Walther, T., Klein, T., Bouri, E. (2019). Exogenous drivers of bitcoin and cryptocurrency volatility – a mixed data sampling approach to forecasting. Journal of International Financial Markets, Institutions and Money, 63, 101133. https://doi.org/10.1016/j.intfin.2019.101133.
Zhang, Z., Dai, H.N., Zhou, J., Mondal, S.K., García, M.M., Wang, H. (2021). Forecasting cryptocurrency price using convolutional neural networks with weighted and attentive memory channels. Expert Systems with Applications, 183, 115378. https://doi.org/10.1016/j.eswa.2021.115378.
Biographies
Šestanović Tea
T. Šestanović obtained her PhD in economics in 2017. She is currently an assistant professor at University of Split, Faculty of Economics, Business and Tourism. She is teaching statistics and similar courses on all levels of studies, as well as business decision making. She is a president of Croatian Operational Research Society (CRORS) and an editor-in-chief of Croatian Operational Research Review (CRORR). Her main scientific interests are time series, neural networks, financial modelling and statistics.
Kalinić Milićević Tea
T. Kalinić Milićević is a teaching assistant at University of Split, Faculty of Economics, Business and Tourism (FEBT). She graduated in mathematics from University of Split, Faculty of Science, and she finished postgraduate specialist study program in business economics on FEBT. She is teaching mathematics, quantitative methods, financial modelling and actuarial analysis. She is a treasurer at Croatian Operational Research society (CRORS). Her main scientific interests are machine learning models, financial modelling, actuarial science and optimization.
