1. bookVolume 69 (2021): Issue 2 (June 2021)
Journal Details
License
Format
Journal
First Published
28 Mar 2009
Publication timeframe
4 times per year
Languages
English
access type Open Access

Comparative study of forecasting approaches in monthly streamflow series from Brazilian hydroelectric plants using Extreme Learning Machines and Box & Jenkins models

Published Online: 21 May 2021
Page range: 180 - 195
Received: 24 Mar 2020
Accepted: 29 Nov 2020
Journal Details
License
Format
Journal
First Published
28 Mar 2009
Publication timeframe
4 times per year
Languages
English
Abstract

Several activities regarding water resources management are dependent on accurate monthly streamflow forecasting, such as flood control, reservoir operation, water supply planning, hydropower generation, energy matrix planning, among others. Most of the literature is focused on propose, compare, and evaluate the forecasting models. However, the decision on forecasting approaches plays a significant role in such models’ performance. In this paper, we are focused on investigating and confront the following forecasting approaches: i) use of a single model for the whole series (annual approach) versus using 12 models, each one responsible for predicting each month (monthly approach); ii) for multistep forecasting, the use of direct and recursive methods. The forecasting models addressed are the linear Autoregressive (AR) and Periodic Autoregressive (PAR) models, from the Box & Jenkins family, and the Extreme Learning Machines (ELM), an artificial neural network architecture. The computational analysis involves 20 time series associated with hydroelectric plants indicated that the monthly approach with the direct multistep method achieved the best overall performances, except for the cases in which the coefficient of variation is higher than two. In this case, the recursive approach stood out. Also, the ELM overcame the linear models in most cases.

Keywords

Araujo, L.N., Belotti, J.T., Alves, T.A., Tadano, Y.D.S., Siqueira, H., 2020. Ensemble method based on Artificial Neural Networks to estimate air pollution health risks. Environmental Modelling and Software, 123, 104567. Search in Google Scholar

Arsenault, R., Côté, P., 2019. Analysis of the effects of biases in ensemble streamflow prediction (ESP) forecasts on electricity production in hydropower reservoir management. Hydrology and Earth System Sciences, 23, 2735–2750. https://doi.org/10.5194/hess-23-2735-2019 Search in Google Scholar

Arsenault, R., Latraverse, M., Duchesne, T., 2016. An efficient method to correct under-dispersion in ensemble streamflow prediction of inflow volumes for reservoir optimization. Water Resour. Manage., 30, 4363–4380. https://doi.org/10.1007/s11269-016-1425-4 Search in Google Scholar

Atiya, A.F., El-Shoura, S.M., Shaheen, S.I., El-Sherif, M.S., 1999. A comparison between neural-network forecasting techniques - case study: River flow forecasting. IEEE Trans. on Neural Networks, 10, 2, 402–409. Search in Google Scholar

Bartlett, P.L., 1998. The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network. IEEE Trans. on Information Theory, 44, 2, 525–536. Search in Google Scholar

Belotti, J.T., Siqueira, H., Araujo, L.N., Stevan JR, S.L., Mattos Neto, P.S., Marinho, M.H.N., Oliveira, J.F.L., Usberti, F.L., Leone Filho, M.A., Converti, A., Sarubbo, L., 2020a. Neural-based ensembles and unorganized machines to predict streamflow series from Brazilian hydroelectric plants. Energies, 13, 4769. Search in Google Scholar

Belotti, J.T., Castanho, D.S., Araujo, L.N., Silva, V., Antonini Alves, T., Tadano,Y.S., Stevan Jr., S.L., Corrêa, F.C., Siqueira, H.V., 2020b. Air pollution epidemiology: A simplified generalized linear model approach optimized by bio-inspired metaheuristics. Environmental Research, 191, 110106. Search in Google Scholar

Box, G., Jenkins, G., Reinsel, G.C., 2008. Time Series Analysis, Forecasting and Control. 4nd ed. Wiley. Search in Google Scholar

CEPEL, 2020. PREVIVAZ – Software for Prediction of Daily, Weekly and Monthly Inflows. Electric Energy Research Center (Brazil). Available online: http://www.cepel.br/en_us/products/previvaz-software-for-prediction-of-daily-weekly-and-monthly-inflows-1.htm (accessed on 3rd July, 2020). Search in Google Scholar

Cybenkot, G., 1989. Aproximation by superpositions of a sigmoidal function. Mathematics of Control, Signals, and Systems, 2, 303–314. Search in Google Scholar

de Souza Dias, V., Pereira da Luz, M., Medero, G., Tarley Ferreira Nascimento, D., 2018. An overview of hydropower reservoirs in Brazil: Current situation, future perspectives and impacts of climate change. Water, 10, 5, 592. Search in Google Scholar

Dilini, W.M.N., Attygalle, D., Hansen, L.L., Nandalal, K.D.W., 2016. Ensemble forecast for monthly reservoir inflow; A dynamic neural network approach. In: Proc. 4th Annual International Conference on Operations Research and Statistics. Global Science & Technology Forum, Singapor, pp. 84–90. Search in Google Scholar

EPE, 2019. National Energy Balance. Energy Research Company. Ministry of Mines and Energy, Brazil. Search in Google Scholar

Fendeková, M., Pekárová, P., Fendek, M., Pekár, J., Škoda, P., 2014. Global drivers effect in multi-annual variability of runoff. Journal of Hydrology and Hydromechanics, 62, 3, 169–176. Search in Google Scholar

Feng, G., Qian, Z., Dai., N., 2012. Reversible watermarking via extreme learning machine prediction. Neurocomputing, 82, 62–68. Search in Google Scholar

Francelin, R., Ballini, R. Andrade, M.G., 1996. Backpropagation and Box & Jenkins approaches to streamflow forecasting. In: Proc. Latin-Iberian-American Congress on Operations Research and Systems Engineering – CLAIO, Rio de Janeiro, pp. 1307–1312. Search in Google Scholar

Friedman, M., 1937. The use of ranks to avoid the assumption of normality implicit in the analysis of variance. Journal of the American Statistical Association, 32, 200, 675–701. Search in Google Scholar

Hailegeorgis, T.T., Alfredsen, K., 2017. Regional statistical and precipitation–runoff modelling for ecological applications: Prediction of hourly streamflow in regulated rivers and ungauged basins. River Research and Applications, 33, 2. https://doi.org/10.1002/rra.3006 Search in Google Scholar

Haykin, S., 2008. Neural Networks and Learning Machines. 3th ed. Prentice Hall. Search in Google Scholar

Hernandez-Ambato, J., Asqui-Santillan, G., Arellano, A., Cunalata, C., 2017. Multistep-ahead streamflow and reservoir level prediction using ANN for production planning in hydroelectric stations. In: Proc. 16th IEEE International Conference on Machine Learning and Applications, Cancun, Mexico, pp. 479–484. Search in Google Scholar

Hippel, K.W., McLeod, A.I., 1994. Time Series Modelling of Water Resources and Environmental Systems. Elsevier Science, Amsterdam, The Netherlands. Search in Google Scholar

Honorato, A.G., Silva, G., Guimaraes Santos, C., 2018. Monthly streamflow forecasting using neuro-wavelet techniques and input analysis. Hydrological Sciences Journal, 63, 15–16, 2060–2075. Search in Google Scholar

Huang, G.-B., Zhu, Q.-Y., Siew, C.-K., 2006a. Extreme learning machine: theory and applications. Neurocomputing, 70, 1–3, 489–501. Search in Google Scholar

Huang, G.-B., Chen, L., Siew, C.-K., 2006b. Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans. on Neural Networks, 17, 4, 879–892. Search in Google Scholar

Huang, G.-B., Zhou, H., Ding, X., Zhang, R., 2012. Extreme Learning Machines for regression and multiclass classification. IEEE Transactions on Systems, Man, and Cybernetics – Part B: Cybernetics, 42, 2, 513–529. Search in Google Scholar

Hwang, J.L., Monn, S., 1991. Temporal difference method for multistep prediction: application to power load forecasting. In: Proc. of the First Forum on Application of Neural Networks to Power Systems, Seattle, USA, pp. 41–45. Search in Google Scholar

International Energy Agency, 2012. Technology Roadmap: Hydropower. Available online: http://www.iea.org/publications/freepublications/publication/2012_Hydropower_Roadmap.pdf (accessed on 15 June 2020). Search in Google Scholar

International Hydropower Association, 2020. Hydropower Status Report - sector trends and insights [online]. Available online: https://www.hydropower.org/publications/2020-hydropower-status-report (accessed on 15 June 2020). Search in Google Scholar

Kachba, Y., Genaro Chiroli, D.M., Belotti, J.T., Antonini Alves, T., Souza Tadano, Y., Siqueira, H., 2020. Artificial neural networks to estimate the influence of vehicular emission variables on morbidity and mortality in the largest metropolis in South America. Sustainability, 12, 7, 2621. Search in Google Scholar

Kohavi, R., John, G., 1997. Wrappers for feature subset selection. Artificial Intelligence, 97, 1–2, 273–324. Search in Google Scholar

Liu, Y., Ye, L., Qin, H., Hong, X, Ye, J., Yin, X., 2018. Monthly streamflow forecasting based on hidden Markov model and Gaussian Mixture Regression. Journal of Hydrology, 561, 146–159. Search in Google Scholar

Lizot, M., Andrade Júnior, P.P., Trojan, F., Magacho, C.S., Thesari, S.S., Goffi, A.S., 2020. Analysis of evaluation methods of sustainable supply chain management in production engineering journals with high impact. Sustainability, 12, 270. Search in Google Scholar

Luna, I., Ballini, R., 2011. Top-down strategies based on adaptive fuzzy rule-based systems for daily time series forecasting. Intern. Journal of Forecasting, 27, 3, 708–724. Search in Google Scholar

Luo, X., Yuan, X., Zhu, S., Xu, Z., Meng, L., Peng, J., 2019. A hybrid support vector regression framework for streamflow forecast. Journal of Hydrology, 568, 184–193. Search in Google Scholar

Maceira, M.E.P., Terry, L.A., Costa, F.S., Damázio, J.M.G., Melo, A.C., 2002. Chain of Optimization Models for Setting the Energy DIspach and Price in the Brazilian System. In: 14th Power Systems Computation Conference (PSCC). Sevilla – Espanha. Search in Google Scholar

Maceira, M.E.P., Damázio, J.M., 2004. The use of PAR (p) model in the stochastic dual dynamic programming optimization scheme used in the operation planning of the Brazilian hydropower system. In: 8th International Conference on Probabilistic Methods Applied to Power Systems. Iowa State University, Ames, Iowa. Search in Google Scholar

Mattos Neto, P.S., Marinho, M.H., Siqueira, Hugo, Tadano, Y.S., Antonini Alves, T., Machado, V., Oliveira, J.F.L., Madeiro, F., 2020. A Methodology to Increase the Accuracy of Particulate Matter Predictors Based on Time De composition. Sustainability, 12, 7310. https://doi.org/10.3390/su12187310 Search in Google Scholar

McLeod, A.I., 1994. Diagnostic checking of periodic autoregression models with applications. Journal of Time Series Analysis, 15, 2, 221–233. Search in Google Scholar

Mendes Junior, J.J.A., Freitas, M.L., Siqueira, H.V., Lazzaretti, A.E., Pichorim, S.F., Stevan, JR, S.L., 2020. Feature selection and dimensionality reduction: an extensive comparison in hand gesture classification by sEMG in eight channels armband approach. Biomedical Signal Processing and Control, 59, 1–11. Search in Google Scholar

Miche, Y., Sorjamaa, A., Bas, P., Simula, O., Jutten, C., Lendasse A., 2010. OP-ELM: Optimally pruned extreme learning machine. IEEE Transactions on Neural Networks, 21, 1, 158–162. Search in Google Scholar

Miedema, S.A., 2015. A head loss model for homogeneous slurry transport for medium sized particles. Journal of Hydrology and Hydromechanics, 63, 1, 1–12. Search in Google Scholar

Nelson, M., Hill, T., Remus, T., O’Connor, M., 1999. Time series forecasting using NNs: Should the data be deseasonalized. Journal of Forecasting, 18, 359–367. Search in Google Scholar

ONS, 2019. Electric System National Operator Brazil. Available in: http://www.ons.org.br/operacao/vazoes_naturais.aspx Search in Google Scholar

Puchta, E.P., Lucas, R., Ferreira, F.R.V., Siqueira, H.V., Kaster, M.S., 2016. Gaussian adaptive PID control optimized via genetic algorithm applied to a step-down DCDC converter. In: Proc. 12th IEEE International Conference on Industry Applications (INDUSCON), Curitiba, Brazil, pp. 1–6. Search in Google Scholar

Puchta, E.P., Siqueira, H., Kaster, M.S., 2020. Optimization tools based on metaheuristics for performance enhancement in a Gaussian adaptive PID controller. IEEE Transactions on Cybernetics, 50, 1–10. Search in Google Scholar

Santana Jr., C.J., Macedo, M.G.M., Siqueira, H., Gokhale, A.A., Bastos-Filho, C.J.A., 2019. A novel binary artificial bee colony algorithm. Future Generation Computer Systems, 98, 180–196. Search in Google Scholar

Santos, P., Macedo, M., Figueiredo, E., Santana Jr. C., Soares, F., Siquera, H., Maciel, A., Gokhale, A., Bastos-Filho, C.J.A., 2018. Application of PSO-based clustering algorithms on educational databases. In: Annals of the IEEE Latin American Conference on Computational Intelligence (LACCI), Guadalajara, Mexico, pp. 1–6. Search in Google Scholar

Silva, N., Siqueira, I., Okida, S., Stevan Jr., S.L., Siqueira, H., 2019. Neural networks for predicting prices of sugarcane derivatives. Sugar Tech., 21, 514–523. Search in Google Scholar

Siqueira, H., Boccato, L., Attux, R., Lyra Filho, C., 2012a. Echo state networks for seasonal streamflow series prediction. Lecture Notes in Computer Science. 7435, 226–236. Search in Google Scholar

Siqueira, H., Boccato, L., Attux, R., Lyra Filho, C., 2012b. Echo state networks for seasonal streamflow series prediction. Lecture Notes in Computer Science, 7664, 491–500. Search in Google Scholar

Siqueira, H.V., Boccato, L., Attux, R., Lyra, C., 2014. Unorganized machines to seasonal straemflow series forecasting. International Journal of Neural Systems, 24, 3, 1430009. Search in Google Scholar

Siqueira, H., Boccato, L., Luna, I., Attux, R., Lyra, C., 2018. Performance analysis of unorganized machines in streamflow forecasting of Brazilian plants. Applied Soft Computing, 68, 494–506. Search in Google Scholar

Siqueira, H., Luna, I., 2019. Performance comparison of feedforward neural networks applied to stream flow series forecasting. Mathematics in Engineering, Science and Aerospace, 10, 41–53. Search in Google Scholar

Siqueira, H., Luna, I., Alves T.A., Tadano, Y.S., 2019. The direct connection between box & Jenkins methodology and adaptive filtering theory. Mathematics in Engineering, Science and Aerospace, 10, 27–40. Search in Google Scholar

Siqueira, H., Macedo, M.G.M., Tadano, Y.S., Alves T.A., Stevan Jr, S.L., Santos Jr. D., Marinho, M.H.N., Mattos Neto, P.S., Oliveira, Luna, I., F. L., Leone Filho, M. A., Sarubbo, L., Converti, A., 2020a. Selection of temporal lags for predicting riverflow series from hydroelectric plants using variable selection methods. Energies, 13, 4769. Search in Google Scholar

Siqueira, H., Tadano, Y.S., Alves, T.A., Attux, R., Lyra Filho, C., 2020b. Deseasonalization methods in seasonal streamflow series forecasting. In: New Trends in Computational Vision and Bio-inspired Computing. Springer International Publishing, pp. 1551–1560. Search in Google Scholar

Siqueira, H., Santana Jr., C.J., Macedo, M.G.M., Figueiredo E., Gokhale, A.A., Bastos-Filho, C.J.A., 2020c. Simplified binary cat swarm optimization. Integrated Computer-Aided Engineering, 28, 1–15. Search in Google Scholar

Sorjamaa, A., Hao, J., Reyhani, N., Ji, Y., Lendasse, A., 2007. Methodology for long-term prediction of time series. Neurocomputing, 70, 2861–2869. Search in Google Scholar

Stedinger, J.R., 2001. Report on the Evaluation of CEPEL’s PAR Models. Technical Report. School of Civil and Environmental Engineering, Cornell University, Ithaca, New York. Search in Google Scholar

Stojković, M., Kostić, S., Prohaska, S., Plavšić, J., Tripković, V., 2017. A new approach for trend assessment of annual streamflows: a case study of hydropower plants in Serbia. Water Resour. Manage., 31, 1089–1103. Search in Google Scholar

Tadano, Y.S., Siqueirra, H.V., Alves, T.A., 2016. Unorganized machines to predict hospital admissions for respiratory diseases. In: Annals of the 2016 IEEE Latin American Conference on Computational Intelligence (LACCI), Cartagena, Columbia, p. 1. Search in Google Scholar

Tang, Z., de Almeida, C., Kadane, J.B., 1991. Time series forecasting using Neural Networks vs. Box-Jenkins methodology. Simulation, 57, 5, 303–310. Search in Google Scholar

Tayyab, M., Zhou, J., Adnan, R., Meng, C., Zahra, A., 2016. Streamflow prediction by applying generalized regression network with time series decomposition method. Indonesian Journal of Electrical Engineering and Computer Science, 4, 3, 611–616. Search in Google Scholar

Thesari, S.S., Trojan, F., Batistus, D.R., 2019. A decision model for municipal resources management. Management Decision, 57, 11, 3015–3034. Search in Google Scholar

Tsay, R.S., 2005. Analysis of Financial Time Series. 2nd edn. Wiley & Sons. Search in Google Scholar

Uamusse, M., Ndalila, P., Tsamba, A.J., de Oliveira Carvalho, F., Person, K., 2015. Monthly stream flow predition in Pungwe River for small hydropower plant using wavelet method. International Journal of Energy and Power Engineering, 4, 280–286. Search in Google Scholar

Vecchia, A.V., 1985. Maximum likehood estimation fo periodic autoregressive-moving average models. Technometrics, 27, 4, 375–384. Search in Google Scholar

Wang, Y., Cao, F., Yuan, Y., 2011. A study on effectiveness of extreme learning machine. Neurocomputing, 74, 16, 2483–2490. Search in Google Scholar

Wei, S., Yang, H., Song, J., Abbaspour, K., Xu, Z., 2013. A wavelet-neural network hybrid modelling approach for estimating and predicting river monthly flows. Hydrological Sciences Journal, 58, 2, 374–389. Search in Google Scholar

Yang, T., Gao, X., Sellars, S.L., Sorooshian, S., 2015. Improving the multi-objective evolutionary optimization algorithm for hydropower reservoir operations in the California Oroville–Thermalito complex. Environmental Modelling & Software, 69, 262–279. Search in Google Scholar

Yang, T., Gao, X., Sorooshian, S., Li, X., 2016. Simulating California reservoir operation using the classification and regression-tree algorithm combined with a shuffled cross-validation scheme. Water Resources Research, 52, 3, 1626–1651. Search in Google Scholar

Yang, T., Asanjan, A.A., Welles, E., Gao, X., Sorooshian, S., Liu, X., 2017. Developing reservoir monthly inflow forecasts using artificial intelligence and climate phenomenon information. Water Resources Research, 53, 4, 2786–2812. Search in Google Scholar

Yang, T., Liu, X., Wang, L., Bai, P., Li, J., 2020. Simulating hydropower discharge using multiple decision tree methods and a dynamical model merging technique. Journal of Water Resources Planning and Management, 146, 2, 04019072. Search in Google Scholar

Yaseen, Z.M., Kisi, O., Demir, V., 2016a. Enhancing long-term streamflow forecasting and predicting using periodicity data component: Application of artificial intelligence. Water Resources Management, 30, 4125–4151. https://doi.org/10.1007/s11269-016-1408-5 Search in Google Scholar

Yaseen, A.M., Jaafar, O., Deo, R.C., Kisi, O., Adamowski, J., Quilty, J., El-Shafie, A., 2016b. Stream-flow forecasting using extreme learning machines: A case study in a semi-arid region in Iraq. Journal of Hydrology, 542, 603–614. Search in Google Scholar

Yaseen, Z.M., Ebtehaj, I., Bonakdari, H., Deo, R.C., Mehr, A.D., Mohtar, W., Diop, L., El-Shafie, A Singh, V.P., 2017. Novel approach for streamflow forecasting using a hybrid ANFIS-FFA model. Journal of Hydrology, 554, 263–276. Search in Google Scholar

Zhang, D., Lin, J., Peng, Q., Wang, D., Yang, T., Sorooshian, S., Liu, X., Zhuang, J., 2018. Modeling and simulating of reservoir operation using the artificial neural network, support vector regression, deep learning algorithm. Journal of Hydrology, 565, 720–736. Search in Google Scholar

Zhou, T., Voisin, N., Fu, T., 2018. Non-stationary hydropower generation projections constrained by environmental and electricity grid operations over the western United States. Environmental Research Letters, 13, 7, 074035. Search in Google Scholar

Zhu, S., Zhou, J., Ye, L., Meng, C., 2016. Streamflow estimation by support vector machine coupled with different methods of time series decomposition in the upper reaches of Yangtze River, China. Environ. Earth Sci., 75, 531. https://doi.org/10.1007/s12665-016-5337-7. Search in Google Scholar

Recommended articles from Trend MD

Plan your remote conference with Sciendo