INTERNATIONAL JOURNAL OF LATEST TECHNOLOGY IN ENGINEERING,
MANAGEMENT & APPLIED SCIENCE (IJLTEMAS)
ISSN 2278-2540 | DOI: 10.51583/IJLTEMAS | Volume XIII, Issue XII, December 2024
www.ijltemas.in Page 17
Modeling and Simulation of ‘Univariate and Multivariate analytics’ by
applying ‘Deep Learning and Machine Learning’ Application of
Support Vector Regression, Random Forest, K-Nearest Neighbors,
Long Short-Term Memory and Gated Recurrent Units Algorithms for
Time Series forecasting in the Neural Network Model.
Ashraf Shahriar
Department of Electrical and Computer Engineering (ECE), North South University, Bangladesh.
DOI : https://doi.org/10.51583/IJLTEMAS.2024.131202
Received: 05 December 2024; Accepted: 16 December 2024; Published: 30 December 2024
Abstract: The research focuses on the modeling and simulation of univariate and multivariate time series analysis by applying machine
learning (ML) and deep learning (DL) techniques for accurate forecasting. The study includes the individuals and combined application
of algorithms such as Support Vector Regression (SVR), Random Forest (RF), K-Nearest Neighbors (KNN), Long Short-Term Memory
(LSTM), and Gated Recurrent Units (GRU) in the context of neural networks. These techniques are evaluated for their analytical
performance in a number of time series estimation settings. ML approaches are known for their simplicity and efficiency in small data
sets. On the other hand, DL approaches require larger data sets and more computational resources, but offer higher accuracy and
flexibility in demanding setups. The study concludes by highlighting the importance of choosing the right algorithm based on the nature
of the data and the forecast object. The results provide valuable insights for applications in finance, energy, healthcare, and other fields
where time series forecasting plays an important role. Future research may consider hybrid and interpretability-enhanced approaches to
develop applications of these models in real-world settings. In this study, for the forecasting specification especially Univariate analysis,
the demonstrations show the actual values for the past 15 days and the forecasts for each model for the next 10 days.
Key words: Univariate, Multivariate, SVR, RF, KNN, LSTM, GRU, Bangladesh, Time Series, Sylhet, Time Series, Neural networking.
I. Introduction
This study investigates and compares the effectiveness of SVR, RF, KNN, LSTM, and GRU algorithms in forecasting univariate and
multivariate time series. By integrating these models in a neural network context, the study attempts to provide insight into their
performance and classify the best methods for different forecasting scenarios. Furthermore, the study investigates the trade-off between
ML and DL techniques in terms of forecast accuracy, computational power, and model complexity. In this framework, univariate time
series studies are concerned with forecasting a single time-dependent variable, while multivariate time series forecasting includes
multiple variables that may be interrelated or affect each other. The challenge of multivariate forecasting lies in modeling the complex
relationships between these sets of variables. Therefore, it is important to apply algorithms that are suitable to include such dynamics.
The results of this study are expected to benefit practitioners and researchers in areas where time series research is important by
providing guidance for selecting appropriate task prediction models. The study area is located in Sylhet district of Bangladesh, at
longitude 92.16 and latitude 24.8392.
II. Methodology
A. This systematic method guarantees a complete assessment of ML and DL algorithms, presenting actionable insights into their
suitability for univariate and multivariate time collection forecasting applications.
B. Data Collection and Preprocessing
Data Sources: Data Sources: Appropriate statistics were gathered from NASA for Multivariate and BWDB for univariate time
collection evaluation.
Data Cleaning: Data Cleaning: Missing values have been dealt with via way of means of imputation techniques and the outliers
have been perceived and indifferent to make certain statistics excellence.
Normalization: The statistics became standardized the use of performances like Min-Max Scaling to enhance version schooling
and convergence, specifically for DL algorithms.
Feature Engineering: For multivariate analytics, correlation evaluation became directed to categorize the important things and
systems that effect the goal variable. Lag systems, transferring averages, and different time-structured variables have been
formed to seize temporal shapes.