Distributed Tree-based Machine Learning for Short-Term Load Forecasting with Apache Spark
نویسندگان
چکیده
منابع مشابه
Benchmarking Apache Spark with Machine Learning Applications
We benchmarked Apache Spark with a popular parallel machine learning training application, Distributed Stochastic Gradient Descent for Matrix Factorization [5] and compared the Spark implementation with alternative approaches for communicating model parameters, such as scheduled pipelining using POSIX socket or MPI, and distributed shared memory (e.g. parameter server [13]). We found that Spark...
متن کاملMLlib: Machine Learning in Apache Spark
Apache Spark is a popular open-source platform for large-scale data processing that is well-suited for iterative machine learning tasks. In this paper we present MLlib, Spark’s open-source distributed machine learning library. MLlib provides efficient functionality for a wide range of learning settings and includes several underlying statistical, optimization, and linear algebra primitives. Shi...
متن کاملShort-Term Electricity-Load Forecasting Using a TSK-Based Extreme Learning Machine with Knowledge Representation
Abstract: This paper discusses short-term electricity-load forecasting using an extreme learning machine (ELM) with automatic knowledge representation from a given input-output data set. For this purpose, we use a Takagi-Sugeno-Kang (TSK)-based ELM to develop a systematic approach to generating if-then rules, while the conventional ELM operates without knowledge information. The TSK-ELM design ...
متن کاملCloud Computing for Short-Term Load Forecasting Based on Machine Learning Technique
Short-term electric load forecasting (STLF) plays the main role in making operational decisions in any electrical power system. The implementation of forecasting algorithms collides with the high computational power needed to perform the complex perdition processes on large datasets. In this paper, a cloudbased STLF algorithm is implemented. The performance analysis of the proposed system was c...
متن کاملShort - Term Load Forecasting
This paper presents a novel hybrid method for short-term load forecasting. The system comprises of two artificial neural networks (ANN), assembled in a hierarchical order. The first ANN is a multilayer perceptron (MLP) which functions as integrated load predictor (ILP) for the forecasting day. The output of the ILP is then fed to another, more complex MLP, which acts as an hourly load predictor...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2021
ISSN: 2169-3536
DOI: 10.1109/access.2021.3072609