Informatica

Considering the landscape information of the optimization problem represents a promising research direction, as landscape features can provide a metaheuristic algorithm with useful information for understanding the search state, allowing it to adjust the search strategy accordingly. As a successful branch of metaheuristic algorithms for solving single-objective bound-constrained problems, however, the original design of differential evolution (DE) does not sufficiently consider information about the landscape of the solution space. To address this, an effective DE based on reinforcement learning (RL) that dynamically selects a suitable mutation operator via landscape information during the convergence process is proposed in this study, which consists of two phases: offline and online. In the “offline” phase, the proposed algorithm uses an RL-based algorithm to construct a learning model to understand the relationships between landscape characteristics and search operators. Then, in the “online” phase, the learning model constructed from the offline phase and a lightweight fitness landscape analysis (FLA) method are used by the DE to dynamically determine the suitable mutation operator based on the search state encountered by DE during the convergence process, which can reduce the costs for the FLA in every iteration. To understand the performance of the proposed algorithm, the CEC2021 and CEC2022 benchmark functions are used to evaluate its search performance against different DE-based algorithms for solving single-objective optimization problems. Simulation results show that the proposed algorithm outperforms other state-of-the-art DE-based algorithms and other DE algorithms based on FLA and RL in most cases.

This paper shows a few novel calculations for wind speed estimation, which is focused around soft computing. The inputs of to the estimators are picked as the wind turbine power coefficient, rotational rate and blade pitch angle. Polynomial and radial basis function (RBF) are applied as the kernel function of Support Vector Regression (SVR) technique to estimate the wind speed in this study. Instead of minimizing the observed training error, SVR_poly and SVR_rbf attempt to minimize the generalization error bound so as to achieve generalized performance. The results are compared with the adaptive neuro-fuzzy (ANFIS) results.

Reinforcement learning addresses the question of how an autonomous agent can learn to choose optimal actions to achieve its goals. Efficient exploration is of fundamental importance for autonomous agents that learn to act. Previous approaches to exploration in reinforcement learning usually address exploration in the case when the environment is fully observable. In contrast, we study the case when the environment is only partially observable. We consider different exploration techniques applied to the learning algorithm “Utile Suffix Memory”, and, in addition, discuss an adaptive fringe depth. Experimental results in a partially observable maze show that exploration techniques have serious impact on performance of learning algorithm.