Design and Implementation of Parallel Counterpropagation Networks Using MPI
Volume 18, Issue 1 (2007), pp. 79–102
Pub. online: 1 January 2007
Type: Research Article
Received
1 October 2004
1 October 2004
Published
1 January 2007
1 January 2007
Abstract
The objective of this research is to construct parallel models that simulate the behavior of artificial neural networks. The type of network that is simulated in this project is the counterpropagation network and the parallel platform used to simulate that network is the message passing interface (MPI). In the next sections the counterpropagation algorithm is presented in its serial as well as its parallel version. For the latter case, simulation results are given for the session parallelization as well as the training set parallelization approach. Regarding possible parallelization of the network structure, there are two different approaches that are presented; one that is based to the concept of the intercommunicator and one that uses remote access operations for the update of the weight tables and the estimation of the mean error for each training stage.