Catalog Home Page

Improving three layer neural net convergence

Alder, M., Sok, G.L., Hadingham, P. and Attikiouzel, Y. (1991) Improving three layer neural net convergence. In: Second International Conference on Artificial Neural Networks, 18 - 20 November, Bournemouth, UK pp. 318-322.

[img]
Preview
PDF - Published Version
Download (381kB)
Link to Published Version: http://ieeexplore.ieee.org/xpl/articleDetails.jsp?...
*Subscription may be required

Abstract

The authors investigate the relationship between three layer feed forward back-propagation nets (using the terminology of Rumelhart et al., see Nature vol.323, p.533 et seq., 1986) and the committee net of (Nilsson, see Learning Machines, McGraw-Hill, 1956), and show that a simple modification to the algorithm of the latter makes them, in respect of their power to classify data sets, equivalent. Two algorithms may, however, be equivalent in power but differ greatly in their practicality. In the second part the authors conduct some experiments in order to determine whether the modified committee algorithm can compete with back-propagation in a variety of applications. It is found that the committee algorithm (a) is about ten times as fast in some applications and (b) is much less prone to getting trapped in local minima. The theoretical interest in the paper stems from the ease of analysing the committee algorithm together with the equivalence. The experimental interest is that this method of speeding up back-propagation may be used with other improvements to reduce training times in some applications

Publication Type: Conference Paper
Publisher: IEEE
Copyright: © 1991 IEEE
URI: http://researchrepository.murdoch.edu.au/id/eprint/20266
Item Control Page Item Control Page

Downloads

Downloads per month over past year