Constructive Neural Networks

Constructive Neural Networks

Author: Leonardo Franco

Publisher: Springer

Published: 2009-11-25

Total Pages: 296

ISBN-13: 364204512X

DOWNLOAD EBOOK

This book presents a collection of invited works that consider constructive methods for neural networks, taken primarily from papers presented at a special th session held during the 18 International Conference on Artificial Neural Networks (ICANN 2008) in September 2008 in Prague, Czech Republic. The book is devoted to constructive neural networks and other incremental learning algorithms that constitute an alternative to the standard method of finding a correct neural architecture by trial-and-error. These algorithms provide an incremental way of building neural networks with reduced topologies for classification problems. Furthermore, these techniques produce not only the multilayer topologies but the value of the connecting synaptic weights that are determined automatically by the constructing algorithm, avoiding the risk of becoming trapped in local minima as might occur when using gradient descent algorithms such as the popular back-propagation. In most cases the convergence of the constructing algorithms is guaranteed by the method used. Constructive methods for building neural networks can potentially create more compact and robust models which are easily implemented in hardware and used for embedded systems. Thus a growing amount of current research in neural networks is oriented towards this important topic. The purpose of this book is to gather together some of the leading investigators and research groups in this growing area, and to provide an overview of the most recent advances in the techniques being developed for constructive neural networks and their applications.


Executive Functions and Constructive Neural Networks

Executive Functions and Constructive Neural Networks

Author: John Larry Stricker

Publisher:

Published: 2004

Total Pages: 268

ISBN-13:

DOWNLOAD EBOOK

The present work explores how executive functions can be implemented in neural networks. Computational models such as neural networks allow researchers to develop more sophisticated conceptualizations of how executive functioning could be implemented in the brain. However, most computational models are designed only to solve a single problem rather than to solve multiple problems and integrate new and old knowledge. The problem domain for the models of the present work consists of Boolean logic expressions. These expressions easily lend themselves to implementation in neural networks while at the same time they can represent a range of problems that relate to executive functions, such as learning complementary vs. unrelated information. Network architectures and training regimes are developed that allow neural networks to solve multiple problems constructively while minimizing the impact of interference. The networks illustrate that the constructive learning of multiple problems does not require an executive controller, separate memory systems, or the constructive addition of learning resources.


Constructive Learning

Constructive Learning

Author: Rajesh Girish Parekh

Publisher:

Published: 1998

Total Pages: 456

ISBN-13:

DOWNLOAD EBOOK

This dissertation focuses on two important areas of machine learning research - regular grammar inference and constructive neural network learning algorithms. Regular grammar inference is the process of learning a target regular grammar or equivalently a deterministic finite state automaton (DFA) from labeled examples. We focus on the design of efficient algorithms for learning DFA where the learner is provided with a representative set of examples for the target concept and additionally might be guided by a teacher who answers membership queries. DFA learning algorithms typically map a given structurally complete set of examples to a lattice of finite state automata. Explicit enumeration of this lattice is practically infeasible.