The Layer-Wise Method and The Backpropagation Hybrid Approach to Learning A Feedforward Neural Network  

Oleh:

Rubanov, N. S.

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: IEEE Transactions on Neural Networks vol. 11 no. 2 (2000), page 295-305.
Topik: Hybrid; layer - wise method; backpropagation; hybrid approach; learning; neural network

Ketersediaan

Perpustakaan Pusat (Semanggi) Nomor Panggil: II36.4 Non-tandon: 1 (dapat dipinjam: 0) Tandon: tidak ada

Lihat Detail Induk

Isi artikel

Feedforward neural networks (FNN s) have been proposed to solve complex problems in pattern recognition and classification and function approximation. Despite the general success of learning methods for FNN s, such as the backpropagation (BP) algorithm, second -order optimization algorithms and layer - wise learning algorithms, several drawbacks remain to be overcome. In particular, two major drawbacks are convergence to a local minima and long learning time. We propose an efficient learning method for a FNN that combines the BP strategy and optimization layer by layer. More precisely, we construct the layer - wise optimization method using the Taylor series expansion of nonlinear operators describing a FNN and propose to update weights of each layer by the BP - based Kaczmarz iterative procedure. The experimental results show that the new learning algorithm is stable, it reduces the learning time and demonstrates improvement of generalization results in comparison with other well - known methods.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali