Advanced Neural-Network Training Algorithm With Reduced Complexity Based on Jacobian Deficiency  

Oleh:

Zhou, G. ; Si, J.

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: IEEE Transactions on Neural Networks vol. 9 no. 3 (1998), halaman 448-453.
Topik: jacobian matrix; neural - network; training algorithm; reduced complexity; jacobian deficiency

Ketersediaan

Perpustakaan Pusat (Semanggi) Nomor Panggil: II36.3 Non-tandon: 1 (dapat dipinjam: 0) Tandon: tidak ada

Lihat Detail Induk

Isi artikel

We introduce an advanced supervised training method for neural networks. It is based on Jacobian rank deficiency and it is formulated, in some sense, in the spirit of the Gauss - Newton algorithm. The Levenberg - Marquardt algorithm, as a modified Gauss - Newton, has been used successfully in solving non linear least squares problems including neural - network training. It out performs the basic backpropagation and its variations with variable learning rate significantly, but with higher computation and memory complexities within each iteration. The mew method developed in this paper is aiming at improving convergence properties, while reducing the memory and computation complexities in supervised training of neural networks. Extensive simulation results are provided to demonstrate the superior performance of the new algorithm over the Levenberg - Marquardt algorithm.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali