The Cascade-Correlation Learning : A Projection Pursuit Learning Perspective  

Oleh:

Hwang, Jenq-Neng ; You, Shih-Shien ; Lay, Shyh-Rong ; Jou, I-Chang

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: IEEE Transactions on Neural Networks vol. 7 no. 2 (1996), page 278-289.
Topik: projection; cascade - correlation; learning; projection; pursuit

Ketersediaan

Perpustakaan Pusat (Semanggi) Nomor Panggil: II36.1 Non-tandon: 1 (dapat dipinjam: 0) Tandon: tidak ada

Lihat Detail Induk

Isi artikel

Cascade - correlation (Cascor) is a popular supervised learning architecture that dynamically grows layers of hidden neurons of fixed nonlinear activations (e. g., sigmoids), so that the network topology (size, depth) can be efficiently determined. Similar to a cascade - correlation learning network (CCLN), a projection pursuit learning network (PPLN) also dynamically grows the hidden neurons. Unlike a CCLN where cascaded connections from the existing hidden units to the new candidate hidden unit are required to establish high - order nonlinearity in approximating the residual error, a PPLN approximates the high - order nonlinearity by using trainable parametric or semi - parametric nonlinear smooth activations based on minimum mean squared error criterion. An analysis is provided to show that the maximum correlation training criterion used in a CCLN tends to produce hidden units that saturate and thus makes it more suitable for classification tasks instead of regression tasks as evidenced in the simulation results. It is also observed that this critical weakness in CCLN can also potentially carry over to classification tasks, such as the two - spiral benchmark used in the original CCLN paper.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali