On The Structure of Strict Sense Bayesian Cost Functions and Its Application  

Oleh:

Cid-Sueiro, J. ; Figueiras-Vidal, A. R.

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: IEEE Transactions on Neural Networks vol. 12 no. 3 (2001), page 445-455.
Topik: Bayesian; structure; strict sense; bayesian cost; functions; application

Ketersediaan

Perpustakaan Pusat (Semanggi) Nomor Panggil: II36.5 Non-tandon: 1 (dapat dipinjam: 0) Tandon: tidak ada

Lihat Detail Induk

Isi artikel

In the context of classification problems, the paper analyzes the general structure of the strict sense Bayesian (SSB) cost functions, those having a unique minimum when the soft decisions are equal to the posterior class probabilities. We show that any SSB cost is essentially the sum of a generalized measure of entropy, which does not depend on the targets, and an error component. Symmetric cost functions are analyzed in detail. Our results provide a further insight on the behavior of this family of objective functions and are the starting point for the exploration of novel algorithms. Two applications are proposed. First, the use of asymmetric SSB cost functions for posterior probability estimation in non - maximum a posteriori (MAP) decision problems. Second, a novel entropy minimization principle for hybrid learning : use labeled data to minimize the cost function, and unlabeled data to minimize the corresponding entropy measure.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali