Temporal Difference Learning Applied to Sequential Detection  

Oleh:

Kuh, A. ; Guo, Chengan

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: IEEE Transactions on Neural Networks vol. 8 no. 2 (1997), page 278-287.
Topik: LEARNING; temporal; difference learning; sequential detection

Ketersediaan

Perpustakaan Pusat (Semanggi) Nomor Panggil: II36.2 Non-tandon: 1 (dapat dipinjam: 0) Tandon: tidak ada

Lihat Detail Induk

Isi artikel

This paper proposes a novel neural - network method for sequential detection, We first examine the optimal parametric sequential probability ratio test (SPRT) and make a simple equivalent transformation of the SPRT that makes it suitable for neural - network architectures. We then discuss how neural networks can learn the SPRT decision functions from observation data and labels. Conventional supervised learning algorithms have difficulties handling the variable length observation sequences, but a reinforcement learning algorithm, the temporal difference (TD) learning algorithm works ideally in training the neural network. The entire neural network is composed of context units followed by a feedforward neural network. The context units are necessary to store dynamic information that is needed to make good decisions. For an appropriate neural - network architecture, trained with independent and identically distributed (iid) observations by the TD learning algorithm, we show that the neural - network sequential detector can closely approximate the optimal SPRT with similar performance. The neural - network sequential detector has the additional advantage that it is a non parametric detector that does not require probability density functions. Simulations demonstrated on iid Gaussian data show that the neural network and the SPRT have similar performance.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali