Anda belum login :: 03 Dec 2023 03:48 WIB
Temporal Difference Learning Applied to Sequential Detection
Article from Journal - ilmiah internasional
IEEE Transactions on Neural Networks vol. 8 no. 2 (1997)
Perpustakaan Pusat (Semanggi)
1 (dapat dipinjam: 0)
Lihat Detail Induk
This paper proposes a novel neural - network method for sequential detection, We first examine the optimal parametric sequential probability ratio test (SPRT) and make a simple equivalent transformation of the SPRT that makes it suitable for neural - network architectures. We then discuss how neural networks can learn the SPRT decision functions from observation data and labels. Conventional supervised learning algorithms have difficulties handling the variable length observation sequences, but a reinforcement learning algorithm, the temporal difference (TD) learning algorithm works ideally in training the neural network. The entire neural network is composed of context units followed by a feedforward neural network. The context units are necessary to store dynamic information that is needed to make good decisions. For an appropriate neural - network architecture, trained with independent and identically distributed (iid) observations by the TD learning algorithm, we show that the neural - network sequential detector can closely approximate the optimal SPRT with similar performance. The neural - network sequential detector has the additional advantage that it is a non parametric detector that does not require probability density functions. Simulations demonstrated on iid Gaussian data show that the neural network and the SPRT have similar performance.
Klik untuk menuliskan opini Anda tentang koleksi ini!
Copyright © 2006, 2007
Unika Atma Jaya
, all rights reserved
Process time: 0 second(s)