An HMM-Based Speech-to-Video Synthesizer  

Oleh:

Williams, J. J. ; Katsaggelos, A. K.

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: IEEE Transactions on Neural Networks vol. 13 no. 4 (2002), page 900-915.
Topik: SPEECH; HMM - based; speech; video synthesizer

Ketersediaan

Perpustakaan Pusat (Semanggi) Nomor Panggil: II36.7A Non-tandon: 1 (dapat dipinjam: 0) Tandon: tidak ada

Lihat Detail Induk

Isi artikel

Emerging broadband communication systems promise a future of multimedia telephony, e. g. the addition of visual information to telephone conversations. It is useful to consider the problem of generating the critical information useful for speechreading, based on existing narrowband communications systems used for speech. This paper focuses on the problem of synthesizing visual articulatory movements given the acoustic speech signal. In this application, the acoustic speech signal is analyzed and the corresponding articulatory movements are synthesized for speechreading. This paper describes a hidden Markov model (HMM) - based visual speech synthesizer. The key elements in the application of HMM s to this problem are the decomposition of the overall modeling task into key stages and the judicious determination of the observation vector's components for each stage. The main contribution of this paper is a novel correlation HMM model that is able to integrate independently trained acoustic and visual HMM s for speech - to - visual synthesis. This model allows increased flexibility in choosing model topologies for the acoustic and visual HMMs. Moreover the propose model reduces the amount of training data compared to early integration modeling techniques. Results from objective experiments analysis show that the propose approach can reduce time alignment errors by 37.4 % compared to conventional temporal scaling method. Furthermore, subjective results indicated that the purpose model can increase speech understanding.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali