An intentional stance modulates the integration of gesture and speech during comprehension  

Oleh:

Kelly, Spencer D. ; Ward, Sarah ; Creigh, Peter ; Bartolotti, James

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: Brain and Language (Full Text) vol. 101 no. 3 (2007), page 222-233.
Topik: Gesture; Speech; Language; Brain; Verbal; Nonverbal; Controlled; Semantic; Intention; N400
Fulltext: 101_03_Kelly.pdf (810.88KB)

Isi artikel

The present study investigates whether knowledge about the intentional relationship between gesture and speech inXuences controlled processes when integrating the two modalities at comprehension. Thirty-Wve adults watched short videos of gesture and speech that conveyed semantically congruous and incongruous information. In half of the videos, participants were told that the two modalities were intentionally coupled (i.e., produced by the same communicator), and in the other half, they were told that the two modalities were not intentionally coupled (i.e., produced by diVerent communicators). When participants knew that the same communicator produced the speech and gesture, there was a larger bi-lateral frontal and central N400 eVect to words that were semantically incongruous versus congruous with gesture. However, when participants knew that diVerent communicators produced the speech and gesture—that is, when gesture and speech were not intentionally meant to go together—the N400 eVect was present only in right-hemisphere frontal regions. The results demonstrate that pragmatic knowledge about the intentional relationship between gesture and speech modulates controlled neural processes during the integration of the two modalities.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali