How iconic gestures enhance communication: An ERP study  

Oleh:

Wu, Ying Choon ; Coulson, Seana

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: Brain and Language (Full Text) vol. 101 no. 3 (2007), page 234-245.
Topik: Gesture; N400; N300; Semantic integration; Language comprehension; Object recognition; Conceptual integration; Embodiment; ERP; Meaning; Simulation
Fulltext: 101_03_Wu.pdf (464.68KB)

Isi artikel

EEG was recorded as adults watched short segments of spontaneous discourse in which the speaker’s gestures and utterances contained complementary information. Videos were followed by one of four types of picture probes: cross-modal related probes were congruent with both speech and gestures; speech-only related probes were congruent with information in the speech, but not the gesture; and two sorts of unrelated probes were created by pairing each related probe with a diVerent discourse prime. Event-related potentials (ERPs) elicited by picture probes were measured within the time windows of the N300 (250–350 ms post-stimulus) and N400 (350–550ms poststimulus). Cross-modal related probes elicited smaller N300 and N400 than speech-only related ones, indicating that pictures were easier to interpret when they corresponded with gestures. N300 and N400 eVects were not due to diVerences in the visual complexity of each probe type, since the same cross-modal and speech-only picture probes elicited N300 and N400 with similar amplitudes when they appeared as unrelated items. These Wndings extend previous research on gesture comprehension by revealing how iconic co-speech gestures modulate conceptualization, enabling listeners to better represent visuo-spatial aspects of the speaker’s meaning.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali