the dynamics of processing and learning foreign …

1
clown acrobat sausage shirt NP1 verb NP2 The clown will sew the shirt Proportions of trials with at least one inspection to region EYE-MOVEMENTS PHASE 2 (EXP 1) SECOND LANGUAGE ACQUISITION (SLA) IN THE WILD In natural contexts, understanding and learning foreign languages is not trivial: linguistic regularities & idiosyncrasies on all levels are intertwined (i.e. words and grammar) Additionally, visual cues are far from direct: Problem for mapping new words onto referents (referential uncertainty, Gleitman, 1990) How can a learner cope with this situation and, more than that turn the tables exploiting interdependencies between words, sentences, and the visual world? SET-UP Participants: Experiment 1 - 24, Experiment 2 - 20 Miniature artificial language 6 verbs (3 food verbs & 3 clothing verbs) with suffix –(me)ma 12 nouns: 6 characters & 6 objects (3 food items, 3 clothing items) Word order SVO, same article for all NPs (si) Phase 1: People learned 6 verbs (& are tested) Phase 2: Scenes & sentences: learn the 12 nouns (6 agents, 6 objects) Phase 3: Forced choice vocabulary test Phase 4: Sentence judgment test THE DYNAMICS OF PROCESSING AND LEARNING FOREIGN LANGUAGE IN NATURAL CONTEXTS JUDITH KÖHNE (JUDITH@COLI.UNI-SB.DE) & MATTHEW W. CROCKER, SAARLAND UNIVERSITY No proof for bootstrapped noun learning due to verb restrictions and anticipation Visual and linguistic context cues certainly influence both L2 word learning & sentence comprehension in natural contexts (however, possibly in different ways) Phase 2 [Si badut] NP1 [tambamema] verb [si kemei] NP2 . DET clown sew-MEMA DET shirt ‘The clown will sew the shirt.’ Bootstrapping via semantic verb restriction Cross- situational word learning [Si badut] NP1 [bermamema] verb [si jafek] NP2 . DET clown eat-MEMA DET corn ‘The clown will eat the corn.’ References Altmann, G.T.M., & Kamide, Y. (1999). Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition, 73, 247-264. Gleitman, L. (1990). The structural sources of verb meanings. Language Acquisition, 1, 3–55. Wonnacott, E., Newport, E.L., & Tanenhaus, M.K. (2008). Acquiring and processing verb argument structure: Distributional learning in a miniature language. Cognitive Psychology, 56, 165-209. Yu, C. & Smith, L.B. (2007). Rapid word learning under uncertainty via cross-situational statistics. Psychological Science, 18, 414-420. QUESTIONS Does cross-situational word learning work for L2 in natural context, i.e. with words embedded in sentences and referents in scenes? Do semantic verb restrictions bootstrap L2 noun learning? Do visual and linguistic context improve the processing of L2 sentences on-line? Does incremental processing lead to prediction and does this influence L2 noun learning (Altmann & Kamide, 1999; Wonnacott 2008)? RESULTS Sig. bigger difference in looks to target vs. distractor object in verb & NP2 than difference in looks to target vs. distractor character in NP1 Verb-restrictions enhanced inspections on target object & caused anticipatory looks Linguistic context was rapidly exploited & seemed to improve understanding However, objects not learned sig. better than characters No direct evidence for bootstrapping of noun learning Divergence between online comprehension and actual word learning CONCLUSION People were able to use statistical information about co-occurrences of words and referents (cross-situational word learning) even with words embedded in sentences and referents as parts of scenes (>noun learning) Linguistic contextual cues based on already gained knowledge (semantic verb restrictions) were rapidly exploited to understand sentences (eye-movements) 1) Use statistical information about the co-occurrence of referents and words (cross-situational word learning, Yu & Smith, 2007) 2) Use linguistic contextual cues based on already gained knowledge to get more knowledge (linguistic bootstrapping effects) Moreover, how do general automatic sentence processing mechanisms apply to L2 comprehension (incrementality & prediction, rapid integration of contextual cues) EXPERIMENTS 1 & 2 LEARNING PERFORMANCE Nouns learned sig. better than chance (Exp 1: 55% vs. 25% chance; Exp 2: 72%) Sentence judgements Exp 1: 65% - sig. better than chance (50%)

Upload: others

Post on 06-Feb-2022

1 views

Category:

Documents


0 download

TRANSCRIPT

clown

acrobat sausage

shirt

NP1 verb NP2

The clown will sew the shirt

Pro

porti

ons

of tr

ials

with

at l

east

one

insp

ectio

n to

regi

on

EYE-MOVEMENTS PHASE 2 (EXP 1)

SECOND LANGUAGE ACQUISITION (SLA) IN THE WILD

•  In natural contexts, understanding and learning foreign languages is not trivial: linguistic regularities & idiosyncrasies on all levels are intertwined (i.e. words and grammar)

•  Additionally, visual cues are far from direct: Problem for mapping new words onto referents (referential uncertainty, Gleitman, 1990)

•  How can a learner cope with this situation and, more than that turn the tables exploiting interdependencies between words, sentences, and the visual world?

SET-UP

•  Participants: Experiment 1 - 24, Experiment 2 - 20 •  Miniature artificial language •  6 verbs (3 food verbs & 3 clothing verbs) with suffix –(me)ma •  12 nouns: 6 characters & 6 objects (3 food items, 3 clothing items) •  Word order SVO, same article for all NPs (si)

Phase 1: People learned 6 verbs (& are tested) Phase 2: Scenes & sentences: learn the 12 nouns (6 agents, 6 objects) Phase 3: Forced choice vocabulary test Phase 4: Sentence judgment test

THE DYNAMICS OF PROCESSING AND LEARNING FOREIGN LANGUAGE IN NATURAL CONTEXTS JUDITH KÖHNE ([email protected]) & MATTHEW W. CROCKER, SAARLAND UNIVERSITY

•  No proof for bootstrapped noun learning due to verb restrictions and anticipation

➩ Visual and linguistic context cues certainly influence both L2 word learning & sentence comprehension in natural contexts (however, possibly in different ways)

Phase 2

[Si badut]NP1 [tambamema]verb [si kemei]NP2. DET clown sew-MEMA DET shirt ‘The clown will sew the shirt.’

Bootstrapping via semantic verb

restriction

Cross-situational

word learning

[Si badut]NP1 [bermamema]verb [si jafek]NP2. DET clown eat-MEMA DET corn ‘The clown will eat the corn.’

References Altmann, G.T.M., & Kamide, Y. (1999). Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition, 73, 247-264. Gleitman, L. (1990). The structural sources of verb meanings. Language Acquisition, 1, 3–55.

Wonnacott, E., Newport, E.L., & Tanenhaus, M.K. (2008). Acquiring and processing verb argument structure: Distributional learning in a miniature language. Cognitive Psychology, 56, 165-209. Yu, C. & Smith, L.B. (2007). Rapid word learning under uncertainty via cross-situational statistics. Psychological Science, 18, 414-420.

QUESTIONS

•  Does cross-situational word learning work for L2 in natural context, i.e. with words embedded in sentences and referents in scenes?

•  Do semantic verb restrictions bootstrap L2 noun learning?

•  Do visual and linguistic context improve the processing of L2 sentences on-line?

•  Does incremental processing lead to prediction and does this influence L2 noun learning (Altmann & Kamide, 1999; Wonnacott 2008)?

RESULTS

•  Sig. bigger difference in looks to target vs. distractor object in verb & NP2 than difference in looks to target vs. distractor character in NP1 ➩ Verb-restrictions enhanced inspections on target object & caused anticipatory looks ➩ Linguistic context was rapidly exploited & seemed to improve understanding

•  However, objects not learned sig. better than characters ➩ No direct evidence for bootstrapping of noun learning

➥ Divergence between online comprehension and actual word learning

CONCLUSION

•  People were able to use statistical information about co-occurrences of words and referents (cross-situational word learning) even with words embedded in sentences and referents as parts of scenes (>noun learning)

•  Linguistic contextual cues based on already gained knowledge (semantic verb restrictions) were rapidly exploited to understand sentences (eye-movements)

1) Use statistical information about the co-occurrence of referents and words (cross-situational word learning, Yu & Smith, 2007)

2) Use linguistic contextual cues based on already gained knowledge to get more knowledge (linguistic bootstrapping effects)

•  Moreover, how do general automatic sentence processing mechanisms apply to L2 comprehension (incrementality & prediction, rapid integration of contextual cues)

EXPERIMENTS 1 & 2

LEARNING PERFORMANCE

 Nouns learned sig. better than chance (Exp 1: 55% vs. 25% chance; Exp 2: 72%)

  Sentence judgements Exp 1: 65% - sig. better than chance (50%)