role-plays for call: system architecture and resources sabrina wilske & magdalena wolska...
TRANSCRIPT
![Page 1: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/1.jpg)
Role-plays for CALL: System Architecture and Resources
Sabrina Wilske & Magdalena [email protected]
Saarland University
ICL, Villach, September 2008
![Page 2: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/2.jpg)
© 2008 Wilske & Wolska2
Motivation
• Practicing communicative skills is an important aspect in foreign language learning (→ Communicative Approach)
• One technique: role-plays - interactive activity grounded in a well-defined authentic real-world situation
• Learner has a task or a problem to solve
• Basic social interactions (greetings, introductions)
• Hotel booking, ordering in a restaurant, shopping, etc.
• What if you don't have anyone around to conduct role-plays with?
→ Use a computer!
![Page 3: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/3.jpg)
© 2008 Wilske & Wolska3
Goals
• Dialogue system for roleplay-like dialogues
• Use insights from dialogue systems technology to build an architecture for language learning dialogues
whose resources (e.g. linguistic) can be authored by non-technical developers (e.g. language teachers)
• long term objective: spoken interaction present prototype: type-written
![Page 4: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/4.jpg)
© 2008 Wilske & Wolska4
Goals - Example Target Dialogues
W1: Good evening, Sir.
G1: Good evening.
W2: What would you like as a starter?
G2: Can you bring me a green salad, please?
W3a: Sure.
W3b: What would you like for the main course?
G3: I’d like the Marinated Flank Steak.
W4: How would you like your steak: rare, medium, or well done?
G4: Well done, please.
W5: Alright.
W1: Good Evening, are you ready to order?
G1: Sure, what would you recommend for a starter?
W2: Our Caesar Salad is very good.
G2: I’ll have the Caesar Salad then.
W3a: Okay.
W3b: And what would you like for the main course?
G3: Could I have the Beef Stroganov?
W4: Sure. Would you like potatoes or rice with that?
G4: I’ll have the potatoes please.
W5: Okay..
![Page 5: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/5.jpg)
© 2008 Wilske & Wolska5
Goals: Dialogue Activity
• Various scenarios (in a hotel, in a restaurant, ...)
• Different configurations of a particular scenario
• Different instantiations of the scenario setup (e.g. different restaurants, different menus)
• Following different paths in a dialogue (e.g. order a starter or not)
• Using different realizations of communicative goals
![Page 6: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/6.jpg)
© 2008 Wilske & Wolska6
Outline
• System Architecture
• Overview on Components
• Language Model
• Dialogue Model
• Domain Model
• Interaction between Components
• Illustrating Example
• Summary
• Problems, Further Work
![Page 7: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/7.jpg)
© 2008 Wilske & Wolska7
System Architecture: Components
In order to realize these dialogues, we need the following components:
• Specification of the dialogue flow: → Dialogue Model
alternative dialogue flows
• Specification of the domain knowledge → Domain Model
different scenarios and different configuration of the scenario
• Relevant communicative acts and utterances in the given scenario → Language Model
different linguistic realizations of communicative acts
• Authoring tasks divided:
• Language Model/Dialogue Model → language teachers
• Domain Model → language teachers? (→ experts in domain modeling)
![Page 8: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/8.jpg)
© 2008 Wilske & Wolska8
x y
ut-1
ut-2
ut-7
ut-3
ut-4 ut-5
ut-6 ut-8
Dialogue Model
Language Model Domain Model
ut-2
ut-1
ut-n
:= ... ... ... ....
:= ... slot-x ... ....
:= ... slot-x ...slot-y....
dialogue flow
utterances and communicative
acts
domain knowledge
System Architecture: Components
![Page 9: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/9.jpg)
© 2008 Wilske & Wolska9
x y
ut-1
ut-2
ut-7
ut-3
ut-4 ut-5
ut-6 ut-8
Dialogue Model
Language Model Domain Model
ut-2
ut-1
ut-n
:= ... ... ... ....
:= ... slot-x ... ....
:= ... slot-x ...slot-y....
utterances and communicative
acts
System Architecture: Language Model
![Page 10: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/10.jpg)
© 2008 Wilske & Wolska10
Language Model
• Mapping between utterance types (communicative acts) and set of strings that can realize them
• Implemented as context-free grammar
→Templates with slots for `fillers‘ from the domain model
REQUEST(X) := I would like X please.
Generating system utterances: random utterance from set of utterances for given type
Understanding user utterances: matching semantic tags
REQUEST(X) := I would like X{X} please {request}
![Page 11: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/11.jpg)
© 2008 Wilske & Wolska11
x y
ut-1
ut-2
ut-7
ut-3
ut-4 ut-5
ut-6 ut-8
Dialogue Model
Language Model Domain Model
ut-2
ut-1
ut-n
:= ... ... ... ....
:= ... slot-x ... ....
:= ... slot-x ...slot-y....
dialogue flow
System Architecture: Dialogue Model
![Page 12: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/12.jpg)
© 2008 Wilske & Wolska12
Dialogue Model
• State-based representation of sequences of utterances
• Depending on requirements of the scenario: linear, branching, looping
• Implementation: dialogue management tool DialogOS (extendable platform allows to connect arbitrary components and exchange information with them)
ut-1
ut-2
ut-7
ut-3
ut-4 ut-5
ut-6 ut-8
Dialogue Model
![Page 13: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/13.jpg)
© 2008 Wilske & Wolska13
x y
Domain Model
domain knowledge
System Architecture: Domain Model
Language Model
ut-2
ut-1
ut-n
:= ... ... ... ....
:= ... slot-x ... ....
:= ... slot-x ...slot-y....
ut-1
ut-2
ut-7
ut-3
ut-4 ut-5
ut-6 ut-8
Dialogue Model
![Page 14: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/14.jpg)
© 2008 Wilske & Wolska14
Domain Model & Microworld
• Encodes domain knowledge by specifing relevant concepts, entities, and relations
• Also knowledge relevant to dialogue flow (at the moment)
• Formulated as an ontology (at the moment)
x y
Domain Model instance
Menu-Header x item 1 item 2MenuHeader y item 3 item 4
Microworld
• Microworld: Provides the context of learner‘s task (entities they can refer to)
• → Specific instantiation of a subset of the domain model
![Page 15: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/15.jpg)
© 2008 Wilske & Wolska15
x y
ut-1
ut-2
ut-7
ut-3
ut-4 ut-5
ut-6 ut-8
Dialogue Model
Language Model Domain Model instance
Menu-Header x item 1 item 2MenuHeader y item 3 item 4
Microworld
ut-2
ut-1
ut-n
:= ... ... ... ....
:= ... slot-x ... ....
:= ... slot-x ...slot-y....
dialogue flow
utterances and communicative
acts
domain knowledge
System Architecture: Components
![Page 16: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/16.jpg)
© 2008 Wilske & Wolska16
Outline
• Motivation & Goal definition
• System Architecture
• Overview on Components
• Language Model
• Dialogue Model
• Domain Model
• Interaction between Components
• Illustrating Example
• Summary
• Problems, Further Work
![Page 17: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/17.jpg)
© 2008 Wilske & Wolska17
Interaction between modules
• Building blocks of dialogue model are utterance types
• Separation allows independent development and relatively easy adaptation to other languages
ut-1
ut-2
ut-7
ut-3
ut-4 ut-5
ut-6 ut-8
Dialogue Model
Language Model
utterance type ut-x
ut-2
ut-1
ut-n
:= ... ... ... ....
:= ... slot-x ... ....
:= ... slot-x ...slot-y....
![Page 18: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/18.jpg)
© 2008 Wilske & Wolska18
x y
Language Model Domain Model
domain entitiesas slot fillers
instance
Menu-Header x item 1 item 2MenuHeader y item 3 item 4
Microworld
ut-2
ut-1
ut-n
:= ... ... ... ....
:= ... slot-x ... ....
:= ... slot-x ...slot-y....
Interaction between modules
• Utterance template abstracts away from specific content words by specifying slots to be filled with appropriate items from the microworld
• Allows automatic modification of the language model according to a given microworld
![Page 19: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/19.jpg)
© 2008 Wilske & Wolska19
x y
ut-1
ut-2
ut-7
ut-3
ut-4 ut-5
ut-6 ut-8
Dialogue Model
Domain Model
domain structure induces dialogue structure
instance
Menu-Header x item 1 item 2MenuHeader y item 3 item 4
Microworld
• Sequence of utterances in overall dialogue structure is informed by the domain model
• While executing the dialogue the dialogue manager refers directly to to concepts of domain model
• Features of concepts can trigger subdialogues
Interaction between modules
![Page 20: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/20.jpg)
© 2008 Wilske & Wolska20
MenuStarters
Salads
Green Salad
Mixed Salad
Soups
Corn Soup
Chicken Soup
Main Courses
Lasagne...
Fish...
Steak
Sirloin Steak
Marinated Flank Steak
Example: Domain Model & Microworld
![Page 21: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/21.jpg)
© 2008 Wilske & Wolska21
GREETING
GREETINGGood evening.
Example: Dialogue Model
ASK.for(coursei)
REQUEST(x∊coursei) ASK.how(x,listpx
)
REQUEST(x,p∊listpx)ACKNOWLEDGE
for each coursei ∊ Courses
x has undiscussed property slot
x has no undiscussed property slot
Good evening, Sir.
What would you like as a starter?
Sure.
x has undiscussed property slot
starter
Can you bring me a green salad, please?
![Page 22: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/22.jpg)
© 2008 Wilske & Wolska22
GREETING
GREETINGGood evening.
Example: Dialogue Model
ASK.for(coursei)
REQUEST(x∊coursei) ASK.how(x,listpx
)
REQUEST(x,p∊listpx)ACKNOWLEDGE
for each coursei ∊ Courses
x has undiscussed property slot
x has no undiscussed property slot
Good evening, Sir.
main
Well done, please.Alright.
x has undiscussed property slot
I’d like the Marinated Flank Steak, please.How would you like your steak: rare, medium, or well done?
What would you like for the main course?
![Page 23: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/23.jpg)
© 2008 Wilske & Wolska23
Summary
• Presented an architecture for executing language learning dialogues
• Key: separate domain knowledge from dialogue structure and language model → with view to independent development of system resources
• Allows to conduct dialogues in different scenarios and different variants of one scenario
• Implemented for the Restaurant and Shopping scenario
![Page 24: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/24.jpg)
© 2008 Wilske & Wolska24
Problems / Further work
• Authoring domain model requires expert background in knowledge representation (ontology modeling)
→ Other (easier) ways to represent domain knowledge (targeting non-technical authors)
• Further work on the format of the language model (with respect to ease of authoring for language teachers)
• Is there a standard for encoding language learning relevant information at the utterance level?
• Include other parameters: proficiency level, register, social context
• Evaluation of System:
• Usability (for Learners and Authors)
• Learning gains
![Page 25: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/25.jpg)
© 2008 Wilske & Wolska
Thank you.
![Page 26: Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska sw@coli.uni-sb.de Saarland University ICL, Villach, September](https://reader036.vdocument.in/reader036/viewer/2022062407/56649e465503460f94b3b326/html5/thumbnails/26.jpg)
© 2008 Wilske & Wolska26
DialogOS GUI