a 3 eh 3 th international workshop on authoring of adaptive and adaptable educational hypermedia...

AA33EHEH33thth International Workshop on Authoring of International Workshop on Authoring of

Adaptive and Adaptable Educational Adaptive and Adaptable Educational HypermediaHypermedia

Alexandra CristeaAlexandra CristeaRosa Carro & Rosa Carro &

Franca GarzottoFranca Garzotto

19th of July, 2005 3rd Int. Workshop on Authoring of Adaptive and Adaptable Educational Hypermedia, AIED’05, Amsterdam, The Netherlands

Workshop StructureWorkshop StructureFULL PAPERS:FULL PAPERS: 9:00- 9:15 Welcome & Workshop Goals, Structure, etc. 9:00- 9:15 Welcome & Workshop Goals, Structure, etc. Mixed paper session 1 (9:15 – 10:30) Models, Design and AuthoringMixed paper session 1 (9:15 – 10:30) Models, Design and Authoring coffee breakcoffee breakFull paper session 1 (11:00 - 12:30) Full paper session 1 (11:00 - 12:30) Adaptive assessment Adaptive assessment AuthoringAuthoring

Authoring and ConvertingAuthoring and Converting lunch breaklunch break

Full paper session 2 (14:00 - 15:00)Full paper session 2 (14:00 - 15:00) Authoring evaluationAuthoring evaluationPOSTERS:POSTERS: Poster session 1 (15:00-15:30)Poster session 1 (15:00-15:30) Authoring Systems Authoring Systems coffee break coffee break Poster session 2 (16:00 - 16:15)Poster session 2 (16:00 - 16:15) Authoring LanguageAuthoring Languageshort breakshort breakPANEL & DISCUSSIONS (16:30 - 17:30)PANEL & DISCUSSIONS (16:30 - 17:30)

PROGRAM (9:00 - 17:30)PROGRAM (9:00 - 17:30)


Workshop GoalsWorkshop Goals Up to now, the focus of adaptive hypermedia Up to now, the focus of adaptive hypermedia

research has been on delivery rather than research has been on delivery rather than authoring. Only recently have we noticed a shift authoring. Only recently have we noticed a shift in focus. in focus.

In more details: In more details: • to attract the interest of the related research to attract the interest of the related research

communities to the important issues of design and communities to the important issues of design and authoring in adaptive hypermedia; authoring in adaptive hypermedia;

• to discuss the current state of the art in this field; and to discuss the current state of the art in this field; and • to identify new challenges in the field. to identify new challenges in the field.


Workshop FocusWorkshop Focus design, implementation and design, implementation and

evaluation of general Adaptive and evaluation of general Adaptive and Adaptable (Educational) Hypermedia, Adaptable (Educational) Hypermedia, with special emphasis on the with special emphasis on the connection to user modelling and connection to user modelling and pedagogy. pedagogy.


IssuesIssues* What are the main characteristics (that should be) modelled * What are the main characteristics (that should be) modelled

of learners?of learners?* How can the pedagogical knowledge be formulated in a * How can the pedagogical knowledge be formulated in a

reusable manner?reusable manner?* How to support pedagogic scenarios?* How to support pedagogic scenarios?* * How can we consider user cognitive styles in adaptive How can we consider user cognitive styles in adaptive

hypermedia?hypermedia?* How can we consider user learning styles in adaptive * How can we consider user learning styles in adaptive

hypermedia?hypermedia?* Are there any recurring patterns that can be detected in the * Are there any recurring patterns that can be detected in the

authoring process generally speaking, and in the authoring authoring process generally speaking, and in the authoring of user or pedagogic model in particular?of user or pedagogic model in particular?


ThemeTheme Theme:Theme: evaluation & focus on pedagogical evaluation & focus on pedagogical

implicationsimplications Previous workshops:Previous workshops:

• 22ndnd: design: design and and evaluationevaluation of adaptive and of adaptive and adaptable (Educational) Hypermedia adaptable (Educational) Hypermedia applications and authoring tools. applications and authoring tools.

• 11st:st: Design AH; learning styles; AH authoring Design AH; learning styles; AH authoring patternspatterns


TopicsTopics* Design patterns for adaptive educational hypermedia* Design patterns for adaptive educational hypermedia* Authoring user models for adaptive/adaptable educational hypermedia* Authoring user models for adaptive/adaptable educational hypermedia* Authoring pedagogic models for adaptive/adaptable educational * Authoring pedagogic models for adaptive/adaptable educational

hypermediahypermedia* Generic authoring for adaptive/adaptable educational hypermedia* Generic authoring for adaptive/adaptable educational hypermedia* Authoring patterns for user models and pedagogic models in * Authoring patterns for user models and pedagogic models in

adaptive/adaptable educational hypermediaadaptive/adaptable educational hypermedia* Authoring Tools for user models and pedagogic models in * Authoring Tools for user models and pedagogic models in

adaptive/adaptable educational hypermediaadaptive/adaptable educational hypermedia* Generic authoring tools in adaptive/adaptable educational hypermedia* Generic authoring tools in adaptive/adaptable educational hypermedia* Reusable user models and pedagogic models* Reusable user models and pedagogic models* Connecting adaptive educational hypermedia with cognitive/learning * Connecting adaptive educational hypermedia with cognitive/learning

stylesstyles* Evaluation of authoring tools for adaptive educational hypermedia* Evaluation of authoring tools for adaptive educational hypermedia* Evaluation of adaptive educational hypermedia design patterns* Evaluation of adaptive educational hypermedia design patterns* Evaluation of adaptive educational hypermedia authoring patterns* Evaluation of adaptive educational hypermedia authoring patterns


Expected OutcomeExpected Outcome The workshop will also lead to a better understanding and The workshop will also lead to a better understanding and

cross-dissemination of specific aspects of the cross-dissemination of specific aspects of the authoring authoring problem of AEHproblem of AEH, as well as , as well as specific solutionsspecific solutions applied by applied by different parties. different parties.

Moreover, we hope the workshop will lead to generalization Moreover, we hope the workshop will lead to generalization of solutions, such as patterns extracted from existing of solutions, such as patterns extracted from existing design and authoring processes in AH, evaluation design and authoring processes in AH, evaluation methodology, pedagogical implications, etc. methodology, pedagogical implications, etc.

This workshop continues the series started with the help of This workshop continues the series started with the help of the EC project ADAPT (Minerva, Socrates programme): the EC project ADAPT (Minerva, Socrates programme): http://wwwis.win.tue.nl/~acristea/HTML/Minerva/index.htmlhttp://wwwis.win.tue.nl/~acristea/HTML/Minerva/index.html

Furtheron, the workshop should be seen as a platform that Furtheron, the workshop should be seen as a platform that enables the cooperation and exchange of information with enables the cooperation and exchange of information with other related European and non-European projects. other related European and non-European projects.


PapersPapers Full papers:Full papers:

• original mature research resultsoriginal mature research results Posters: Posters:

• original ongoing research original ongoing research All submissions underwent a thorough reviewing All submissions underwent a thorough reviewing

and refereeing process in order to decide on and refereeing process in order to decide on acceptance.acceptance.

Selected papers will also be Selected papers will also be invited for a Special invited for a Special Issue on Personalization of Computing and Issue on Personalization of Computing and Services of the Jodi journalServices of the Jodi journal..• With your help!With your help!


BEST PAPER PRESENTATION BEST PAPER PRESENTATION SELECTION FORMSELECTION FORM

Please select from below the Please select from below the three best papersthree best papers (especially presentation, but also content) (especially presentation, but also content) according to you, write their numbers (1-11) in according to you, write their numbers (1-11) in the space below and the space below and hand the form to one of the hand the form to one of the Workshop Chairs before leavingWorkshop Chairs before leaving::

Best paper number: _______Best paper number: _______ Second best paper number:_________Second best paper number:_________ Third best paper number:________Third best paper number:________


Program CommitteeProgram CommitteeHelen Ashman, University of Nottingham (UK) Helen Ashman, University of Nottingham (UK) Paul De Bra, Technische Universiteit Eindhoven (Netherlands) Paul De Bra, Technische Universiteit Eindhoven (Netherlands) Tim Brailsford, University of Nottingham (UK)Tim Brailsford, University of Nottingham (UK)Licia Calvi, University of Pavia (Italy) Licia Calvi, University of Pavia (Italy) Hugh Davis, Southampton University (UK) Hugh Davis, Southampton University (UK) Serge Garlatti, GET-ENST Bretagne (France) Serge Garlatti, GET-ENST Bretagne (France) Nicola Henze, University of Hannover (Germany) Nicola Henze, University of Hannover (Germany) Judy Kay, University of Sydney (Australia)Judy Kay, University of Sydney (Australia)Kinshuk, Massey University (New Zealand) Kinshuk, Massey University (New Zealand) Wolfgang Nejdl, University of Hannover (Germany) Wolfgang Nejdl, University of Hannover (Germany) Toshio Okamoto, University of Electro-Communications (Japan) Toshio Okamoto, University of Electro-Communications (Japan) Helen Pain, University of Edinburgh (UK) Helen Pain, University of Edinburgh (UK) Simos Retalis, University of Piraeus (Greece) Simos Retalis, University of Piraeus (Greece) Pilar Rodríguez, Universidad Autonoma de Madrid (Spain)Pilar Rodríguez, Universidad Autonoma de Madrid (Spain)Johann Schlichter, Technical University of Munich (Germany)Johann Schlichter, Technical University of Munich (Germany)Marcus Specht, Fraunhofer Institute for Applied Information Technology (Germany)Marcus Specht, Fraunhofer Institute for Applied Information Technology (Germany)Daniel Schwabe, PUC - Rio de Janeiro (Brazil) Daniel Schwabe, PUC - Rio de Janeiro (Brazil) Carlo Strapparava, IRST (Italy) Carlo Strapparava, IRST (Italy) Lorna Uden, Staffordshire University (UK)Lorna Uden, Staffordshire University (UK)Vincent Wade, Trinity College (Ireland) Vincent Wade, Trinity College (Ireland) Gerhard Weber, Freiburg University of Education (Germany) Gerhard Weber, Freiburg University of Education (Germany) Wolfgang Woerndl, Technical University of Munich (Germany)Wolfgang Woerndl, Technical University of Munich (Germany)


Workshop StructureWorkshop StructureFULL PAPERS:FULL PAPERS: 9:00- 9:15 Welcome & Workshop Goals, Structure, etc. 9:00- 9:15 Welcome & Workshop Goals, Structure, etc. Mixed paper session 1 (9:15 – 10:30) Models, Design and AuthoringMixed paper session 1 (9:15 – 10:30) Models, Design and Authoring coffee breakcoffee breakFull paper session 1 (11:00 - 12:30) Full paper session 1 (11:00 - 12:30) Adaptive assessment Adaptive assessment AuthoringAuthoring

Authoring and ConvertingAuthoring and Converting lunch breaklunch break

Full paper session 2 (14:00 - 15:00)Full paper session 2 (14:00 - 15:00) Authoring evaluationAuthoring evaluationPOSTERS:POSTERS: Poster session 1 (15:00-15:30)Poster session 1 (15:00-15:30) Authoring Systems Authoring Systems coffee break coffee break Poster session 2 (16:00 - 16:15)Poster session 2 (16:00 - 16:15) Authoring LanguageAuthoring Languageshort breakshort breakPANEL & DISCUSSIONS (16:30 - 17:30)PANEL & DISCUSSIONS (16:30 - 17:30)

PROGRAM (9:00 - 17:30)PROGRAM (9:00 - 17:30)


MIXED SESSION 1:MIXED SESSION 1: Program, Tuesday, July 19th 2005 Program, Tuesday, July 19th 2005 (Room A-306)(Room A-306) 09.00 - 10.30 session: 09.00 - 10.30 session: Theme Theme models, design and authoringmodels, design and authoring 09.00-09.15 Welcome09.00-09.15 Welcome 9.15-9.45: 9.15-9.45:

Paper 1. Comparing Graphs and Trees for Adaptive HypermPaper 1. Comparing Graphs and Trees for Adaptive Hypermedia Authoring, authors: Manuel edia Authoring, authors: Manuel FreireFreire and Pilar Rodriguez and Pilar Rodriguez

9.45-10.15: 9.45-10.15: Paper 2. Using Schema Analysis for Feedback in Authoring TPaper 2. Using Schema Analysis for Feedback in Authoring Tools for Learning Environments, authors: ools for Learning Environments, authors: HarrieHarrie PassierPassier & Johan & Johan JeuringJeuring

10.15-10.30: 10.15-10.30: Poster Poster 9. The Cost of Authoring with a Knowledge Layer, authors: 9. The Cost of Authoring with a Knowledge Layer, authors: LichaoLichao Li, Judy Kay Li, Judy Kay

10.30 - 11.00 coffee/tea break10.30 - 11.00 coffee/tea break


FULL PAPER SESSION 1:FULL PAPER SESSION 1: 11.00 - 12.30 session: 11.00 - 12.30 session: Theme adaptive assessment authoringTheme adaptive assessment authoring 11.00-11.30: Paper 3. Creating personalised quizzes both to 11.00-11.30: Paper 3. Creating personalised quizzes both to

the learner and to the access device characteristics: the the learner and to the access device characteristics: the Case of CosyQTI, authors: Symeon Retalis, Petros LalosCase of CosyQTI, authors: Symeon Retalis, Petros Lalos

11.30-12.00: Paper 4. Automatic Generation of Exercises for 11.30-12.00: Paper 4. Automatic Generation of Exercises for Self-testing in Adaptive E-learning Systems: Exercises on AC Self-testing in Adaptive E-learning Systems: Exercises on AC Circuits, authors: Paul Cristea, Rodica TuduceCircuits, authors: Paul Cristea, Rodica Tuduce

Theme authoring and convertingTheme authoring and converting 12.00-12.30: Paper 5. Writing MOT, Reading AHA! - 12.00-12.30: Paper 5. Writing MOT, Reading AHA! -

converting between an authoring and a delivery system for converting between an authoring and a delivery system for adaptive educational hypermedia -, authors: Alexandra adaptive educational hypermedia -, authors: Alexandra Cristea, David Smits and Paul de Bra Cristea, David Smits and Paul de Bra

12.30 - 14.00 lunch12.30 - 14.00 lunch


MIXED PAPER SESSIONS:MIXED PAPER SESSIONS: 14.00 - 15.30 session:14.00 - 15.30 session: Theme authoring evaluationTheme authoring evaluation 14.00-14.30: Paper 6. Evaluation of Adaptive Course 14.00-14.30: Paper 6. Evaluation of Adaptive Course

Construction Toolkit (ACCT), authors: Declan Dagger, Vincent Construction Toolkit (ACCT), authors: Declan Dagger, Vincent WadeWade

14.30-15.00: Paper 7. Evaluation of Interoperability of Adaptive 14.30-15.00: Paper 7. Evaluation of Interoperability of Adaptive Hypermedia Systems: testing the MOT to WHURLE conversion in Hypermedia Systems: testing the MOT to WHURLE conversion in a classroom setting, authors: Alexandra Cristea, Craig Stewart, a classroom setting, authors: Alexandra Cristea, Craig Stewart, Tim Brailsford and Paul CristeaTim Brailsford and Paul Cristea

Theme authoring systemsTheme authoring systems 15.00-15.15: Poster 8. Authoring and delivering adaptable 15.00-15.15: Poster 8. Authoring and delivering adaptable

learning objects in SINTEC, authors: Valentin Cristea, Stefan learning objects in SINTEC, authors: Valentin Cristea, Stefan Trausan-MatuTrausan-Matu

15.15-15.30: Poster 10. Telemedicine ontology for AIED, authors: 15.15-15.30: Poster 10. Telemedicine ontology for AIED, authors: O. Ferrer-Roca, A. Figueredo, K. Franco, A. Diaz-CardamaO. Ferrer-Roca, A. Figueredo, K. Franco, A. Diaz-Cardama

15.30 - 16.00 coffee/tea break15.30 - 16.00 coffee/tea break


MIXED PAPER SESSIONS:MIXED PAPER SESSIONS: 16.00 - 17.30 session16.00 - 17.30 session Theme authoring languageTheme authoring language 16.00-16.15: Poster 11. New Features of the 16.00-16.15: Poster 11. New Features of the

OPScript Language, authors: Vicente Arturo OPScript Language, authors: Vicente Arturo ROMERO ZALDIVAR, Jon Ander ELORRIAGA ROMERO ZALDIVAR, Jon Ander ELORRIAGA ARANDIA, Mateo Jerónimo LEZCANO BRITO, Mikel ARANDIA, Mateo Jerónimo LEZCANO BRITO, Mikel LarrañagaLarrañaga

16.15-16.30 short break16.15-16.30 short break Panel & Discussion on A3EHPanel & Discussion on A3EH 16.30-17.30: Panel with Invited Speakers: to be 16.30-17.30: Panel with Invited Speakers: to be

announcedannounced


Original Topics – paper distributionOriginal Topics – paper distribution* Authoring user models for adaptive/adaptable * Authoring user models for adaptive/adaptable

educational hypermediaeducational hypermedia• Poster [9] Knowledge layer addition: cost evaluation, Li & KayPoster [9] Knowledge layer addition: cost evaluation, Li & Kay

* Generic authoring for adaptive/adaptable educational * Generic authoring for adaptive/adaptable educational hypermediahypermedia• Poster [11] OPScript language, Romero et al.Poster [11] OPScript language, Romero et al.

* Authoring Tools for user models and pedagogic models * Authoring Tools for user models and pedagogic models in adaptive/adaptable educational hypermediain adaptive/adaptable educational hypermedia• Posters [8] Sintec, Cristea & Trausan, [10] Telemedicine, Ferrer-Posters [8] Sintec, Cristea & Trausan, [10] Telemedicine, Ferrer-

Roca et al. Roca et al.


Original Topics – paper distributionOriginal Topics – paper distribution* * Reusable user models and pedagogic modelsReusable user models and pedagogic models

• [5] Conversion MOT to AHA!, Cristea, Smits, De Bra[5] Conversion MOT to AHA!, Cristea, Smits, De Bra

* Evaluation of authoring tools for adaptive educational * Evaluation of authoring tools for adaptive educational hypermediahypermedia• [6] ACCT evaluation, Dagger & Wade[6] ACCT evaluation, Dagger & Wade• [7] Evaluation MOT to WHURLE conversion, Cristea et al.[7] Evaluation MOT to WHURLE conversion, Cristea et al.

* Evaluation of adaptive educational hypermedia design * Evaluation of adaptive educational hypermedia design patternspatterns• [2] Schema Analysis: evaluation methodology, Passier & Jeuring[2] Schema Analysis: evaluation methodology, Passier & Jeuring

* Evaluation of adaptive educational hypermedia authoring * Evaluation of adaptive educational hypermedia authoring patternspatterns• [1] Comparing graphs & Trees in A3EH: evaluation, Freire & [1] Comparing graphs & Trees in A3EH: evaluation, Freire &

RodriguezRodriguez


Topics less touchedTopics less touched

* Design patterns for adaptive educational * Design patterns for adaptive educational hypermediahypermedia

* Authoring pedagogic models for * Authoring pedagogic models for adaptive/adaptable educational hypermediaadaptive/adaptable educational hypermedia

* Authoring patterns for user models and * Authoring patterns for user models and pedagogic models in adaptive/adaptable pedagogic models in adaptive/adaptable educational hypermediaeducational hypermedia

* Connecting adaptive educational hypermedia * Connecting adaptive educational hypermedia with cognitive/learning styleswith cognitive/learning styles


Other topics emerging …Other topics emerging …

Authoring for assessmentAuthoring for assessment• [3] Personalized quizzes generation, [3] Personalized quizzes generation,

Retalis & LalosRetalis & Lalos• [4] Exercise generation, Cristea & [4] Exercise generation, Cristea &

TuduceTuduce


Other topics emerging …Other topics emerging … ReuseReuse

• Whole courseware (paper 5, Cristea; 7, Whole courseware (paper 5, Cristea; 7, Stewart)Stewart)

Automatic authoringAutomatic authoring• Quizzes (paper 4, Cristea & Tuduce) Quizzes (paper 4, Cristea & Tuduce)

OntologiesOntologies• Telemedicine (poster 10, Ferrer-Roca)Telemedicine (poster 10, Ferrer-Roca)


PANEL & DISCUSSION(16:30 - 17:30) PANEL & DISCUSSION(16:30 - 17:30)

(Room A-306)(Room A-306) Most important issues in A3EH?Most important issues in A3EH?

Problems & Possible solutionsProblems & Possible solutions

Panelists:Panelists: one person per full paper one person per full paper (preparation discussion over lunch)(preparation discussion over lunch)

moderators: moderators: t.b.a.t.b.a.


GOAL of the panelGOAL of the panelWith the contribution of the panelists and all With the contribution of the panelists and all

workshop partecipans:workshop partecipans: to identify to identify HOT ISSUESHOT ISSUES that are particularly that are particularly

relevant for current and future research on relevant for current and future research on authoring AEHsauthoring AEHs

To discuss whether these are just To discuss whether these are just PROBLEMS PROBLEMS or actually have possible or actually have possible SOLUTIONSSOLUTIONS


Panel structurePanel structure

Two rounds of questions and discussionsTwo rounds of questions and discussions Wrap upWrap up

• ConclusionsConclusions• Future plansFuture plans


What are panelists expected to do?What are panelists expected to do?FIRST ROUNDFIRST ROUND pick one of the panel “hot issues” that you pick one of the panel “hot issues” that you

rank as “particularly relevant”, or mention rank as “particularly relevant”, or mention complementary hot topicscomplementary hot topics

comment how you would address themcomment how you would address them

SECOND ROUNDSECOND ROUND Discuss/contrast other panelists opinionsDiscuss/contrast other panelists opinions Involve the audienceInvolve the audience Propose concrete research actionsPropose concrete research actions


HOT ISSUES for the panelistsHOT ISSUES for the panelistsOrganized along four main “dimensions”:Organized along four main “dimensions”:

CONCEPTUAL TOOLSCONCEPTUAL TOOLS to support the design and authoring to support the design and authoring processprocess

DEVELOPMENT/IMPLEMENTATION TOOLSDEVELOPMENT/IMPLEMENTATION TOOLS for building AEH for building AEH

CONTRIBUTIONS/SUPPORTCONTRIBUTIONS/SUPPORT from other disciplines from other disciplines

EVALUATION and ACCEPTABILITYEVALUATION and ACCEPTABILITY (of conceptual and (of conceptual and development tools): which FACTORS TO MEASURE OR development tools): which FACTORS TO MEASURE OR PROMOTE, and HOW? PROMOTE, and HOW?


HOT ISSUES: (this slide should be distributed to all participants and the audience)HOT ISSUES: (this slide should be distributed to all participants and the audience)

CONCEPTUAL TOOLS for AEH authoringCONCEPTUAL TOOLS for AEH authoring• Design methodologies Design methodologies • Application modelsApplication models• Modeling standardsModeling standards• Patterns (for application design, for implementation Patterns (for application design, for implementation

design, for authoring systems architecture)design, for authoring systems architecture)• Common design languageCommon design language• ..........



DEVELOPMENT/IMPLEMENTATION TOOLS for building AEHDEVELOPMENT/IMPLEMENTATION TOOLS for building AEH• Application Design methodologies Application Design methodologies • Application models and Modeling standardsApplication models and Modeling standards• Implementation standardsImplementation standards• Architecture standardsArchitecture standards• Patterns (for application design, for implementation Patterns (for application design, for implementation

design, for system architecture)design, for system architecture)• Common LanguageCommon Language



CONTRIBUTIONS/SUPPORT from other disciplinesCONTRIBUTIONS/SUPPORT from other disciplines• Pedagogy, instructional design and cognitive sciencesPedagogy, instructional design and cognitive sciences• HCIHCI• Artificial intelligenceArtificial intelligence• Semantic webSemantic web• Collaborative systemsCollaborative systems• Web engineeringWeb engineering• ........



EVALUATION and ACCEPTABILITY: EVALUATION and ACCEPTABILITY: which FACTORS TO MEASURE which FACTORS TO MEASURE OR PROMOTE, and HOW? OR PROMOTE, and HOW? • For the conceptual tools (usability, effectiveness, .....)For the conceptual tools (usability, effectiveness, .....)• For the development tools (usability, effectiveness, For the development tools (usability, effectiveness,

interoperability, ....)interoperability, ....)• For the artifacts built using the tools (usability, For the artifacts built using the tools (usability,

educational impact, portability and interoperability. educational impact, portability and interoperability. ..)..)• Evaluation methodologyEvaluation methodology


Enjoy the presentations, discussions Enjoy the presentations, discussions & panel!& panel!

a 3 eh 3 th international workshop on authoring of adaptive and adaptable educational hypermedia...

Documents

authoring of adaptive

authoring of user

authoring coffee

authoring process

authoring user models

evaluation of authoring

authoring pedagogic

authoring evaluation