a media theoretical approach to

Lehrstuhl Informatik V(Information Systems)

Prof. Dr. M. Jarke

Marc SpaniolYiwei Cao

Ralf Klamma

I5-SCKl-0907-1/19

The 2nd European Conference on Technology Enhanced Learning

A Media Theoretical Approach to Technology Enhanced Learning

in Non-Technical Disciplines

Marc Spaniol, Yiwei Cao and Ralf KlammaSissi, Greece, 19th of September 2007


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-2/19

Agenda• Motivation

- Communities of Practice in Non-Technical Disciplines- Technology Enhanced Learning (TEL) in Non-Technical Disciplines

• Media-centric TEL in Communities- Theory of Transcriptivity- SECI-Model (Socialization – Externalization – Combination – Internalization)

• Information System Support for Media-centric TEL- A media theory for computer science- TEL-Services based on a Lightweight Application Server (LAS)

• Virtual Campfire: TEL-Services applied- Transcription – Collaborative Content Creation- Formalized Localization – Episodic Knowledge in non-linear Stories- Addressing – Contextualized Multimedia Presentations

• Conclusions and Outlook


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-3/19

Communities of Practice (CoPs)in Non-Technical Disciplines

• Characteristics of CoPs [Wenger 1998] in Non-Technical Disciplines (e.g. the Cultural Sciences)

- Collaboration in the Scope of a (Research)-Project- Legitimate Peripheral Participation- Limited financial Resources for Computer Scientific Support

• Typical Working Practices- Recontextualization of Artifacts based on the underlying Theory

Comparison, Discussion und Commenting von ArchivesApplicable Opinion to be discussed in a specific Context

⇒ Keeping Discourse going on, not deciding true/false- Work on Terminology based on evolutionary Categorizations- Individual Modifications of Multimedia Contents (Variations)- Creation of Reference Collections

Fluid Archive


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-4/19

Technology Enhanced Learning (TEL) in Non-Technical Disciplines

• How does Learning take place?- Partition of scientific Disciplines based on Snow: „The Two Cultures“ [1959]- Linear: Model „Natural Sciences and Engineering Sciences“

Old Knowledge is replaces by new KnowledgeMedial Artifacts disappear in the Archive, but remain quotable

⇒ Knowledge is „transported“- Non-linear: Model „Cultural Sciences and Humanities“

New Knowledge emerges from the Discourses about old KnowledgeMedial Artifacts are kept in dynamic Archives

⇒ Knowledge is medial „illustrated“• How to support the non-linear Model of Knowledge Organization and

Creation by means of Information Systems?⇒ Combining:

Operational Media Theory and Knowledge Management Theory


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-5/19

Theory of Transcriptivity• Media Operations

- Transcription: Improving readability and making sense of Pre-Texts- Addressing: Transforming „unaddressed“ Information in „addressed“ Messages- Localization: Adopting Media to local Practices

• “Interleaved” Media Operations• Interdependencies

Multimedia Content ↔ Community Context not systematized

Pre-Texts Transcriptinter- resp. intra-media Transcription

understanding&

critiqueTranskribieren – Medien/Lektüre

[Jäger, Stanitzek 02]


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-6/19

Refined SECI-Model• Combination of western and asian Knowledge Theories• Continuous Knowledge Transformation: Individual ↔ Community• Media Operations and Security Aspects disregarded

implicit Knowledge

explicitKnowledge

Transformationinto

Socialization Externalization

Internalization Combination

procedural declarative

episodicdeclarative semantic

implicit Knowledge

Transformationfrom

explicit Knowledge

The Knowledge Creating Company [Nonaka & Takeuchi 95]

The Declarative/ Procedural Model[Ullman 2004]


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-7/19

A Media Theoretical Approach to TEL• Synthesis of Theory of Transcriptivity and SECI-Model• Focus on Media-theoretic Aspects in

Knowledge Organization and Creation

Combination:formal Localization

Externalization:Transcription

Socialization:practical Localization

Internalization:Addressing

TranscriptPre-Texts

Transcriptin

Context

EC-TEL 2007 [Spaniol et al.]


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-8/19

TEL-Services based on aLightweight Application Server (LAS)

I-Know 2006 [Spaniol et al.]ICWL 2007 [Spaniol et al.]

LAS Components

LAS Services

HTT

PSO

AP

Session-/Security-/User-Management Oth

erP

roto

cols

…Web-Interface(JSP, PHP, etc.)

Java- Application

…

OtherClients

Conn

ecto

rs

Key Features :- 3-Tier Architecture - Java based Implementation- Connectors - Access Control on Service- and Object-Level- Components (internal) - MPEG-7/21 compliant Multimedia-Services - Services (internal & external) - Extension and Replacement of Services at Runtime


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-9/19

Access Control in LAS

Relevant Data- Users / Agents- Groups

(hierarchical ordered)- Security Objects

(e.g. Multimedia Artifacts)

Access Right Management- Permissions / Prohibitions- Roles

(Method Level)

- Access Control Lists (Object Level)

LAS ServiceConnector Client LAS ServerConnector

1 Invoke method M of service S

1.1 Instantiate S, if necessary

Check Access Rights

1.2 Call M on S

1.E AccessDeniedException

1.2E2 LASException

1.2E1 LASServiceException

1.4 Transmit result1.3 Return result

Clie

nt

Server

1.2E1a SecurityException


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-10/19

MPEG-7-Services in LAS

LAS

MPEG-7-HighLevelService

MPEG-7-HighLevelServiceStarter

i5.atlas.las.service.mpeg7

i5.atlas.las.service.mpeg7.highlevelservice

i5.las.api

Service

ServiceStarter

1 org.apache.xmlbeans

mpeg.mpeg7.schema.2001

MPEG-7-Service<<import>>

<<import>>

<<connection>>

i5.las.dbcomponent

LAS-DB-Connector

1

MPEG-7 Database-

eXistIBM DB2 Version 8

Oracle 10g

Key Features:- MPEG-7 compliant Creation, Retrieval, Update, Deletion and Validation of Contents- Persistency based on a MPEG-7 XML-Database (IBM, Oracle, eXist)- Automatic MPEG-7-Binding via Apache XMLBeans


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-11/19

Multimedia Management in LAS

Key Features:- Media Management via associated Community-FTP-Server- LAS Access Control

Client

Media Service

HTT

P-C

onne

ctor

Session-/Security-/Session-Management

LAS FTP Server

1.2.

3.

5.

4.

6.

?

?

Or


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-12/19

LAS-Summary• Community Support

- Java Platform Independence- Easy to Maintain and Extend at Runtime- Core Services for Community-Administration- Fine-grained Access Control

Method LevelObject Level

⇒ „Security-First“-Concept⇒ Platform for Community-Hosting

• TEL Support- Interoperable (Multimedia) Metadata- Cross-Community Support by MPEG-7/21 Compliance- Automatic Conversion to/from Dublin Core⇒ Schema-compliant MPEG-7/21 Modifications via XMLBeans

⇒ Better Community and Multimedia Support than comparable Application Server such as Tomcat or Zope/Plone


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-13/19

Virtual CampfireTEL-Services applied

- Exchange of Multimedia Artifacts

- Protection of geo-spatial Data of unauthorized access (e.g. Tomb Raiders)

- RecontextualizationMultimedia Contents via non-linear Stories

- MPEG-7 based semantic Multimedia Annotations

ICWL 2006: [Spaniol et al.]Knowledge Management Strategies 2007: [Spaniol et al.]

Support of an International Community of Researchers in order toPreserve the Afghan Cultural Heritage by:


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-14/19

TranscriptionCollaborative Content Creation

• Creation & Management:- Media Collections- Metadata- Media Variations

• Collaborative Indexing based on:- Free Text Annotations (a lá Flickr)- Semantic MPEG-7 Basetypes

AgentEventConceptObjectPlaceTimeState


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-15/19

Formalized LocalizationEpisodic Knowledge in non-linear Stories

• Illustration of episodic Knowledge- Modeling of non-linear Stories based on Movement Oriented Design (MOD)

[Sharda 2005]; Cooperation with Victoria Universität Melbourne, Australia- Decomposition of Stories according to a Problem-Hierarchy- Recall of semantic high-quality Metadata on Multimedia Artifacts

Structure of Begin-Middle-End-Sequences

„Mapping“ of (Sub)-Problemsto Multimedia Artifacts

Structured Access to Contents of theMultimedia Archive


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-16/19

AddressingContextualized Multimedia Presentations

• Non-linear Access Sequences in multimedia Stories, i.e. „Success vs. Failure“ depending on Access Sequence

• Context Information via Multimedia Annotations

Currently selected Artifact

Optional Successor-Sequences

Free Text Annotations

MPEG-7 based Annotations


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-17/19

Virtual Campfire – Experiences• Evaluated by

- Researchers at the Chair of Urban History, RWTH Aachen- Working Group of Prof. Nalin Sharda

at Victoria University Melbourne, Australia• Positive Aspects

- Combination of semantic and episodic Knowledge in TELby non-linear Multimedia Stories

- MOD-Structure serves as Guideline for the creation of “useful” Stories- Web 2.0 alike Participation

• Usage of MPEG-7- „Folksonomies“ based on MPEG-7 semantic Basetypes- MPEG-7 Basetypes used for geo-spatial and spatio-temporal Descriptions- Semantic search by regular Expressions⇒ Annotations with MPEG-7 Basetypes increase the Data Quality

• Open Issues- Application on mobile end Devices (e.g. usage of MPEG-21)- User modeling (e.g. by use of IMS LIP or IEEE PAPI)


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-18/19

Conclusions• Experiences in using Virtual Campfire in non-technical Disciplines

- A media theory for Computer Science as a Model of Knowledge Organization and Creation in TEL

- TEL-Services allow an „evolutionary“ Service DevelopmentEasy to Maintain and Extend at RuntimeCore Services for Community-Administration

- Interoperability viaMPEG-7/21 ComplianceDedicated MPEG-7-Services

⇒ Platform for TEL in non-technical Disciplines

• Transfer of Results in different Application Domains- Entrepreneurial Training (VEL – Virtual Entrepreneurship Lab)- Plastics Technology (TRAMP – T.ool for R.epresentation & A.nnotation of

M.ultimedia Content in P.lastics Engineering)


Prof. Dr. M. Jarke


Ralf Klamma

I5-SCKl-0907-19/19

Outlook• Further Development of Virtual Campfire towards mobile Community-Hosting in the

research cluster on "Ultra High-Speed Mobile Information and Communication (UMIC)" - GPS-Embedding- Mobile End Devices- Location Awareness

• Conceptual Enhancements- Graphical Editors for User Interface Design in Communities- Modeling of Media Usage based on the Actor-Network-Theory- Analysis of “Agency and Patienthood” Phenomena in Communities

Informatik 5 (Information Systems) – RWTH Aachen University © 2007

a media theoretical approach to

Documents