the photodentro aggregator federated system …lre.eun.org/edrene/seminars/011/1508.pdfthe...

36
THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND, COUPLED WITH A WEB PORTAL FRONTEND FOR A MOBILE-FRIENDLY, ACCESSIBLE AND SOCIALLY INTERACTIVE USER EXPERIENCE. Anastasios Koutoumanos Ph.D. Computer Technology Insitute & Press - Diophantus [email protected] , May 6th 2014, Athens, Greece 11th EdReNe Conference

Upload: others

Post on 12-Oct-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

THE PHOTODENTRO AGGREGATOR FEDERATEDSYSTEM ARCHITECTURE

A POWERFUL METADATA AGGREGATOR BACKEND, COUPLED WITH A WEB PORTAL FRONTENDFOR A MOBILE-FRIENDLY, ACCESSIBLE AND SOCIALLY INTERACTIVE USER EXPERIENCE.

Anastasios Koutoumanos Ph.D.

Computer Technology Insitute & Press - [email protected]

, May 6th 2014, Athens, Greece11th EdReNe Conference

Page 2: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

OUR TEAMA 'digital' team for implementing and supporting

the 'digital services' of the digital school!

Headed by Prof. Christos KaklamanisCoordinated by Dr Elina MegalouAn efficient software team

11 full-time, in-house developers & dev-opsa team of ~10 external colleagues doing part-time work

A great back-office team for supporting our work, the digitalservices and the associated content

Page 3: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

THE CONTEXT: PHOTODENTRO IS THE ...Greek National Aggregator of Educational Content for schools.

It has been designed and developed in the framework of the"Digital School" National Initiative of the Greek MoE

Page 4: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

PHOTODENTRO AGGREGATORA multi-layer and service oriented architecture has been used

for the Photodentro Aggregator, with the following layers:

1. the Ingestion layer, that processes metadata from variousexternal sources,

2. the Collection Management Layer, that manages thecollections that are to be aggregated in the Federation andprovides an environment for their metadata enrichment,

3. the Aggregation Layer, where the metadata harvesting,validation, and storing take place, and

4. the Photodentro Web portal, that provides general servicesto portal users as well as access to the resources of variousrepositories in a uniform way.

Page 5: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

1

Page 6: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

SYSTEM ARCHITECTURETHE MAIN COMPONENTS

Sources of related materialRepositories with learning resources

Photodentro instancesOther, compliant repositories

The Photodentro aggregatorThe Photodentro portal

Page 7: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

PHOTODENTRO AGGREGATORT HE MAIN COMPONENT S

DSpace Aggregator engine Portal frontend

LOM AP builderUnique Identifier serviceOAI-PMH targetSupport services

Vocabulary serverLOM Validator

OAI-PMH HarvesterQuality Control engine

Link checkPhotodentro LOM AP validation

Schedule management (cron)ReportingSOLR Indexing

TransformationPublishLayoutSocial Features

Page 8: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

INJESTION & COLLECTIONMANAGEMENT

Page 9: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

METADATA INJESTION & TRANSFORMATIONPhotodentro uses the MINT tool (part of the

) for gathering metadata from externalrepositories as well as for facilitating the metadata mapping

process.

MetadataInteroperability Services

Page 10: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

COLLECTION MANAGEMENTThree different cases of repositories:

Case 1: Full supportFully support the Photodentro IEEE LOM AP, andProvide an OAI-PMH target, andthere is no need for metadata enrichment

Case 2: Different IEEE LOM AP or other standard (e.g. LIDO)Case 3: Partial support

Fully support the Photodentro IEEE LOM AP andProvide an OAI-PMH target, butmetadata enrichment is needed

Page 11: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

METADATA PREPARATIONA (heavily customised version of) DSpace is used to provide:

a Unique Identifier servicemapping to the Photodentro LOM Application Profilean OAI-PMH target

The HANDLE system is used as the backend service

to create globally unique, persistent and independent identifiers.

Page 12: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

AGGREGATOR REQUIREMENTScollect metadata records from the Photodentro ecosystemenforce quality and unique identifiersprepare metadata to be used by the Photodentro portallink metadata against the taxonomies and terms of theVocabulary Bankfacilitate smart indexing and advanced query services(Athena)facilitate association of metadata with related social data andanalytics

Page 13: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

OUR APPROACH: DRUPAL BASEDThe main workflow

1. An OAI-PMH module is used as and aggregator to harvest allconnected repositories.

2. A set of curation tasks are performed

3. Each valid metadata record is tranformed to a Drupal entity

4. Each entity is submitted to the SOLR indexer

5. Drupal entities enter the normal publishing workflow

Page 14: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,
Page 15: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

ACTION PLEASE!

Page 16: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,
Page 17: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,
Page 18: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,
Page 19: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,
Page 20: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,
Page 21: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,
Page 22: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,
Page 23: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,
Page 24: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,
Page 25: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,
Page 26: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,
Page 27: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,
Page 28: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,
Page 29: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,
Page 30: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,
Page 31: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,
Page 32: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

HANDS ON. LIVE!Note: This is only for demostration purposes. System under heavy

development!

Page 34: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

PLANNING...... AND THE FUTURE

Page 35: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

PLANNINGThe system is currently under development

1st working version is expected by September 2014Potential user base: approx. 1.5 milion, mostly members of theGreek K-12 community.Everyone will be motivated to register as a memberEmphasis on community-oriented featuresResponsive, finger-friendly user interfaceFaceted search, intuitive search mechanismAccessibility is facilitated (WCAG 2.0 Level AA) and expandedwith speech-enabled web componentsArchitectured for scalability

Page 36: THE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM …lre.eun.org/edrene/seminars/011/1508.pdfTHE PHOTODENTRO AGGREGATOR FEDERATED SYSTEM ARCHITECTURE A POWERFUL METADATA AGGREGATOR BACKEND,

THE FUTUREIntegration of the Photodentro aggregator and portal to theother dschool components.Explore the micro-sites paradigmManagement of social data & paradata, processing ofanalyticsFurther support the Linked-Data paradigmLink to more repositories, both inbound and outbound... more to come. We listen to our users!