metadata-powered dissemination of content
DESCRIPTION
Presentation of cloud-based metadata aggregation infrastructures for agricultural data. Given at Alterra, University of Wageningen, The Netherlands.TRANSCRIPT
![Page 2: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/2.jpg)
“meaningful services around high-quality
agricultural data pools”
http://wiki.agroknow.gr
![Page 3: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/3.jpg)
• publications, theses, reports, other grey literature• educational material and content, courseware• primary data, such as measurements & observations
– structured, e.g. datasets as tables– digitized, e.g. images, videos
• secondary data, such as processed elaborations– e.g. dendrograms, pie charts, models
• provenance information, incl. authors, their organizations and projects
• experimental protocols & methods• social data, tags, ratings, etc.• …
agricultural research(+) content
![Page 4: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/4.jpg)
• stats
• gene banks
• gis data
• blogs,
• journals
• open archives
• raw data
• technologies
• learning objects
• ………..
educators’ view
![Page 5: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/5.jpg)
• stats
• gene banks
• gis data
• blogs,
• journals
• open archives
• raw data
• technologies
• learning objects
• ………..
researchers’ view
![Page 6: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/6.jpg)
• stats
• gene banks
• gis data
• blogs,
• journals
• open archives
• raw data
• technologies
• learning objects
• ………..
practioners’ view
![Page 7: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/7.jpg)
• stats
• gene banks
• gis data
• blogs,
• journals
• open archives
• raw data
• technologies
• learning objects
• ………..
![Page 8: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/8.jpg)
is great…but its not the answer
![Page 9: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/9.jpg)
![Page 10: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/10.jpg)
• aim is:promoting data sharing and
consumption related to any research activity aimed at improving productivity and quality of crops
ICT for computing, connectivity, storage, instrumentation
data infrastructure for agriculture
![Page 11: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/11.jpg)
Publisher
Date Catalog
SubjectID
AuthorTitle
we actually share metadata
![Page 12: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/12.jpg)
e.g. an educational resource
![Page 13: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/13.jpg)
…metadata reflect the context
![Page 14: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/14.jpg)
…sometimes, data also included
![Page 15: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/15.jpg)
metadata aggregations
• concerns viewing merged collections of metadata records from different sources
• useful: when access to specific supersets or subsets of networked collections– records actually stored at aggregator– or queries distributed at virtually aggregated
collections
15
![Page 16: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/16.jpg)
typically look like this
16 Ternier et al., 2010
![Page 17: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/17.jpg)
metadata aggregation tools
More than a harvester:
Validation Service Repository Software Registry Service Harvester
17
Powered by
![Page 18: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/18.jpg)
workflows with commonalities
Harvesting Validating Transforming
OAI target - XMLs
IndexingStoring
Automatic metadata generation
De - duplication service
XMLs
Triplification
![Page 19: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/19.jpg)
typical problem: computing
![Page 20: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/20.jpg)
typical problem: hosting
![Page 21: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/21.jpg)
to curate & preserve we need
![Page 22: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/22.jpg)
even when machinery exists there are problems
• hardware maintenance• technical support• interoperability limitations
– no APIs for the dissemination of data across systems
• hardware costs
![Page 23: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/23.jpg)
the cloud approach
Students
Researchers
Academics
![Page 24: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/24.jpg)
Storage and Processing Monitoring/Management/Allocation layer
Virtualization of Infrastructure Layer
Virtual Machines
Virtualization of Infrastructure LayerVirtualized Infrastractures Management LayerGUI tools and APIs
Cloud provider A Cloud provider B Cloud provider B
![Page 25: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/25.jpg)
what can be hosted on the cloud
• Data storage & management tools– APIs for content dissemination in large networks
• Processing & visualisation tools• Metadata aggregation infra• Search engines and apps for institutions or
communities
![Page 26: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/26.jpg)
what data providers need
… only a browser and internet connection
![Page 27: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/27.jpg)
CASE 1: DATA MANAGEMENT TOOL OVER THE CLOUD
![Page 28: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/28.jpg)
Educational Pathway Authoring Tool
![Page 29: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/29.jpg)
Educational Pathway Authoring Tool
![Page 30: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/30.jpg)
Cloud service workflow
![Page 31: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/31.jpg)
how it works
Demo
![Page 32: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/32.jpg)
comparing costs for hosting data management tool at own site and cloud
Cloud•cloud hosting = 20 euros/month•set up effort = 1hr•back up included
•Total for 5 years = 1200 euros
Hosting at institution•1 server+monitor+ups = 1200 euros•set up > 1 day effort or 100 euros•hardware maintenance effort = difficult to be defined but significant
•Total for 5 years = 1300 +personnel for hardware maintenance+ costs of unexpected HW breakdowns e.g. supplier, hard disk
Costs of software support could be the same for both cases
Costs of software support could be the same for both cases
After 5 years the HW should be renewed/upgraded
After 5 years the HW should be renewed/upgraded
![Page 33: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/33.jpg)
CASE 2: SETTING UP SEARCH SERVICE/PORTAL OVER THE CLOUD
![Page 34: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/34.jpg)
![Page 35: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/35.jpg)
![Page 36: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/36.jpg)
![Page 37: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/37.jpg)
![Page 38: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/38.jpg)
![Page 39: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/39.jpg)
demo• GLN backbone (http://www.greenlearningnetwork.com)
• Organic.Edunet revamp (http://www.greenlearningnetwork.com/organicedunet)
• AgShare Find OER (http://greenlearningnetwork.com/agshareoer)
![Page 40: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/40.jpg)
how it works
Metadata aggregator for educational content
Search API
Template customizationhtml, css, Ajax, JS
Clo
ud
Educational collection management tool
Metadata aggregator for other data types
Search API
Data management tool
Inst
itutio
n
![Page 41: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/41.jpg)
how it works
Metadata aggregator for educational content
Search API
Template customizationhtml, css, Ajax, JS
Clo
ud
Educational collection management tool
Metadata aggregator for other data types
Search API
Data management tool
widget in Facebook page
![Page 42: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/42.jpg)
next challenges
![Page 43: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/43.jpg)
1. Social Research Networking• Connecting peers & visualising social
networks, connecting researchers with publications, recommending relevant research– Mendeley (www.mendeley.com), ResearchGate
(http://www.researchgate.net), Academia.edu (http://academia.edu), ArnetMiner (http://arnetminer.org), …
– Social research components in popular CMSs (JomSocial, Drupal’s Buddylist, Elgg…)
![Page 44: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/44.jpg)
connect peers/publications (+APIs)
http://dev.mendeley.com/
![Page 45: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/45.jpg)
extending social CMS components
http://voa3r.cc.uah.es
![Page 46: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/46.jpg)
2. Enriched research objects• Complex, linked research objects
– executable scientific workflows, e.g. MyExperiment (http://www.myexperiment.org), Kepler (https://kepler-project.org)
– data sets e.g. PLoS (http://www.plos.org), FigShare (http://figshare.com)
– processing web services e.g. BioCatalogue (http://www.biocatalogue.org)
– Scientist generated classifications/taxonomies e.g. Scratchpads (http://scratchpads.eu)
– thematic networks/catalogues e.g. TELeurope (http://www.teleurope.eu), VOA3R (http://voa3r.cc.uah.es)
![Page 47: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/47.jpg)
composite/networked research
http://education.natural-europe.eu/green/exhibits/show/grape-cultivars/to-begin-with
![Page 48: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/48.jpg)
3. End-user interfaces and access• Facilitating and monitoring usage and access
– Visualising social bookmarks (Klerx & Duval)– TinyArm (http://atinyarm.appspot.com) – MACE (http://portal.mace-project.eu) and maeve
interactive installation at Venice Biennale (http://vimeo.com/1738770)
![Page 49: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/49.jpg)
research visualisations & analytics
![Page 50: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/50.jpg)
interactive navigation interfaces
![Page 51: Metadata-powered dissemination of content](https://reader036.vdocument.in/reader036/viewer/2022081414/54c691204a7959c2788b458b/html5/thumbnails/51.jpg)
METADATA AGGREGATOR