workshop on oai and peer review journals in europe geneva, switserland – march 22nd to 24th 2001
DESCRIPTION
Herbert Van de Sompel Cornell University Computer Science – Digital Library Research Group. OAI metadata harvesting specifications. Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001. 0. a brief history of the OAI. the OAI roots. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/1.jpg)
herbert van de sompel
Workshop on OAI and peer review journals in Europe
Geneva, Switserland – March 22nd to 24th 2001
Herbert Van de Sompel
Cornell University
Computer Science – Digital Library Research Group
OAI metadata harvesting specifications
![Page 2: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/2.jpg)
herbert van de sompel
a brief history of the OAI
00
![Page 3: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/3.jpg)
herbert van de sompel
The Open Archives Initiative has been set up to create a forum to discuss and solve matters of interoperability between preprint solutions, as a way to promote their global acceptance. Paul Ginsparg, Rick Luce & Herbert Van de Sompel
the OAI roots
=> Santa Fe Convention: preprint metadata harvesting
![Page 4: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/4.jpg)
herbert van de sompel
interest from other communities
• Digital Library Federation meetings ~ research library community has many materials for which they would like to ‘expose’ metadata
• OAI San Antonio meeting: ~ interest from librarians, publishers, others, ...
![Page 5: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/5.jpg)
herbert van de sompel
resulting actions: organizational
• establish organizational stability for the OAI:
• institutional backing from CNI & DLF
• steering committee: policy guidance
• technical committee: technical specifications
• executive group: day to day coordination
• workshops: public dissemination, feedback
![Page 6: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/6.jpg)
herbert van de sompel
resulting actions: technical
• [09/2000] revise specifications to allow adoption beyond preprints: technical committee
• [09/2000-01/2001] compile new specifications: editing by Carl and Herbert
• [11/2000-01/2001] alpha-test specifications: oai-alpha group
• [01/2001] discontinue the Santa Fe Convention
• [01/2001] release version 1.0 of the OAI protocol
![Page 7: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/7.jpg)
herbert van de sompel
the OAI Metadata Harvesting protocol
11
![Page 8: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/8.jpg)
herbert van de sompel
The OAMH protocol is a low-barrier interoperability specification for the recurrent exchange of metadata between systems
![Page 9: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/9.jpg)
herbert van de sompel
the OAMH protocol
service provider data provider
Requests
Replies
repos i tory
harves ter
6
![Page 10: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/10.jpg)
herbert van de sompel
A&I
federated services
image
FTXT
OPAC
e-print
![Page 11: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/11.jpg)
herbert van de sompel
metadata harvesting via OAMH
metadata
A&I
image
OPAC
e-print
FTXT
harvester
FTXT
![Page 12: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/12.jpg)
herbert van de sompel
federated services via OAMH
metadata
A&I
image
FTXT
e-print
AuthorTitleAbstractIdentifer
OPAC
![Page 13: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/13.jpg)
herbert van de sompel
core concepts in OAMH
• low-barrier interoperability
• data-provider & service-provider model
• metadata harvesting model OAMH protocol
Dublin Core
HTTP basedReply • XML Schema
• Self contained• shared metadata format and parallel, community-
specific metadata formats
![Page 14: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/14.jpg)
herbert van de sompel
OAI harvesting toolsservice provider data provider
DatestampIdentifierSet
Records
repos i tory
harves ter
![Page 15: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/15.jpg)
herbert van de sompel
OAI harvesting tools
Supporting protocol requests:• Identify• ListMetadataFormats• ListSets
Harvesting protocol requests:• ListRecords• ListIdentifiers• GetRecord
repos i tory
service provider data provider
harves ter
![Page 16: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/16.jpg)
herbert van de sompel
supporting protocol requests
ListMetadataFormats
ListMetadataFormats / Time / Request REPEAT
• Format prefix• Format XML schema
/REPEAT
repos i tory
service provider data provider
harves ter
![Page 17: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/17.jpg)
herbert van de sompel
harvesting requests
* from=a * until=b * set=klmListRecords * metadataPrefix=dc
ListRecords / Time / Request REPEAT
• Identifier• Datestamp
• Metadata/REPEAT
repos i tory
service provider data provider
harves ter
![Page 18: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/18.jpg)
herbert van de sompel
Applications of the OAMH protocol?
• federated services [S&R, SDI, alerting, linking, ...]• database synchronization• harvesting the deep Web• ...
![Page 19: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/19.jpg)
herbert van de sompel
OAI - status
22
![Page 20: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/20.jpg)
herbert van de sompel
• freeze specifications for 12 -18 months:
• stable for experimentation; not definitive• minimize risk for early adopters
• maximize chances for future interoperability across communities
revision of specifications
![Page 21: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/21.jpg)
herbert van de sompel
software to run OAI repository
• eprints.org - U. Southampton
• open source metadata server - OCLC
• NT OAI server - U. Illinois
• Aleph 500 - Ex Libris
• Z39.50 OAI gateway - Virginia Tech (ongoing)
• MARC to DC convertor - OCLC
• we expect a lot more ...
• listed on OAI site
![Page 22: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/22.jpg)
herbert van de sompel
tools to support OAI implementation
• Hussein’s Repository explorer
• W3C XSV Schema Validator
• XML Spy
• the OAI comformance tester:
• part of OAI registration service for repositories
• listed on OAI site
![Page 23: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/23.jpg)
herbert van de sompel
modes of running OAI 1.0 repository• mode 0:
• no registration of repository in the OAI registry
![Page 24: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/24.jpg)
herbert van de sompel
modes of running OAI 1.0 repository• mode 1:
• registration of repository in public OAI registry
[includes validation of replies]existence of the repository is visible
![Page 25: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/25.jpg)
herbert van de sompel
modes of running OAI 1.0 repository• mode 2:
• registration of repository in public OAI registry
• usage of the OAI format for identifiers
resolver for OAI formated identifiers
existence of the repository is visible
![Page 26: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/26.jpg)
herbert van de sompel
implementation status
• early adoption by preprint community• but also by others
![Page 27: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/27.jpg)
herbert van de sompel
• data providers:• 20 registered repositories (US and Europe)
implementation status
arXivOCLC Thesis and DissertationsPerseus Digital LibraryPhysNetOxford Text ArchiveLibrary of Congress -- American MemoryCogPrintsHumboldt UniversityMIT ThesisLinguistic Data ConsortiumResource Discovery Network
![Page 28: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/28.jpg)
herbert van de sompel
implementation status
• service providers: •ARC •Open Language Archives• soon to be listed on OAI site
![Page 29: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/29.jpg)
herbert van de sompel
implementation status
• Mellon Foundation funding for OAI-based projects: data providers and service providers
• NSF Digital Library interest in OAI-related projects
• Close contacts with SPARC, DLF, CNI
![Page 30: Workshop on OAI and peer review journals in Europe Geneva, Switserland – March 22nd to 24th 2001](https://reader034.vdocument.in/reader034/viewer/2022052603/568147e2550346895db5170b/html5/thumbnails/30.jpg)
herbert van de sompel
communication re OAI
• lists: subscribe via http://www.openarchives.org
• oai-general list
• oai-implementers list
• web: http://www.openarchives.org
• FAQ: http://www.openarchives.org/faq.htm
• mail: [email protected]