![Page 1: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/1.jpg)
1
An introduction to the NSDL
William Y. ArmsCornell University
![Page 2: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/2.jpg)
2
The NSDL is a program of the National Science Foundation's Directorate for Education and Human Resources, Division of Undergraduate Education.
The NSDL Core Integration is a collaboration between the University Center for Atmospheric Research (Dave Fulker), Columbia University (Kate Wittenberg) and Cornell University (Bill Arms).
The ideas discussed in this talk do not represent the official views of the NSF or the Core Integration team.
Acknowledgement and Disclaimer
![Page 3: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/3.jpg)
3
The NSDL project
1996 Vision articulated by NSF's Division of Undergraduate Education
1997 National Research Council workshop
1998 Preliminary grants through Digital Libraries Initiative 2
1998 SMETE-Lib workshop
1999 NSDL Solicitation
2000 6 Core Integration System projects + 23 others funded
2001 Further collection and service projects + 1 Large Core Integration System project (total about $25 million/year)
2002 Formal release
2006 End of formative phase
![Page 4: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/4.jpg)
4
Continuing questions
(a) Science education: How broadly defined?
(b) Funding: How much with how few dollars?
(c) Education: How can the NSDL have an impact?
(d) Management: How can a diverse community provide shared services?
![Page 5: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/5.jpg)
5
Scientific and technical information in digital form
Materials used in education
Science education: scope of a digital library
Materials tailored toeducation
![Page 6: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/6.jpg)
6
The NSF's strategy
![Page 7: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/7.jpg)
7
NSDL collections funded by the NSF (a) Focused collections
![Page 8: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/8.jpg)
8
![Page 9: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/9.jpg)
9
![Page 10: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/10.jpg)
10
![Page 11: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/11.jpg)
11
NSDL-collections funded by the NSF (b) Aggregates and federations
![Page 12: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/12.jpg)
12
![Page 13: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/13.jpg)
13
![Page 14: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/14.jpg)
14
![Page 15: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/15.jpg)
15
NSDL service projects funded by the NSF
![Page 16: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/16.jpg)
16
![Page 17: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/17.jpg)
17
![Page 18: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/18.jpg)
18
![Page 19: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/19.jpg)
19
Core Integration demonstrations (2000-2001)
![Page 20: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/20.jpg)
20
![Page 21: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/21.jpg)
21
![Page 22: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/22.jpg)
22
The broad view of the NSDL
![Page 23: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/23.jpg)
23
![Page 24: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/24.jpg)
24
![Page 25: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/25.jpg)
25
![Page 26: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/26.jpg)
26
![Page 27: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/27.jpg)
27
All branches of science, all levels of education, very broadly defined:
Five year targets
1,000,000 different users
10,000,000 digital objects
10,000 to 100,000 independent sites
How big might the NSDL be?
![Page 28: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/28.jpg)
28
The NSF cannot fund all collections
![Page 29: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/29.jpg)
29
... to provide a coherent set of services across great diversity.
The Core Integration task ...
![Page 30: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/30.jpg)
30
Resources
Core Integration
Budget $4 million
Staff 25 - 30
Management Diffuse How can a small team, without direct management control, create a very large-scale digital library?
![Page 31: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/31.jpg)
31
A spectrum of interoperability
![Page 32: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/32.jpg)
32
Approaches to interoperability
The conventional approach
Wise people develop standards: protocols, formats, etc.
Everybody implements the standards.
This creates an integrated, distributed system.
Unfortunately ...
Standards are expensive to adopt.
Concepts are continually changing.
Systems are continually changing.
![Page 33: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/33.jpg)
33
Interoperability is about agreements
Technical agreements cover formats, protocols, security systems so that messages can be exchanged, etc. Content agreements cover the data and metadata, and include semantic agreements on the interpretation of the messages. Organizational agreements cover the ground rules for access, for changing collections and services, payment, authentication, etc.
The challenge is to create incentives for independent digital libraries to adopt agreements
![Page 34: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/34.jpg)
34
Function versus cost of acceptance
Function
Cost of acceptance
Many adopters
Few adopters
![Page 35: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/35.jpg)
35
Example: textual mark-up
Function
Cost of acceptance
SGML
ASCII
HTML
XML
![Page 36: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/36.jpg)
36
Levels of interoperability
Level Agreements Example
Federation Strict use of standards AACR, MARC(syntax, semantic, Z 39.50and business)
Harvesting Digital libraries expose Open Archivesmetadata; simple metadata harvesting
protocol and registry
Gathering Digital libraries do not Web crawlerscooperate; services must and search enginesseek out information
![Page 37: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/37.jpg)
37
Metadata is expensive
The NSDL cannot afford to create it manually
![Page 38: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/38.jpg)
38
Every collection is different
![Page 39: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/39.jpg)
39
Users
Collections
Metadata repository
The metadata repository
Services
The metadata repository is a resource for service providers.
It holds information about every collection and item known to the NSDL.
![Page 40: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/40.jpg)
40
Metadata strategy
• Support eight standard formats
• Collect all existing metadata in these formats
• Provide crosswalks to Dublin Core
• Expose records in the metadata repository for others to harvest
• Concentrate on collection-level metadata
• Use automatic generation to augment item-level metadata
![Page 41: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/41.jpg)
41
NSDL metadata options
Eight standard formats
Dublin Core Dublin Core + DC-Ed extensionsLTSC (IMS)ADL (SCORM)MARC 21Content Standard for Digital Geospatial Metadata (FGDC)Global Information Locator Service (GILS)Encoded Archival Description (EAD)
For additional information on supported formats:
http://128.253.121.110/NSDLMetaWG/IntroPage.html
![Page 42: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/42.jpg)
42
Services strategy
![Page 43: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/43.jpg)
43
The metadata repository as a resource
• Records will be exposed through Open Archives Initiative harvesting protocol.
• Core Integration team will provide some services based on the metadata repository.
• The architecture encourages others to build services.
![Page 44: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/44.jpg)
44
Information retrieval
Basic metadata search
Basic content search
Combining metadata and content
James Allan, Bruce Croft (University of Massachusetts, Amherst)
![Page 45: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/45.jpg)
45
Portal
Portal
Portal
Search andDiscoveryServices
Content
SDLIP?OAI
http?
How search service fits into the NSDL
Provides search and discovery functionality to portals
Metadata repository
![Page 46: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/46.jpg)
46
Extending the architecture to support federations
Extending the spectrum of search interoperability
collections with non-DC metadata schemasdistributed and heterogeneous collectionsricher search functionality
geospatial search, thesaurus/concept space search, ...
Supporting the creation of new and personalized collections
Providing access to thesaurus and gazetteer services
Terry Smith, Jim Frew (University of California, Santa Barbara)
![Page 47: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/47.jpg)
47
The ADEPT approach to search interoperability
metadata
per collection provider
ADEPT
OAI metadatarepository
harvest
ADEPTcollectiondiscovery
portal
2. harvest &interpret
ADEPTclient
1. map
ADEPT
3. h & i
![Page 48: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/48.jpg)
48
User profiles and authentication
User authentication
User registryAffiliationsPrivacy
User preferences
User Interfaces and portalsEnable customizable user interface
Rights management
Kate Wittenberg, David Millman (Columbia University)
![Page 49: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/49.jpg)
49
Conclusion The NSDL cannot do everything
![Page 50: An introduction to the NSDL William Y. Arms Cornell University](https://reader035.vdocument.in/reader035/viewer/2022062723/56813e67550346895da87445/html5/thumbnails/50.jpg)
50
Opportunities for the NSDL
• Categories of material that have been given lower priority by libraries and publishers, e.g., datasets, software, and other dynamic content, ...
• Materials that are accessible for automatic processing, e.g., scientific web sites and databases, image collections, ...
• Materials designed for education, e.g.,learning objects, curricula, problem sets, ...
Less opportunity for the NSDL
• Conventional scientific literature with restricted access