TAKE IT TO THE NTH

Technology Foundations forDigital Libraries

Evolution of Digital Libraries

1st Generation:Development ofonline catalogs● MARC standard● ILS systems● Cataloging cooperatives

2nd Generation:Experimentation● Remote access to catalogs● Abstract/indexing services● Electronic journals● Internet use● Technologies●"Skunk works" organizations

3rd Generation:

Institutionalization●Integration of digitalmaterial into library collections●Search for standards●Benchmark practices●Modular architectures●Large collection mgmt.●User focus●Integration with library organization

Source: Next Generation Digital Libraries, Daniel Greenstein, 2002.

Gateway to remote catalogs &

digital content

21st Century Academic Library Technology

● Authentication & authorization● Rights management● Personalization● Discovery● Workroom

Library Portal

Access to local catalogs &

digital content

Interface to othercampus learning& administrative

systems

Digital Library Planning Considerations

Content●eJournals●eBooks●Web resources●Databases●Text/image/audio/video

Applications●Digitization●Multimedia management●Rights management●Searching & linking●Portals●Preservation

Platform●Servers●Storage●Operating Environment●Infrastructure●Browsers●Java

Technology Issues●7x24 availability●Ability to scale withgrowth of digitalcollections●Integration withother campus systems

DigitalLibraryProject

s

Why Sun for Digital Libraries?

✔ Outstanding platform availability and scalability✔ Enterprise-wide infrastructure✔ Best-of-breed digital library solutions✔ Library industry specialization

"We added five new Sun servers this year...we have purchased Sun products whenever we had a choice." – H. Thomas Hickerson, Associate UniversityLibrarian for Information Technologies, Cornell University

Platform Availability

Highly AvailableServers & Storage

✔ Servers and storage designed for hardware failure prevention, fast recovery, and easy serviceability as well as performance.

Robust Software

✔ Operating system and network management software that isolates faults, protects data, and supports hardware availability features.

Mission CriticalServices

✔ 7x24 support for enterprise-wide network computing environments.

Proven Solutions

✔ Collaboration with key third-party vendors.

"It's just amazing, our Sun servers never stop. There is no scheduled down time."– John Sack, Associate Publisher of HighWire Press, Stanford University

"Sun Remote Services provides remote monitoring of the Sun servers on our network, in order to detect problems at the earliest possible stage."– Ray Norton, Technical Services Manager, National Library of New Zealand

Platform Scalability

"We have used Sun servers for a long time...We knew that a UNIX-based system – in particular the Solaris Operating Environment-based Sun system – would scale extremely well" – Ira Fuchs, VP for IT Research, Andrew W. Mellon Foundation, commenting on JSTOR.

✔ A single binary-compatible product family

✔ Extends from servers that cost less than a PC to heavy-duty systems that rival mainframes in uptime and far exceed them in performance.

✔ System memory bandwidth seamlesly scales with the number of processors, maintaining a near-linear increase in compute power

Digital Library Portals

"The teaching and learning environment is moving towards Web-based support and a significant portion of our collection is now electronic. We needed a gateway to theworld..." – Frances Groen, Director of Libraries, McGill University

● Portals present unified views into disparate information sources and tools

● The portal framework provides key enabling technologies--such as security, access policy management, and personalization.

● Academic libraries often have a portal providing access to all library resources and services.

● Some organizations are integrating the library functions into a broader campus portal.

Integrated Campus IT Architecture

CO

NT

EX

T

Messaging, Commerce and Middleware Services

Application Infrastructure Components

Networking and Computing Infrastructure

Distance Learning Alumni E-Business Fundraising

Lifetime Learning Faculty Publication

Student Self Service Research Syndication

Directory Workflow Calendar Mail Authentication

Data Translation Services (XML, EDI) Cross-Platform Interoperable Services (J2EE)

Single Sign-on Integrated Access Personalized Mobile Privacy

Enterprise Information Portal

Learning &Library Databases

Administration Applications

Mgmt Informationand Reporting Tools

Legacy Transactors D

AR

TS

ER

VIC

E

IN

TE

RF

AC

E &

E

NA

BL

ER

S

PL

UM

BIN

G

Service Integration and Directory Layer

Servers, Databases, Storage, Routers, Wi-Fi and Internet2 Switches

Commercial Digital Library Solutions● Artesia: "TEAMS" ● Endeavor: "ENCompasss" ● Ex Libris: "DigiTool"● Luna Imaging: "Insight"● MuseGlobal: "MuseSearch"● SIRSI: "Hyperion Digital Media Archive"● VTLS: "Visual MIS Multimedia & Imaging Solutions"

Sun showcase: Stanford

Sun showcase: Cornell

Identity & Rights Management

● Generally required by subscription-based resource licensing agreements

● Required to protect local collections (e.g., high resolution images of artwork)

● Authorization mechanisms can also enhance library services– personalization features– links to course-specific materials

● Ideally integrated with campus-wide identification/authorization processes

Searching and Linking Technologies for Enhanced Resource Discovery

Broadcast Search● Simultaneous search of

multiple sources● OPAC, other catalogs,

internet search engines, databases

● Consolidated search results with de-duping, filtering, sorting, etc.

Linking● Search results or

bibliographic record is starting point

• Based on proposed OpenURL standard (NISO)

● Users can "click through" to locate additional related resources

University of California, Berkeley

● The Berkeley Sun SITE builds digital collections and services, provides information and support to digital library developers worldwide

● NSF Digital Library Initiative Phase 1 Geographic Information Systems project

● NSF Digital Library Initiative Phase 2 Project: "Re-inventing Scholarly Information Dissemination and Use" – enabling technologies– content management– access system– preservation repository

● Four focus areas: making journals available electronically, digitization of unique holdings, electronic publishing of scholarly communication, and creation of digital archives.

● In 1998, developed gateway to 21 Cornell libraries, digital collections, and more than 16,000 e-Journals

● One of the world's largest digitization programs.– 900,000 pages, full-text searchable in "Making of America" collection

of 19th century literature● Development partner with Endeavor Information Systems for

ENCompass, and a Sun Center of Excellence for digital libraries.● Goal is to ensure workable, cost-effective commercial solutions.

– Cornell believes vendors can dedicate more resources

● $12 million Library Digital Initiative began four years ago to build a common infrastructure for Harvard's more than 100 libraries.

● Focus was to incent participation and standardization.

● Not R&D, objective is to establish stable production environment

– technical infrastructure– services and consulting– address policy issues– internal grants for adding to digital collections

● Oracle-based repository for all types of objects– includes responsibility for preservation and migration

● Multi-catalog searching and access

●Began as Andrew F. Mellon Foundation project with University of Michigan and Princeton University.

●Back issues of paper journals converted into electronic formats.– savings in space– improved access to journal content– solution to preservation problems associated with storing paper

volumes • 169 journals, 1,100 user institutions worldwide• Delivers page images to users for efficiency and accuracy, full-

text searchable.• With over 5 million requests/month, high availability and

reliability are critical.

● One of the largest private universities in the U.S.● Main library and 14 smaller libraries

– circulating collection of 2.5 million volumes● In process of implementing all Ex Libris library

products● Sun/iPlanet infrastructure

● Extensive image and audio collections for performing arts and music libraries

● Designated by Ex Libris as Premier Partner for Ex Libris "DigiTool" product– first beta site

● Emphasis on use of off-the-shelf products and accepted standards from NISO, NIST

HighWire Press● Online publishing of scholarly

journals; goal was to provide common technology infrastructure.

● Not simply electronic images of printed pages; includes links among authors, articles and citations, advanced searching capabilities, high-resolution images, multimedia, and interactivity.

● The largest archive of free life science articles in the world; full text provided for 323 leading journals in science and medicine.

Stanford Digital Repository● Using TEAMS multimedia

management software from Artesia Technologies to build massive digital repository.

● Utilizing METS standard for object management.

● Includes Java-based rights management and charging mechanisms, Kerberos certificates.

● Insight software from Luna Imaging for high resolution images. Will also include video associated with coursework.

Sun's Library Focus

• Gold Sponsor, International Federation of Library Associations• Member, American Library Association• Member, Coalition for Networked Information• Member, National Information Standards Organization• Involved in all NSF Digital Library Initiative Phase 1 projects• Sun Labs support of Stanford/NSF permanent publishing

initiative LOCKSS• Berkeley/UNAM library SunSites

Digital Library Futures

● Best practices for digitization, rights management will emerge.

● Agreed-upon standards and interfaces will be incorporated into commercial products.

● Cooperative solutions for preservation will appear. ● Digital libraries will be seamlessly integrated with

learning management systems and other campus systems.