Networked Digital Library of Theses and Dissertations
(NDLTD) UNESCO, Paris
September 27-28, 1999
Edward A. Fox [email protected]
CC CS DLRL Internet TIC
Virginia Tech, Blacksburg, VA, USA
Acknowledgements (Selected)
Sponsors: ACM, Adobe, IBM, Microsoft, NSF, OCLC, SURA, US Dept. of Education, …
Co-PIs: John Eaton, Brian Kleiner, Gail McMillan
Students: Fernando Das Neves, Robert France, Neill Kipp, Paul Mather, Constantinos Phanouriou, James Powell, Ohm Sornil, David Watkins, Chang Zhang, Jianxin Zhao
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members, Collection– Support, Extensions
Conclusion
Virginia Tech Background Largest university in Virginia, land-grant, town population
35K plus 25K students Blacksburg Electronic Village, since 1992, with 80% of
community on Internet Net.Work.Virginia, largest ATM network, with over 650 sites,
for education, research, govt LMDS, Local Multipoint Distribution Service, gigabit wireless
networking - 1/3 of Virginia Math Emporium, 500 workstations Faculty Development Initiative, round 2
ACITC Advanced Communications and Information Technology
Center, opening summer 2000 Connects to the library, with a focus on IT 1/3 high-tech (multimedia) classrooms 1/3 digital/electronic library (reading room) 1/3 research labs: 10, including:
– Digital Library Research Laboratory (DLRL)– Center for Applied Technologies in the Humanities– HCI; HPC; Multimedia; Visualization (CAVE), ...
Digital Libraries --- Virginia Tech MARIAN (NLM) CS DL Prototype - ENVISION (NSF, ACM) TULIP (Elsevier, OCLC) DL for CS Education - EI (NSF, ACM) WATERS, NCSTRL (NSF) NDLTD (SURA, US Dept. of Education) CSTC (NSF, ACM) CRIM (NSF, SIGMM) WCA (Log) Repository (W3C) VT-PetaPlex-1 (Knowledge Systems)
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members, Collection– Support, Extensions
Conclusion
Digital Libraries --- Objectives
World Lit.: 24hr / 7day / from desktop Integrated “super” information systems: 5S: streams,
structures, spaces, scenarios, societies Ubiquitous, Higher Quality, Lower Cost Education, Knowledge Sharing, Discovery Disintermediation -> Collaboration Universities Reclaim Property Interactive Courseware, Student Works Scalable, Sustainable, Usable, Useful
DLs: Why of Global Interest? National projects can preserve antiquities and heritage:
cultural, historical, linguistic, scholarly Knowledge and information are essential to economic and
technological growth, education DL - a domain for international collaboration
– wherein all can contribute and benefit
– which leverages investment in networking
– which provides useful content on Internet & WWW
– which will tie nations and peoples together more strongly and through deeper understanding
DL Challenges
Preservation - so people with trust DLs
Supporting infrastructure - networks, ...
Scalability, sustainability, interoperability
DL industry - critical mass by covering libraries, archives, museums, corporate info, govt info, personal info - “quality WWW” integrating IR, HT, MM, ...
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members, Collection– Support, Extensions
Conclusion
How to Build a Digital Library
Understand the problem (using the 5S
Framework)
Solve the problem (using the Star
Methodology)
– design, develop, evaluate,
– refine, operate
Definition: Digital Libraries are complex systems that
help satisfy info needs of users (societies) provide info services (scenarios) organize info in usable ways (structures) present info in usable ways (spaces) communicate info with users (streams)
(see also latest issue of Information Processing and Management)
Definition: 5S Framework Societies: interacting people (, computers) Scenarios: services, functions, operations, methods Spaces: domains + constraints (e.g., distance,
adjacency): 2D, vector, probability Structures: relations, trees, nodes and arcs Streams: sequences of items (text, audio, video,
network traffic)
5S: Components
Societies: roles, rituals, reasons, relationships, artifacts Scenarios: acquire, index, consult, administer, preserve Spaces: physical, temporal, functional, presentational,
conceptual Structures: architectures, taxonomies, schema,
grammars, links, objects Streams: granularities, protocols, paths, flows,
turbulences
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members, Collection– Support, Extensions
Conclusion
DLs --- Educational Implications Support distance education Level the playing field by giving everyone access to high
quality resources Enrich learning by giving access to primary rather than
secondary materials/objects Integrate simulations, visualizations, and multi-modal
presentations to enhance learning Allow learn-at-your-own-pace, ensuring success Allow specialized interfaces, or embedded DL for rich
support of learning activities
How do universities anddigital libraries relate?
Each U. will have its own digital library. Hence there will be large numbers (i.e., critical mass).
All students will learn how to use and how to “feed” digital libraries (and bring those habits to future work as needs and skills).
All digital library problems (esp. federation, flexibility, personalization) appear at U’s (so they are a good type of testbed, with willing collaborators in-place for developing solutions).
SMETE Library(from www.dlib.org)
Context: Global movement toward Digital Libraries (see April 1998 CACM)
NSF effort: Science, Mathematics, Engineering, and Technology Education Digital Library (focussed on undergraduates)– 3 workshops, yearly increasing funds / new calls
SMETE Library likely to operate as distributed federation, with separate parts for each key discipline, and to lead to a global effort
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members, Collection– Support, Extensions
Conclusion
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members, Collection– Support, Extensions
Conclusion
DLs: Broad Impact DLs should be in companies DLs should be in government (integrated) DLs should be built for all types of data, information, and
knowledge– covering knowledge management– covering data mining, IR, discovery, visualization– promoting specialized work on all types of collections for all types
of user groups DLs should encompass libraries, archives, museums, and
other institutions -- we can now store all data generated!
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members, Collection– Support, Extensions
Conclusion
A Digital Library Case StudyDomain: graduate education,
researchGenre:ETDs=electronic
theses & dissertationsSubmission: http://etd.vt.eduCollection:
http://www.theses.org
Project: Networked Digital Library of Theses & Dissertations (NDLTD) http:// www.ndltd.org
Media
ETD Web Sitehttp://www.ndltd.org/
ETDs Got Your Interest?
Graduate Students
Singapore AMChronicle of Higher Ed.National Public RadioNY Times ...
U. Laval
Key Ideas: Networked infrastructure
Scalability
Education is the rationale
University collaboration
Workflow, automation
Authors must submitMaximal access
PDF, SGML, MMStandards
Federated search
8th graders vs. grads
MARC, DC, URNs
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members, Collection– Support, Extensions
Conclusion
What led to today’s meeting? 1987 mtg in Ann Arbor: UMI, VT, … 1992 mtg in Washington: CNI, CGS, UMI, VT and 10
universities with 3 reps each 1993 mtg in Atlanta to start Monticello Electronic Library
(MEL): SURA, SOLINET 1994 mtg in Blacksburg re ETD project: std of PDF + SGML
+ multimedia objects 1996 funding by SURA, US Dept. of Education (FIPSE) for
regional, national projects 1997 meetings in UK, Germany, ...
Status of the Local Project Approved by university governance Spring
1996; required starting 1/1/97 Submission & access software in place Submission workshops for students (and
faculty) occur often: beginner/adv. Faculty training as part of Faculty
Development Initiative Over 2000 ETDs in collection
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History, Activities– Members, Collection– Support, Extensions
Conclusion
Aiding universities to enhance grad educ., publishing and IPR efforts
Helping improve the availability and content of theses and dissertations
Educating ALL future scholars so they can publish electronically and effectively use digital libraries (i.e., are Information Literate and can be more expressive)
What are we doing?
What are the long term goals? 400K US students / year getting grad degrees are
exposed / involved 200K/yr rich hypermedia ETDs that may turn into
electronic portfolios Dramatic increase in knowledge sharing: lit.
reviews, bibliographies, … Services providing lifelong access for students:
browse, search, prior searches, citation links
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History, Process– Members, Collection– Support, Extensions
Conclusion
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members, Collection– Support, Extensions
Conclusion
Institutional Members
Coalition for Networked Information (CNI) Committee on Inst. Coop. (CIC) Diplomica.com Dissertation.com Ibero-American Science & Technology Education Consortium
(ISTEC) National Library of Portugal Organization of American States (OAS) UNESCO
US University Members U. of Iowa U. of Maine U. of Oklahoma U. of South Florida U. of Tennessee, Knoxville U. of Tennessee, Memphis U. of Texas at Austin U. of Virginia U. Wisconsin - Madison Vanderbilt U. Virginia Tech - required since 1/97 West Virginia U. - required beginning fall 1998 Worcester Polytechnic Inst.
Air University (Alabama)Cal TechClemson UniversityCollege of William & MaryConcordia University (Illinois)East Tenn. State UniversityFlorida Institute of Tech.Florida International UniversityMichigan TechNaval Postgraduate School (CA)North Carolina State U.Penn. State UniversityRochester Institute of Tech.U. of FloridaU. of GeorgiaUniversity of Hawaii, Manoa
Australian Project Members
U. New South Wales (lead institution)U. of MelbourneU. of QueenslandU. of SydneyAustralian National UniversityCurtin U. of TechnologyGriffith U.
German Project Members
Humboldt University (lead institution)3 other universities5 learned societies
– Mathematics, Physics, Chemistry, Sociology, Education
1 computing center2 major libraries
Other International MembersChinese University of Hong KongChungnam National U., Dept of CS (S. Korea)City University, London (UK)Darmstadt U. of Tech. (Germany)Free University of Berlin (Germany - Vet. Med.)Gyeongsang National U. (Korea)India Institute of Technology, Bombay (India)Nanyang Technological U. (Singapore, part)National U. of Singapore (Singapore, part)*National Library of PortugalPolytechnic University of Valencia (Spain)Rhodes U. (South Africa)St. Petersburg St. Tech.U (Russia)Univ. de las Américas Puebla (Mexico)Univ. of Pisa (Italy)U. Laval; U. of Guelph; U. Waterloo; Wilfrid Laurier U. (Canada)
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members: NUDL, Collection– Support, Extensions
Conclusion
NUDL
1/15/99 NUDL proposal to NSF under DLI2 international program– VT: Library, Grad School, Industrial&Systems Eng.– Partners: UK (2) , Singapore, Russia, Korea, Greece, Germany,
plus Iberoamerican group (Spain, Portugal, Argentina, Brazil, Chile, Mexico)
– Problems: Multilingual search, multimedia submissions, requirements/usability, …
Start with ETDs, then expand to other student works, portfolios, data sets, (CS) courseware, ...
NUDL Partners
Ricardo A. Baeza-Yates, Universidad de Chile, Chile José Luis Brinquete Borbinha, Biblioteca Nacional, Portugal José Hilario Canós Cerdá, Universidad Politécnica de Valencia, Spain Stavros Christodoulakis, Technical University of Crete, Greece Lautaro Guerra Genskowsky, Universidad Técnica Federico Santa Maria,Chile Juan José Goldschtein, Univesidad de Belgrano, Argentina Peter Diepold, Humboldt University, Germany Francisco Javier Jaén Martinez, Spain Sung Hyon Myaeng, Chungnam National University, Korea Ana Maria Beltran Pavani, Prédio Cardeal Leme, Brazil Lim Ee Peng, Nanyang Technological University, Singapore Alexander I. Plemnek, St.-Petersburg State Technical University, Russia J. Alfredo Sánchez, Universidad de las Américas-Puebla, Mexico
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members, Collection– Support, Extensions
Conclusion
Access Statistics
1996 1997 1998
Total successful requests: 37,171 247,573 628,401Av. successful requests/day: 102 685 1,690Requests for .PDF files: 4,600 72, 854 343,236Requests for .HTML file 28,225 129,831 215,896Distinct hosts served 9,015 22,725 36,724Total data transferred: 3,229M 25,953M 74,051MAv. data transferred/day: 9M 73M 222M
Popular Works 1996458 Seevers, Gary L. Identification of Criteria for Delivery of Theological Education Through Distance Education: An International Delphi Study (Ph.D., Educational Research and Evaluation, April 1993; 1353Kb)
432 Hohauser, Robyn Lisa. The Social Construction of Technology: The Case of LSD (MS in Science and Technology Studies, Feb. 1995; 244Kb)
390 Childress, Vincent William. The Effects of Technology Education, Science, and Mathematics Integration Upon Eighth Grader's Technological Problem-Solving Ability (Ph.D. in Vocational and Technical Education, July 1994; 285Kb)
310 Kuhn, William B. Design of Integrated, Low Power, Radio Receivers in BiCMOS Technologies (Ph.D. in Electrical Engineering, Dec. 1995; 2Mb)
287 Sprague, Milo D. A High Performance DSP Based System Architecture for Motor Drive Control ( MS in Electrical Engineering, May 1993; 878Kb)
165 Wallace, Richard A. Regional Differences in the Treatment of Karl Marx by the Founders of American Academic Sociology (MS in Sociology, Nov. 1993; 479Kb)
150 McKeel, Scott Andrew. Numerical Simulation of the Transition Region in Hypersonic Flow (Ph.D. in Aerospace Engineering, Feb. 1996; 3Mb)
Popular Works 19979920 Liu, Xiangdong. Analysis and Reduction of Moire Patterns in Scanned Halftone Pictures (Ph.D. in Computer Science, May 1996; 6.6Mb)
7656 Petrus, Paul. Novel Adaptive Array Algorithms and Their Impact on Cellular System Capacity (Ph.D. in Electrical Engineering, March 1997; 5Mb)
2781 Agnes, Gregory Stephen. Performance of Nonlinear Mechanical, Resonant-Shunted Piezoelectric, and Electronic Vibration Absorbers for Multi-Degree-of-Freedom Structures (Ph.D. in Engineering Mechanics, Sept. 1997; ? + 7926Kb)
2492 Gonzalez, Reinaldo J. Raman, Infrared, X-ray, and EELS Studies of Nanophase Titania (Ph.D. in Physics, July 1996; 4607Kb)
1877 Shih, Po-Jen. On-Line Consolidation of Thermoplastic Composites (Ph.D. in Engineering Mechanics, Feb. 1997; 3.3Mb)
1791 Saldanha, Kevin J. Performance Evaluation of DECT in Different Radio Environments (MS in Electrical Engineering, Aug. 1996; 3.2Mb)
1431 DeVaux, David. A Tutorial on Authorware (MS in CS, April 1996; 2.3Mb)
1394 Kuhn, William B. Design of Integrated, Low Power, Radio Receivers in BiCMOS Technologies (Ph.D. in Electrical Engineering, Dec. 1995; 2518Kb)
Popular Works 1998
K-accesses Mbytes Degree Year Dept Tables/Figures Author
75, 12, PhD, 1997, ME, 38/174, Maillard 56, 6.5, PhD, 1996, CS, 8/93, Liu 20, 3.9, PhD, 1997, EE, 9/121, Laster 15, 4.9, PhD, 1997, CpE, 17/127, Tripathi 12, 6.6, MS, 1997, EE, 7/96, Nicoloso 6.7, 4.6, PhD, 1996, Physics, 8/62 (32 color),
Gonzalez
International Use 1996 1997 1998 850 2992 8170 United Kingdom 608 2,501 4223 Australia 346 2378 7373 Germany 713 2367 3970 Canada 387 1264 2201 South Korea 463 1161 4431 France 250 725 2553 Italy 191 867 2781 Netherlands 183 1130 1449 Brazil 22 967 1089 Thailand 83 958 1414 Greece
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members, Collection, Relationships– Support, Extensions
Conclusion
Relationship with publishers
Concern of faculty and students that still wish to publish books or journal articles, voiced: campus, Chronicle, NPR, Times
Solution: Approval Form gives students, faculty choices on access, when to change access condition; use IPR controls in DL
Solution: by case, work with publishers and publisher associations to increase access– AAP, AAUP– AAAS, ACM, ACS, Elsevier, ...
Some responses from publishers
ACM: need to acknowledge copyright Elsevier: need to acknowledge copyright IEEE-CS: endorse initiative ACS: After first publication, can release Textbook publishers: different market,
manuscript significantly reworked General: restricting access to local campus will
not cause any problems
Who are sponsors / cooperators? Funding, Donations of hardware/software
– SURA– US Dept. of Education (FIPSE)– Adobe Systems– IBM– Microsoft– OCLC
Others Serving on Steering Committee– National/Regional Projects: Australia, French
speaking group, Germany, IberoAmerica (ISTEC), UK (UTOG)
– CGS, National Lib. Canada, NSF, OAS, SOLINET, UMI, UNESCO, ...
How does this relate to UMI?
1987 UMI workshop to explore ETDs Support letter for US Dept. of Ed. proposal Steering and technical committee membership ProQuest Direct pilot of scanning works started
1/1/97, free 2 yr access to front part Collaborating on:
– accepting electronic author submissions– standards (e.g., representation), research
ETD Initiative (and UMI)
StudentsLearn aboutDL, EPub
TDsbecome more
expressive
N. Amer. (T)Ds areaccessible, archived
Global TDsbecome more
accessible,archived
UMI
Universities
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members, Collection, Access– Support, Extensions
Conclusion
User Search Support(multilingual, XML)
NDLTD W orld FederatedSearch
Virg in ia Tech ...(un iv)
U M I ...(corporate)
C IC ...(un iv group)
Portugese N L ...(national lib)
Austra lia(regional)
UserInterface
Note: All groups shown are connected with NDLTD.
Interoperability Tests Planned IBM DL: donated equipment, technical support,
powerful IPR (see TOIS, D-Lib) Z39.50: OCLC SiteSearch / VT tailored s/w
– university libraries w. catalogs of freely shared MARC records pointing to archival copies
– via URNs: handles & PURLs Dienst / NCSTRL - www.ncstrl.org: CS depts.,
DARPA, NSF, CNRI, Cornell - UVA is working on extensions for ETDs - Portugal is studying use for Europe - VT is working on Dienst to Z39.50 gateway
Access Approaches
Goal: Maximize access and services, e.g., by encouraging:
UMI centralized services Distributed service: Dienst, Z39.50 Regional services (e.g., OhioLink, AZ/NM) Local servers with browse, search
– From local catalogs to local archives WWW robot indexing and search services
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members, Collection, Involvement– Support, Extensions
Conclusion
Why might a university want to be involved?
To improve graduate education / better prepare your students / increase their knowledge and visibility
To unlock university information To save money for students and for the
university / improve workflow To build an important digital library
How can a university get involved?
Select planning/implementation team– Graduate School– Library– Computing / Information Technology– Institutional Research / Educ. Tech.
Send us letter, give us contact names Adapt Virginia Tech solution
– Build interest and consensus– Start trial / allow optional submission
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members, Collection, Member Types– Support, Extensions
Conclusion
Type 1 Members University Requires ETDs
Adobe Acrobat and/or XML/SGML tools Automated submission & processing Archive/access through UMI, (OCLC,)
Virginia Tech, ... (Local) WWW site, publicity (Local) Assistance provided as requested:
email, phone, listserv(s)
Type 2 Members University Agrees to Require ETDs
Like Type 1 but set date not reached Usually has an option or pilot May: wait for new AY; start with all who enter
after; … Build grass roots support
– Advisory committee: representative? expert?– Champions to spread by word of mouth– Approval: Senates, Commissions, Deans, Students– Publicity to reach community
NDLTD Members, Types 3-7
3. Part of university requires ETDs4. University allows ETDs5. University investigating, has pilot6. University consortium joins:
– CIC (Big 10 coordinating body)7. Non-university organization joins
– CNI (Coalition for Networked Info.)
Everyone LearnsStudents become “info literate”Students learn about discovery, search,
categorization/classification, e-pub, preservation, helping others find/reuse
Campus starts to think about IPR– e.g., Virginia Tech symposium
Faculty and students improve quality as reader base expands
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members, Collection– Support, Extensions
Conclusion
Support Services Developed
WWW site with > 300 Mb, CD, videotape Automated submission system (MySQL, UNIX,
WWW scripts - grad school/library) Student guidelines, style sheets, multimedia training
materials, FAQs, press info SGML and XML DTDs for ETDs SGML to HTML (web generator) LaTeX, Word templates, converters
Support Offered
Software, documentation, tech support Email, listservs ([email protected], -eval, -
grad, -library, -technical) Donations: Adobe, Microsoft Evaluation: instruments, analysis
http://scholar.lib.vt.edu - solutions/statistics (Temporary storage / archiving; aid - in setting up
an int’l service & archive)
PetaPlex
Digital Library Machine (“super” object store)
Parallel computer / storage utility for scale of 1000 to 1,000,000 gigabytes (terabyte/petabyte)
Knowledge Systems Incorporated is supplying VT-PetaPlex-1 with
– high speed backbone connection (OC-12)
– 2.5 terabytes through 100 “Nanoservers”:
– Network connection + IBM 25GB disk + 233 MHz Pentium II + Linux
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members, Collection– Support, Extensions
Conclusion
Accessibility Activities / Plans
Interface design (simple, 3D, VR) Usability studies Generic multi-lingual support Support for those with disabilities Hybrid collection (paper, MARC,
abstracts, full-text, multimedia) Disciplinary classifications, tools Visualization of results, collection
Enhancements
Dublin Core spec, MARC crosswalk DTDs for SGML, XML(+ <discipline>ML) Annotation system (author, friends, notes) Routing system (based on Sift) Multilingual WWW site, training materials (Spanish
recently done in Valencia) Better federated search (w. Z39.50, planned with
Dienst and Harvest - maybe MARIAN)
MARIAN Layers
Database Layer
Search Engine Layer
User Information Layer
User Interface Layer
User User User User
OUTLINE Introduction
– VT, DL, 5S, Education, Chain– Interest, Impact
NDLTD– Overview, History– Members, Collection– Support, Extensions
Conclusion
Future Work - 1 of 2 Working with publishers to increase level of access as
much as possible Interoperability tests among universities and with UMI
to provide integrated services Study with testbed that emerges, to improve
information retrieval, browsing, interface, and other types of user support
Evaluation, improving learning experience, spread to worldwide initiative, sustainable support and coordination
Future Work - 2 of 2 Adding services currently prototyped
– annotation and SDI (routing) capabilities– Dublic Core metadata, crosswalk to MARC– support with IBM DL, OCLC SiteSearch
Adding other services planned– building and using citation database (w. SFX)– implementing plagiarism check (like “SCAM”)
Developing NUDL as a sustainable self governing global institution (w. committees) including active participation in Japan