Session C105: Creating and Funding New Session C105: Creating and Funding New Initiatives Initiatives

A Tale of (2.0) Repositories:A Tale of (2.0) Repositories:Mapping History to CommunityMapping History to Community

Terence K. HuweTerence K. HuweInstitute for Research on Labor and EmploymentInstitute for Research on Labor and Employment

University of California, BerkeleyUniversity of California, Berkeley

Internet Librarian InternationalInternet Librarian InternationalOctober 16, 2008October 16, 2008

What I Will Cover TodayWhat I Will Cover Today

Digital Library Development—in two very Digital Library Development—in two very different design streamsdifferent design streamsResource: The California Labor Federation, Resource: The California Labor Federation, AFL-CIO: Proceedings and PapersAFL-CIO: Proceedings and PapersResource: California’s Living New Deal ProjectResource: California’s Living New Deal ProjectWhat they are and how they were fundedWhat they are and how they were fundedHow they each engage and build community, in How they each engage and build community, in different waysdifferent waysStrategic lessons we learned—and how they Strategic lessons we learned—and how they may transfer to other settingsmay transfer to other settings

The Design Environment: The Design Environment: Wide Open!Wide Open!

Digital library design requires rigorous skill—but the Digital library design requires rigorous skill—but the learning curve is manageablelearning curve is manageableDigital repositories are more flexible than full-scale Digital repositories are more flexible than full-scale archivesarchivesRepositories can be repurposed as “Thematic Web Repositories can be repurposed as “Thematic Web Sites” Sites” A repository can be built using different tools, and with A repository can be built using different tools, and with varied goals in mindvaried goals in mindWe chose two distinct developmental directions to We chose two distinct developmental directions to achieve different goalsachieve different goalsWe matched our technical to our user community needsWe matched our technical to our user community needs

Two Design Streams Stood Out:Two Design Streams Stood Out:XML-METS and PHP5XML-METS and PHP5

An XML-based, METS-compliant repository of fully An XML-based, METS-compliant repository of fully formed digital objects, persistent and backed by formed digital objects, persistent and backed by a dark archive as wella dark archive as well

METS: Metadata Encoding and Transmission StandardMETS: Metadata Encoding and Transmission StandardThe METS schema is a standard for encoding descriptive, The METS schema is a standard for encoding descriptive, administrative, and structural metadata regarding objects within a administrative, and structural metadata regarding objects within a digital library, expressed using the XML schema language of the digital library, expressed using the XML schema language of the World Wide Web Consortium. The standard is maintained in the World Wide Web Consortium. The standard is maintained in the Network Development and MARC Standards Office of the Library of Network Development and MARC Standards Office of the Library of Congress, and is being developed as an initiative of the Digital Congress, and is being developed as an initiative of the Digital Library Federation.Library Federation.

Advantages of METS-Compliant Advantages of METS-Compliant Digital ResourcesDigital Resources

Highly structuredHighly structured

Recognizes the interlinked nature of Recognizes the interlinked nature of administrative, descriptive and structural administrative, descriptive and structural information as fundamental elements of information as fundamental elements of the digital objectthe digital object

Enables you, the developer, to create very Enables you, the developer, to create very detailed finding aids using Encoded detailed finding aids using Encoded Archival Description (EAD)Archival Description (EAD)

Beyond METS: PHP5 is PowerfulBeyond METS: PHP5 is Powerful

The open Web offers durable and The open Web offers durable and compelling alternativescompelling alternatives

Open source Web programming Open source Web programming languages are sophisticatedlanguages are sophisticated

Many of the features of METS-based Many of the features of METS-based resources can be mimicked and even resources can be mimicked and even improved uponimproved upon

The answer: PHP5The answer: PHP5

PHP5-Driven RepositoriesPHP5-Driven Repositories

Are as flexible as your collective goals Are as flexible as your collective goals requirerequire

Give you the tools to create quality sites Give you the tools to create quality sites based on database-driven Web designbased on database-driven Web design

PHP5 is free and supported by a large PHP5 is free and supported by a large open source constituencyopen source constituency

It Compares well with Rails and other It Compares well with Rails and other programming platforms programming platforms

Strategic thinking should drive Strategic thinking should drive digital library developmentdigital library development

In some cases, the highly structured In some cases, the highly structured METS approach is bestMETS approach is best

But if speed, “public relations” and overall But if speed, “public relations” and overall program needs require faster action, program needs require faster action, PHP5 may be a better choicePHP5 may be a better choice

Our (2.0) RepositoriesOur (2.0) Repositories

California Labor Federation, AFL-CIO: California Labor Federation, AFL-CIO: Proceedings and PapersProceedings and Papers– METS compliant, and conforms to all METS compliant, and conforms to all

international standardsinternational standards

California’s Living New Deal ProjectCalifornia’s Living New Deal Project– PHP5, running our Sun server, well-written, PHP5, running our Sun server, well-written,

home grown programminghome grown programming

The California Labor Federation, AFL-The California Labor Federation, AFL-CIO: Proceedings and PapersCIO: Proceedings and Papers

100 years of California labor history100 years of California labor history– Conference proceedings, legislative voting records, Conference proceedings, legislative voting records,

newspapersnewspapers

California’s labor history—from the gold rush California’s labor history—from the gold rush onward—has been highly influential in the U.S.onward—has been highly influential in the U.S.The California Labor Federation was actively The California Labor Federation was actively interested in the projectinterested in the projectThe University of California Labor and The University of California Labor and Employment Research Fund provided generous Employment Research Fund provided generous fundingfunding

The Online Archive of CaliforniaThe Online Archive of California

Has a copy of the same collectionHas a copy of the same collection

Has made it widely availableHas made it widely available

A detailed finding aid will be uploaded in A detailed finding aid will be uploaded in fall 2008fall 2008

OAC uses a standard display so the OAC uses a standard display so the collection conforms to that displaycollection conforms to that display

We were the “pilot” project for contributing We were the “pilot” project for contributing PDF-format objects to the OACPDF-format objects to the OAC

Greatest Impact: Broad Access Greatest Impact: Broad Access Creates New Research PotentialCreates New Research Potential

The Internet paradigm of universal access The Internet paradigm of universal access remains powerfulremains powerfulVery deep silos of knowledge, like this one Very deep silos of knowledge, like this one become available to allbecome available to all100 years of labor history on your desktop 100 years of labor history on your desktop screenscreenCollaboration between the Labor Collaboration between the Labor Movement and faculty who study laborMovement and faculty who study labor

California’s Living New Deal ProjectCalifornia’s Living New Deal Project

Born of a moment of epiphany about Born of a moment of epiphany about FDR’s “New Deal”FDR’s “New Deal”– The artifacts are everywhereThe artifacts are everywhere– 2121stst century U.S. students may not know the century U.S. students may not know the

full story of the New Dealfull story of the New Deal

A group of impassioned geographers, A group of impassioned geographers, historians and photographers got to workhistorians and photographers got to work

What Was Needed: An Engaged What Was Needed: An Engaged CommunityCommunity

Volunteers throughout California are part Volunteers throughout California are part of a community of content providers—of a community of content providers—citizen documentarians in a sensecitizen documentarians in a sense

Many are archivists and historians Many are archivists and historians themselvesthemselves

UC Berkeley Ph.D. candidates review the UC Berkeley Ph.D. candidates review the work they compile for entry into the Web work they compile for entry into the Web resourceresource

Silicon Valley Mavericks:Silicon Valley Mavericks:

Wrote the code in Ruby on RailsWrote the code in Ruby on Rails

Did a great job of putting a site together---Did a great job of putting a site together---chicken wire and chewing gum includedchicken wire and chewing gum included

IRLE Library Web staff rewrote the entire IRLE Library Web staff rewrote the entire Web site in PHP5Web site in PHP5

It’s now running on our Sun server but It’s now running on our Sun server but may migrate to the UC Berkeley Web farmmay migrate to the UC Berkeley Web farm

Key value point: PERSISTENCE!Key value point: PERSISTENCE!

Two Organizational CollaboratorsTwo Organizational Collaborators

The California Historical SocietyThe California Historical Society– Paid staff and volunteer coordinatorsPaid staff and volunteer coordinators

The Columbia Foundation, our funding The Columbia Foundation, our funding partnerpartner

The University is the custodian of the The University is the custodian of the scholarly output, but it “belongs” scholarly output, but it “belongs” emotionally to many groups in the emotionally to many groups in the community toocommunity too

Value Points of a PHP5 ApproachValue Points of a PHP5 Approach

Born digital by geographers, and focused on Born digital by geographers, and focused on geospatial relationships—perfect for PHP5geospatial relationships—perfect for PHP5

Provides a straightforward way for vastly Provides a straightforward way for vastly different organizations to collaborate and create different organizations to collaborate and create their own “smart mob”their own “smart mob”

Has caused considerable excitement among Has caused considerable excitement among Roosevelt scholars and may be adoptedRoosevelt scholars and may be adopted

Is expandable, transferrable and easy to editIs expandable, transferrable and easy to edit

Some (2.0) ConclusionsSome (2.0) Conclusions

Digital repository development is a Digital repository development is a strategic process that can showcase strategic process that can showcase library skill to non-librarianslibrary skill to non-librariansChoose the appropriate information Choose the appropriate information architecture based on user needsarchitecture based on user needsBuild interactive features into the Build interactive features into the architecture—or tie them on (e.g. blogs)architecture—or tie them on (e.g. blogs)Focus on community by giving everybody Focus on community by giving everybody as much direct access as possibleas much direct access as possible

URLs and ReferencesURLs and References

California Labor Federation, AFL-CIO: Proceedings and PapersCalifornia Labor Federation, AFL-CIO: Proceedings and Papers--In the Online Archive of California: --In the Online Archive of California: http://content.cdlib.org/search?style=oac-img&sort=title&relation=ark:/13030/kt0489q6r6http://content.cdlib.org/search?style=oac-img&sort=title&relation=ark:/13030/kt0489q6r6California’s Living New Deal Project: California’s Living New Deal Project: http://livingnewdeal.berkeley.eduhttp://livingnewdeal.berkeley.eduIRLE Library Home: IRLE Library Home: http://www.irle.library.berkeley.eduhttp://www.irle.library.berkeley.eduMETS Home Page at the Library of Congress: METS Home Page at the Library of Congress: http://www.loc.gov/standards/mets/http://www.loc.gov/standards/mets/California Historical Society: California Historical Society: http://www.californiahistoricalsociety.org/http://www.californiahistoricalsociety.org/The Columbia Foundation: The Columbia Foundation: http://www.columbiafoundation.org/http://www.columbiafoundation.org/Library of Congress METS Tools and Utilities: Library of Congress METS Tools and Utilities: http://www.loc.gov/standards/mets/mets-tools.htmlhttp://www.loc.gov/standards/mets/mets-tools.html

Session C105: Creating and Funding New Session C105: Creating and Funding New Initiatives Initiatives

A Tale of (2.0) Repositories:A Tale of (2.0) Repositories:Mapping History to CommunityMapping History to Community

Terence K. HuweTerence K. HuweInstitute for Research on Labor and EmploymentInstitute for Research on Labor and Employment

University of California, BerkeleyUniversity of California, Berkeley

Internet Librarian InternationalInternet Librarian InternationalOctober 16, 2008October 16, 2008