nu primo – what’s next “ w hat to do with digital objects in primo ”
DESCRIPTION
NU Primo – What’s Next “ W hat to do with Digital Objects in Primo ”. IGeLU 2014 Michael North - Sr . Systems Analyst / Programmer Lead , Systems Team. AGENDA. .1. Digital Objects and Digital Collections : What is our Plan ? Why Use Primo ? - PowerPoint PPT PresentationTRANSCRIPT
NU Primo – What’s Next“What to do with Digital Objects in
Primo”
IGeLU 2014
Michael North - Sr. Systems Analyst / Programmer Lead, Systems Team
AGENDA
.1. Digital Objects and Digital Collections : What is our Plan ? Why Use Primo ?
.2. Fedora and Primo workflow / Integrated with Blackboard
.3. Fun Item : Dublin Core : Youtube Videos and Blackboard Canvas ???
.4. MODS protocol extract and Ingestion (Winterton Collection)
.5. EAD to Primo (Finding Aids)
.6. METS schema : African Maps Collection
.7. MODS schema : African Posters
.8. LibGuides into Primo
What is our Plan? … ya gotta have a plan !
Heaviest Traffic Blackboard
2nd Heaviest Traffic Library
Fastest Growing Traffic Repositories
= The “sweet spot”Develop integrated solution
ISSUES:Metadata choice ?Repository solution ?Primo Configuration ?
Working with DC Silo’s
Working with Primo
Moving to …… Fedora and Primo
First Hurdle
* All different inside* Consistent Delivery
Why use Primo for Digital Collections Viewing ?
Built-in facet search capability.Boolean search capability
Value of cross collection searching.Facets work (select 2+)Advanced searchingIntegration into other applications (such as Blackboard CMS)
#1 reason: Access points increased (more than one way to find). Entry point for patron into a collection/website they never knew about.
NOTE: Use Primo instead of hiring a team of developers to build a repository website capable of
cross-collection searching ! ! !
Digital Collections Searching And
Cross Collection Searching
NEW : Repository Cross Searching VIEW
Cross Collection Searching
More Options : to facilitate Xsearching
Advanced Search Select specific Digital Collection
Repository Metadata Workflow into Primo So-Far !
EAD/MODS to PNX/Primo (Winterton / Africana Posters)
METS/MODS to PNX/Primo (Africana Maps)
EAD to PNX/Primo (Archon - Finding Aids)
XML to PNX/Primo (LibGuides)
Dublin Core to PNX/Primo (YouTube Videos)
Fedora to Primo Overview
Metadata Schema EAD, MODS, METS, DC, etc.
MODSDatafile
(xml)
PNXDatafile
PNXDB
FEDORA PRIMO
Fedora Objects
Schema Conversions: Convert non-
MODS metadata to MODS xml
files.
Ruby/Rails script with
XSLT
Primo Harvest:XML File Splitter & Harvest
MODS to PNX :
Convert MODS xml files into
single PNX file.
Ruby/Rails script with
XSLT
Primo BackOffice using basic XML pipe
ITQL or SPARQL query
PIDs file
Fedora Exported
File
Extract Fedora
Metadata: Extract Fedora
Objects Metadata
Schema to xml files.
(mets, dc, ead, etc)
MODS metadata export
Non-MODS metadata export
1
2
2
3
4
5
OR
2 3 5Extract PIDs File:
Use ITQL to create file with
PIDs.
1
4
Add Collection Updates:
Use above procedure – only use the
add_content.rb script.
6
Ruby/Rails script
* 4 Ruby Scripts (export, convert, mods_2_pnx, add_content.rb)* Fedora = modular repository system for management and dissemination of digital content.
* Why do we run 3 scripts ? It will be one script eventually ! ! !
Something Special for our Teaching Faculty
With Primo and Blackboard interoperability
=================
Dublin CoreUse DC to manually add
YouTube Videos for Faculty Classroom use with
Blackboard CMS.
Example: DC record from Faculty Form
PULL E-Shelf folders into Blackboard
Primo E-Shelf Folders built by Faculty Member
PULL feature
E-Shelf Folders in Blackboard Course Documents PageWith additional instructions
* Dynamically linked ! ! !
DYNAMICLinks ! ! !
YouTube VideosHistory
The professor was thrilled.
PUSH feature of Primo/Blackboard interoperability
Side note :We added Primo Searching (and Library Resources) into Blackboard
How the Primo/Bb Project Comes Around "FULL CIRCLE" with our
repository development
• Teachers provide digital objects or request one (NU scanning project). These objects are made available through Primo via "harvesting."
• Teachers pull or push this material into their Blackboard Course Materials pages.
• Students use the material in a classroom environment.
Primo/Blackboard Video’s
YouTube : Northwestern Primo/Blackboard PULL Integration Demo http://youtu.be/dq_C4AAWF2U
YouTube : Northwestern Primo/Blackboard PUSH Integration Demo http://youtu.be/B6rSV4hgy5g
PLEASE USE BOTH LINKS (there are older vids on this site)
CANVAS ????
Northwestern is moving to Canvas this fall and will no longer be using Blackboard so we are now looking at replicating these features in Canvas, and possible using LTI.
Our next major undertaking ! ! ! !
Blackboard
MODSHarvesting
MODs Primo
(Winterton Collection)
The Winterton Collection (using MODS)
We chose MODS because it lets us document “hierarchical” metadata.
Provenance ! ! !
Important to Special Collections and Archives.
Winteron Case.
Why MODS ?
MODSDatafile
(xml)
PNXDatafile
PNXDB
FEDORA PRIMO
Fedora Objects
Ruby/Rails script with
XSLT
Primo Harvest:XML File Splitter & Harvest
MODS to PNX :
Convert MODS xml files into
single PNX file.
Primo BackOffice using file
splitter and basic XML
pipeITQL or SPARQL query
PIDs file
Extract Fedora Metadata:
Extract Fedora Objects
Metadata Schema to xml
files.
MODS metadata export
1
2
4
5
2 5Extract PIDs File: Use ITQL to create file with PIDs.
1
4XSLTEAD
MODS
EAD/MODS to PNX/PrimoWinterton Collection
Ruby/Rails script
Winterton Process
The Winterton records in Fedora are stored, along with corresponding images, as Fedora Objects. These objects include multiple files including descriptive metadata. The Fedora object (theoretically) might have a tiff file, a jpeg file, a pdf.
First, we created an XSLT script which created the MODS portion of the Fedora objects and these are the record form one sees on the Digital Collections site.
Then we created a Ruby on Rails script that exports the MODS files out of Fedora.
Then we created a Ruby/Rails script that uses an XSLT script that transforms the MODS records into PNX records.
Finally, we ingest the PNX record into using the default XML file splitter and pipe.
Primo Record Discovery – Details Tab
Parent of image
Actual image (item record)
Primo Record Discovery – Online Resource Tab
Actual Photo displayClick on “thumbnail” or image displayed in Online Resource or Details tabs.
Image on parent page
Parent of actual image record (hierarchy provided)Click on the “Link to source in Winterton Collection of East African Photographs” link in the “Online Resource” or “Details” tabs. This will display the parent page of the individual record (shows where the image came from).
Clicking on Component Page provides Picture detail…. Plus metadata for the picture.
So, Why Is This So GREAT ! ! !
This harvesting method incorporates hierarchical metadata into Primo for our collections, and provides another access point for patrons who never knew about the Winterton Collection. So now, patrons can look at the digital object directly in a webpage, or they can go to the Winterton Repository website via Primo and be placed right into the collection website so they can look at other related objects.
EAD Finding Aids (Archon)
into Primo
Metadata Schema: EAD
MODSDatafile
(xml)
PNXDatafile
PNXDB
FEDORA PRIMO
Fedora Objects
Schema Conversions:
Convert non-MODS metadata
to MODS xml files.
Ruby/Rails script with
XSLT
Primo Harvest:XML File Splitter & Harvest
MODS to PNX :
Convert MODS xml files into
single PNX file.
Ruby/Rails script with
XSLT
Primo BackOffice using basic XML pipe
ITQL or SPARQL query
PIDs file
Fedora Export
File
Extract Fedora
Metadata: Extract Fedora
Objects Metadata
Schema to xml files.
Non-MODS metadata export
1
2
3
4
5
2 3 5Extract PIDs File:
Use ITQL to create file with
PIDs.
1
4
EAD to PNX/PrimoArchon – Finding Aids
Ruby/Rails script
ARCHON (Finding Aids - publishes archival descriptive information ) EAD
EAD Metadata for the Finding Aids (inventories, indexes or guides)
Archival and Manuscript Collection Portal : Over 400 collections are accessible using EAD Finding Aids
Just listings – indexes – guides - inventories
Getting from here….
To here….
Ingested into Fedora
Archon EAD record
Extract PIDS file from FEDORA using ITQL query
Ruby on Rails script Uses PIDs file to extract the entire EAD record from FEDORA
EAD record extracted from FEDORA
MODS records created from descriptive section of EAD
XSLT script
XSLT script transforms records into PNX data file
Set up pipe and simple normalization rules that copy the PNX data file into Primo
Finding aids in Primo Another ACCESS POINT ! ! !
Metadata Schema: EAD
MODSDatafile
(xml)
PNXDatafile
PNXDB
FEDORA PRIMO
Fedora Objects
Schema Conversions:
Convert non-MODS metadata
to MODS xml files.
Ruby/Rails script with
XSLT
Primo Harvest:XML File Splitter & Harvest
MODS to PNX :
Convert MODS xml files into
single PNX file.
Ruby/Rails script with
XSLT
Primo BackOffice using basic XML pipe
ITQL or SPARQL query
PIDs file
Fedora Export
File
Extract Fedora
Metadata: Extract Fedora
Objects Metadata
Schema to xml files.
Non-MODS metadata export
1
2
3
4
5
2 3 5Extract PIDs File:
Use ITQL to create file with
PIDs.
1
4
EAD to PNX/PrimoArchon – Finding Aids
Ruby/Rails script
REVIEW SLIDE ARCHON (Finding Aids)EAD
METS Metadata Schema into
Primo (African Maps)
MODSDatafile
(xml)
PNXDatafile
PNXDB
FEDORA PRIMO
Ruby/Rails script with
XSLT
Primo Harvest:XML File Splitter & Harvest
MODS to PNX :
Convert MODS xml files into
single PNX file.
Primo BackOffice using file
splitter and basic XML
pipeITQL or SPARQL query
PIDs file
Extract Fedora
Metadata: Extract Fedora
Objects Metadata
Schema to xml files.
MODS metadata export
1
2
4
5
2 5Extract PIDs File: Use ITQL to create file with PIDs.
1
4
METS/MODS to PNX/PrimoAfricana Maps Collection
Ruby/Rails script
MODSDC
Africana MapsFedora Objects
METS
Africana Maps Process
In our Fedora Africana Maps Collection, the Fedora Objects contain METS files that function as a wrapper around MODS and Dublin Core metadata. The METS file contains a Description Section that contain MODS metadata and Dublin Core metadata. The MODS and DC metadata was created by using the VB script behind Gary Strawn’s Catalogers Toolkit Program (not the actual program menu itself). .1. In short, MODS and DC metadata is contained within the METS metadata schema. .2. Then, a Ruby/Rails script accesses the MODS metadata (within METS) and creates a MODS XML file.
.3. Then, a Ruby/Rails script is run with an XSLT file, that converts the MODS XML to a PNX file. .4. Using the Primo XML File Splitter, the Africana Maps PNX file is harvested by Primo.
AFRI-MAPS : METS Wrapper with MODS
Primo Record for African Map Collection
View and Zoom in Primo VIEW ONLINE tab
MODS: African
Posters into Primo
MODSDatafile
(xml)
PNXDatafile
PNXDB
FEDORA PRIMO
Fedora Objects
Ruby/Rails script
with XSLT
Primo Harvest:XML File Splitter & Harvest
MODS to PNX :
Convert MODS xml files into
single PNX file.
Primo BackOffice using file
splitter and basic XML
pipeITQL or SPARQL query
PIDs file
Extract Fedora
Metadata: Extract Fedora
Objects Metadata
Schema to xml files.
MODS metadata export
1
2
4
5
2 5Extract PIDs File: Use ITQL to create file with PIDs.
1
4XSLTEAD
MODS
EAD/MODS to PNX/PrimoAfrican Posters Collection
Ruby/Rails script
Image appears in the Primo Online Resource tab
Linking takes the user to the image inside the Collection website (new “access”)
LibGuides into
Primo
LibGuides into Primo
LibGuides records Send link
that will generate an XML
file
Springshare
XML Datafile
XSLT script Excel
table
(links guide ID number with guide
creator name)
PRIMO
libguideaccounts
Mapping table
Primo BackOffice using file splitter and basic XML pipe PNX
DB
LibGuides into Primo – why good!
• Use XSLT script to create mapping table that will link LibGuide creator to guide
LibGuides into Primo
XSLT script
Accounts, Categories, Guides
LibGuides into Primo• Upload mapping table in Primo Back Office
LibGuides into Primo• Configure file splitter
• Create normalization rules
• Configure data source
LibGuides into Primo
• Define pipe
LibGuides into Primo
Records appear in Primo:
LibGuides into PrimoRecords appear in Primo “VIEW ONLINE” tab
DID I SAY YET. . . . . . . . . . . .What I have shown you today provides additional ACCESS POINTS to your digital collections such that users can find your digital collection, LibGuides, AND Finding Aids, without ever knowing where they are ! ! ! ! And once Primo links take them to the collection website (that they did not know existed), they will discover MORE ! ! !
Session Review
.1. Digital Objects and Digital Collections : What is our Plan ? Why Use Primo ?
.2. Fedora and Primo workflow / Integrated with Blackboard
.3. Fun Item : Dublin Core : Youtube Videos and Blackboard Canvas ???
.4. MODS protocol extract and Ingestion (Winterton Collection)
.5. EAD to Primo (Finding Aids)
.6. METS to Primo : African Maps Collection
.7. MODS to Primo : African Posters
.8. LibGuides XML into Primo
What’s Next
.1. Deep Search setup with News Archives from Vanderbilt University.
.2. More Digital Collections at Northwestern.
.3. Looking at ingesting external collections of interest (Africana). Example : DPLA collections harvest ??? Smithsonian ???