the strachwitz frontera digital archive of mexican and mexican-american recordings chicano studies...

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

The Strachwitz Frontera Digital

Archive of Mexican and Mexican-

American Recordings

Stephen DavisonGordon Theil

TECH TALK #12Dec. 18, 2003

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Participants

• Arhoolie Foundation– Chris Strachwitz

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Participants

• Arhoolie Foundation– Chris Strachwitz

• UCLA– Chicano Studies Research Center– Music Library– Digital Library Program

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Participants

• Arhoolie Foundation– Chris Strachwitz

• UCLA– Chicano Studies Research Center– Music Library– Digital Library Program

• Los Tigres del Norte Foundation

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Participants

• Arhoolie Foundation– Chris Strachwitz

• UCLA– Chicano Studies Research Center– Music Library– Digital Library Program

• Los Tigres del Norte Foundation

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Project outline

1. Digitization2. Data import, editing3. Production

a. Infrastructure• Application programming• Website design

b. Data• Create audio & image derivatives• Data upload

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Some digital audio statistics

• Audio masters: 24 bit samples, 96kHz– 138,240,000 bits/sec. = 16.5

MB/min.– 30,000 3-minute recordings

1,483,154 MB = 1.4 terabytes

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Some digital audio statistics

• Audio masters: 24 bit samples, 96kHz– 138,240,000 bits/sec. = 16.5

MB/min.– 30,000 3-minute recordings

1,483,154 MB = 1.4 terabytes

• Audio submasters: 16 bit, 44.1kHz– 42,336,000 bits/sec. = 5.0

MB/min.

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Some digital audio statistics

• Audio masters: 24 bit samples, 96kHz– 138,240,000 bits/sec. = 16.5 MB/min.– 30,000 3-minute recordings

1,483,154 MB = 1.4 terabytes

• Audio submasters: 16 bit, 44.1kHz– 42,336,000 bits/sec. = 5.0 MB/min.

• Service copies (web delivery, reference)– MPEG Audio Layer 3 (MP3)– 128,000 bits/sec (128 kbps)

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Some digital audio statistics

• Audio masters: 24 bit samples, 96kHz– 138,240,000 bits/sec. = 16.5 MB/min.– 30,000 3-minute recordings

1,483,154 MB = 1.4 terabytes

• Audio submasters: 16 bit, 44.1kHz– 42,336,000 bits/sec. = 5.0 MB/min.

• Service copies (web delivery, reference)– MPEG Audio Layer 3 (MP3)– 128,000 bits/sec (128 kbps)

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

1. Digitization

• At Arhoolie Records in El Cerrito, CA– Tom Diamant, Manager of

Arhoolie Records

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

1. Digitization

• At Arhoolie Records in El Cerrito, CA

• Disc cleaning

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

1. Digitization

• At Arhoolie Records in El Cerrito, CA

• Disc cleaning• Choice of stylus

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

1. Digitization• At Arhoolie Records in El Cerrito,

CA• Disc cleaning• Choice of stylus• Audio digitization (real time)

– Technics Sp-15 Turntable, Shure M44G Cartridge, Elberg MD12 pre-amp, Prism Sound Dream AD-2 A/D converter, Digital Audio Labs CardDeluxe sound card, Wavelab 3.0 software, 24/96 transfer

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

1. Digitization

• At Arhoolie Records in El Cerrito, CA

• Disc cleaning• Choice of stylus• Audio digitization (real time)• Create keywords

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

1. Digitization

• At Arhoolie Records in El Cerrito, CA

• Disc cleaning• Choice of stylus• Audio digitization (real time)• Create keywords• Scan label

– 300 dpi, 24 bit color

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

1. Digitization

• At Arhoolie Records in El Cerrito, CA

• Disc cleaning• Choice of stylus• Audio digitization (real time)• Create keywords• Scan label• Copy data, audio files, images

to DVD-R

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

1. Digitization• At Arhoolie Records in El Cerrito,

CA• Disc cleaning• Choice of stylus• Audio digitization (real time)• Create keywords• Scan label• Copy data, audio files, images to

DVD-R• Mail to UCLA

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

1. Digitization• At Arhoolie Records in El Cerrito,

CA• Disc cleaning• Choice of stylus• Audio digitization (real time)• Create keywords• Scan label• Copy data, audio files, images to

DVD-R• Mail to UCLA

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Filen: idl_277-A_R-277-ALabel: IdealCatalog no.: 277-AMatrix no.: R-277-AAlt. mat. no.: A 11958Title: Perdi A Mi MadreComposer: Gonzalez, M.E.Genre: CanciónArtist/Label: Los Dos ManuelesArtist/Real name: Gonzalez, Manuel & Valdez, ManuelAccompaniment: Conjunto Ideal y Narciso MartinezKeywords: funeral lament despairNotes: 78 was sent for processing of 2000 copies on February 18, 1949 along with an order

for 3000 labels.Transfer date: 3/7/02Stylus: 2

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

2. Data import, editing

• Map data to UCLA Core DB

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

2. Data import, editing

• Map data to UCLA Core DB

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

2. Data import, editing

• Map data to UCLA Core DB

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Data import, editing

• Map data to UCLA Core DB

DC_Identifier: idl_277-A_R-277-ADC_Title: Perdí A Mi MadreDC_Descr.: <genre>Canción</genre>

<matrix>R-277-A</matrix><matrix>A 11958</matrix><note>Conjunto Ideal y Narciso Martinez</note><note>78 was sent for processing of 2000 copies on February18, 1949 along with an order for 3000 labels.</note>

DC_Publisher: Ideal 277-ADC_Language: Spanish

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

2. Data import, editing

• Map data to UCLA Core DB• Edit names to conform to

controlled list

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Data import, editing

• Map data to UCLA Core DB• Edit names to conform to

controlled list

DC_Identifier: idl_277-A_R-277-ADC_Title: Perdí A Mi MadreDC_Descr.: <genre>Canción</genre>

<matrix>R-277-A</matrix><matrix>A 11958</matrix><note>Conjunto Ideal y Narciso Martinez</note><note>78 was sent for processing of 2000 copies on February18, 1949 along with an order for 3000 labels.</note>

DC_Publisher: Ideal 277-ADC_Language: Spanish

DC_Creator: González, M. E. [composer] DC_Creator: Los Dos Manueles [artistLabel] DC_Creator: González, Manuel [artistRealName] DC_Creator: Valdez, Manuel [artistRealName]

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

2. Data import, editing

• Map data to UCLA Core DB• Edit names to conform to

controlled list• Map keywords to controlled

subject list

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Data import, editing

• Map data to UCLA Core DB• Edit names to conform to

controlled list• Map keywords to controlled

subject list

DC_Identifier: idl_277-A_R-277-ADC_Title: Perdí A Mi MadreDC_Descr.: <genre>Canción</genre>

<matrix>R-277-A</matrix><matrix>A 11958</matrix><note>Conjunto Ideal y Narciso Martinez</note><note>78 was sent for processing of 2000 copies on February18, 1949 along with an order for 3000 labels.</note>

DC_Publisher: Ideal 277-ADC_Language: Spanish

DC_Creator: González, M. E. [composer] DC_Creator: Los Dos Manueles [artistLabel] DC_Creator: González, Manuel [artistRealName] DC_Creator: Valdez, Manuel [artistRealName]

DC_Subject: Lament—FuneralDC_Subject: Love--Despair

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

2. Data import, editing

• Map data to UCLA Core DB• Edit names to conform to controlled

list• Map keywords to controlled subject

list• Create audio & image submasters• Create MP3 files• Update Core DB with file information

– Inventory of digital content– Provides links in DL application

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Data import, editing• Map data to UCLA Core DB• Edit names to conform to controlled

list• Map keywords to controlled subject

list• Create audio & image submasters• Create MP3 files• Update Core DB with file information

– Inventory of digital content– Provides links in DL application

DC_Identifier: idl_277-A_R-277-ADC_Title: Perdí A Mi MadreDC_Descr.: <genre>Canción</genre>

<matrix>R-277-A</matrix><matrix>A 11958</matrix><note>Conjunto Ideal y Narciso Martinez</note><note>78 was sent for processing of 2000 copies on February18, 1949 along with an order for 3000 labels.</note>

DC_Publisher: Ideal 277-ADC_Language: Spanish

DC_Creator: González, M. E. [composer] DC_Creator: Los Dos Manueles [artistLabel] DC_Creator: González, Manuel [artistRealName] DC_Creator: Valdez, Manuel [artistRealName]

DC_Subject: Lament—FuneralDC_Subject: Love--Despair

MASTERTIF: idl_277-a_r-277-a.tifMASTERWAV: idl_277-a_r-277-a.wavMP3: idl_277-a_r-277-a_a.mp3SUBMASTTIF: idl_277-a_r-277-a_a.tifSUBMASTWAV: idl_277-a_r-277-a_a.wav

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

2. Data import, editing

• Map data to UCLA Core DB• Edit names to conform to controlled

list• Map keywords to controlled subject

list• Create audio & image submasters• Create MP3 files• Update Core DB with file information

– Inventory of digital content– Provides links in DL application

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Progress

• Beta (August 2003)– 11,703 data records– 11,203 audio files– 11,693 images

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Progress

• Beta (August 2003)– 11,703 data records– 11,203 audio files– 11,693 images

• Launch (February 2004)– 15,560 data files– 15,055 audio files– 15,550 images

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Progress

• Beta (August 2003)– 11,703 data records– 11,203 audio files– 11,693 images

• Launch (February 2004)– 15,560 data files– 15,055 audio files– 15,550 images

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

a. Infrastructure• Application programming• Website design

b. Data• Create audio & image

derivatives• Data upload

3. Production

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Data upload• Upload metadata and images to

Digital Library system (Linux, Oracle, JSP)

• Upload MP3 files to Helix (Real) audio server

• Generate Ram and SMIL files– Ram metafile: activates RealMedia

player– SMIL (Synchronized Multimedia

Integration Language): location of server; length of the clip to stream

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

ColdFusion application & DL file server

Audiomasters &derivatives

Imagemasters &derivatives

MS Access DB(metadata)

Data management(CF application)

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Oracle DB(metadata)

Images(TIFF)

Audio content (MP3)

DL application & file servers

Media streaming & file server ColdFusion application & DL file server

Audiomasters &derivatives

Imagemasters &derivatives

MS Access DB(metadata)

Data management(CF application)

Web server, JSP,DL applications

Helixmediaserver

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Web server, JSP,DL applications

Oracle DB(metadata)

Helixmediaserver

Images(TIFF)

Audio content (MP3)

Browser

PC DL application & file servers

Media streaming & file server ColdFusion application & DL file server

Audiomasters &derivatives

Imagemasters &derivatives

MS Access DB(metadata)

Data management(CF application)

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Web server, JSP,DL applications

Oracle DB(metadata)

Rammetafiles

Media player

Helixmediaserver

Images(TIFF)

Audio content (MP3)

Browser

PC DL application & file servers

Media streaming & file server ColdFusion application & DL file server

Audiomasters &derivatives

Imagemasters &derivatives

MS Access DB(metadata)

Data management(CF application)

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Web server, JSP,DL applications

Oracle DB(metadata)

Rammetafiles

Media player

Helixmediaserver

Images(TIFF)

Audio content (MP3)

Browser

PC DL application & file servers

Media streaming & file server ColdFusion application & DL file server

Audiomasters &derivatives

Imagemasters &derivatives

MS Access DB(metadata)

Data management(CF application)

Ram metafile:

rtsp://audior.library.ucla.edu/frontera/smil/idl_277-a_r-277-a_a.smil

Ram metafile:

rtsp://audior.library.ucla.edu/frontera/smil/idl_277-a_r-277-a_a.smil

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Web server, JSP,DL applications

Oracle DB(metadata)

Rammetafiles

Media player

Helixmediaserver

Images(TIFF)

Audio content (MP3)

Browser

PC DL application & file servers

Media streaming & file server ColdFusion application & DL file server

Audiomasters &derivatives

Imagemasters &derivatives

MS Access DB(metadata)

Data management(CF application)

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Web server, JSP,DL applications

Oracle DB(metadata)

Rammetafiles

SMILfiles

Media player

Helixmediaserver

Images(TIFF)

Audio content (MP3)

Browser

PC DL application & file servers

Media streaming & file server ColdFusion application & DL file server

Audiomasters &derivatives

Imagemasters &derivatives

MS Access DB(metadata)

Data management(CF application)

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Web server, JSP,DL applications

Oracle DB(metadata)

RAMmetafiles

SMILfiles

Media player

Helixmediaserver

Images(TIFF)

Audio content (MP3)

Browser

PC DL application & file servers

Media streaming & file server ColdFusion application & DL file server

Audiomasters &derivatives

Imagemasters &derivatives

MS Access DB(metadata)

Data management(CF application)

SMIL file:

<smil><head><meta name="base" content="rtsp://audior.library.ucla.edu/frontera/"/></head><body><audio src="idl_277-a_r-277-a_a.mp3"/></body></smil>

SMIL file:

<smil><head><meta name="base" content="rtsp://audior.library.ucla.edu/frontera/"/></head><body><audio src="idl_277-a_r-277-a_a.mp3"/></body></smil>

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Web server, JSP,DL applications

Oracle DB(metadata)

RAMmetafiles

SMILfiles

Media player

Helixmediaserver

Images(TIFF)

Audio content (MP3)

Browser

PC DL application & file servers

Media streaming & file server ColdFusion application & DL file server

Audiomasters &derivatives

Imagemasters &derivatives

MS Access DB(metadata)

Data management(CF application)

SMIL file:

<smil><head><meta name="base" content="rtsp://audior.library.ucla.edu/frontera/"/></head><body><audio src="idl_277-a_r-277-a_a.mp3" end="50s"/></body></smil>

SMIL file:

<smil><head><meta name="base" content="rtsp://audior.library.ucla.edu/frontera/"/></head><body><audio src="idl_277-a_r-277-a_a.mp3" end="50s"/></body></smil>

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Web server, JSP,DL applications

Oracle DB(metadata)

Rammetafiles

SMILfiles

Media player

Helixmediaserver

Images(TIFF)

Audio content (MP3)

Browser

PC DL application & file servers

Media streaming & file server ColdFusion application & DL file server

Audiomasters &derivatives

Imagemasters &derivatives

MS Access DB(metadata)

Data management(CF application)

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Web server, JSP,DL applications

Oracle DB(metadata)

Rammetafiles(IP access

control)

SMILfiles

Media player

Helixmediaserver

Images(TIFF)

Audio content (MP3)

Browser

PC DL application & file servers

Media streaming & file server ColdFusion application & DL file server

Audiomasters &derivatives

Imagemasters &derivatives

MS Access DB(metadata)

Data management(CF application)

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Web server, JSP,DL applications

Oracle DB(metadata)

Rammetafiles(IP access

control)

SMILfiles

Helixmediaserver

Images(TIFF)

Audio content (MP3)

PC DL application & file servers

Media streaming & file server ColdFusion application & DL file server

Audiomasters &derivatives

Imagemasters &derivatives

MS Access DB(metadata)

Data management(CF application)

×

Media player

Browser

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Web server, JSP,DL applications

Oracle DB(metadata)

Rammetafiles(IP access

control)

SMILfiles

Media player

Helixmediaserver

Images(TIFF)

Audio content (MP3)

Browser

PC DL application & file servers

Media streaming & file server ColdFusion application & DL file server

Audiomasters &derivatives

Imagemasters &derivatives

MS Access DB(metadata)

Data management(CF application)

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

Next steps

• Data reload• Spanish language pages• Implement access control

The Strachwitz Frontera Digital Archive of Mexican and Mexican-American Recordings

Chicano Studies Research Center – Music Library – Digital Library Program

http://digital.library.ucla.edu/frontera

Website