computational characterization of salsa music filesalsa • piano or guitar: ... salsa data set find...

Computational Characterization of

Salsa Music

Gerardo M. Sarria M.

Pontificia Universidad Javeriana - Cali

October, 2014

Cali

Pontificia Universidad Javeriana

• 184.254,84 m2

• 19 undergraduate programs

• 23 graduate programs

• 6928 students

• 800 faculty members

OMLinux

• 1st OM Linux port

• OpenMusic v4.5

• CMUCL - Gtk+ - Midishare

• AGNULA Project

AVISPA and Cordial/PiCO

• Cordial, a high-level visual programming language integrating object-oriented and constraint programming intended for musical applications.

• PiCO, a calculus integrating objects and constraints.

*C. Rueda, G. Alvarez, L. O. Quesada, G. Tamura, F. D. Valencia, J. F. Diaz, and G. Assayag. Integrating constraints and concurrent objects in musical applications: A calculus and its visual language. Constraints, 6(1):21-52, 2001.

rtccProcess calculus:

• Based on ccp

• True concurrency

• Metrical notion of time

• Bounded time

• Transition system with resource handling

• Chu spaces

• Real-time logic

rtcc

rtcc - dissonancesThe cycle of tension-relaxation:

Preparation

Dissonance

Resolution

Stochastic Context-Free Grammars

Stochastic Context-Free Grammars

Degrees representation:

Grammar for major scales:

MuZA• Constraint system in MoZArt

• Harmony

• Music relations implemented as propagators

Music Search Engine

Music Search Engine

Storage Retrieval

Music Search Engine

• Content based retrieval

• MPEG7

• New Oracle datatype: ORDMP7

Project Salsa

Salsa• What is salsa?

• What makes salsa be salsa?

• Instruments

• Rhythm, melody, harmony

• Lyrics

• Singer / Band

• …

Salsa

• Son clave:!"

#"!

# #!! $ !% $&

Salsa• Piano or guitar:

!""#

$% &"' &'"( &&

""""

" $""!

&"

"&$""

&" &

#

""

$#'"

%(

2

'"

""""

&&"""

$"&

"&

'"

%(

3

&""

$' "&

" ""

))))'

& """

"

&&"'"

" $""

%(

4 #

""

$"&

Salsa• Structure:

• Chorus:

Intro Verse Chorus Verse Chorus SoloInstrumental Chorus Ending

Montuno (singer/choir)Normal (choir)

Project Salsa

Data Set

IA

Salsa Data SetFind songs

Pre-analyze the songs (repetitions,metadata)

Audio features and metadata extraction

Addition to data set

Salsa Data SetFind songs

Pre-analyze the songs (repetitions,metadata)

Audio features and metadata extraction

Addition to data set

Chorus extraction

Salsa Data Set

Salsa Data Set

Salsa Data Set

Salsa Data Set

WebPagehttp://salsadataset.elgta.org/

Salsa IA

• Weka

• Support Vector Machine, K-Nearest Neighbors, Decision trees

• Clustering, classification

Salsa IA• Salsa 60s

• Salsa 70s

• Salsa 80s

• Salsa 90s

• Salsa 00s

• Salsa 10s

Future: ComparisonHuman Expert vs Our System

Future: Salsa DanceRelation between dance and music

Thank you