![Page 1: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/1.jpg)
Computational Characterization of
Salsa Music
Gerardo M. Sarria M.
Pontificia Universidad Javeriana - Cali
October, 2014
![Page 2: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/2.jpg)
![Page 3: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/3.jpg)
Cali
![Page 4: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/4.jpg)
![Page 5: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/5.jpg)
Pontificia Universidad Javeriana
• 184.254,84 m2
• 19 undergraduate programs
• 23 graduate programs
• 6928 students
• 800 faculty members
![Page 6: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/6.jpg)
OMLinux
• 1st OM Linux port
• OpenMusic v4.5
• CMUCL - Gtk+ - Midishare
• AGNULA Project
![Page 7: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/7.jpg)
AVISPA and Cordial/PiCO
• Cordial, a high-level visual programming language integrating object-oriented and constraint programming intended for musical applications.
• PiCO, a calculus integrating objects and constraints.
*C. Rueda, G. Alvarez, L. O. Quesada, G. Tamura, F. D. Valencia, J. F. Diaz, and G. Assayag. Integrating constraints and concurrent objects in musical applications: A calculus and its visual language. Constraints, 6(1):21-52, 2001.
![Page 8: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/8.jpg)
rtccProcess calculus:
• Based on ccp
• True concurrency
• Metrical notion of time
• Bounded time
• Transition system with resource handling
• Chu spaces
• Real-time logic
![Page 9: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/9.jpg)
rtcc
![Page 10: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/10.jpg)
rtcc - dissonancesThe cycle of tension-relaxation:
Preparation
Dissonance
Resolution
![Page 11: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/11.jpg)
Stochastic Context-Free Grammars
![Page 12: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/12.jpg)
Stochastic Context-Free Grammars
Degrees representation:
Grammar for major scales:
![Page 13: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/13.jpg)
MuZA• Constraint system in MoZArt
• Harmony
• Music relations implemented as propagators
![Page 14: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/14.jpg)
Music Search Engine
![Page 15: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/15.jpg)
Music Search Engine
Storage Retrieval
![Page 16: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/16.jpg)
Music Search Engine
• Content based retrieval
• MPEG7
• New Oracle datatype: ORDMP7
![Page 17: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/17.jpg)
Project Salsa
![Page 18: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/18.jpg)
Salsa• What is salsa?
• What makes salsa be salsa?
• Instruments
• Rhythm, melody, harmony
• Lyrics
• Singer / Band
• …
![Page 19: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/19.jpg)
Salsa
• Son clave:!"
#"!
# #!! $ !% $&
![Page 20: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/20.jpg)
Salsa• Piano or guitar:
!""#
$% &"' &'"( &&
""""
" $""!
&"
"&$""
&" &
#
""
$#'"
%(
2
'"
""""
&&"""
$"&
"&
'"
%(
3
&""
$' "&
" ""
))))'
& """
"
&&"'"
" $""
%(
4 #
""
$"&
![Page 21: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/21.jpg)
Salsa• Structure:
• Chorus:
Intro Verse Chorus Verse Chorus SoloInstrumental Chorus Ending
Montuno (singer/choir)Normal (choir)
![Page 22: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/22.jpg)
Project Salsa
Data Set
IA
![Page 23: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/23.jpg)
Salsa Data SetFind songs
Pre-analyze the songs (repetitions,metadata)
Audio features and metadata extraction
Addition to data set
![Page 24: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/24.jpg)
Salsa Data SetFind songs
Pre-analyze the songs (repetitions,metadata)
Audio features and metadata extraction
Addition to data set
Chorus extraction
![Page 25: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/25.jpg)
Salsa Data Set
![Page 26: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/26.jpg)
Salsa Data Set
![Page 27: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/27.jpg)
Salsa Data Set
![Page 29: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/29.jpg)
Salsa IA
• Weka
• Support Vector Machine, K-Nearest Neighbors, Decision trees
• Clustering, classification
![Page 30: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/30.jpg)
Salsa IA• Salsa 60s
• Salsa 70s
• Salsa 80s
• Salsa 90s
• Salsa 00s
• Salsa 10s
![Page 31: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/31.jpg)
Future: ComparisonHuman Expert vs Our System
![Page 32: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/32.jpg)
Future: Salsa DanceRelation between dance and music
![Page 33: Computational Characterization of Salsa Music fileSalsa • Piano or guitar: ... Salsa Data Set Find songs Pre-analyze the songs (repetitions,metadata) Audio features and metadata](https://reader031.vdocument.in/reader031/viewer/2022020205/5b86a5267f8b9ad1318d6c6b/html5/thumbnails/33.jpg)
Thank you