witchcraft towards integration of mir and folk song research peter van kranenburg, j ö rg garbers,...

WITCHCRAFT

Towards Integration of MIR and Folk Song Research

Peter van Kranenburg, Jörg Garbers, Anja Volk, Frans Wiering, Louis P. Grijp, Remco C. Veltkamp

2ISMIR 2007 - Towards Integration of MIR and folk Song Research

Introduction: Purpose

Present our approach toimprove

cooperation betweenMusic Information Retrieval andFolk Song Research (Musicology)


Introduction: Central Question

How to retrieve related folk song melodies from a large database?


Folk Song Research

NeededKnowledge about Folk Song Melodies

Provided byFolk Song Research (Volksliedkunde)


Folk Song Research

Most important feature of folk songs:

Oral Transmission


Folk Song Research: Major Tasks

ClassificationGroup together melodies that share some features

IdentificationTo which ‘tune-family’ does this melody belong?


Folk Song Research: Classification

Classification Krohn (early 20th c.)

• Cadence tones Bartók, Kodály (first half 20th c.)

• Number of lines• Cadence tones• Number of syllables in each line• Ambitus

Dutch Archive of Folk Songs (mid 20th c.)• Accent tones


Folk Songs in MIR

Folk Songs in Music Information Retrieval Online search engines ISMIR Other studies


Folk Songs in MIR: Search Engines

Search Engines Danish Folklore Archives Digital Archive of Finnish Folk Tunes Themefinder MELDEX Musipedia

Very limited knowledge about oral variation incorporated


Folk Songs in MIR: ISMIR and Essen

ISMIR proceedings 2001-2006:

8 studies employing the Essen folk song collection.None of these because of specific interest in folk songs.


Folk songs in MIR: Other

Contour approach Juhász (2000, 2002, 2004, 2006) Huron (1995)

Segmentation Juhász (2004) Bod (2002)

Repeating Patterns Conklin and Anagnostopoulou (2001)

Geographic data Toiviainen and Eerola (2003) Aarden and Huron (2001)


Integration and Cooperation

For building a search engine

Integrate knowledge from Folk Song Research with knowledge and methods from Music Information Retrieval


Evaluation

How to evaluate a search engine for folk song melodies?

A ground truth is based on choices, assumptions, hypotheses, theories about music, musical intuition, etc.

Ground TruthEvaluate the musical model


MusicInformationRetrieval

FolkSong

Research

Activities and Role Model

MusicalModeling

Implementation evaluation

deployment

MusicInformationRetrieval

FolkSong

Research

ComputationalMusicology


Role Model: Folk Song Research

Tasks: Defining concepts precisely Evaluate implemented models Effort to understand possibilities and

limitations of computational approach

Interest: Folk MusicMethods: Musicological


Role Model: Music Information Retrieval

Delivers: Software components Interface components User models Features ...

Interest: Music InformationSystems

Methods: Computer Science


Role Model: Computational Musicology

Tasks Deconstruct Folk Song Research

concepts Enable Folk Song Research to evaluate

the implemented models Pack software components into libraries

& toolboxes Provide frameworks

Interest: (Folk) MusicMethods: Computer Science


Integration

The MIR community could gain much from pursuing the Computational Musicology-role more ambitiously.

And Musicology as well


Future Directions

Use concepts from Folk Song Research• Most important: tune-family model

Use features from Folk Song Research Develop new models for oral variation in

collaboration with folk song researchers Iteratively improve these musical models, thus

avoiding the problem of ground truth

This will result in an increasing understanding of the concepts of Folk Song Research, thus in improved search engines.


Questions?

Further Reading:http://www.cs.uu.nl/research/techreps/UU-CS-2007-016.html

witchcraft towards integration of mir and folk song research peter van kranenburg, j ö rg garbers,...

Documents