algorithmic composition: an overview of the field, inspired by a...

34
Algorithmic composition: Algorithmic composition: An overview of the field, inspired by a An overview of the field, inspired by a criticism of its methods criticism of its methods Presentation in the seminar Topics in Computer Music at RWTH Aachen University Sven Deserno 24 June 2015

Upload: others

Post on 01-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

Algorithmic composition: Algorithmic composition: An overview of the field, inspired by a An overview of the field, inspired by a

criticism of its methodscriticism of its methods

Presentation in the seminar Topics in Computer Music at RWTH Aachen University

Sven Deserno

24 June 2015

Page 2: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

Algorithmic Composition What to expect? 01/24

BasisPearce, Meredith, Wiggins (2002): “Motivations and methodologies for automation of the computational process”

In additionOverview of the field of algorithmic compositionAppreciation for good science and appropriate methods

WHAT TO EXPECT?

Page 3: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

1. Introduction 1.1 What is algorithmic composition? 1.2 The Problem: Pearce/Meredith/Wiggins' criticism

2. How did we get there? 2.1 A history of algorithmic composition 2.2 Different problems and approaches

3. Towards a solution 3.1 Motivation 3.2 Pearce/Meredith/Wiggins' 4 motivations

4. Conclusion

OUTLINE

02/24

Page 4: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

1. Introduction1. Introduction1.1 What is algorithmic composition?1.1 What is algorithmic composition?

Page 5: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

WHAT IS ALGORITHMIC COMPOSITION?

03/24

“...the partial or total automation of the process of music composition by using computers.”

- Fernández/Vico, 2013

“...the technique of using algorithms to create music.”

- Wikipedia: Algorithmic composition, 21 June 2015

Introduction What is algorithmic composition?

Page 6: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

1. Introduction1. Introduction1.2 The Problem: Pearce/Meredith/Wiggins' criticism1.2 The Problem: Pearce/Meredith/Wiggins' criticism

Page 7: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

THE PROBLEM

04/24

Widespread failure to…

“...specify the precise practical and theoretical aims of research”

“...adopt an appropriate methodology for achieving the stated aims”

“...adopt a means of evaluation appropriate for judging the degree to which the aims have been satisfied”

- Pearce/Meredith/Higgins, 2002

Introduction The problem: Pearce/Meredith/Wiggins' criticism

Page 8: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

THE PROBLEM

05/24

“an implicit assumption that simply describing a computer program that composes music counts as a useful contribution to research”

- Pearce/Meredith/Higgins, 2002

Introduction The problem: Pearce/Meredith/Wiggins' criticism

Page 9: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

A CASE STUDY

06/24

David Cope's EMIExperiments in Musical IntelligenceImitates the style of a given corpus

Exemplary results: www.youtube.com/user/davidhcope/

Wiggins' reviewPublished work on EMI is vague & unscientificReview begins with a discussion of pseudoscience

Introduction The problem: Pearce/Meredith/Wiggins' criticism

Page 10: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

WHY IS THIS BAD?

07/24

Requirements for progress

Well-defined problems

Possible solutions to these problems

The ability to meaningfully compare solutions

Solid methodology

Introduction The problem: Pearce/Meredith/Wiggins' criticism

Page 11: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

2. How did we get there?2. How did we get there?2.1 A history of algorithmic composition2.1 A history of algorithmic composition

Page 12: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

HISTORY: FIRSTS

08/24

First conceptualisation

Ada Lovelace, on the Analytical Engine:

“Supposing, for instance, that the fundamen-tal relations of pitched sounds in the science of harmony and of musical composition were susceptible of such expressions and adaptations, the engine might compose elaborate and scientific pieces of music of any degree of complexity or extent.”

- Ada Lovelace, 1843

How did we get there? A history of algorithmic composition

Image: commons.wikimedia.org

Page 13: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

HISTORY: FIRSTS

09/24

Proof of concept

1954: “Illiac Suite” by Lejaren Hiller, Leonard Isaacson

4 movements for string quartet

First composition by a computer program

Implementing and testing several principlese.g. different sets of rules, probabilities/randomness

How did we get there? A history of algorithmic composition

Page 14: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

HISTORY: FIRSTS

10/24

Iannis Xenakis

Composer (1922 – 2001)

Pioneer in computer music

Used the output of algorithms & mathematical models in his compositions

How did we get there? A history of algorithmic composition

Image: www.iannis-xenakis.org

Page 15: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

HISTORY: PRE-COMPUTER

11/24

Guido d'Arezzo11th centuryDeterministic mapping of vowel sounds to pitches

W. A. Mozart (attributed)18th century“Musikalisches Würfelspiel” / “Dice Music”Randomised combination of pre-composed parts

How did we get there? A history of algorithmic composition

Page 16: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

2. How did we get there?2. How did we get there?2.2 Different problems and approaches2.2 Different problems and approaches

Page 17: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

SOURCES OF VARIETY

12/24How did we get there? Different problems and approaches

Algorithm

Page 18: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

SOURCES OF VARIETY

12/24How did we get there? Different problems and approaches

Algorithm

Input:Musical scoresRecordingsExtra-musical dataRulesProbabilities...

Output:Musical scores?Synthesised sound?

Page 19: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

SOURCES OF VARIETY

12/24

Each choice defines a different problem!

How did we get there? Different problems and approaches

Algorithm

Characteristics:Determinism?Degree of human intervention?

Input:Musical scoresRecordingsExtra-musical dataRulesProbabilities...

Output:Musical scores?Synthesised sound?

Technical approach:See upcoming slide!

What is a “good” or “correct” output?

Page 20: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

TECHNICAL APPROACHES

13/24How did we get there? Different problems and approaches

Figure: Fernández/Vico, 2013

Page 21: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

TECHNICAL APPROACHES

14/24

Immense variety of approaches

Further complication: Similar approaches are used to achieve different ends

Choice of any one approach needs justification!

How did we get there? Different problems and approaches

Page 22: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

WHAT IS A GOOD/CORRECT OUTPUT?

15/24

What is good music?Question for music theorists and philosophersNot particular to algorithmic compositionSubjective impression of listener/larger audienceAre there computable measures for algorithms?

What is the aim/expectation?“style imitation” vs “genuine composition” (Nierhaus 2009)

Imitation of a style/corpus vs automation of compositional tasks (Fernández/Vico 2013)

How did we get there? Different problems and approaches

Page 23: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

3. Towards a solution3. Towards a solution3.1 Motivation3.1 Motivation

Page 24: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

HOW CAN WE DO BETTER?

16/24

Switch hatsComposer: “What is my artistic vision?”

“What sounds good to me?”

Scientist: “How can I make that relevant to the scientific discourse?”“How can I measure that?”

Reminder (Pearce/Meredith/Wiggins)Specify aims!Adopt appropriate methodology!Adopt appropriate means of evaluation!

Towards a solution Motivation

Page 25: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

3. Towards a solution3. Towards a solution3.2 Pearce/Meredith/Wiggins' 4 motivations3.2 Pearce/Meredith/Wiggins' 4 motivations

Page 26: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

4 DIFFERENT MOTIVATIONS

17/24

Categorisation by motivation1. “Algorithmic composition” in a stricter sense2. Design of compositional tools3. Computational modelling of musical styles4. Computational modelling of music cognition

Due to Pearce/Meredith/Wiggins

Failure to distinguish between these tasks leads to bad methodology & bad research!

Towards a solution Pearce/Meredith/Wiggins's 4 motivations

Page 27: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

4 DIFFERENT MOTIVATIONS

18/24

1. “Algorithmic composition”

Objective is artistic

Algorithm is tool in the compositional process

Reflects composer's needs & vision

When published, the theoretical/practical relevance must be demonstrated!

Towards a solution Pearce/Meredith/Wiggins's 4 motivations

Page 28: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

4 DIFFERENT MOTIVATIONS

19/24

2. Design of compositional tools

Software engineering standards should be upheld!

Perform and document analysis, design, implementation, and testing stages!

Towards a solution Pearce/Meredith/Wiggins's 4 motivations

Page 29: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

4 DIFFERENT MOTIVATIONS

20/24

3. Computational modelling of musical styles

Allows for hypotheses about the properties of different styles

Tests for over- and undergeneration can be made significant→ How well does the algorithm emulate the style?

Towards a solution Pearce/Meredith/Wiggins's 4 motivations

Page 30: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

4 DIFFERENT MOTIVATIONS

21/24

4. Computational modelling of music cognition

Goal: Test hypotheses about the cognitive processes that are required for musical composition

The relations and differences between algorithmic and cognitive processes must be made clear!

Towards a solution Pearce/Meredith/Wiggins's 4 motivations

Page 31: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

4. Conclusion4. Conclusion

Page 32: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

WHAT SHOULD YOU TAKE AWAY?

22/24

Algorithmic composition...…is a complex and fascinating topic…can comprise different tasks…has seen a plethora of approaches

Pearce/Meredith/WigginsThe field suffers from a lack of appropriate methodsCategorisation by 4 motivations might help

The mere description of an algorithm that composes music is not a valuable contribution to research!

Conclusion

Page 33: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

SOURCES

23/24

Print1. Pearce, Marcus, Meredith, David, and Geraint Wiggins. “Motivations and methodologies for automation of the compositional process.” Musicae Scientiae 6.2 (Fall 2002): 119-147.

2. Fernández, Jose David, and Francisco Vico. “AI Methods in Algorithmic Composition: A Comprehensive Survey.” Journal of Artificial Intelligence Research 48 (2013): 513-582.

3. Papadopoulos, George, and Geraint Wiggins. “AI Methods for Algorithmic Composition: A Survey, a Critical View and Future Prospects.” AISB Symposium on Musical Creativity, 1999.

4. Supper, Martin. “A Few Remarks on Algorithmic Composition.” Computer Music Journal 25.1 (Spring 2001): 48-53.

5. Nierhaus, Gerhard. Algorithmic Composition: Paradigms of Automated Music Generation. Wien: Springer, 2009.

6. Wiggins, Geraint. “Computer Models of Musical Creativity: A Review of Computer Models of Musical Creativity by David Cope.” Literary and Linguistic Computing 23.1 (2008): 109-116.

Page 34: Algorithmic composition: An overview of the field, inspired by a …hpac.rwth-aachen.de/teaching/sem-mus-15/Deserno.pdf · 2015-06-24 · “AI Methods for Algorithmic Composition:

SOURCES

24/24

Webhttp://blogs.bodleian.ox.ac.uk/adalovelace/about-ada-lovelace/

https://en.wikipedia.org/wiki/Algorithmic_composition

https://commons.wikimedia.org/

http://www.iannis-xenakis.org/

All retrieved on 21 June 2015