comp342 computer music
DESCRIPTION
Comp342 Computer Music. Course Objectives. Course Objectives. 1. General Appreciation 1.1. Have a general appreciation of the use of music in computer applications 2. Music Theory and Acoustics Based Skills - PowerPoint PPT PresentationTRANSCRIPT
Comp342Comp342Computer MusicComputer Music
Course Course ObjectivesObjectives
Course ObjectivesCourse Objectives
1. General Appreciation1. General Appreciation– 1.1. Have a general appreciation of the use of music in 1.1. Have a general appreciation of the use of music in
computer applicationscomputer applications
2. Music Theory and Acoustics Based Skills2. Music Theory and Acoustics Based Skills– 2.1. Understand the basics of common practice music 2.1. Understand the basics of common practice music
notation, including pitch, rhythm, and dynamicsnotation, including pitch, rhythm, and dynamics– 2.2. Be able to translate common practice music 2.2. Be able to translate common practice music
notation into computer music languages such as notation into computer music languages such as CsoundCsound
– 2.3. Understand the basics of musical acoustics, 2.3. Understand the basics of musical acoustics, including vibration and harmonic seriesincluding vibration and harmonic series
Course ObjectivesCourse Objectives
3. Sound Analysis Based Skills3. Sound Analysis Based Skills– 3.1. Have a working knowledge of spectrum 3.1. Have a working knowledge of spectrum
analysis, including the phase vocoderanalysis, including the phase vocoder– 3.2. Understand how to analyze the 3.2. Understand how to analyze the
frequency content of a sound with frequency content of a sound with applications such as Spectrogram and PVanapplications such as Spectrogram and PVan
Course ObjectivesCourse Objectives
4. Sound Synthesis Based Skills4. Sound Synthesis Based Skills– 4.1. Have a working knowledge of the most 4.1. Have a working knowledge of the most
common sound synthesis methods, including common sound synthesis methods, including additive, wavetable, FM, and sampling synthesisadditive, wavetable, FM, and sampling synthesis
– 4.2. Understand how to implement these synthesis 4.2. Understand how to implement these synthesis methods in computer music languages such as methods in computer music languages such as Csound Csound
– 4.3. Develop instrument designs for acoustic music 4.3. Develop instrument designs for acoustic music instruments in computer music languages such as instruments in computer music languages such as CsoundCsound
Course ObjectivesCourse Objectives
5. Sound Effects Based Skills5. Sound Effects Based Skills– 5.1. Have a working knowledge of the most 5.1. Have a working knowledge of the most
common sound effects, including echo and common sound effects, including echo and reverberationreverberation
– 5.2. Understand how to implement these effects 5.2. Understand how to implement these effects in computer music languages such as Csound in computer music languages such as Csound
– 5.3. Apply these effects to different types of 5.3. Apply these effects to different types of sounds and understand how they modify the sounds and understand how they modify the soundsound
Comp342Comp342Computer MusicComputer Music
Recommended Books:Recommended Books:Recommended Books:Recommended Books:• Computer MusicComputer Music by Charles Dodge & T. Jerse, by Charles Dodge & T. Jerse,
Schirmer Books, 2nd Edition, 1997. Schirmer Books, 2nd Edition, 1997.
• The Computer Music TutorialThe Computer Music Tutorial by Curtis Roads by Curtis Roads• Cooking with Cooking with Csound Part 1: Woodwind and Brass Csound Part 1: Woodwind and Brass
RecipesRecipes by Andrew Horner and Lydia Ayers, A-R by Andrew Horner and Lydia Ayers, A-R Editions, 2002Editions, 2002
Computer MusicComputer Music
An interdisciplinary field includingAn interdisciplinary field including– Music Music – Computer ScienceComputer Science– Electrical Engineering (signal processing)Electrical Engineering (signal processing)– Physics (musical acoustics)Physics (musical acoustics)– Psychology (psychoacoustics, music Psychology (psychoacoustics, music
perception)perception)
Computer Music AreasComputer Music Areas(possible Projects & Presentations)(possible Projects & Presentations)
Signal ProcessingSignal Processing– Sound Analysis and ResynthesisSound Analysis and Resynthesis– Physical Modeling of Musical InstrumentsPhysical Modeling of Musical Instruments– Musical EffectsMusical Effects– 3D Spatialization3D Spatialization– Audio Coding and CompressionAudio Coding and Compression– Audio Signal SeparationAudio Signal Separation– Music Signal Pitch DetectionMusic Signal Pitch Detection
AIAI– Machine Recognition of Audio and MusicMachine Recognition of Audio and Music– Musical Instrument RecognitionMusical Instrument Recognition– Music Perception and CognitionMusic Perception and Cognition– PsychoacousticsPsychoacoustics– AI and MusicAI and Music
Computer Music Areas Computer Music Areas (possible Projects & Presentations)(possible Projects & Presentations)
SoftwareSoftware– Music VisualizationMusic Visualization– Music Composition Systems and ToolsMusic Composition Systems and Tools– Music Programming LanguagesMusic Programming Languages– Algorithmic CompositionAlgorithmic Composition– Music Notation and PrintingMusic Notation and Printing– Music on the InternetMusic on the Internet– Music in Computer GamesMusic in Computer Games– Sound Effects in Computer GamesSound Effects in Computer Games– Computer Music and Digital ArtComputer Music and Digital Art
DatabaseDatabase– Music Information RetrievalMusic Information Retrieval– Musical InformaticsMusical Informatics– Music DatabasesMusic Databases
Computer Music Areas Computer Music Areas (possible Projects & Presentations)(possible Projects & Presentations)
Computer EngineeringComputer Engineering– Audio HardwareAudio Hardware– Music Performance Interfaces (new musical Music Performance Interfaces (new musical
instruments)instruments)– Interactive Performance SystemsInteractive Performance Systems– Real Time Performance SystemsReal Time Performance Systems– Music WorkstationsMusic Workstations– SoundcardsSoundcards– Music SynthesizersMusic Synthesizers– Music and Audio on Mobile PhonesMusic and Audio on Mobile Phones– Wireless Audio SystemsWireless Audio Systems– Music NetworksMusic Networks– MIDIMIDI
Computer Music Areas Computer Music Areas (possible Projects & Presentations)(possible Projects & Presentations)
Theory/ScienceTheory/Science– Music Data Structures and RepresentationMusic Data Structures and Representation– Musical Tuning and IntonationMusical Tuning and Intonation– Music GrammarsMusic Grammars– Musical AcousticsMusical Acoustics– Acoustics of Musical Instruments and the Acoustics of Musical Instruments and the
VoiceVoice
You are welcome to propose your own You are welcome to propose your own topic that includes music and technologytopic that includes music and technology
COMP342 Project & PresentationCOMP342 Project & Presentation
For the comp342 project, you will devise, implement, and document For the comp342 project, you will devise, implement, and document your own computer music application. your own computer music application. You will choose your own topic that includes computers and music. You will choose your own topic that includes computers and music. The list in the previous slides (4-7) will give you some project ideas. The list in the previous slides (4-7) will give you some project ideas. The reference books on slide 2 are good for details (especially The reference books on slide 2 are good for details (especially "Computer Music Tutorial")."Computer Music Tutorial").
The tentative format for the project is the following:The tentative format for the project is the following:– 10-minute presentation (like short conference presentation, or my 10-minute presentation (like short conference presentation, or my
lectures)lectures)– 5-minutes for Q&A (while the next group sets up)5-minutes for Q&A (while the next group sets up)– You will turn in a softcopy of your PowerPoint notesYou will turn in a softcopy of your PowerPoint notes– You will also turn in a short paper (4 pages) summarizing your You will also turn in a short paper (4 pages) summarizing your
presentationpresentation– You will work in groups of normally 4 peopleYou will work in groups of normally 4 people
Who Makes Computer Music?Who Makes Computer Music?The 4-person model for computer music:The 4-person model for computer music:
1.RESEARCHER/PROGRAMMER
COMPUTER
2.COMPOSER
4.LISTENER
SCORE
MUSIC3.PERFORMER
Brief Overview of Computer Brief Overview of Computer Music HistoryMusic History
Computer Music HistoryComputer Music History
Pre-historyPre-history– Harmonium (1900)Harmonium (1900)– Electric organElectric organ– Musak (background music in shops)Musak (background music in shops)
1930’s1930’s– Ondes MartenotOndes Martenot– ThereminTheremin
Computer Music HistoryComputer Music History
Ondes MartenotOndes Martenot– An early electroacoustic instrument An early electroacoustic instrument
developed by Maurice Martenot developed by Maurice Martenot – Includes:Includes:
2 oscillators2 oscillators
3 loudspeakers3 loudspeakers
An oscillating Chinese gongAn oscillating Chinese gong
A spring reverb unit and sympathetic strings)A spring reverb unit and sympathetic strings)
A small keyboard which provides vibrato and a A small keyboard which provides vibrato and a wide range of sliding tones.wide range of sliding tones.
– [6][6] Example: Olivier Messaien, Example: Olivier Messaien, OraisonOraison (1937)(1937)
Computer Music HistoryComputer Music History
<C:2><C:2> ThereminTheremin
• Real-time instrumentReal-time instrument
• Radio antennas used to control pitch Radio antennas used to control pitch and amplitude and amplitude
• Difficult to control, but sounded voice-Difficult to control, but sounded voice-like in the hands of an expertlike in the hands of an expert
Computer Music HistoryComputer Music History
1940’s WWII 1940’s WWII – Tape recorderTape recorder– ComputersComputers– RadioRadio
1950’s 1950’s – RCA SynthesizerRCA Synthesizer– Speech processingSpeech processing
Bell Labs Bell Labs LPCLPC
<C:1><C:1> Soundtrack to Soundtrack to Forbidden PlanetForbidden Planetby Louis and Bebe Barronby Louis and Bebe Barron
Computer Music HistoryComputer Music HistoryComputer Music HistoryComputer Music History
Computer Music HistoryComputer Music History
1960’s Analog Synthesizers1960’s Analog Synthesizers– Arp 2500 & 2600Arp 2500 & 2600– Famous pop musicians started using synthesizersFamous pop musicians started using synthesizers
WhoWhoEmerson, Lake, Power - ELPEmerson, Lake, Power - ELP
– MonophonicMonophonic
1970’s Fancier Analog Synthesizers1970’s Fancier Analog Synthesizers– Moog, Buchla, KorgMoog, Buchla, Korg– Polyphonic [2-3 voices]Polyphonic [2-3 voices]– Wendy Carlos - Wendy Carlos - Switched On BachSwitched On Bach– Software synthesisSoftware synthesis
VAX780 ComputerVAX780 ComputerMIT MIT StanfordStanford
Computer Music Computer Music HistoryHistory
Buchla synthesizer Buchla synthesizer – Manipulate sounds by turning knobs Manipulate sounds by turning knobs – Synthesizer didn't have memory, so everything Synthesizer didn't have memory, so everything
had to be recorded on analog tape had to be recorded on analog tape – It took a long time to set up the patch chords It took a long time to set up the patch chords
before hearing any soundbefore hearing any sound
Computer Music HistoryComputer Music History
1980’s Digital Synthesizer1980’s Digital Synthesizer– Yamaha DX – 7Yamaha DX – 7– FM synthesisFM synthesis– MIDI – communication protocol for synthesizersMIDI – communication protocol for synthesizers– Polyphonic [8-16 voices]Polyphonic [8-16 voices]– Software synthesisSoftware synthesis– Computers: Macs & PC with soundcardsComputers: Macs & PC with soundcards
1990’s Soundcards1990’s Soundcards– Sampling synthesisSampling synthesis– Polyphonic [32-64 voices]Polyphonic [32-64 voices]
Computer Music NowComputer Music NowSoftware synthesis on computersSoftware synthesis on computersHardwareHardware– SynthesizersSynthesizers– SoundcardsSoundcards– Portable devicesPortable devices
CDs, DAT tapes, and minidisks for storing CDs, DAT tapes, and minidisks for storing soundfilessoundfiles<C:3><C:3> Interactive body synthesizersInteractive body synthesizers
What Can a Computer Do?What Can a Computer Do?Synthesize sounds Synthesize sounds – [7][7] Synthesized soundsSynthesized sounds can resemble can resemble
familiar sounds or they can sound familiar sounds or they can sound artificialartificial
• Transform one sound into Transform one sound into another, such as another, such as [8][8] a horn into an a horn into an oboeoboe
What Can a Computer Do?What Can a Computer Do?
Create the space where sounds Create the space where sounds move around more easily than move around more easily than human performershuman performers– [9][9] SpatializationSpatialization of opening of opening
bassoon solo in Stravinsky's bassoon solo in Stravinsky's The The Rite of SpringRite of Spring
What Can a Computer Do?What Can a Computer Do?[10][10] SampleSample sounds sounds
pasted on a surfacepasted on a surface
• Process sampled sounds using Process sampled sounds using effectseffects• [11][11] TranspositionTransposition • [12][12] Time stretchingTime stretching • [13][13] EchoEcho • [14][14] Ring modulationRing modulation
in a musical in a musical [15][15] collagecollage• A picture made with materials and objects ...A picture made with materials and objects ...
Synthesizing SoundsSynthesizing SoundsCsound Csound – A computer music languageA computer music language
Makes a soundfile by compiling a score and Makes a soundfile by compiling a score and orchestra file orchestra file
The result is large binary file which the The result is large binary file which the computer plays as a "soundfile"computer plays as a "soundfile"
– similar to playing a CDsimilar to playing a CD– .wav file.wav file
Making a SoundfileMaking a Soundfilefrom Csoundfrom Csound
A Simple Csound OrchestraA Simple Csound Orchestra;simple.orc;simple.orc ; name of orchestra; name of orchestra
;CODE on left;CODE on left ; COMMENTS on right; COMMENTS on right
sr=22050sr=22050 ; sampling rate; sampling ratekr=2205kr=2205 ; control rate; control rateksmps=10ksmps=10 ; samples/control ; samples/control
per.per.nchnls=1nchnls=1 ; 1 channel playback; 1 channel playback
instr 1instr 1 ; beginning of instr.; beginning of instr.iampiamp == p4p4 ; maximum amplitude; maximum amplitude ifreqifreq == p5p5 ; frequency in Hertz; frequency in Hertziwaveiwave == 11 ; use wavetable 1; use wavetable 1asigasig oscilioscili iamp, ifreq, iwave iamp, ifreq, iwave ; generate signal; generate signal
outout asigasig ; output signal; output signalendinendin ; end of instrument; end of instrument
[16][16] A Simple Csound ScoreA Simple Csound Score
;simple.sco;simple.sco - use with simple.orc- use with simple.orc ; name of score; name of score
;function table for waveform for sinewave oscillator;function table for waveform for sinewave oscillatorf1 0 4096 10 1f1 0 4096 10 1
;p1;p1 p2p2 p3p3 p4p4 p5p5;; startstart durdur ampamp HertzHertzi1i1 11 22 40004000 440440 ; note statement; note statement
ee ; end of score; end of score
Many Ways to Process SoundsMany Ways to Process Sounds
Time stretchingTime stretching– Stretch and compress soundsStretch and compress sounds
Make them longer or shorter than their original Make them longer or shorter than their original durationsdurations
– Requires running a sound analysis program on Requires running a sound analysis program on the sample which may leave the file full of pops the sample which may leave the file full of pops and clicksand clicks
Some files require considerable "clean-up" workSome files require considerable "clean-up" work
Too much fixing may change the sound dramatically, Too much fixing may change the sound dramatically, resulting in either a nice feature or a disasterresulting in either a nice feature or a disaster
Many Ways to Process SoundsMany Ways to Process Sounds
Controlling timbre (quality of Controlling timbre (quality of sound) sound) – [19][19] Leaving the pops and Leaving the pops and
crackling in the stretched crackling in the stretched sound made a professional sound made a professional singer sound like a witchsinger sound like a witch
– [20][20] Transposing the pitch of Transposing the pitch of a witcha witch up and down up and down produces glottal clicks and produces glottal clicks and chattering sounds chattering sounds
Examples of Instrument ModelingExamples of Instrument Modeling
[25][25] voices — composition program by Chui Lok voices — composition program by Chui Lok Sum Rod, Chan Ka Lok Carl and Leung Kin Lung Sum Rod, Chan Ka Lok Carl and Leung Kin Lung Lone (0:50)Lone (0:50)[26][26] voices — Bach, voices — Bach, Jesus Bleibet Meine FreudeJesus Bleibet Meine Freude — class project by Chan Yu Hong, Yeung Kwun — class project by Chan Yu Hong, Yeung Kwun and Chow Tsz Ho (2:20)and Chow Tsz Ho (2:20)[27][27] voices — Vivaldi, voices — Vivaldi, Laudamus teLaudamus te — class — class project by Lo Hoi Yee, Janice and Chan Wai Yi project by Lo Hoi Yee, Janice and Chan Wai Yi (1:30) (1:30) [28][28] voices — Palestrina, voices — Palestrina, SanctusSanctus — class — class project by Leung Chun Fai, Kevin and Wong project by Leung Chun Fai, Kevin and Wong Chung Ling, Iris (2:03)Chung Ling, Iris (2:03)
Examples of Instrument Examples of Instrument ModelingModeling
[29][29] French horn — French horn — Richard Strauss, Richard Strauss, Til Til Eulenspiegel's Merry Eulenspiegel's Merry PranksPranks (:09) (:09)[2][2] French horn — French horn — Richard Strauss, Richard Strauss, Ein Ein HeldenlebenHeldenleben (:29) (:29)[5][5] Chinese Dizi — Chinese Dizi — LiubanLiuban (:32) (:32)
Andrew HornerAndrew Horner