dr. richard boulanger - three decades with csound: the ... · the berklee college of music, dr....

5
Paper Session 1 Friday 25 th November 2016, 15:00-17:00, Bewerunge Room, Maynooth University. Dr. Richard Boulanger - Three Decades with Csound: The Roots, Birth, and Early Years Looking back at more than 30 years of working side-by-side with Professor Barry Vercoe at The MIT Media Lab and on MIT Csound, Berklee College of Music’s Professor of Electronic Production and Design, Dr. Richard Boulanger, author and editor of The Csound Book (MIT Press - 2000), will share his personal stories on Csound’s roots (1969-1985); birth (1986); the early years (1986-1991); and hi-light some seminal projects and breakthroughs along the way (ADI SharCsound, OLPCsound, MIDI, Real- Time Audio IO, GPL Open Source Licensing, and Csound5). In this talk, Dr.B. will share his wonderful collaborative and mentoring experiences with Barry Vercoe, dating back to the pre-dawn of the program through the early years of this amazing three decade Csound saga. What were some of the fun, funny, and amazing Csound-based projects upon which Richard and Barry collaborated? What led to Csound? Where did it come from? What were some of the early hurdles and breakthroughs? Who were the key developers along the way, and in what ways did they help to carry the torch and blaze a new path? For me, music is a medium through which the inner spiritual essence of all things is revealed and shared. Compositionally, I am interested in extending the voice of the traditional performer through technological means to produce a music that connects with the past, lives in the present and speaks to the future. Educationally, I am interested in helping students see technology as the most powerful instrument for the exploration, discovery, and realization of their essential musical nature—their inner voice. Brian Carty - Robotune: An iOS Application Built with Csound Robotune is an iOS vocal processing App(lication) built with Csound. The App was envisaged primarily as a teaching tool designed to analyse contemporary vocal processing techniques such as tuning, harmonisation and common time domain processes. Background and motivation will be discussed, followed by an overview and demonstration of the App. Reflections on the development process will be offered, from critical listening and referencing to algorithm emulation and development, testing and release. The primarily 'trial and error' approach taken to the process will be highlighted throughout. Brian Carty is the Director of Education at the Sound Training College in Temple Bar, Dublin. Before this, he completed his Irish Research Council funded PhD on Binaural

Upload: others

Post on 11-Mar-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Dr. Richard Boulanger - Three Decades with Csound: The ... · The Berklee College of Music, Dr. Richard Boulanger, President and CEO of Boulanger Labs, will discuss how his collaborations

PaperSession1

Friday25thNovember2016,15:00-17:00,BewerungeRoom,MaynoothUniversity.

Dr.RichardBoulanger-ThreeDecadeswithCsound:TheRoots,Birth,andEarlyYears

Lookingbackatmorethan30yearsofworkingside-by-sidewithProfessorBarryVercoeatTheMITMediaLabandonMITCsound,BerkleeCollegeofMusic’sProfessorofElectronicProductionandDesign,Dr.RichardBoulanger,authorandeditorofTheCsoundBook(MITPress-2000),willsharehispersonalstoriesonCsound’sroots(1969-1985);birth(1986);theearlyyears(1986-1991);andhi-lightsomeseminalprojectsandbreakthroughsalongtheway(ADISharCsound,OLPCsound,MIDI,Real-TimeAudioIO,GPLOpenSourceLicensing,andCsound5).Inthistalk,Dr.B.willsharehiswonderfulcollaborativeandmentoringexperienceswithBarryVercoe,datingbacktothepre-dawnoftheprogramthroughtheearlyyearsofthisamazingthreedecadeCsoundsaga.Whatweresomeofthefun,funny,andamazingCsound-basedprojectsuponwhichRichardandBarrycollaborated?WhatledtoCsound?Wherediditcomefrom?Whatweresomeoftheearlyhurdlesandbreakthroughs?Whowerethekeydevelopersalongtheway,andinwhatwaysdidtheyhelptocarrythetorchandblazeanewpath?Forme,musicisamediumthroughwhichtheinnerspiritualessenceofallthingsisrevealedandshared.Compositionally,Iaminterestedinextendingthevoiceofthetraditionalperformerthroughtechnologicalmeanstoproduceamusicthatconnectswiththepast,livesinthepresentandspeakstothefuture.Educationally,Iaminterestedinhelpingstudentsseetechnologyasthemostpowerfulinstrumentfortheexploration,discovery,andrealizationoftheiressentialmusicalnature—theirinnervoice.BrianCarty-Robotune:AniOSApplicationBuiltwithCsound

RobotuneisaniOSvocalprocessingApp(lication)builtwithCsound.TheAppwasenvisagedprimarilyasateachingtooldesignedtoanalysecontemporaryvocalprocessingtechniquessuchastuning,harmonisationandcommontimedomainprocesses.Backgroundandmotivationwillbediscussed,followedbyanoverviewanddemonstrationoftheApp.Reflectionsonthedevelopmentprocesswillbeoffered,fromcriticallisteningandreferencingtoalgorithmemulationanddevelopment,testingandrelease.Theprimarily'trialanderror'approachtakentotheprocesswillbehighlightedthroughout.BrianCartyistheDirectorofEducationattheSoundTrainingCollegeinTempleBar,Dublin.Beforethis,hecompletedhisIrishResearchCouncilfundedPhDonBinaural

Page 2: Dr. Richard Boulanger - Three Decades with Csound: The ... · The Berklee College of Music, Dr. Richard Boulanger, President and CEO of Boulanger Labs, will discuss how his collaborations

AudioatNUIMaynooth.Brian’sbackgroundisprimarilyacademic;hehaspresentedhisresearchworkaroundtheworldandpublishedinanumberofbooksandjournals.Healsoworksprofessionallyasamusician,producerandaudioprogrammer.StevenYi-OnCsoundandBlue

Aswecelebratethe30thanniversaryofCsound,IhavebeenreflectingonBlue'sown15yearhistoryandallthathasdevelopedwithinthetwoprograms.Inthispaper,IwouldliketorevisitthehistoryofCsoundfrommyperspectiveasthedeveloperofBlue.IwilldiscusskeydevelopmentsinCsoundandtheirimpactsuponCsounduseandpractice.IwillalsolookathowthesedevelopmentsinfluencedmyownapproachtodesigningBlueandhowmyviewshaveevolvedovertime.Finally,IwilllookatnewfeaturesplannedforCsound7andwhattheymeanforfutureBluedevelopment.StevenYiisacomposerandprogrammer.HeistheauthoroftheBlueIntegratedMusicEnvironment,authorofPinkandScoremusiclibraries,andcoredeveloperofCsound.HeholdsaPhDinDigitalArtsandHumanitiesfromtheNationalUniversityofIreland,Maynooth.Inhisfreetime,heenjoyspracticingandstudyingT'aiChi.Dr.RichardBoulanger-BoulangerLabs:WritingAppsandBuildingHardwareSynthswithCsoundInside

Aswecelebratethe30thanniversaryofCsound,IhavebeenreflectingonBlue'sown15yearhistoryandallthathasdevelopedwithinthetwoprograms.Inthispaper,IwouldliketorevisitthehistoryofCsoundfrommyperspectiveasthedeveloperofBlue.IwilldiscusskeydevelopmentsinCsoundandtheirimpactsuponCsounduseandpractice.IwillalsolookathowthesedevelopmentsinfluencedmyownapproachtodesigningBlueandhowmyviewshaveevolvedovertime.Finally,IwilllookatnewfeaturesplannedforCsound7andwhattheymeanforfutureBluedevelopment.BornoutofanumberofcoursesintheElectronicProductionandDesignDepartmentatTheBerkleeCollegeofMusic,Dr.RichardBoulanger,PresidentandCEOofBoulangerLabs,willdiscusshowhiscollaborationswithundergraduatestudentsatthecollegehaveledtothedevelopmentofanumberofsuccessfuliPadappswhichhaveleveragedforthemamazingandhi-profilejobsatApple,Vimeo,andIzotope(tonameafew),researchappointmentsatGeorgiaTechandStanford,andtothespin-offofacommercially-successfulEuroRack-based,internationallydistributed,modularsynthesizercompany-Qu-Bit.

Page 3: Dr. Richard Boulanger - Three Decades with Csound: The ... · The Berklee College of Music, Dr. Richard Boulanger, President and CEO of Boulanger Labs, will discuss how his collaborations

PaperSession2Saturday26thNovember2016,10:00-12:00,BewerungeRoom,MaynoothUniversity.

MartinCrowley,JamesKelly-EducationalToolsforLiveSoundEngineeringBuiltUsingCabbageandCsoundLivesoundengineeringisaresource-heavytopictoteach.Practicalexperienceisessential,ideallyinaprofessionalperformancevenue.Thiscanoftenbeunfeasibleduetofactorssuchasexpenseandalackofresourcesortrainingfacilities.Thethreetoolsdevelopedaimtogivethelearneranintroductiontocommonlivesoundengineeringtasksinavirtuallearningenvironment,thusmaximisingtimeavailableinactualvenues.Asignalroutingtool,avirtual“RoomTuner”(usingimpulseresponses)andafeedbackdemonstrationtoolarepresented.MartinCrowleyhasbeenastudentofAudioProductionforseveralyears.Hehasabackgroundinradioproductionanddjing,buthisconsumingpassionisliveelectronicmusicperformance.Heiscurrentlydevisingatechnologyenabledliveperformanceinstallationforan8channelambisonicspeakerarraywiththehelpof'Csound’and‘PureData’.JamesKellyholdsaHNDinAudioProduction&SoundEngineeringandiscurrentlystudyingforaBAinCreativeMusicProductionatIADT/STCTemplebar.HisMajorProjectfocusesondevelopingsoftwaretoolsusingcsoundandCabbage.FedericoRusso-MIDIControlledAudioEffects–Real-TimeReshapingoftheAudioSignalExplanationofthegeneralstructureoftheinstrumentItisaMIDIcontrolledaudioeffect,whichisdividedinto4modules.Eachmoduleprocessestheaudiosignalindifferentways,exceptfortheaudioinput,whichisneededtogetthesourcesignal.Theaudiosignalflowstroughthemodulesthankstoadry/wetsystembasedoninternalbusses.Explanationofeachmoduleoftheinstrument(codeorder)-Module1:audioinput.-Module2:audioshift,warpandfreeze,separatedforspectralamplitudesandfrequencies,controlledviaMIDI.ImplementedwithanLFOcontrolledbinauralmovement.-Module3:audioresynthesis,usingavocoder-likestructure,withselectionofwaveformtoblendtheincomingsignalwith.ExplanationoftheworkflowTheinstrumentwascreatedmodulebymodule,testingthecorrectfunctionalityeachtimealineofcodewaswritten.Creativeuseofreferenceswasapplied,lookingattheusethatotherdevelopershadofopcodesintheirinstruments,tounderstandtheirfunctionsandpossibleapplicationsintheinstrument.

Page 4: Dr. Richard Boulanger - Three Decades with Csound: The ... · The Berklee College of Music, Dr. Richard Boulanger, President and CEO of Boulanger Labs, will discuss how his collaborations

ApplicationsTheinstrumentfindsitsusefulnessincinematicsoundeffectsforvoicesandnontonalbasedmusic,duetoitsrandombehaviourfromthepvsfreezeopcode(thefreezeofthefrequenciesistriggeredbythekeyboard).FedericoRussobegantostudytheelectricbasswhenhewas13underAndreaGrossi,enrollinginthecoursesoftheAccademiaNovaofRome.Healsostudiedcello,withtheconcertperformerandprofessoroftheIstitutoSuperiorediStudiMusicaliGaetanoBragaofTeramoMatteoScarpelli.Duringhisstudies,healsoplayed,composedandarrangedmusicwithhisband,Libra:thebandplayedinsomeofthemoreimportantstagesoftheRomanscene,butalsoinothercitiesthankstothepromotionaltourforthealbumSottopelle(Volcanrecords),thislandedthebandonMTVnewgeneration.AfterthathestartedtostudysoundengineeringattheSaintLouiscollegeofmusicinRome,wherehefoundedwithtwocolleaguestheOneGotFatCollectiveforexperimentalelectronicmusicandvideos.Inadditiontothat,duringthesoundengineeringstudieshemettheexperimentalmusiccomposerLucaSpagnoletti,whointroducedhimtoaudioprogramming,speciallytheobjectprogrammingofMaxmsp.ShaneByrne-CsoundasaToolforEnablingMusiciansThispaperexplorestheuseofCsoundasameansfordevelopingcompositionalandperformancetoolsformusicianswithcomplexdisabilities.ItdiscusseshowCsoundcanbeusedtodevelopinstrumentsthataredesignedspecificallyaroundtheindividualmusician’sneedsandtastes.Thisincludesnotonlythedesignofsoftwareinstrumentsbutalsothehardwareinterfacesthatareusedtointeractwiththesoftware.ThisarticlewillalsoaddressthemethodologiesemployedwhenrunningCsoundonembeddedcomputingdevicessuchastheIntelGalileoandprovideacasestudyofarecentbuildthatwascompletedonbehalfofTheDrakeMusicProject.ShaneByrneisacomposerofacousticandelectronicmusicandiscurrentlyaPhDresearcheratMaynoothUniversityfocusingoninteractivityandparticipationwithinelectronicmusiccomposition.In2013hecompletedhisBAinMusicTechnologywithfirstclasshonoursandin2014completedanMAincreativemusictechnologiesalsoreceivingfirstclasshonours.Hiscurrentworkisfocusedonphysicalcomputingandthepotentialforhumaninteractiontoaddtoanoverallimmersivemusicalexperienceforboththeperformerandtheaudience.Hisworkhasmorerecentlyledhimtoinvestigatethepotentialforsuchinteractiontofacilitateandencouragelearningamongstthelearningimpairedandtheautisticcommunity.Healsoworksasasounddesigner,foleyartistandmixingengineer.HisfirstloveisperformanceandregularlytakespartinimprovisationnightsandoccasionallyplaysgigswithseveralnoiseandprogressiverockbandsinDublin.

Page 5: Dr. Richard Boulanger - Three Decades with Csound: The ... · The Berklee College of Music, Dr. Richard Boulanger, President and CEO of Boulanger Labs, will discuss how his collaborations

ThomMcDonnell-DevelopmentoftheCsoundHRTFOpcodestoAllowuseofAnyDataset,utilisingtheSOFAstandardBinauralhearingallowshumansdeterminethedirectionofsound,bydetectingsmalldifferencesbetweenthesignalshittingtheears.ThedifferencesateachearareInter-auralTimeDifferences(ITD)andInter-auralIntensityDifferences(IID),togetherformingtheHeadRelatedTransferFunction(HRTF).Botharefrequencydependent,whichislargelyduetophysiology;thisimpliesadifferentfrequencyandphaseprofileforeachdirectionin360degreesspacearoundthehead.Aseachlistener'sphysiologydiffers,theHRTFvariesbetweenlisteners.TheCsoundHRTFopcodesusetheMITdatasettocreateawellworkinggeneralisedHRTFasasolutiontothedifficultyinacquiringfullypersonalisedHRTFs.Severalstudiesarriveattheconclusionthatthereisadegradationoflocalisationabilitywhennon-individualisedHRTFsareused,with“confusions”andreversalsoccurringmoreoften.Theabilitytoutiliseanydataset(potentiallya“hacked”individualiseddataset)isdesirableasitoffersamorerobustsolution,allowinguserstofindamorecloselymatcheddatasettoimproveimmersionandlocalisation.TheAudioEngineeringSociety(AES)hasrecentlyputforwardasolutionindefiningastandardisedspatialaudiodatafileformat(SOFA).Thisallowsfurtherdevelopmentofthecurrentopcodes,retainingbackwardscompatibility,andallowinguserstoauditionanduseanydataset.Thecurrentopcodeshaveprovenrobust;thealgorithmsforinterpolationofHRTFsworkwellandarethusmaintainedinthisdevelopment.TheHRTFreverbopcodescouldbenefitfromsometonalimprovementsbasedonananalysisofnon-binauralindustrystandardproducts;thiswillalsobeaddressed.ThomMcDonnellisaDublin-basedProducerandLecturer.HespecialisesinteachingMusicTechnology,Synthesis,StudioEngineering,AudioProductionandElectronics.