Machine Learning for the Inverse Control of FM Synthesis

ROSA GARZA MENTORS: DR. EDGAR BERDAHL & ANDREW PFALZ

CCT REU 2017 LSU CENTER FOR COMPUTATION & TECHNOLOGY (CCT)

Frequency Modulation (FM) Synthesis

• InventedbyJohnChowningin1967

*tisanarrayof+me

ControlSignals:•  CarrierFrequency(CF)•  Depth(D)•  ModulaEonFrequency(MF)

Current Sound Design Procedure

AddiEve/FM

Synthesizer

SynthesizedSound

Control

Signals

Research Goal

InverseControlof

FMSynthesis

SynthesizedSound

Target

Sound

Long Short Term Memory (LSTM) Recurrent Neural Network (RNN)

 Hyperparameters:

• LearningRate(1e-4–1e-7)

• NumberofUnrollings(1,5,10,15,50,100)

• Epochs(1,5,20,100)

• NumberofLSTMLayers

CalculaEngLoss:MeanSquaredError

• Goal:Lowloss(closeto0)

First Test

1ControlSignalAudio LSTM

LossLabel

Second Test

3ControlSignalsAudio LSTM

LossLabel

FullyConnectedLayer

Third Test

LSTMAudioAudio LSTM

Loss

FullyConnectedLayer

FMSynthesizer

Small Edit to Third Test

FourierTransformofLSTMAudio

Audio LSTM

Loss

FullyConnectedLayer

FMSynthesizer

FourierTransformofAudio

Fourth Test

LSTMAudioAudio LSTM

Loss

FullyConnectedLayer

FMSynthesizer

Most Recent Data

Seeingalossof0.002

Piano Input Data

Acknowledgements  ThankyoutoforthisopportunitytobeapartoftheCenterforComputaEon&Technology(CCT)atLouisianaStateUniversity(LSU)REU2017.

 Thankyoutomygraduatestudent,AndrewPfalz,Dr.Berdahl,andDr.JesseAllison.Alsotomyfamilyandfriendsfortheirsupportthroughoutmysummerresearchexperience.

 ThismaterialisbaseduponworksupportedbytheNaEonalScienceFoundaEonunderawardOCI-1560410withaddiEonalsupportfromtheCCTatLSU.

Ques%ons?