kabuki 2800 “a real-time digital audio effects system for performance” team “big country”...

40
Kabuki 2800 “a real-time digital audio effects system for performance” team Big Countrypresents ECEN4610 Preliminary Design Review 14 September 2006

Post on 22-Dec-2015

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Kabuki 2800

“a real-time digital audio effects system

for performance”

team “Big Country” presents

ECEN4610 Preliminary Design Review14 September 2006

Page 2: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Agenda

1. Project overview2. Architecture3. Implementation4. Risk management5. Division of labor6. Schedule

Page 3: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

OVERVIEWDesign goal

Customizeable and extensible real-time digital audio effects system for live performance

Page 4: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Project overviewTarget consumer

Live performance! Electronic

composers Electronic

musicians Mic’ed acoustic

musicians

Page 5: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Project overviewCurrent status

Kabuki 1200 Summer ‘06 Some effects Slider input No custom effects Slow display

Page 6: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Project overviewKabuki 2800 baseline requirements

Computer control+display interface Support for saved presets Custom effects Time-domain base effects Portable

Page 7: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Project overviewKabuki 2800 secondary requirements

Interchangeable human input board FFT coprocessor for performance Frequency-domain effects

Page 8: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Block Diagram

Kabuki 2800

Summer Progress

Page 9: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

IMPLEMENTATION

How is it all going to work?

1. Effects2. I/O Card3. Touchscreen4. Performance Module5. DSP Co-Processing

X

X X

X

X X

X X X

S F H

Page 10: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Effects (on DSK) Filter and Equalizer FIR IIR

Echo & ReverbBuffering

FlangeFancy Buffering

GranulationCrazy Buffering

Pitch Time Shifting-FFT and/or wavelet transform

Etc..

Page 11: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

I/O CardEMIF

Computer

Interrupts

Page 12: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

I/O Card FPGA Altera Cyclone I/II 3-8ns propogation low-cost FIFO “MegaFunction”

Clock Source: buffered clock from EMIF

Page 13: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

USB: DLP Designs USB to parallel module (USB Control Cores for FPGAs)

RS-232• MAX3232

• 1Mbit/s• 2Tx & 2Rx

EMIF bus: (drive and voltage change)• MAX3000E

• Converts voltage levels from 1.2 <-> 5.5 Volts

Mostly PCB and some Wire-Wrap

I/O Card

Page 14: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Performance Module FPGA to handle communication and device

polling. 4-5 foot buttons

• (Directly into logic device)

1-2 Pedals• Pedals act as attenuators• Feed 5V signal• AD7861 (ADC with 11bit resolution)

• Low speed• PLCC 44 package

Clock Source: Crystal Oscillator (1MHz)

Page 15: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

DSP Co-processorTMS3206713B-200

200pin HLQFP• Not BGA!!!

Connection• through Host Peripheral Interface on DSK

192K internal SRAM• Maybe enough!

Clock Source:• same as DSK, 50MHz Crystal Oscillator.

HPI

Page 16: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Touch ScreenMotion Computing M1300

Slate style tablet: large screen Linux Preset Programming Slider Display

Page 17: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Development Structure

Primary

Secondary

Kabuki 2800

Page 18: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Dan’s Tasks

Primary

Software Effects Software Devices Software

simulation

Secondary

Layout design and fabrication.

Firmware

Kabuki 2800

Page 19: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Justin’s Tasks

Primary I/O Layout Design

and Fabrication Firmware USB design and

Protocols

Secondary

Does No have any.

Kabuki 2800

Page 20: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Tim’s Tasks

Primary

Performance board firmware

layout and design

Kabuki 2800

Secondary

USB Design and Protocols

Device Casing

Page 21: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Yazan Task’sPrimary

Device Casing and Fabrication

DSK and interface Card

Kabuki 2800

Secondary Module hardware design Module Firmware design Audio effect algorithm

simulation Audio effect algorithm Final packaging and

Software

Page 22: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Phase 1 – Milestone 1, Nov. 2Phase 2 – Milestone 2, Nov.

30Phase 3 – Expo, Dec. 14

ScheduleSchedule

Page 23: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

PhasesPhases Phase 1 – Development &

Prototyping Phase 2 – Integration Phase 3 – Testing and Production

Page 24: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

FPGA configured FPGA boots from EEPROM FLASH reads/writes properly DSK I/O Firmware Complete USB tested RS-232 interface tested

Performance BoardPerformance BoardPhase 1

Page 25: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

FPGA configured and tested

Performance BoardPerformance BoardPhase 2

Page 26: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

All interfaces fully functional (RS-232, USB) Flash storage able to load / store presets I/O functions with DSK and DSP co-

processor USB firmware interfaces with FPGA and

with host computer RS-232 interface fully functioning Firmware completed and under testing Communication established with DSP

coprocessor.

I/O BoardI/O BoardPhase 3

Page 27: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

FPGA configured and tested FPGA boots from EEPROM A/D converter tested Firmware in testing

Performance BoardPerformance BoardPhase 1

Page 28: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

FPGA interfaces with I/O board Foot – pedals generate interrupts A/D converter samples fader pedal

Performance BoardPerformance BoardPhase 2

Page 29: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

FPGA interfaces with Interface Card All user inputs are fully functional

Performance BoardPerformance BoardPhase 3

Page 30: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Board Layout Complete

DSP Coprocessor DSP Coprocessor Phase 1

Page 31: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Board fabricated, populated and ready for testing

JTAG ready

DSP Coprocessor DSP Coprocessor Phase 2

Page 32: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

DSP Processor is able to implement FFT and Wavelet Transforms

DSP is able to communicate with I/O board and and co-process transforms

DSP Coprocessor DSP Coprocessor Phase 3

Page 33: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Effect Algorithms Effect Algorithms Phase 1

Time Domain Effects SimulatedPhasingFiltersEtc.

Page 34: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Most time domain effects simulated

Several more time domain effects implemented

FFTs simulated in Matlab

Effect Algorithms Effect Algorithms Phase 2

Page 35: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Time Domain effects implemented

FFT and Wavelet Domain effects simulated and implemented

Effect Algorithms Effect Algorithms Phase 3

Page 36: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

RISKS AND RISKS AND CONTINGENCY CONTINGENCY PLANPLAN

Sources of Risk USB interface RS-232 interface DSP co-processor Touch-screen interface

Page 37: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

USB FIFO InterfaceUSB FIFO Interface RISKS:

Needs Windows DLLs to be recognized Must interface with FPGA Timing

CONTINGENCY PLAN USE RS-232 USE Preprogrammed Flash Memory

Page 38: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

RS-232 InterfaceRS-232 Interface RISKS

Communication is not fast enough Timing

CONTINGENCY PLAN Make the performance board stackable

on top of the existing DSK

Page 39: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

DSP co-processorDSP co-processor RISKS:

Timing Memory Interface

CONTINGENCY PLAN: Eliminate effects that need extensive

FFT / wavelet processing Use the existing DSK to implement

transforms

Page 40: Kabuki 2800 “a real-time digital audio effects system for performance” team “Big Country” presents ECEN4610 Preliminary Design Review 14 September 2006

Touch-screen InterfaceTouch-screen Interface RISKS:

USB must work We must be able to access the Windows

dll files to monitor touches We must be able to monitor touches on

the screen in real-time CONTINGENCY PLAN:

Use sliders / faders