robot unicorn attackweb.mit.edu/.../qyn_project_design_presentation.pdf · sound effects and music...

17
Robot Unicorn Attack

Upload: others

Post on 07-Jul-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Robot Unicorn Attackweb.mit.edu/.../qyn_Project_Design_Presentation.pdf · Sound effects and music Final integration and testing Stretch goals Kelly Tania Both. Title: Flying Pegasus

Robot Unicorn Attack

Page 2: Robot Unicorn Attackweb.mit.edu/.../qyn_Project_Design_Presentation.pdf · Sound effects and music Final integration and testing Stretch goals Kelly Tania Both. Title: Flying Pegasus

Bringing the Game to Life

Page 3: Robot Unicorn Attackweb.mit.edu/.../qyn_Project_Design_Presentation.pdf · Sound effects and music Final integration and testing Stretch goals Kelly Tania Both. Title: Flying Pegasus

Flying Pegasus Ground AttackKelly Qi | Tania Yu

Page 4: Robot Unicorn Attackweb.mit.edu/.../qyn_Project_Design_Presentation.pdf · Sound effects and music Final integration and testing Stretch goals Kelly Tania Both. Title: Flying Pegasus

System Overview

Camera Object

Recognition

Game LogicGraphicsGame

Output

Page 5: Robot Unicorn Attackweb.mit.edu/.../qyn_Project_Design_Presentation.pdf · Sound effects and music Final integration and testing Stretch goals Kelly Tania Both. Title: Flying Pegasus

Camera● Nexys4-DDR OV7670 Camera

● VGA 640x480 resolution

● Tracks hand motion

● RGB2HSV

Page 6: Robot Unicorn Attackweb.mit.edu/.../qyn_Project_Design_Presentation.pdf · Sound effects and music Final integration and testing Stretch goals Kelly Tania Both. Title: Flying Pegasus

Object RecognitionFilter

Motion

Flight Attack

Hand coordinates

Motion signal

Video framesBRAM

Page 7: Robot Unicorn Attackweb.mit.edu/.../qyn_Project_Design_Presentation.pdf · Sound effects and music Final integration and testing Stretch goals Kelly Tania Both. Title: Flying Pegasus

Game Logic

Environment pixel Obstacle pixelAttack hit signal

Pegasus

Controller

Environment Obstacles

Attack pixel

Pegasus pixel

Collision signal

Attack

Sound effects

Page 8: Robot Unicorn Attackweb.mit.edu/.../qyn_Project_Design_Presentation.pdf · Sound effects and music Final integration and testing Stretch goals Kelly Tania Both. Title: Flying Pegasus

Graphics

Page 9: Robot Unicorn Attackweb.mit.edu/.../qyn_Project_Design_Presentation.pdf · Sound effects and music Final integration and testing Stretch goals Kelly Tania Both. Title: Flying Pegasus

Sprite Storage

• Load background image

to BRAM one column at a

time

• Pre-load sprites in BRAM

SD controller SD card

BRAM

Image/audio

Write memory

Image/audio

Image pixel

Image/audio

Controller

Page 10: Robot Unicorn Attackweb.mit.edu/.../qyn_Project_Design_Presentation.pdf · Sound effects and music Final integration and testing Stretch goals Kelly Tania Both. Title: Flying Pegasus

Game Output

●Video to the monitor

●Audio to the speaker

Page 11: Robot Unicorn Attackweb.mit.edu/.../qyn_Project_Design_Presentation.pdf · Sound effects and music Final integration and testing Stretch goals Kelly Tania Both. Title: Flying Pegasus
Page 12: Robot Unicorn Attackweb.mit.edu/.../qyn_Project_Design_Presentation.pdf · Sound effects and music Final integration and testing Stretch goals Kelly Tania Both. Title: Flying Pegasus

Ground Ground

Pegasus Obstacle

Obstacle

ObstacleObstacle

Obstacle

Obstacle

Obstacle

Obstacle

Obstacle

Page 13: Robot Unicorn Attackweb.mit.edu/.../qyn_Project_Design_Presentation.pdf · Sound effects and music Final integration and testing Stretch goals Kelly Tania Both. Title: Flying Pegasus

Ground Ground

Pegasus ObstacleAttack beam

Page 14: Robot Unicorn Attackweb.mit.edu/.../qyn_Project_Design_Presentation.pdf · Sound effects and music Final integration and testing Stretch goals Kelly Tania Both. Title: Flying Pegasus

Ground Ground

Pegasus

Page 15: Robot Unicorn Attackweb.mit.edu/.../qyn_Project_Design_Presentation.pdf · Sound effects and music Final integration and testing Stretch goals Kelly Tania Both. Title: Flying Pegasus

Environment pixel Obstacle pixelAttack hit signal

Camera Filter

Motion

Flight Attack

Pegasus

Controller

Environment Obstacles

Sound effects

Monitor

Speaker

Hand coordinates

Motion signal

Speed

Attack pixel

Pegasus pixel

Collision signal

Pixel value

Sound wave

Sound byte

Sound output

Video output

Video input

Pegasus coordinates

SD controller SD card

BRAMImage pixel

Image/audio

Write memory

Image/audio

Image/audio

Page 16: Robot Unicorn Attackweb.mit.edu/.../qyn_Project_Design_Presentation.pdf · Sound effects and music Final integration and testing Stretch goals Kelly Tania Both. Title: Flying Pegasus

WeekTask

11/1 11/8 11/15 11/22 11/29

Motion tracking

Basic graphics

Flight physics

Integration and testing of basics

Attacking obstacles

Collision detection/death

Integration and testing

More graphics

Sound effects and music

Final integration and testing

Stretch goals

Kelly

Tania

Both

Page 17: Robot Unicorn Attackweb.mit.edu/.../qyn_Project_Design_Presentation.pdf · Sound effects and music Final integration and testing Stretch goals Kelly Tania Both. Title: Flying Pegasus