live action first person shooter game patrick judd ian katsuno bao le

Live Action First Person Shooter Game

Patrick Judd

Ian Katsuno

Bao Le

Inspiration

Inspired by the “Real Time Color Replacement” Project (2009)

Wanted to combine their invisibility effect with a Duck Hunt style game

http://en.wikipedia.org/wiki/Duck_Hunt http://www.eecg.toronto.edu/~pc/courses/432/2009/projects/colorreplacement.pdf

How our game works

Camera captures the game stage and displays it on a monitor

People/objects which enter the stage become targets

User shoots targets on the monitor with a gun controller

When a target is hit, it disappears (invisibility effect)

Revised Project Goal

Two foreseen difficulties1. Custom HW interface for gun controller

2. Tracking multiple targets Revised project goals

1. Use a mouse instead of a gun controller

2. Restrict number of supported targets to one

Initial System Block DiagramCamera

Video Decoder

Mouse

Serial Port Driver

RAM-live image

-reference image

MicroBlaze Processor

Target Locator

RAM-Modified image

Target Drawer

Draw B/W Image*

Video Encoder

Monitor

Light gun

Optional

Target Manager

Hit/Miss Analyzer

Analog

Digital

Video_to_ram

Target Locator

Compares reference image to live image

A difference in color indicated a target

Encodes targets location as:

(x min, y min)

(x max, y max)

Memory

Microblaze

Reference Image Live Image

(x min, y min) (x max, y max)

Target Locator

Reference Image

Live Image

Target Location

PS/2 Mouse

FPS requires: High Precision Quick Response Time

Replaced Light Gun as input.

No ECE532 project has used it!

Mouse Operation

Xilinx IP: XPS_Ps2 v1.00a Communicates with Microblaze over PLB SW Initialization: predefined sequence of

byte codes Interrupts on action (move or click) Receives info packets in ISR

Software – Target Manger

Tracks movement of target based on coordinates from the target locator Needs to distinguish an old target from a new

target Compares target location to mouse

coordinates to detect “hits” Remembers if a target has be hit

Target Remover Gets coordinates of box to

remove from microblaze(x min, y min) (x max, y max)

If (pixel is in box)read from reference image

Elseread from live image

Memory

Microblaze

Reference Image Live Image

(x min, y min) (x max, y max)

Target Remover

Output Image

Video Encoder

Design Flow - Hardware

Start with simple custom core to read and write to memory

Create verilog testbench and simulate core Compare output waveforms with spec Test core in hardware Incrementally add functionality

Design Flow - Software

Wrote algorithms and data structures in Linux Integrated into microblaze code Debugged microblaze software using xps gdb

Problem - Mouse Initialization

Initialization: Send and receive a sequence of byte-codes

Problem: Mouse wouldn’t follow script!Debug:

Tried to isolate the problem:Tried mouse on other PCRead Registers using XMD

Solution: Get another mouse!

Problem - Mouse Buffer Overflow

Problem: Buffer overflow interrupt occur

Debug: Decrease sample rate Receive more than one packet in ISR?

Solution: Printf too slow, Remove it!

Problem – Custom Logic

Target Locator core worked correctly in simulation

However the core did not function in hardware

Tried a variety of debug methods but could not isolate the cause of the problem LEDs and switches Chipscope XPS hdl simulator

Problem – Custom Logic

Solution: Use mem_to_ip/ip_to_mem core from “Real Time

Color Replacement” Project Used their FSMs to perform memory reads and

writes Added our own target locator logic Also move target remover functionality to software

Problem - Integration

the ps2 core caused erroneous target detection when it was added to the project

possibly due to bus read errors We are currently unable to find a solution

For the demo

Two demos too show functionality of parts of the design before integration, in lieu of the ps2 – detection issue

For the demo

1. Target locator reading the video signal and sending target information to microblaze

Video Decoder

RAM- live image

-reference image

MicroBlaze Processor

Target Locator

Video Encoder

For the demo

2. Mouse to video interface and target remover functionality

Video Decoder

Mouse

Serial Port Driver

RAM

-live image-reference image

MicroBlaze Processor

Video Encoder

Target Manager

Hit or Miss Analyzer

Lessons learned

Don’t try to reinvent the wheel We spend a lot of timing trying to recreate what

other group had already done instead of focusing on the “new” aspects of our project

Lessons learned

Our approach to hardware debugging was less than ideal We had

multiple group members debugging independently used different methods

Should have decided on the best method concentrated our efforts

Conclusion

Could not produce a fully functioning project However

Learned valuable lessons in project management Were the first group to use a ps2 mouse with their

project Will add this to the ece532 knowledge base