Christian Brothers University 650 East Parkway South

Memphis, TN 38103-5813

INTERACTIVE MISSIONS MAP

James M. Whitaker

Student IEEE Membership Number: 90510555

Submitted for consideration in

Region 3, IEEE

Student Paper Competition

Endorsement of Branch Counselor: The author(s) of this paper are student members of this IEEE student branch and will still be undergraduate students at the time of SoutheastCon. This paper is the only entry of our student branch. Signature: Name (Typed): John Ventura Telephone Number of Counselor: (901) 321-3429

1

INTERACTIVE MISSIONS MAP Abstract

The Church Mission Society, a group of evangelistic societies working with churches around the world stated that over

nine thousand men and women have served as mission partners during its 200-year history and saw a 43% increase in the

number of people taking part in missions last year. Churches must maintain records on existing missions and provide information

to their members and the public on their missionary efforts in a global context. This project includes the design and

implementation of an interactive system that will enable a user to view and navigate data containing information on the church’s

missionaries. These missionaries are located in different areas of the world and must be displayed in an interactive way. The

solution is a cost effective and efficient system that conveys information and data on missions worldwide for a local church.

2

Table of Contents

Abstract 1 Table of Contents 2 1. Introduction to the Interactive Missions Map 3 1.1 First Evangelical Church 3 1.2 The Current Missions Display 3 1.3 The Display Requirements 3 2. Potential Missions Display Options 4 2.1 Concept Generation 4 2.2 Hardware Options 4 2.3 Software Options 8 2.3.1 Mapping Software 8 2.3.2 Touch System Software 9 3. Missions Display Design 10 3.1 Overall System 10 3.2 Hardware System 11 3.3 Mapping Software System 13 3.4 Touch Software System 15 4. Conclusions 15 5. Appendices 16 6. Sources and References 17 6.1 Sources 17 6.2 References 17

List of Figures

Figure 1 - Johnny Lee Infrared Pen System 5 Figure 2 - Total Internal Reflection Touch System 6 Figure 3 - Squinting Infrared Recognition System 6 Figure 4 - Rear Projection Infrared Recognition System 7 Figure 5 - Block Diagram of the Interactive Missions Map System 11 Figure 6 - Infrared LED Ribbon in Off and On State 12 Figure 7 – PS3 Eye Camera with Band Pass Light Filter 13 Figure 8 – Interactive Missions Map Hardware 13 Figure 9 - Missionary Information in World Wind 14

List of Tables

Table 1 – Hardware Screening Matrix 8 Table 2 – Mapping Software Screening Matrix 9

List of Appendices

Appendix 5.1 – Example Input Text File 16 Appendix 5.2 – Cost Analysis 16 Appendix 5.3 – Social and Political Analysis 16 Appendix 5.4 – Sustainability 17 Appendix 5.5 – Environmental Analysis 17

3

1. Introduction to the Interactive Missions Map

1.1 First Evangelical Church

Mission work abroad has been a driving factor for First Evangelical Church for over 70 years. In the Mission and Vision

statement of the church the final tenant is to “extend the love of God through evangelism and missions.” The church itself has

over 40 missionaries, several missions’ agencies, and over 70 national workers in more than 25 countries. A very significant task

of First Evan is to inform its congregation about the missionaries, as well as extend these passions and desires of the church to

the younger generation.

1.2 The Current Missions Display

The present display of the missionaries is a large bookcase with face outs and pamphlets underneath. This current

design makes it very difficult to update, is outdated, and requires a significant amount of paper. Missionaries come and go

frequently, making up-to-date information difficult to produce.

1.3 The Display Requirements

In light of the current display, there are some specifications and desired elements for the new display. It must be

interactive; it must be easy to use; and it must be aesthetically appealing. It must also be cost effective and relatively portable for

events in other parts of the church. The church has multiple utilities, such as a projector and computer, which can be used to

reduce the cost of the project.

Therefore, the system must be economically feasible, as well as meet the following criterion for the requirement

specifications:

Allow for limited accessibility from a variety of users

Allow for as much cross-platform transferable software as possible (if a computer is needed).

Minimize maintenance and production costs.

Display must have a high resolution.

Design must place emphasis on aesthetic appeal

4

2. Potential Missions Display Options

2.1 Concept Generation

There are varieties of options for an interactive display that would meet the needs of the church. There are two aspects

of the missions display that contribute to the overall system: hardware and software. In addition, the software has two sub

categories: the mapping software and the touch software. Each part of the overall system has several implementations, however

the best one for the church must be chosen.

2.2 Hardware Options

The hardware is comprised of the display and the means of displaying the information and not necessarily the

information itself. There are five options to be considered, each of which is described and contrasted with the requirements and

the other options.

Option 1: Switchboard Control

A switchboard-controlled display allows the user to see information that is physically displayed on a map. The

switchboard may have options to highlight the locations of various missionaries across the globe through buttons and

informational panels. These types of panels are seen in a number of museums and other educational facilities.

This type of display is very easy to create and has relatively inexpensive parts; however, the disadvantages to this

option are its lack of mobility, its outdated technology, and its difficulty to update. These three disadvantages indicate that a more

complex system may be needed.

Option 2: Commercial Touch Screen Display

A commercial touch screen would display the information given it by a computer. The displays are highly aesthetically

appealing as well as moderately easy to implement. The disadvantage is that a commercial touch screen display is very

expensive, making it a less viable option.

Option 3: “Johnny Lee”

The Johnny Lee Implementation requires the use of a Wii remote’s infrared camera, a computer, and a projector [1].

The user interacts with the system through the infrared emissions of an infrared pen. The movements are recorded by the

infrared camera and translated into meaningful coordinates through the computer’s software. This system is displayed in Figure

1. This type of implementation is very inexpensive, as it uses utilities already owned by the church. Disadvantages to the “Johnny

5

Lee” option are the source of infrared light and the projector interference. If an infrared pen is used as the source of infrared light,

either the user must have an infrared pen or one must be provided. This could cause some hassle in the ease of use, making the

system harder to use. Another problem is that the projector would have interference from the user interfering with the projection

path of the display, making the missions display less visually appealing.

Figure 1 – Johnny Lee Infrared Pen System

Option 4: Side Squinting

The Side Squinting Implementation requires the use of two infrared cameras and a touch surface that has the ability to

emit infrared light mounted on a display such as a television screen or monitor [2]. The light is translated into meaningful

coordinates by the use of the infrared cameras that are mounted to the edges of the display. The software interprets this and the

display is updated. The display can be any type of screen to display the software. The infrared emitting surface is constructed

from an acrylic pane that has the capability of emitting infrared light due to Total Internal Reflection [3]. Total Internal Reflection is

the process of light being reflected inside a medium without emission due to the index of refraction of the material. This process

is shown in Figure 2. This overall system is shown in Figure 3.

6

Figure 2 – Total Internal Reflection Touch System

Figure 3 – Side Squinting Infrared Recognition System

The side squinting system has a variety of benefits, such as, its low cost (due to the provided utilities); there is no need

for an infrared pen as in the ”Johnny Lee” system; and a display does not need to be constructed. The disadvantages to this

system are the mobility and software implementation. The overall system, shown above, is as mobile as the screen that the

7

touch surface and cameras are mounted on. This system requirement for a preexisting display also adds significantly to the

overall cost of the project.

Option 5: Rear Projection

The Rear Projection Implementation requires an infrared camera, a projector, and a computer [2]. The display is

constructed from an acrylic pane that has the capability of emitting infrared light due to Total Internal Reflection principle. The

Total Internal Reflection process can be viewed in Figure 2. The projector is mounted behind the screen, and a computer

interprets the infrared light recognized by the camera and updates the display as needed. This system is displayed in Figure 4.

The Rear Projection system has the same benefits as the side squinting system, such as low cost and no infrared pen;

additionally it uses a projector as its screen as opposed to a commercial display, reducing the cost. The main drawback is the

need for rear space for a projector.

Figure 4 – Rear Projection Infrared Recognition System

8

The screening matrix in Table 1 allows a choice to be made according to the needs that are given in various areas of

the project. This screening matrix shows the advantages and disadvantages to each of the possible implementations. The

number next to the column heading is the weight that is placed on each of the categories of consideration.

Option

Cost Efficiency

(3)

Aesthetic Appeal

(2)

Convenience for User

(2) Performance

(2)

Ease of Implementation

(1) Portability

(1) Total

Switchboard Controlled 2 1 1 1 0 0 5

Commercial Touch Screen Display 0 2 2 2 1 0 7

Johnny Lee 3 0 0 2 1 1 7

Side Squinting 1 2 2 2 0 0 7

Rear Projection 3 2 2 2 1 1 11

Table 1 – Hardware Screening Matrix

The screening matrix shows the Rear Projection Implementation to be the best hardware implementation choice for

First Evangelical Church due to the specific needs of the digital missions map system. The other implementation choices are

shown to be equal in total while varying in the different aspects in which each benefits and fails.

2.3 Software Options

The rear projection system requires two software components that must work in unison. The higher level of the two is

the mapping software and the lower level is the touch input and interpretation system. These two portions must be able to work

together, for the touch information must provide the input for the mapping software. The possible options for each kind of

software must also be weighed.

2.3.1 Mapping Software

The mapping software displays the locations of the missionaries and other information about them. This portion itself is

also subject to the same goals as the hardware (cost efficiency, aesthetics, performance, etc.), therefore the options must be

carefully weighed as well.

9

Option 1: Custom Mapping Software

Custom mapping software requires the creation of software that displays a world map. The digital input is equated with

predetermined coordinates on the screen that display the desired information of the missionaries in the area that the interaction

occurs.

Option 2: World Wind Java

World Wind is open-source software developed by NASA. It displays an interactive globe and streams imagery from

NASA’s databases, allowing for a high-resolution interaction with the digital world [4]. This existing software must be modified to

display the desired information about the missionaries when a marker is interacted with in the software.

The analysis of the two implementations methods are compared in Table 2. The World Wind Java software is shown to

be the best software implementation choice for First Evangelical Church due to the higher level of aesthetic appeal and ease of

implementation.

Option

Cost Efficiency

(3)

Aesthetic Appeal

(2)

Convenience for User

(2) Performance

(3)

Ease of Implementation

(3)

Cross Platform

(1) Total

Custom Mapping Software 3 0 2 3 1 1 10

World Wind Java 3 2 2 3 3 1 14

Table 2 – Mapping Software Screening Matrix

2.3.2 Touch System Software

The touch system software involves the recognition of infrared points by the camera as well as the translation of the

infrared data. There are two options available for consideration:

Option 1: Cursor Substitution

A variety of infrared detectors is available to substitute the cursor’s position with the information that is received

through the infrared detector, regardless of the input method (IR camera types). This would create an easy implementation with

the ability to act as the computer cursor allowing a single input via the infrared source. The downside to this implementation is

the software is operating system specific because the information is obtained at the driver level.

Option 2: NUI Group Infrared Detection Software (TUIO)

The NUI Group “Community Earth” software is a version of World Wind that has been modified to accept infrared input

[5]. This allows the user to interact with the World Wind software with a variety of multi-touch commands (recognition of multiple

10

infrared spots to manipulate the program) such as, using two fingers to zoom in and out as well as change the orientation. The

addition of a third finger allows the display to change its pitch angle, creating a horizon view. The advantage of this software is

that, while there is still a driver level component, the driver serves the information on a TCP/IP port, allowing the cross-platform

java application to listen and interpret the input commands. Drivers for the touch input device(s) are also available for most

operating systems, which furthers cross platform capability. This software must however be made to work with World Wind Java.

After the choosing of the mapping software, the infrared recognition system chosen must be the NUI group

implementation. This implementation is the only meaningful way to interact with the mapping software. The reason for this is that

the World Wind application must be able to utilize features such as zooming in and out. These features are needed because in

some areas, First Evangelical Church has missionaries that are concentrated in a small region. When the mapping software is

shown from a large perspective, the markers for various missionaries’ information are blurred together, making the software

unusable, unless the user can view the smaller area in detail. Therefore, the NUI group implementation for the infrared

recognition software is chosen. Furthermore, a project called “Community Earth” that incorporates an older version of World

Wind Java and the multi-touch TUIO software was constructed by the NUI group, which provides a powerful reference [5].

3. Missions Display Design

3.1 Overall System

The completion of the Touch-Screen Missions Map is dependent on all the elements of its subsystems to be

operational: the mapping software, the touch system software (some hardware is involved for testing purposes), and the

hardware implementation. The overall system interaction is displayed in Figure 5.

11

Figure 5 – Block Diagram of the Interactive Missions Map System

3.2 Hardware System

The hardware system itself has three major components: a sheet of acrylic, infrared LEDs, and an infrared camera.

The additional components that are required, such as the computer and projector, are basic plug and play devices, and do not

affect the overall design of the hardware, however they must be generically considered.

Acrylic:

The screen requires a sheet of acrylic to act as the medium for the infrared light to be contained. Because the system

is based on total internal reflection of infrared light, the acrylic must be optically clear and thick enough so light can be evenly

distributed throughout the acrylic. The size of the acrylic is chosen to be a 42” 16x9 aspect ratio display. This size is chosen for

three reasons. Most projectors are able to project a 42” image from a distance at most 5’. This size would be easily readable yet

not too large to move. Finally, a 3x4 aspect ratio image would appear fine on the 16x9 ratio as well as provide options for more

advanced projectors (high definition projectors are biased to a 16x9 aspect ratio).

With these elements in consideration, a 37.5”x21.5”x0.472” sheet of optically clear acrylic was purchased from Acrylite,

who will custom cut the acrylic [6].

12

Infrared LEDs:

The e infrared LEDs produce the infrared light that is reflected inside the acrylic. In order to have enough infrared light

in the acrylic, the LEDs should be placed at most 3cm apart from each other. The LEDs should also have a wide-angle beam for

maximum reflection (otherwise, the light will shine directly across to the other side) [7]. A wavelength of 940nm is chosen for the

frequency of the infrared light, because it is lower into the infrared spectrum to provide less interference from other sources of

infrared light. In order to reduce soldering as well as cumbersome displays, an LED ribbon from Environmental Lights was used.

The ribbon is approximately 9’ long to border the parameter of the acrylic. The LEDs are placed every 0.98” ensuring maximum

distribution of infrared light throughout the acrylic [8]. A power supply was purchased with the LED ribbon, which supplies the

12W needed by the LEDs [8]. Figure 6 displays the infrared LED ribbon in the on and off state.

Figure 6 – Infrared LED Ribbon in Off and On State

Infrared Camera:

The infrared camera must be able to recognize the frequency of light that the infrared LEDs are producing (in this case

940nm). It must also be able to connect to a computer in order to communicate the recognition of infrared light. A PS3 Eye

Camera was found to be the best fit [5][7]. While being relatively inexpensive, a simple replacement of the infrared filter with a

band pass light filter (with the wavelength being 940nm) allows it to filter most other sources of light, focusing on the infrared light

that is present. Figure 7 displays the PS3 Eye Camera.

13

Figure 7 – PS3 Eye Camera with Band Pass Light Filter

The combination of the prior elements, as well as a stand made from 3/8” steel tubing, give the final hardware product

the touch display for the Interactive Missions Map. The touch display is shown in Figure 8

Figure 8 – Interactive Missions Map Hardware

3.3 Mapping Software System

World Wind Java is a highly interactive program, from its varying displays to its intricate graphics system. The main

four tasks that needed to be accomplished were to 1) create a way to show where the missionaries are, 2) be able to display

additional information about the missionaries, 3) have these abilities respond to touch software, and 4) have this be easy to

update without having to reprogram.

14

Displaying Missionary Locations:

In order to display a missionary’s location, some type of marker must be implemented. A marker is created with a given

latitude and longitude and can be any number of shapes and sizes. In this case, the markers are resizable red spheres that

display on the general location of where the missionary is located. A marker alone does not give very much information about the

missionary other than the location; therefore, the ability to display more information is needed. In World Wind Java, a marker can

be made “pickable,” meaning it detects when it is picked due to some event [4]. When this happens a new window is constructed

and displayed, showing the additional information desired. Figure 10 illustrates this process.

Figure 9 - Missionary Information in World Wind

Touch Interactions with World Wind:

Software developed by the NUI group called “Community Earth” developed a touch interaction system for an older

version of World Wind Java [5]. By modifying this software, it can be used as the picking mechanism. For ease of use, when the

user touches a point the location is tested to see if a marker exists in that place. If it does, the information about the appropriate

missionary is displayed, otherwise the program continues without displaying any information. When a missionary’s information is

being displayed, the next touch of the system will close the window and continue to run normally.

15

Updating the Missionaries:

Each time World Wind Java is loaded, a designated folder is searched. This folder contains text and html documents

about the missionaries that will be displayed. The information is organized having a field for the coordinates of the marker, the

names of the missionaries, and additional information. This allows a wide variety of people to edit these files and display what is

desired. An example of these text files is given in Appendix A.

3.4 Touch Software System

The touch software, developed by the NUI Group, has three aspects that operate together to form a cross-platform

result. First, the information from the infrared camera must be interpreted to locate “blobs” or touch points. An interaction

between the driver for the IR camera and a program interprets these touch “blobs” (one such program is called Community Core,

developed by the NUI Group). Secondly, the information is translated to a TCP/IP packet [5]. This packet can then be

broadcasted to a port. By doing this, a java application merely needs to listen to the port, so that there is no need for the driver to

be directly connected with the World Wind Java software or even the touch interpretation.

4. Conclusion

This project developed an interactive system that enables a user to view and navigate a display system that contains

information on the church’s missionaries. Moreover, the missionaries are located in different areas of the world and are displayed

in an interactive way.

The Touch Screen Missions Map is a project that encompasses a variety of elements such as hardware, software,

drivers, and some aspects of network communications. This project is a combination of these elements and an examination of

the benefits and drawbacks of each. This choosing of the appropriate applications and implementations proved to be the most

important part of the project. After the selection of the elements and components, the project was constructed, tested, and

revised.

16

5. Appendices

5.1 Example of Input Text File

DavidIrwin.txt:

32.7833333 <- longitude

-96.8 <- latitude

David Irwin <- name

Organization: Wycliffe Bible Translators <-additional information (may also reference an HTML to display file)

Location: Dallas, Texas <-additional information

5.2 Cost Analysis:

The total cost of purchased materials for the project:

Component Cost

Acrylic Pane $126

Infrared LED Ribbon $134

Power Supply $25

Infrared Camera $40

Total Cost: $365

Commercial Touch Screen Monitor Cost $1500

5.3 Social and Political Analysis:

The effects of this project are largely social and political. The overall goal of the Touch Screen Missions Map is to bring

a closer community to the church by making the congregation aware of the missionaries abroad and the work they are doing.

The political aspect of the missions map is through the social matter of bringing information about the missionaries to the people

in the church. By seeing the information about the missionaries, a stronger desire to support them will be instilled, due to the

readily accessible information of what their needs are.

17

5.4 Sustainability:

The Interactive Missions Map is made to last. It can be operational with a few key base components, such as the touch

display and infrared camera, and some generic components, such as a computer (with the correct software) and a projector. The

only aspect that could be an issue is projector bulbs. Projector bulbs will eventually burn out (after 3,000 – 4,000 hours) but it is

an expense regardless.

5.5 Environmental Analysis:

The average power consumption of the overall system is a combination of its parts. A common LCD projector

consumes 120 watts, a common desktop computer consumes 400 watts, the infrared ribbon consumes 12 watts, and the infrared

camera off a USB power supply coupling its energy consumption with the computer. Therefore, the total power consumed by the

system is approximately 532 watts.

6. Sources and References

6.1 Sources

Pat Murris, World Wind Java Developer

Nolan Ramseyer, Owner and Founder of Peau Productions

6.2 References

[1] Human Computer Interaction

http://www.johnnylee.net

[2] DIY Touch Panels

http://mortalspaces.com/diytouchpanels/

[3] Multi Touch interface with Java and JavaFX

http://developers.sun.com/learning/javaoneonline/2008/pdf/TS-6127.pdf

[4] World Wind Central

http://worldwindcentral.com/wiki/Java

18

[5] NUI Group

http://nuigroup.com/

[6] Acrylite

http://www.acrylite-shop.com

[7] Peau Productions

http://www.peauproductions.com/

[8] Environmental Lights

https://www.environmentallights.com/