powerpoint presentation2014.icoict.org › wp-content › uploads › 2013 › 01 ›...

85
ICoICT, 28/5/2014

Upload: others

Post on 30-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

ICoICT, 28/5/2014

Page 2: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Introduction - What is IoT

Sensors and Trend of Sensing › Sensors

› WSN – energy efficiency

IoT Communications

IoT Computing prototypes › iLukBa

› HajjLocator

› NFC-Smart Poster

› HajjLocator

› 3D: Visualisation and Navigation

Summary

Page 3: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Introduction - What is IoT?

Page 4: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

What Could We Do with the Internet?

Information Gathering

Online Shopping (Activity)

Get In Touch With People (Social Networking)

Google, Ask, Bing, etc.

Amazon, Lazada, Bhineka, etc.

Facebook, Twitter, MySpace, etc.

Page 5: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

How Internet Evolved?

PERERA et al. : CONTEXT AWARE COMPUTING FOR THE INTERNET OF THING

Page 6: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Internet Today

• Those using their mobiles to connect to the internet have grown in number from 55% in late 2011 to 65% by the end of 2013.

• During the same period, going online via a tablet grew at an even faster rate – from just 12% up to 29%.

https://www.globalwebindex.net/

• Indonesia has around 236.8k mobile phone users with population 237,556,363 so the penetration is about 99.68% (on September 2013) – “CIA – The world Factbook”, 14 January 2014.

Page 7: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Internet Today (Cont)

Kinesis Survey Technologies, J. Cazes, L. Townsend, H. Rios, J. Ehler-James, 2010

Page 8: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Internet of Things (IoT)

http://www.agtinternational.com/technology/internet-of-things/

• Everything value will be on the network in one form or another

• All objects will be interacting and communicating with each other

Page 9: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

IoT in Context-Awareness Perspective

• Identify (Who)

• Activity (What)

• Response (Environment)

• Location (Where)

Page 10: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Our Research Focus on IoT Area

Page 11: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Our Goal … Our goal is:

to make user interacting with “the things” easier in the smart environment where “the things”: • spread throughout (pervasive), • are everywhere at the same time (ubiquitous), and • Are embedded (ambient) in the environment.

The UI needs not to be difficult, tedious or need hard learning to the user.

It should potentially be: • safe, • easy, • simple, and • enable new functionality without need to learn a new technology.

It provides relevant information and a simple way for a user to deal with it.

Page 12: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Internet of Things (IoT): Environment

Home

http://www.telegraph.co.uk/technology/internet/10542550/Everything-connected-the-smart-home-in-2014.html

Office

http://www.smartofficefurniture.ca/

Parking

http://green.autoblog.com/2009/03/20/smart-fortwos-get-half-price-parking-in-350-new-york-parking-gar/

Page 13: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Internet of Things (Iot): Environment

School

http://www.tabletsforschools.org.uk/samsung-smart-school/samsung-smart-school-8/

Store

http://upshotsites.com/mlsfixturesandequipment/services.html

City

http://people4smartercities.com/image/iskandar-smart-city

Page 14: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

http://www.smartsantander.eu/

Smart Santander, Spain. The world’s most advanced smart city

Key Functions • Validation of approaches to the architectural model of the IoT. • Evaluation of the key building blocks of the IoT architecture, in

particular, IoT interaction & management protocols and mechanisms; device technologies; and key support services such as discovery, identity management and security.

• Evaluation of social acceptance of IoT technologies and services.

Page 15: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

• 12000 sensors installed in the city, including in the ground.

• Inform to public: temperature, humidity, level of pollution, noise, light, traffic, road work, bus schedule, etc.

Page 16: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Internet of Things (IoT): Applications

J.Gubbietal./FutureGenerationComputerSystems29 (2013) 1645–1660

Page 17: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

NFC School System

http://i.bnet.com/blogs/scholarchip-nfc-support-for-mobile-check-ins.jpg

M.A Ayu, “TouchIn: An NFC Supported Attendance System in a University Environment “, Vol. 4, No. 5, October 2014

• Attendance Manipulation Tracking

• Automation (Simplify Process)

• Time Efficiency

Page 18: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

NFC Payment System

T. Mantoro et al., “NFC Secured Online Transaction in Mobile Computing Business “, International Journal Of Computers And Communications, 4 (6), 2012

• Guarantee Privacy and Security

• Automation (Simplify Process)

Page 19: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Elderly Monitoring

http://www.ashvillesmarthomes.com/blog/home-automation-helps-elderly-disabled/

J.V Lee, Y.D Chuah, and K.T.H Chiengm “Smart Elderly Home Monitoring System with an Android Phone“, International Journal of Smart Home Vol. 7, No. 3, May, 2013

• Prevent accident

• Help the older person to stay in their home

• Tracking elderly Fall

Page 20: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Smart Parking

N Kim, C Jing, B. Zhou and Y Kim “Smart Parking Information System Exploiting Visible Light Communication“, International Journal of Smart HomeVol.8, No.1 (2014), pp.251-260

• Getting the Real-time Parking Information

• Finding Parking Space

Page 21: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Smart Parking

• System guide the car for parking

• Sending car information to server

• Car information can be used for payment purpose

• System can guide the car to the nearest parking space

• Tracking current car position

Page 22: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Sensors and Trend of Sensing in IoT

Page 23: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Type of Sensors

• Three types of sensors: • Precise Location (Fixed sensor) • Proximate Location (Proximate sensor) • Predicted Location (History Location)

Page 24: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Not all sensors/devices can be represented as a user identity in a smart environment (home/office). The requirements for a sensor/device to be a user/device are:

• used as a personal and privacy device • have capability to connect to the network with certain MAC address.

For example: mobile phone, PDA and tablet with a Bluetooth and/or WiFi enabled device.

In case a user has more than one devices, then the latest sensor data that store in the repository will be used as a current state.

Sensor Identity

Page 25: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Family Member Identification

• Detecting the family member in smarthome

• Turning off the potentialy “Dangerous” object

• Obtaining family member’s location

Y.C Yu, “Smart Door: A Ubiquitous Collaboration System for Home Activities in the Smart Home “, Journal of Information Science and Engineering 29, 1227-1248 (2013)

• Reminding the family member’s schedule

Page 26: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Family Member Identification Context Relation

Security

Location Activity

Page 27: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Family Member Identification

CASE SMARTHOME ACTION GOAL

Family member wants to enter the home

The door will be automatically unlocked

Automation

All family members are outside

Turning off the potentialy dangerous object

Security

Family member forget a meeting schedule

Reminding the family member to leave the home

Activity

Family member is nearing home

Open the fence Location

Page 28: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Generalisation of the Sensor Data Format

sensor-id user-id location-id time sensor-state

Sensor data format:

Every sensor object has its own sensor identity and user identity

sensor-id user-id descriptions sensor-type

EA003 U4011906 Sensor embedded in Joe’s Chair Fixed/Precise

EA100 U4011906 Joe’s PDA Proximate

EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

sensor-id user-id loc-id time state interpretation

EA004 U0000000 E231 1090974717 1 The door in room E231 is open and has been since 6:23:31 25/08/07. That was 5

minutes ago

EA003 U4011906 E231 1090974717 1 Somebody sitting in Joe’s Chair in room E231 and has been since 6:23:31

25/08/07. That was 3 minutes ago

EA99 U4011906 E231 1090974717 1 Joe’s Bluetooth enabled Mobile phone is in his room (E231) and has been since

6:23:31 25/08/07. That was 8 minutes ago

Page 29: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Smart Sensor Processing From Fixed and Proximate Sensor Servers

Page 30: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Fixed and Proximate Location Sensor Servers

Page 31: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations
Page 32: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Examples of the Environment Response response to phone call

(“U4011906”, “E213”,”EA099”,1090973456,1) from Bluetooth scanner (“U4011906”, “E213”,”EA009”,1090994856,1) from Joe’s phone sensor

Joe and his personal mobile phone came into room E213 and someone took Joe’s phone off the hook. The mobile phone sensor has Joe’s identity, but the phone sensor has no user identity containment.

Resp2phonecall(_,sensor_id):- Stat(sensor_id,“EA099”), Stat(sensor_id, “EA009”),

Sensor_state(“EA099”,1, ~t), Sensor_state(“EA009”,1, ~t).

irMedia Player

Rules for pattern matching:

Page 33: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Mantoro T., Ayu M. A., Ali H. S., Usino W., Kadhum M.M. Energy Efficiency Mechanisms Using Mobile Node in Wireless Sensor Networks. NDT (1) 2012: 536-550. Dubai, UEA.

Page 34: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Wireless Data

Collection Network

(IoT - WSN)

Environment Pollution

Smart Home/Smart Office

e-Health (bio-medical)

Temperature, Pressure & Motion

Base Station (BS)

Page 35: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

The base station collects

the data from the sensors, aggregate and send it to

the outside world:

monitor some area, collect

data and report to the base

station.

Page 36: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations
Page 37: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Environmental monitoring (temperature, humidity, etc.)

Smart home/Active Office (pervasive computing)

Traffic monitoring

Military Applications

battlefield surveillance

Page 38: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

RELATED WORK

WSNs Routing Protocols (Singh et al. , 2010)

• Location-based Protocols.

• Data-centric Protocols.

• Hierarchical Protocols.

(Cluster-Based)

• Mobility-based Protocols.

• Multipath-based Protocols.

• Heterogeneity-based Protocols.

• QoS-based protocols.

MECN, SMECN, GAF, GEAR,

Span, TBF, BVGF, GeRaF

SPIN, Directed Diffusion,

Rumor Routing,

COUGAR, ACQUIRE, EAD,

Information-Directed Routing,

Gradient- Based Routing,

Energy-aware Routing,

Information-Directed Routing,

Quorum-Based Information

Dissemination,

Home Agent Based Information

Dissemination

LEACH, PEGASIS, HEED,

TEEN, APTEEN

SEAD, TTDD, Joint Mobility

and Routing,

Data MULES, Dynamic Proxy

Tree-Base Data Dissemination Sensor-Disjoint Multipath,

Braided Multipath,

N-to-1 Multipath Discovery IDSQ, CADR, CHR

SAR, SPEED, Energy-Aware Routing

Page 39: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Packet collision

Overhearing

Idle listening

Multihopping

Page 40: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

PROBLEM

Page 41: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

SOLUTION???

NO RELAY NODES! MOBILE BASE STATION(S)

Page 42: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

To Prolong Wireless Sensor Network Lifetime by wise

management of the energy

Page 43: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

1. Three level multihop structure

2. Using mobile elements which move in Fermat’s spiral

pattern.

Benefits:

› To minimize energy consumption

› To increase network lifetime

Page 44: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

LEVEL 3

LEVEL 2 LEVEL 1

THREE LEVEL WSN STRUCTURE

Page 45: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

MOBILE-BASED FERMAT’S SPIRAL

(RADIAL PROPAGATION/SPIRAL WSN STRUCTURE)

Page 46: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Fermat parabolic Spiral

Vogel, H. in 1979 [15]

The propagation distances ri for

each level i that minimize energy

consumption

Prusinkiewicz and Lindenmayer, in

1990 [17]

Page 47: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

60

450 300

200 120

Page 48: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

60

450 300

200 120

Page 49: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

No. of Nodes Throughput % Energy (J)

60 40 38

120 40 79

200 28 118

300 16.7 130

450 23.8 220

0

50

100

150

200

250

300

350

400

450

1 2 3 4 5

No. of Nodes Throughput(%) Energy (J)

Page 50: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

No. of Nodes Throughput % Energy (J)

60 85 74

120 81.7 135

200 88.5 238

300 88.3 373

450 91.1 573

0

100

200

300

400

500

600

1 2 3 4 5

No. of Nodes Throughput(%) Energy(J)

Page 51: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

0 100 200 300 400 500

1

2

3

4

5

Spiral WSN 3-Tier WSN No. of Nodes

Page 52: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

1

Three level multihop structure

Less Energy

Less Throughput

Mobile-based Fermat’s Spiral

Higher Energy (Efficiency)

Higher Throughput

Page 53: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

IoT Computing prototypes • NFC-Smart Poster

• Smart Home

• iLukBa

• iSpeechNews

• HajjLocator

• 3D: Visualisation and Navigation

• “Cool” internet appliances

Page 54: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Module 13, Mobile Computing

Prototypes: NFC Smart Poster

Contact us/direct dial and more info

Grab the Logo

Join Facebook with NFC

NFC - Academic Calendar

Page 55: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Contact us! More info

Page 56: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Enjoy it!

Page 57: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Join the FST – students Facebook group here:

COPYRIGHT BY INTEG KUCT IIUM 2012

Are you one of FST Postgraduate students?

Faculty of Science and Technology, USBI

Page 58: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Tap your NFC enabled-phone below and receive the calendar

COPYRIGHT BY INTEG KICT IIUM 2012

NFC

Page 59: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Smart Home Modelling

Page 60: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Smart Home Modelling

User motion during working day (left) and non working day (right)

User Location detection during not a working day

User Location detection during a working day

16 Different States between day and night time

Page 61: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Examples of Environment Response

Mobile user 1 Mobile user 2 Mobile user n

Access Point 1

Access Point 2

Access Point n

Microphone,

Speaker,

Bluetooth-scanner

Microphone,

Speaker,

Bluetooth-scanner

Microphone,

Speaker,

Bluetooth-scanner

User Location Environment Response File Server/

Web Server

Pull (WiFi) Push (Bluetooth)

SpeechCA MyLoCA

Small devices with WiFi, Bluetooth or GSM enable

“Where is” obj ? “Tell him”

Symbolic indoor user- location

Linux: /MyLoCA/scanWiFi

/MyLoCA/WiFisignals /MyLoCA/userlocation

Windows: /SpeechCA/wisx.java /SpeechCA/record.java /SpeechCA/tellhim.java

i-LukBA: Indoor hybrid user location and voice for environment response

The 20th International Invention, innovation, and Technology Exhibition (ITEX), Kuala Lumpur, Malaysia, 15-17 May 2009)

Page 62: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations
Page 63: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

HajjLocator framework

Client-side application interface

Page 64: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations
Page 65: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations
Page 66: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

VisUN-3D: Visualization and Navigation

VisUN-3D for user navigation needs the following information:

his location in the 3D map

his location in the 3D walk-space

the target location to meet

his colleague location in the 3D map

his colleague location in the 3D walk-space.

Page 67: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

3D Visualization and Navigation: Problems

Previous implementation in 3D model suited for mobile devices’ interface/display with users realistic perception were left unsolved.

Dynamic entity navigation of environment with 3D model in mobile devices for two or more users is not currently offered in mobile device services.

Page 68: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Related Works

Page 69: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Basic of our approach

Page 70: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Co-processing Interactive Architecture

Structural-view navigation. This process will produce a 3D map and 3D walk-space for user navigation (navigation

object tools) using hierarchy of the symbolic (name) location instead of coordinate

location.

Spatial-view navigation, which navigates in the 3D walk-space and animates the

object to get an equivalent view between the 3D walk-space and the real campus

environment (interface between navigation objects and 3D maps).

Page 71: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Co-processing Interactive Architecture

Page 72: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Bi-A* Pathfinding Algorithm

Bi-A* pathfinding algorithm is an extension of Dijkstra/Prim algorithm and Best-First-Search algorithm for VISUN-3D environment. This algorithm can be used for routing 3D requirements in a 3D software development for visualization and navigation purposes.

The complexity of this algorithm in navigate two users is | h(x) − h * (x) | = O((log h * (x))/2) (note:

x=current of user location

h*=optimal heuristic, the exact time/distance to get from current user location (x) to the target)

Page 73: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Bi-A* Pathfinding Algorithm

To implement the algorithm the 3D model at the top layer should be removed and take square grids at the bottom layer (at this stage)

Page 74: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Bi-A* Pathfinding Algorithm

Page 75: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Mapping the Jungle

Page 76: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Zone Orientation • The 3D model is designed for zone A to zone D of IIUM Gombak campus, which is within

the administrative and academic area of the IIUM Gombak campus.

Page 77: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Sample Scenario

3D walk-space transitions, user ‘blue’ (left) will meet user ‘green’ (right) from different angle

Page 78: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Sample Scenario

The distance of user “blue” (left) and user “green” (right) is getting closer and they can estimate based on time and distance between them.

Page 79: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Sample Scenario

User ‘blue’ in a meeting with user ‘green’

Page 80: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Sample Scenario

3D walk-space with 3D map inside, in three different PDAs

Page 81: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Summary of VisUN-3D

• Improved the mobile user spatial knowledge of the environment.

• Enables users to view their locations of services and real places in an intuitive and user-friendly way.

• To be used for predicting and determining purpose based on time and distance between mobile device users and a certain landmark/object.

Page 82: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

“Cool” internet appliances

World’s smallest web server

http://www-ccs.cs.umass.edu/~shri/iPic.html

IP picture frame

http://www.ceiva.com/

Web-enabled toaster +

weather forecaster

Internet phones

Page 83: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Examples of Environment Response

iSpeechNews: a Real Time Speech News Service for UbiComp Environment

iSpeechNews Hybrid Protocol Stack: deliver a real time news in the form of Speech and lips graphic animation

International Exposition of Research and Inventions of Institutions of Higher Learning (PECIPTA 2009), Kuala Lumpur Convention Centre, 8-10 Oct 2009)

Page 84: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

The reality of internet of things (IoT) is just around the corner. If you want to be part of it then be ready to explore and contribute to it through the expertise that you have.

Page 85: PowerPoint Presentation2014.icoict.org › wp-content › uploads › 2013 › 01 › IoT-icoICT-tm26-0… · EA099 U4011906 Joe’s Mobile phone Proximate Sensor Data and the Interpretations

Thakn yuo for yrou atteniton…

[email protected]