skinput
TRANSCRIPT
![Page 1: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/1.jpg)
04/12/23SKINPUT 1
Nikitha VidyadharNO : 32
![Page 2: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/2.jpg)
04/12/23SKINPUT 2
Can You Ever Can You Ever Imagine Imagine
Human Body Human Body As AAs A
TOUCH TOUCH SCREEN?????SCREEN?????
![Page 3: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/3.jpg)
04/12/23SKINPUT 3
YEAH !!!YEAH !!!
THERE IS A SOLUTIONTHERE IS A SOLUTION AND AND
THAT IS THAT IS
SKINPUTSKINPUT
![Page 4: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/4.jpg)
STRUCTURE OF PRESENTATIONSTRUCTURE OF PRESENTATION
04/12/23SKINPUT 4
Motivation
Overview Principle of Skinput
Mechanism and Processing model
Experiment
Advantages And Disadvantages
Skinput in future
Conclusion
![Page 5: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/5.jpg)
MOTIVATIONMOTIVATION
Touch screens are familiar nowadays.Certain drawbacks of them are : Limited interaction space
Less accurate interactions
Cannot make buttons and screens larger without losing the primary benefits of small size
04/12/23SKINPUT 5
![Page 6: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/6.jpg)
OVERVIEWOVERVIEWGiving input through skin.
Skinput turns human body into touch screen input surface.
Developed by Chris Harrison, Desney Tan, and
Dan Morris of the Microsoft Research's
Computational User Experiences Group. Its first public appearance was at Microsoft's
Tech Fest 2010
04/12/23SKINPUT 6
![Page 7: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/7.jpg)
WHAT SKINPUT DOESWHAT SKINPUT DOES??Primary functions areControl audio devices.Make phone calls.Navigate browsing systems.Play games.
Uses series of sensors to determine where user tapped on skin
04/12/23SKINPUT 7
![Page 8: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/8.jpg)
PRINCIPLE OF SKINPUTPRINCIPLE OF SKINPUT
It listens to vibrations in your body.
Skinput also responds to the various hand gestures.
The arm is an instrument
04/12/23SKINPUT 8
![Page 9: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/9.jpg)
WHAT MAKES IT WORKWHAT MAKES IT WORK??
04/12/23SKINPUT 9
![Page 10: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/10.jpg)
PICO PROJECTORPICO PROJECTOR
It is also known as pocket projector or mobile projector. Displays Menu. The system comprises three main parts:
The Laser light source The Combiner optics The Scanning mirror
04/12/23SKINPUT 10
![Page 11: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/11.jpg)
BIO ACOUSTICSBIO ACOUSTICS
Study of sound waves inside living body.
When a finger taps the skin, several distinct forms of acoustic energy are produced.
Longitudinal WavesTransverse Waves
04/12/23SKINPUT 11
![Page 12: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/12.jpg)
TRANSVERSE WAVESTRANSVERSE WAVESCreated by the displacement of the skin
from a finger impact.
They are visible when we slow down it 14 times.
Tapping on soft regions of the arm create higher amplitude transverse wave than tapping on boney areas.
Sensors activated as wave passes under it. 04/12/23SKINPUT 12
![Page 13: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/13.jpg)
LONGITUDINAL WAVESLONGITUDINAL WAVESSome of the energy is transmitted inwards
towards the Skelton.
Causes internal skeletal structure to vibrate.
These waves travel through the soft tissues of the arms, exciting the bone .
It responds to mechanical excitation by rotating rigid body.
04/12/23SKINPUT 13
![Page 14: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/14.jpg)
BIO ACOUSTICS : BIO ACOUSTICS : SENSINGSENSING
Each body part creates different type of vibrations
depending on:BonesMusclesTendons
These signal need to be sensed and worked upon.
This is done by wearing wave sensor armbands.
Sensing elements detect vibrations transmitted through the body.
04/12/23SKINPUT 14
![Page 15: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/15.jpg)
ARMBANDARMBAND
04/12/23SKINPUT 15
INSIDE VIEWINSIDE VIEW
OUTSIDE VIEW
OUTSIDE VIEW
![Page 16: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/16.jpg)
ARMBAND ARMBAND MECHANISMMECHANISM
Detect vibrations transmitted through the body.
Arm band device consists of two components: 1. Projector 2. Detector
Armbands are placed in 2 ways.Above the elbow Below the elbow
04/12/23SKINPUT 16
![Page 17: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/17.jpg)
ARMBAND PROTYPEARMBAND PROTYPE
04/12/23SKINPUT 17
Two arrays of 5 sensing elements incorporated into an armband.
2 Sensor packages focus on the arm of armband
One package was located near the Radius other near the Ulna.
![Page 18: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/18.jpg)
BLUETOOTHBLUETOOTH
04/12/23SKINPUT 18
Armband is connected to Mobile Device or Computer via Bluetooth
![Page 19: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/19.jpg)
MECHANISMMECHANISM
Arm band detects the acoustic signals and convert them to electronic signals which
easily enable the users to perform simple tasks as
browsing through a mobile phone menu,
making calls, controlling portable music players etc.
04/12/23SKINPUT 19
![Page 20: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/20.jpg)
PROCESSINGPROCESSING MODELMODEL
04/12/23SKINPUT 20
Projector display image
on arm
Vibrations are captured from
sensors
This is connected to Mobile Device via Bluetooth.
A software to match sound
frequencies to specific skin location is
used.
Corresponding action is
implemented in device
Finger taps on arm
![Page 21: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/21.jpg)
PROCESSING(PROCESSING(detaileddetailed))
04/12/23SKINPUT21
Employ a Mackie Onyx 1200F audio interface to
digitally capture data from ten sensors.
Connected via Fire Wire to a conventional
computer
Each channel was sampled at 5.5
KHZ(55KHZ total)by
ATmega168 processor
Data was sent to our primary application
written in JAVA
![Page 22: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/22.jpg)
04/12/23SKINPUT 22
This program perform three key functions:-
Provides a live visualization of the data
It segments inputs from the data stream into independent instances(taps).
Classified these input instances
The audio stream was segmented into individual taps using an absolute exponential average of all 10 channels
![Page 23: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/23.jpg)
SEGMENTATIONSEGMENTATION
04/12/23SKINPUT 23
![Page 24: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/24.jpg)
04/12/23SKINPUT 24
After the input has been segmented ,the wave forms are analyzed.
Employing a brute force learning approach computing 186 features in total( includes combinationarily).
186 features includes
Average amplitude, SD and total energy of the waveforms in each channel(30 features).
Average amplitude ratios b/w channel pairs(45 features).
Average of these ratios(1 feature). 256 point FFT for all 10 channels (take only lower 10
values ie (100 features). a rough estimation of the fundamental frequency of the
signal displacing each sensor (10 features).
![Page 25: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/25.jpg)
04/12/23SKINPUT 25
BRUTE FORCE LEARNING approach computes 186
features in total.
Support Vector Machine
Classify Input instances using Weka Machine Learning Tool
Kit.
Event associated with location is instantiated.
Interactive feature bounded to that event fired.
![Page 26: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/26.jpg)
EXPERIMENTEXPERIMENT
04/12/23SKINPUT 26
Participants 13 ->7 female, 6 male. Ages ranged from 20 to 56. Body mass indexes (BMIs) ranged
from 20.5 (normal) to 31.9 (obese).
Three input groupings from the multitude of possible location combinations to test .
From these groupings,5 experimental conditions was derived.
![Page 27: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/27.jpg)
LOCATIONSLOCATIONS
04/12/23SKINPUT 27
![Page 28: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/28.jpg)
TRAINING AND CLASSIFICATIONTRAINING AND CLASSIFICATION
04/12/23SKINPUT 28
![Page 29: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/29.jpg)
RESULTSRESULTSFIVE FINGERSFIVE FINGERS
04/12/23SKINPUT 29
Accuracy remained high for five finger
condition averaging 87.7%
When classification was incorrect, the system believed the input to be an adjacent finger 60.5% of the time.
Ring finger constituted 63.3% of the misclassifications.
![Page 30: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/30.jpg)
WHOLE ARMWHOLE ARM
04/12/23SKINPUT 30
Below-elbow placement performed the best posting at 95.5% accuracy.
Moving the sensor above the elbow reduced accuracy to 88.3 (7.2% drop).
The eyes free input condition yielded lower accuracies than other conditions averaging
85%(10.5% drop)
![Page 31: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/31.jpg)
FOREARMFOREARM
04/12/23SKINPUT 31
Classification accuracy for the 10 location forearm condition stood at 81.5%.
Higher accuracies can be achieved by collapsing the 10 locations into groups.
![Page 32: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/32.jpg)
BMI EFFECTSBMI EFFECTS
04/12/23SKINPUT 32
High BMI is correlated with decreased accuracies.
No direct relation with gender of the participants
![Page 33: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/33.jpg)
WALKING AND JOGGINGWALKING AND JOGGING
04/12/23SKINPUT 33
Each participant trained and tested the system while walking and jogging on a treadmill.
3 input location were used to evaluate accuracy .
In walking trials system never produced a false input.
In jogging trials the system had 4 false-positive input events over 6 min of continuous jogging.
Accuracy decreased to 83.3% and 60% for male and female participants respectively.
![Page 34: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/34.jpg)
04/12/23SKINPUT 34
![Page 35: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/35.jpg)
04/12/23SKINPUT 35
ADVANTAGESADVANTAGES No need to interact with the gadget directly.
Don’t have to worry about keypad.
People with larger fingers get trouble in navigating tiny buttons and keypads on mobile phones. With skin put this problem disappears.
The body is portable and always available, and fingers are a natural input device.
![Page 36: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/36.jpg)
DISADVANTAGESDISADVANTAGES
04/12/23SKINPUT 36
Band seems easy enough to slip on, people found difficult to wear a very big band around their arm for the day.
Not enough research has been conducted product to test the possible skin diseases get from using this product.
Very high cost which will not be affordable for the common man.
![Page 37: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/37.jpg)
SKINPUT IN FUTURESKINPUT IN FUTURE
04/12/23SKINPUT 37
A person might walk toward their home, tap their palm to unlock the door and then tap some virtual buttons on their arms to turn on the TV and start flipping through channels.
Extensive Research is going on Currently on Skinput to
make the armband more smaller.Incorporate More Devices with This System.Extend accuracy level.
![Page 38: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/38.jpg)
04/12/23SKINPUT 38
With small sized Pico-projectors ,Skinput oriented systems are emerging trend.
Research carried out for smaller wrist band watch sized sensor armband.
FUTURE IMPLICATIONS
![Page 39: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/39.jpg)
CONCLUSIONCONCLUSION
04/12/23SKINPUT 39
Skinput allows the human body as an input surface.
It describes a novel, wearable bio-acoustic sensing array that we built into an armband in order to detect and localize finger taps on the forearm and hand.
We conclude with descriptions of several prototype applications that demonstrate the rich design space we believe Skinput enables.
![Page 40: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/40.jpg)
BIBLIOGRAPHYBIBLIOGRAPHY
04/12/23SKINPUT 40
http://research.microsoft.com/enus/um/redmond/groups/cue/skinput Official Home Page of Skinput.
http://www.chi2010.org Home Page of Computer & Human Interactions Conference, April,2010.
http://www.chrisharrison.net/projects/skinput Personal Homepage of Chris Harrison.
http://research.microsoft.com/en-us/um/people/dan Homepage of Dan Morris.
SKINPUT: Appropriating the Body as an Input Surface Chris Harrison , Desney Tan , Dan Morris
![Page 41: Skinput](https://reader036.vdocument.in/reader036/viewer/2022070316/556163a4d8b42a87628b4d26/html5/thumbnails/41.jpg)
04/12/23SKINPUT 41