Speak moreSpeak more with less effort with less effort

2 / 23

KTypeKType● KType Overview:KType Overview:

● What is KType?What is KType?

● Who is it for?Who is it for?

● How can you help?How can you help?

● How does KType work?How does KType work?

● ““KType for iPad” FeaturesKType for iPad” Features

3 / 23

What is KType?What is KType?● KTypeKType is a research project: is a research project:

● to to improve communicationimprove communication● for individuals with for individuals with speech & motor disabilitiesspeech & motor disabilities

● ““KType for iPadKType for iPad” app:” app:

First product developed withFirst product developed with

insights gained from theinsights gained from the

KType researKType research project.ch project.

4 / 23

Who is KType for?Who is KType for?● KType is for individuals who KType is for individuals who cannot cannot

verbally communicateverbally communicate with ease or speed. with ease or speed.

● KType is built to assist users who:KType is built to assist users who:

● cannot control or seecannot control or see keyboard/mouse/LCD keyboard/mouse/LCD

● may have may have muscle spasmsmuscle spasms, motor tics, paralysis, motor tics, paralysis

● have have trouble readingtrouble reading, writing, spelling, writing, spelling

5 / 23

Who is KType for?Who is KType for?● KType can assist individuals with:KType can assist individuals with:

● Motor Neuron Diseases such as ALSMotor Neuron Diseases such as ALS

● Cerebral PalsyCerebral Palsy

● StrokeStroke

● AutismAutism

● Neurological TraumaNeurological Trauma

● Speech Disorders: Speech Disorders: Apraxia with Aphasia, DysarthriaApraxia with Aphasia, Dysarthria

6 / 23

How can you help?How can you help?● Recommend users for case-studiesRecommend users for case-studies

● Connect me with care organizationsConnect me with care organizations

● Medical Centers (Trauma Units)Medical Centers (Trauma Units)

● Nursing Home (Senior-Care facilities)Nursing Home (Senior-Care facilities)

● Special Education SchoolsSpecial Education Schools

● Associations (ALS Assoc., ASHA etc.)Associations (ALS Assoc., ASHA etc.)

7 / 23

How does KType work?How does KType work?● ““KType for iPadKType for iPad” app:” app:

● Accepts user input via Accepts user input via touchscreentouchscreen and and

physical physical buttonsbuttons / switches / switches

● Speaks in realistic Speaks in realistic male and female voicesmale and female voices

● Guesses what the user is trying to type, Guesses what the user is trying to type,

minimizing the need to spell out each wordminimizing the need to spell out each word

8 / 23

KType: FeaturesKType: Features● Going beyond accessibility:Going beyond accessibility:

● Built for Built for unsteady handsunsteady hands

● Speak moreSpeak more with less effort with less effort

● Make Make your ownyour own keyboard keyboard

● Customizable featuresCustomizable features

9 / 23

KType: Unsteady handsKType: Unsteady hands● PROBLEMPROBLEM: Individuals with unsteady hands : Individuals with unsteady hands

find it difficult to:find it difficult to:

● NavigateNavigate touch-screen interfaces touch-screen interfaces

● Touch Touch precise locationsprecise locations on the screen on the screen

● Operate keyboard and mouse on a regular PCOperate keyboard and mouse on a regular PC

10 / 23

KType: Unsteady handsKType: Unsteady hands● SOLUTIONSOLUTION: Split the : Split the TouchTouch action into two! action into two!

1. POINT:1. POINT:– Move an on-screen Move an on-screen cursorcursor by touch by touch– Optional: Optional: StabilizeStabilize the cursor's motion automatically the cursor's motion automatically

2. CLICK:2. CLICK:

– By tapping touch-screen OR By tapping touch-screen OR wireless buttonswireless buttons operated by hand/feetoperated by hand/feet

– Optional: Prevent accidental clicks by requiring Optional: Prevent accidental clicks by requiring double double or or tripletriple taps taps

11 / 23

KType: Unsteady handsKType: Unsteady handsPOINTPOINT (like a mouse cursor) (like a mouse cursor) CLICK CLICK (any key)(any key)

12 / 23

KType: Speak moreKType: Speak more● PROBLEMPROBLEM::

Typing takes more effort than speaking.Typing takes more effort than speaking.

How do we make typing easier?How do we make typing easier?

13 / 23

KType: Speak moreKType: Speak more● SOLUTIONSOLUTION: Make typing easier by: Make typing easier by

● Reducing movementReducing movement of hands: of hands:

– Rearrange keysRearrange keys so common sequences are so common sequences are closer closer

– Enlarge commonly used keys / buttonsEnlarge commonly used keys / buttons

● AnticipatingAnticipating the user's next action: the user's next action:

– Type a few letters and KType suggests 3-7 wordsType a few letters and KType suggests 3-7 words

– Make suggestions based on the contextMake suggestions based on the context

14 / 23

KType: Speak moreKType: Speak more● FUN FACT #1FUN FACT #1::

● Over 100,000 Twitter users indirectly helped Over 100,000 Twitter users indirectly helped

create a keyboard layout that is create a keyboard layout that is better better than than

QWERTYQWERTY for users who press keys with one for users who press keys with one

finger instead of typing with 10 fingers.finger instead of typing with 10 fingers.

15 / 23

KType: Speak moreKType: Speak more● FUN FACT #2FUN FACT #2::

● Analysis of Analysis of 10 Million Tweets10 Million Tweets from Twitter from Twitter

helped create technology that can provide helped create technology that can provide

intelligent suggestions, not just spellcheck.intelligent suggestions, not just spellcheck.

● KType can instantly suggest:KType can instantly suggest:

– ““SOMEWHERE” when user types “SMW”SOMEWHERE” when user types “SMW”

– ““HUNGRY” and “HOPING” after user types “I AM HN”HUNGRY” and “HOPING” after user types “I AM HN”

– ““POTTER” and “MET” after user types “HARRY”POTTER” and “MET” after user types “HARRY”

16 / 23

KType: Your own keyboardKType: Your own keyboard● Why rearrange the keyboard layout that has Why rearrange the keyboard layout that has

been in use for over a hundred years?been in use for over a hundred years?

● Because it is Because it is not optimalnot optimal for use with 1 finger for use with 1 finger

● QWERTY layout was designed in 1870sQWERTY layout was designed in 1870s

– It was optimized for typing with It was optimized for typing with 10 fingers10 fingers

– Commonly used letter sequences were purposely Commonly used letter sequences were purposely

put in different rows to put in different rows to minimize typewrite jamsminimize typewrite jams

17 / 23

KType: Your own keyboardKType: Your own keyboard● KType comes with the “KType comes with the “OptimusOptimus” keyboard ” keyboard

layout, optimized for 1-finger use by layout, optimized for 1-finger use by

analyzing commonly typed sequences:analyzing commonly typed sequences:

● TH, TE, TITH, TE, TI● ST, SL, SIST, SL, SI● CH, CKCH, CK● QUQU

18 / 23

KType: Your own keyboardKType: Your own keyboard● KType offers these preset layouts:KType offers these preset layouts:

● OptimusOptimus by KType by KType

● ABCABC (easy to learn) (easy to learn)

● QWERTYQWERTY (computer) (computer)

● CommonCommon Words Words

19 / 23

KType: Your own keyboardKType: Your own keyboard● Fully editable:Fully editable:

● CustomizeCustomize any any

keyboard layoutkeyboard layout

● Drag & dropDrag & drop to to

resize & move keysresize & move keys

● Fix pronunciationFix pronunciation of of

non-English words non-English words

20 / 23

KType: CustomizationsKType: Customizations● KType can be tailored for KType can be tailored for each usereach user::

● Change VoiceChange Voice: gender, volume, pitch, speed : gender, volume, pitch, speed

● Configure: Configure: Input and outputInput and output device parameters device parameters

● DesignDesign: Keyboard layout and button text: Keyboard layout and button text

● SupportsSupports 10 different 10 different users on a single iPad users on a single iPad

21 / 23

KType: On the RoadmapKType: On the Roadmap● Send Send EmailEmail, Text/SMS, Tweets, Text/SMS, Tweets

● Add Add pictures & soundpictures & sound to keyboard buttons to keyboard buttons

● Automatically Automatically learnlearn users' typing patterns users' typing patterns

● ListenListen to Facebook updates, news & web to Facebook updates, news & web

articles, and incoming emailsarticles, and incoming emails

22 / 23

KType: On the RoadmapKType: On the Roadmap● POINT using:POINT using:

● JoystickJoystick

● WiiMote / Kinect3DWiiMote / Kinect3D

● Eye / Gaze TrackingEye / Gaze Tracking

● Head TrackingHead Tracking

● CLICK using:CLICK using:

● Sip/Puff SwitchSip/Puff Switch

● WiiFit PadWiiFit Pad

● iPod TouchiPod Touch

● Ribbon SwitchRibbon Switch

Thank YouThank You

Contact:Contact: Chirag MehtaChirag Mehta

chirag@ktype.netchirag@ktype.net

727-386-9382727-386-9382

@chime1998@chime1998