naiboli

1

NaiBoli is shared under common creative license.

http://architecture-soa-bpm-eai.blogspot.com

Comprehensive gesture language – NaiBoli v 0.1

While conceptualizing a mobile app, I realized there is not a single comprehensive notation for

gesture modeling. There are few attempts which seem to be incomplete. So as usual, I have to

develop my own solution.

Before diving further, I like to call gesture language a name - NaiBoli.

Nai – नई (New)

Boli – बोल� (Dialect)

While designing NaiBoli following factors were of prime concern:

1. Should be independent of device, platform, form factor, programming language, and

natural language.

2. Should be easy to learn and use (manually as well as tool)

3. Gesture recognition is in its infancy and evolving at very fast pace, so new language

must be evolvable.

This is the first interation of NaiBoli and certainly not complete and very accurate. NaiBoli is a

work in the progress.

Enough fluff. Let start the real stuff.

NaiBoli divides notations/symbols into following types

• Aadhar (आधार - Base) elements

• Tulika (त�ूलका - Brush) elements

• Chaal (चाल - Action) elements

• Rupantran (�पांतरण - Transformation) elements

• Parinami (प�रणामी - Resultant) elements

Aadhar elements denote something on which action will take place. In future, more elements

are expected like 3 dimensional spaces to cater Microsoft Kinect or Oura, occult, wrist

band/watch, ring, glasses like google glass, etc.

Single screen Device

(Double boundary

bounded area in

shape of device

screen)

3 Dimensional Space

(Do not forget

Microsoft Kinect,

LeapMotion, and

other gaming devices)

Wrist Wearable Glasses (google glass)

2



devices

Ring (smarty ring, ring

with three dots – I am

not able to recall its

name)

Tulika elements denotes thing which makes gesture. It can be finger, stylus, eye, or any other

body part or equipment.

Pointer Tap Pointer Hold

Right palm with

fingers Left palm with fingers

Right eye

Left eye

Right eye with lid

Left eye with lid

Right eye with

eyebrow Left eye with eyebrow

Right eye with lid &

eyebrow

Left eye with lid &

eyebrow

Staring right eye Staring left eye

Staring right eye with

lid

Staring left eye with

lid


eyebrow Staring left eye with

eyebrow


lid & eyebrow Staring left eye with

lid & eyebrow Closed right eye

Closed left eye

Lips (closed mouth) Open Mouth with no

teeth showing

Open mouth with

teeth showing (Teeth) Tongue

Body

Body with fingers

Glasses (on right eye)

Glasses (on left eye)

Head

Fist

3



Chaal elements denote action.

Movement in a

direction (swipe using

finger/s, palm, and

stylus) (At par with

Tulika elements)

Movement with

pressure in a

direction (drag in case

of finger, palm, and

stylus) (At par with

Tulika elements)

Movement in

opposing direction -

outward(Pinch out

using fingers)

Movement in

opposing direction -

inward (Pinch in using

fingers)

Rupantran elements apply transformation on Tulika elements and add context to it. Rupantran

elements also represent actions like drag or swipe.

There are following classes of Rupantran elements.

• Class 1: Applied to a Tulika element only at a given point of time. These elements may

attach with a Tulika element as sub script.

• Class 2: Applied to multiple Tulika elements. These elements glue two Tulika elements.

• Class 3: Applied to a Chaal element at a given point of time. These elements transform

Chaal elements.

• Class 4: Applied to Aadhar elements. These elements to be shown out of boundary of

device.

• Class 5: Applied to Tulika as well as Chaal elements.

Rupantran Class 1 elements

No or Not (sub script

to a Tulika element) !

Physical touch (sub

script to a Tulika

element)

Nothing or t

Finger (sub script to a

Tulika element) F Stylus (sub script to a

Tulika element) S

Palm (sub script to a

Tulika element) P


sequential gesture

separator (At par with

Tulika elements)

, Split separator(At par

with Tulika elements) /

4



To (e.g. move from

point A to B in 2 to 3

seconds) (At par with

Tulika elements)

-


Fast (sub script to a

Chaal element) f Slow (sub script to a

Chaal element) s


Device Tilt

or

Device Shake

Device movement in a

particular fashion

(e.g. move device in

shape of 8 to calibrate

its compass)

Device Hold during tilt

motion H


number of times

(numeral) (At par with

a Tulika element or

sub script to a Chaal

element)

2 Time (seconds) (At

par with a Tulika

element or sub script

to a Chaal element)

sec min

Logical OR (At par

with or sub script to

Tulika elements) –

e.g.: Go to store and

bring milk or juice.

To (e.g. move from

point A to B in 2 to 3

seconds) (At par with

Tulika elements)

-

Parinami elements are resultant of application of Rupantran elements on Aadhar, Tulika or

Chaal elements. Let’s explore some of the examples of Parinami elements

Action Symbol Remarks

Tap and then tap again

using finger ,

Double Tap using finger

5



Double Tap using stylus

3 finger swipe

Tap using one finger, hold

for 2 sec and then drag

Tap using two finger, hold

for 2 sec and then drag

Tap using stylus, hold for

2 sec and then drag

Tap and hold, then drag

and then tap elsewhere

using fingers

Tap and then slow swipe

using stylus

Tap and then swipe for 1

second using stylus

Tap and then swipe for 1

second using stylus

Tap in air using figure and

then swipe Do not forget Samsung Galaxy S4

wink right eye 2 to 3 times

Blink both eyes 2 times

Close both eyes with force

Protruded Lips

Smiling lips

Bilking eyes

Winking right eye

Shaking head in YES

motion

Shaking head in NO

motion

Moving head in circular

fashion ( clockwise)

Moving tongue up and

down

Tilting rectangular device

(think of phone) between

10 to 30 degree and

holding there

6



Tilting rectangular device

(think of phone) between

10 to 30 degree then

holding there for 2 to 5

second and bringing back

to original position

naiboli

Business