Gesture Recognition.A gesture is a form of non-verbal communication in which visible bodily actions communicate particular messages.

Gestures include movement of the hands, face, or other parts of the body.

What is Gesture Recognition

Interface with computers using gestures of the human body, typically hand movements.

(Gesture recognition is an important skill for robots that work closely with humans.)

Applications

Classification

System Overview

Feature Extraction

Pre-processing

Image Acquisition

Determines hand position in image using skin colour-(GMM).Convert the image into grey-scale

Pre-processing consist of two steps Segmentation Filtering filtering techniques are applied on images in pre-processing phase

Feature extractionCanny edge detector is used to detect the border of hand image.

Match with the databaseThe database consist of 25 hand gesture of International sign language.

Image Capture

Segmentation and filtering

Edge detection and isolate the image

gesture recognition

Basic hand gestures of American sign language

ResultNumber of gesture per class = 20Total class = 25Total number of gesture = 20*25 = 500Correctly classified gesture = 493

Accuracy = (𝑐𝑜𝑟𝑟𝑒𝑐𝑡𝑙𝑦 𝑐𝑙𝑎𝑠𝑠𝑖𝑓𝑖𝑒𝑑 𝑔𝑒𝑠𝑡𝑢𝑟𝑒

𝑡𝑜𝑡𝑎𝑙 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑔𝑒𝑠𝑡𝑢𝑟𝑒)*100%

= (493/500)100%= 98.6%

Future

Challenges

There are limitations on the equipment used

Images may not be under consistent lighting

Variety of implementations

Background noise

Distance from the camera, and the camera's resolution and quality

Accuracy = (𝒄𝒐𝒓𝒓𝒆𝒄𝒕𝒍𝒚 𝒄𝒍𝒂𝒔𝒔𝒊𝒇𝒊𝒆𝒅 𝒈𝒆𝒔𝒕𝒖𝒓𝒆

𝒕𝒐𝒕𝒂𝒍 𝒏𝒖𝒎𝒃𝒆𝒓 𝒐𝒇 𝒈𝒆𝒔𝒕𝒖𝒓𝒆)*100%

= (493/500)100%= 98.6%

References

J. Triesch and C. von der Malsburg. ―A System for Person-Independent Hand Posture Recognition against Complex Background IEEE, 2001 Transactions on Pattern Analysis and Machine Intelligence, Vol.23, Nº. 12, December 2001.

E. Sanchez-Nielsen, L. Antón-Canalis, M. Hernandez-Tejera, ―Hand gesture recognition for human machine interaction‖, Journal of WSCG, Vol.12, No.1-3 (February 2003).

L. Bretzner, I. Laptev, and T. Lindberg, "Hand Gesture Recognition using Multi-Scale Color Features, Hierarchical Models and Particle Filtering", IEEE International Conf. on Automatic Face and Gesture Recognition, 2002.