text detection and reading of product label for blind persons

13
(Affiliated to Rashtrasant Tukadoji Maharaj Nagpur University) 2015-2016 Presented By Mr. Vivek R. Chamorshikar Guided By Prof. Saiyad Sharik Kaji P.G. DEPARTMENT OF COMPUTER SCIENCE & ENGG. WAINGANGA COLLEGE OF ENGINEERING AND MANAGEMENT NAGPUR.

Upload: vivek-chamorshikar

Post on 24-Jan-2017

976 views

Category:

Engineering


4 download

TRANSCRIPT

Page 1: text detection and reading of product label for blind persons

(Affiliated to Rashtrasant Tukadoji Maharaj Nagpur University) 2015-2016

Presented By

Mr. Vivek R. Chamorshikar

Guided ByProf. Saiyad Sharik Kaji

P.G. DEPARTMENT OF COMPUTER SCIENCE & ENGG.

WAINGANGA COLLEGE OF ENGINEERING AND MANAGEMENTNAGPUR.

Page 2: text detection and reading of product label for blind persons

SEMINAR ON

“AN APPROACH FOR TEXT DETECTION AND READING OF PRODUCT LABEL FOR BLIND

PERSONS”

Date: 18 / 10 /2015 Seminar Phase: I Seminar No: 1

Page 3: text detection and reading of product label for blind persons

Contents Introduction Literature Review Problem Statement System Architecture Possible Contribution Time Schedule Conclusion References

 

Page 4: text detection and reading of product label for blind persons

Introduction 314 million visually impaired people worldwide, 45

million are blind.

Camera-based assistive text reading framework to help blind person read text labels

An efficient and effective motion based method to define a region of interest (ROI) in the video

Extracted output component is use to inform the blind user of recognized text codes in the form of speech or audio

Page 5: text detection and reading of product label for blind persons

Literature Review

No Year of Publication

Title of the paper

Author’s name

Study

1 2014 Portable Camera-Based Assistive Text and Product Label Reading From Hand-Held Objects for Blind Persons

Chucai Yi, Yingli Tian and Aries Arditi

This is the main paper of this research, this paper totally focus recent developments in computer vision, digital cameras, and portable computers make it feasible to assist these individuals by developing camera-based products that combine computer vision technology with other existing commercial products such optical character recognition (OCR) systems.

02 2014 Information and Assisted Navigation System for Blind People

Karen Duarte, Jos´e Cec´ılio, Jorge S´a Silva, Pedro Furtado

The system presented in this paper aims to highlight the user’s device integrating it with devices and technologies already used by users, as their own smartphone.

Page 6: text detection and reading of product label for blind persons

No. Year of Publication

Title of the paper

Author’s name Study

03 2009 An algorithm enabling blind users to find and read barcodes

Ender Tekin and James M. Coughlan

In this paper, the ability of people who are blind or have significant visual impairments to read printed labels and product packages will enhance independent living and foster economic and social self-sufficiency.

04 2007 Text Extraction and Document Image SegmentationUsing Matched Wavelets and MRF Model

Sunil Kumar, Rajat Gupta, Nitin Khanna, Santanu Chaudhury and Shiv Dutt Joshi

This paper proposes scheme for the extraction of textual areas of an image using globally matched wavelet filters. A clustering-based technique has been devised for estimating globally matched wavelet filters using a collection of ground truth images and text extraction scheme

05 2003 Texture-Based Approach for Text Detection inImages Using Support Vector Machines andContinuously Adaptive Mean Shift Algorithm

Kwang In Kim, Keechul Jung, and Jin Hyung Kim

This paper show texture-based method for detecting texts in images. A support vector machine (SVM) is used to analyze the textural properties of texts.No external texture feature extraction module is used.

Page 7: text detection and reading of product label for blind persons

Problem Statement Position the object of interest within the center

of the camera’s view.

Camera with sufficiently wide angle.

To obtain a region of interest (ROI) of the object with proper text recognition

Page 8: text detection and reading of product label for blind persons

System Architecture

Page 9: text detection and reading of product label for blind persons

Possible ContributionTo make sure the hand-held object appears in the

camera view.

Obtain a region of interest (ROI) of the object

Motion based algorithm to solve the aiming problem for blind users

Automatic text localization to extract text regions from complex background and multiple text patterns

Page 10: text detection and reading of product label for blind persons

Time ScheduleWork to be done /month Jul’

15

Aug’1

5

Sep’15 Oct 15 Nov’15 Dec’15 Jan’ 16 Feb’

16

Mar’

16

Apr’

16

May’

16

June’

16

Studying and analyzing different Data

Stream algorithms and technique.

Studying of literatures regarding Project

Designing of algorithm for the

dynamicity of privacy system

Start implementing Project Phase

I

Phase II

Phase III

Phase IV

Testing

Thesis Preparation

Page 11: text detection and reading of product label for blind persons

Conclusion This paper has introduced to read printed

text on hand-held objects for assisting blind persons. In order to solve the common aiming problem for blind users, a motion-based method to detect the object of interest is projected, while the blind user simply shakes the object for a couple of seconds. This method can effectively distinguish the object of interest from background or other objects in the camera view.

Page 12: text detection and reading of product label for blind persons

References[1] Chucai Yi, Yingli Tian and Aries Arditi ,”Portable Camera-Based Assistive Text and Product Label Reading From Hand-Held Objects for Blind Persons”, IEEE/ASME TRANSACTIONS ON MECHATRONICS, VOL. 19, NO. 3, JUNE 2014[2] Karen Duarte, Jos´e Cec´ýlio, Jorge S´a Silva, Pedro Furtado “Information and Assisted Navigation System for Blind People”, Proceedings of the 8th International Conference on Sensing Technology, Sep. 2-4, 2014, Liverpool, UK[3] Sunil Kumar, Rajat Gupta, Nitin Khanna, Santanu Chaudhury and Shiv Dutt Joshi “Text Extraction and Document Image Segmentation Using Matched Wavelets and MRF Model”, IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 16, NO. 8, AUGUST 2007[4] Kwang In Kim, Keechul Jung, and Jin Hyung Kim “Texture-Based Approach for Text Detection in Images Using Support Vector Machines and Continuously Adaptive Mean Shift Algorithm”, IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 25, NO. 12, DECEMBER 2003[5] Advance Data Reports from the National Health Interview Survey (2008).[Online]. Available: http://www.cdc.gov/nchs/nhis/nhis_ad.htm. [6] B. Epshtein, E. Ofek, and Y. Wexler, “Detecting text in natural scenes with stroke width transform,” in Proc. Comput. Vision Pattern Recognition, 2010, pp. 2963–2970.

Page 13: text detection and reading of product label for blind persons

THANKING YOU!