one click search
TRANSCRIPT
![Page 1: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/1.jpg)
IntentSearch: Capturing User Intention forOne-Click Internet Image Search
Presented by
Nayana.K.Raj0941943PAACET
26-07-2012
![Page 2: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/2.jpg)
INTRODUCTION
•Search engine which helps to interpret users’ search intention by using ONE-CLICK query image
•Uses 4 steps for image searching
•Text based information of query word and visual content of query image to expand the image pool
![Page 3: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/3.jpg)
EXPLANATION User search intention only by query
keywords is difficult because text based image search suffers from..
•Ambiguity of query keywords
•User doesn't have enough knowledge
•Hard for users to describe the visual content of target images
•Easier search by using both textual and visual content of query
![Page 4: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/4.jpg)
•Web-scale image search engines mostly rely on surrounding text features.
•Users’ search intention by only by query keywords
PROPOSED SYSTEM• Image search on the basis of both
textual and visual content of images
•Image pool is re-ranked based on textual and visual features
EXISTING SYSTEM
![Page 5: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/5.jpg)
Fig. 1: Top-ranked images returned from ‘Bing’ using
“apple” as query
![Page 6: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/6.jpg)
Key contribution is to capture the users’ search intention from this one-click query image in four steps.
•Adaptive similarity
•Keyword expansion
•Visual query expansion
•Image pool expansion
![Page 7: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/7.jpg)
SEARCH TECHNIQUES
The user first submits query keywords q. A pool of image is retrieved by text-based search User is asked to select the query image from image pool The query image is classified as one of the predefined adaptive weight categories Images in the pool are re-ranked based on their visual similarities to the query imageSimilarities are computed using the weight schema
![Page 8: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/8.jpg)
Visual feature design
Existing features : Gist , SIFT, Daubechies Wavelet , Histogram of Gradient (HoG)
New features : Attention guided Color Signature, Color spatialet (CSpa) , Multilayer Rotation Invarient ( EOH), Facial Feauter
![Page 9: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/9.jpg)
Adaptive Weight Schema
•Weight schema is used for similarity calculations
•Lets take image i and j… Adaptive similarity between i & j
Sq(i , j) = ∑fm=1
αmq sm(i,j)
where sm(i,j) similarity between I and j on feature mf is the visual featureαm
q is the express the importance of feature m for measuring similarity
![Page 10: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/10.jpg)
existence of faces, the number of faces in the image
percentage of the image frame taken up by the face region
coordinate of face center relative to the centre of image
Directionality
Color Spatial Homogeneousness (variance of values in different blocks of Color Spatialet)
Total energy of edge map obtained from Canny Operator
Edge Spatial Distribution
Features for query categorization
![Page 11: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/11.jpg)
•Image is divided into clusters•Each word wi has ti clusters
C(wi)= { ci,1 ,.............,ci,ti }
•Visual distance between the query image and a cluster c is calculated as the mean of the distances between the query image and the images in c.
•The cluster Ci,j with the minimal distance is chosen as visual query expansion and its corresponding word wi .
q = wi + q’
Image Clustering
![Page 12: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/12.jpg)
![Page 13: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/13.jpg)
![Page 14: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/14.jpg)
![Page 15: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/15.jpg)
![Page 16: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/16.jpg)
• duplicate images
• User friendly
• Easy search for a particular image(on the internet)
• Can find the image is real or not
DISADVANTAGES
ADVANTAGES
![Page 17: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/17.jpg)
FUTURE ENHANCEMENT
•query log data, which provides valuable co-occurrence information of keywords , for keyword expansion
•Can be improved by including duplicate detection in the future work
![Page 18: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/18.jpg)
CONCLUSION
•Internet image search approach which only requires one-click user feedback
•Intention specific weight schema
•Without additional human feedback
•Possible for industrial scale image search by both text and visual content
![Page 19: One Click Search](https://reader033.vdocument.in/reader033/viewer/2022061108/544cd4cfb1af9f3a0b8b4b9e/html5/thumbnails/19.jpg)
REFERENCES
•J. Cui, F. Wen, and X. Tang, “Real Time Google and LiveImage Search Re-Ranking,” Proc. 16th ACM Int’l Conf. Multimedia, 2008.
• J. Cui, F. Wen, and X. Tang, “IntentSearch: Interactive On-Line Image Search Re-Ranking,” Proc. 16th ACM Int’l Conf. Multimedia,2008.
• “Bing Image Search,” http://www.bing.com/images
•http://www.google.com/imagesearch