kshitij padalkar 13 th oct 2008. contents: in one line… need solutions and other work definition...
TRANSCRIPT
![Page 1: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/1.jpg)
Kshitij Padalkar13th Oct 2008
![Page 2: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/2.jpg)
Contents: In one Line…Need
Solutions and Other WorkDefinition and Maths
Energy , Seam Pixel Removal Criteria
Other Energy Functions?Discrete Image Resizing
Aspect Ratio Change Optimal Seam Order
Image Enlarging Content Amplification Object Removal
Multi-size ImagesLimitationsLinks
![Page 3: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/3.jpg)
In One Line…
Method for Content-Aware Image Resizing
![Page 4: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/4.jpg)
Need
![Page 5: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/5.jpg)
Different Displays-Different Resolutions-(Different Images??)
![Page 6: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/6.jpg)
HTML allows automatic layout of the text, but not the images
![Page 7: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/7.jpg)
Solutions and Other WorkCrop and ScaleSaliencySegmentation
![Page 8: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/8.jpg)
Contents: In one Line…Need
Solutions and Other WorkDefinition and Maths
Energy , Seam Pixel Removal Criteria
Other Energy Functions?Discrete Image Resizing
Aspect Ratio Change Optimal Seam Order
Image Enlarging Content Amplification Object Removal
Multi-size ImagesLimitationsLinks
![Page 9: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/9.jpg)
Definition and Maths…Goal is to remove unnoticeable pixels.Energy Function:
Remove Pixels with least energySort pixels by Energy, remove smallest pixels
(optimum)Remove Column with smallest total Energy
(column)Remove Seam with smallest total Energy (seam)
![Page 10: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/10.jpg)
SeamVertical Seam:
an 8-connected path of pixels in the image from top to bottom, containing one, and only one, pixel in each row of the image
![Page 11: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/11.jpg)
SeamEnergy of a Seam
Minimum Energy Seam
![Page 12: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/12.jpg)
Pixel Removal CriteriaOptimal
![Page 13: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/13.jpg)
Pixel Removal CriteriaPixel
![Page 14: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/14.jpg)
Pixel Removal CriteriaColumn
![Page 15: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/15.jpg)
Pixel Removal CriteriaSeam
![Page 16: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/16.jpg)
Pixel Removal CriteriaComparison
![Page 17: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/17.jpg)
Other Energy FunctionsGradientEntropyHOG (Histogram of Gradient)Saliency
![Page 18: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/18.jpg)
Contents: In one Line…Need
Solutions and Other WorkDefinition and Maths
Energy , Seam Pixel Removal Criteria
Other Energy Functions?Discrete Image Resizing
Aspect Ratio Change Optimal Seam Order
Image Enlarging Content Amplification Object Removal
Multi-size ImagesLimitationsLinks
![Page 19: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/19.jpg)
Aspect Ratio ChangeChange the image from (n X m) to (n X m’)
(assume m’ < m)Remove m-m’=c seams successively
Seam Carving
![Page 20: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/20.jpg)
Aspect Ratio ChangeChange the image from (n X m) to (n X m’)
(assume m’ < m)Remove m-m’=c seams successively
Scaling
![Page 21: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/21.jpg)
Optimal Seam OrderingChange the image from (n X m) to (n’ X m’)
(assume m’ < m and n’ < n)What to do? What is the correct order of seam
carving?Remove vertical seams first? Horizontal seams first? Or alternate between the two?
![Page 22: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/22.jpg)
Optimal Seam OrderingWe optimize
where k = r+c, r = (m−m’), c = (n−n’) and i is used as a parameter that determine if at step i we remove a horizontal or vertical seam: = {0,1}
![Page 23: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/23.jpg)
Optimal Seam OrderingTransport map
Matrix of size n X mEach element T(r,c) holds the minimal cost
needed to obtain an image of size n−r X m−c
![Page 24: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/24.jpg)
Discrete Image ResizingAspect Ratio Change
Optimal Seam OrderImage EnlargingContent AmplificationObject Removal
![Page 25: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/25.jpg)
Image Enlargingcompute the optimal vertical (horizontal) seam
‘s’ on I and duplicate the pixels of s by averaging them with their left and right neighbors (top and bottom in the horizontal case)
![Page 26: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/26.jpg)
Image EnlargingTo reduce the width by ‘k’, compute first ‘k’
vertical seams and duplicate themAll seams duplicated, 50% enlargement. For
more do it in steps.
![Page 27: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/27.jpg)
Discrete Image ResizingAspect Ratio Change
Optimal Seam OrderImage EnlargingContent AmplificationObject Removal
![Page 28: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/28.jpg)
Content AmplificationScale the image, this will scale everything,
content as well as non-content.Shrink the scaled-image by seam carving, this
will carve out the non-content part.
![Page 29: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/29.jpg)
Discrete Image ResizingAspect Ratio Change
Optimal Seam OrderImage EnlargingContent AmplificationObject Removal
![Page 30: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/30.jpg)
Object RemovalUser marks the target object to be removed. Then seams are removed from the image until
all marked pixels are gone.To regain the original size, seam insertion is
employed.
![Page 31: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/31.jpg)
Object RemovalFind the missing shoe…
![Page 32: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/32.jpg)
Object RemovalObject marking to remove unwanted results
![Page 33: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/33.jpg)
Contents: In one Line…Need
Solutions and Other WorkDefinition and Maths
Energy , Seam Pixel Removal Criteria
Other Energy Functions?Discrete Image Resizing
Aspect Ratio Change Optimal Seam Order
Image Enlarging Content Amplification Object Removal
Multi-size ImagesLimitationsLinks
![Page 34: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/34.jpg)
Multi Size ImagesMethods mentioned so far are not real-time.We calculate each seam remove it and
calculate the next seam.
For real-time, we calculate-index map V of size n×m that encodes, for
each pixel, the index of the seam that removed it, i.e., V(i, j) = t means that pixel (i, j) was removed by the t-th seam removal.
![Page 35: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/35.jpg)
Multi Size ImagesHorizontal Index map (H)Vertical Index map (V)
To get an image of width m’, we need to remove m-m’ pixels from each rowwe gather, in each row, all pixels with seam
index greater than or equal to m−m’.Same for changing the height.
Problem comes when we want to change both!
![Page 36: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/36.jpg)
Contents: In one Line…Need
Solutions and Other WorkDefinition and Maths
Energy , Seam Pixel Removal Criteria
Other Energy Functions?Discrete Image Resizing
Aspect Ratio Change Optimal Seam Order
Image Enlarging Content Amplification Object Removal
Multi-size ImagesLimitationsLinks
![Page 37: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/37.jpg)
Limitations
Too much contentNo space for seam to avoid content
![Page 38: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/38.jpg)
Paper ftp://ftp1.idc.ac.il/Arik_shamir/SCweb/imret/vidret.pdf
Youtube demohttp://www.youtube.com/watch?v=6NcIJXTlugc
Search google for Seam Carving…. Many many blogs…
![Page 39: Kshitij Padalkar 13 th Oct 2008. Contents: In one Line… Need Solutions and Other Work Definition and Maths Energy, Seam Pixel Removal Criteria Other Energy](https://reader036.vdocument.in/reader036/viewer/2022062314/56649f2a5503460f94c443ab/html5/thumbnails/39.jpg)
THANK YOU