characteristic point maps
DESCRIPTION
Characteristic Point Maps. Hongzhi Wu Julie Dorsey Holly Rushmeier (presented by Patrick Paczkowski) Computer Graphics Lab Yale University. Outline. Introduction Previous Work Characteristic Point Maps Derivation Preprocessing Usage Results Conclusions Future Work. Motivation. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/1.jpg)
Characteristic Point Maps
Hongzhi Wu Julie Dorsey Holly Rushmeier(presented by Patrick Paczkowski)
Computer Graphics LabYale University
![Page 2: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/2.jpg)
Outline• Introduction• Previous Work• Characteristic Point Maps– Derivation– Preprocessing– Usage
• Results• Conclusions• Future Work
![Page 3: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/3.jpg)
Motivation
• Challenging to Render– Highly complex geometry + materials– High sampling rate to avoid aliasing– Viewed at multiple scales
![Page 4: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/4.jpg)
Introduction
• We present Characteristic Point Maps (CPMs)– A hierarchy of points on the original model• Preserves appearance (i.e. 6D filtered SV-BRDF) at
multiple scales
– Precomputed object-space adaptive sampling
![Page 5: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/5.jpg)
Introduction
……
Mesh Hierarchy
Preprocess
Original Model
+Characteristic Point Maps
…… level 0 level 1 level n
original model simplified meshes
RenderOutputImage
![Page 6: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/6.jpg)
Previous Work
• Texture Mipmap [Wil83]– Pre-filtering textures
• Mesh Simplification [GH98, LT00, SSGH01]– Minimizing texture-mapping distortion
• Appearance-Preserving Mesh Simplification [COM98]– Missing small-scale shadowing and masking effects– For textures, not general BRDFs
• BTF LOD representation [MCT*05]– Dense sampling of 6D BTF for high-frequency effects
![Page 7: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/7.jpg)
Previous Work
Arbitrary BRDF Arbitrary Geometry
Shadowing and Masking Effects
Small footprint
Reflectance Filtering [TLQ*08]
X X O √
Normal Map Filtering
[HSRG07]
X X X √
BTF [DvGNK99] √ √ √ X
Ours [WDR09] √ √ √ √
![Page 8: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/8.jpg)
Derivations• Reflected radiance at x
incident radiance
visibility term
BRDF
cosine termreflected radiance
Li(x, ωi)
dL(x, ωo)
x
ωi
ωo
![Page 9: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/9.jpg)
• Average reflected radiance
AAvis
ωiωoa
vis
![Page 10: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/10.jpg)
Derivations
• After a sequence of transformations,
where
apparent reflectance function
![Page 11: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/11.jpg)
Derivations
• Average reflectance function
– 6D function– Brute-force precomputation is impossible!• No analytical model => huge storage
– E.g. 642 for A, 6x642 for both ωi and ωo
– 642x(6x642)x(6x642) = 2473 Billion!
• Difficult to compress numerically
![Page 12: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/12.jpg)
Derivations
Discretize integration into summation
![Page 13: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/13.jpg)
Derivations
• Visible Projected Area Term– a 2D spherical function– Precompute on GPU and compress using Haar
wavelets
Visible projected area term
![Page 14: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/14.jpg)
Derivations
Summation term
• Summation Term– Want to reduce the number of items
(i.e. find the characteristic points)– Use Randomized Matrix Column Sampling
![Page 15: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/15.jpg)
Illustration
……
x1 x2 …...
ωi1,ωo1
ωi2,ωo2
ωid,ωod
![Page 16: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/16.jpg)
Illustration
……
x1 x2 …...
x1
ωi1,ωo1
ωi2,ωo2
ωid,ωod
x2 …...
…
![Page 17: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/17.jpg)
…
Illustration
………
x1 x2 …...
x1
ωi1,ωo1
ωi2,ωo2
ωid,ωod
x2 …...
…
…
![Page 18: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/18.jpg)
Illustration
……
×
×
×
+
+
x1 x2 …...
x1 x2 …...ωi1,ωo1
ωi2,ωo2
ωid,ωod
α1 α2 α3
α1
α2
α3
…
![Page 19: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/19.jpg)
Randomized Matrix Column Sampling
• Use [DMM06] to sample columns (i.e. to find characteristic points)1. Compute a prob. distribution for choosing a
column from the matrix2. Randomly select m columns according to the
prob. distribution3. Compute the weights for these m columns
![Page 20: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/20.jpg)
Randomized Matrix Column Sampling
– Measure error as L2 norm– Iterate to “boost” the probability of getting the
optimal result– Exploit spatial coherence in apparent reflectance
functions• Determine the number of CPs as the minimum number
to achieve certain approximation quality– High spatial coherence => small number of CPs– Low spatial coherence => large number of CPs
![Page 21: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/21.jpg)
Preprocessing
• Build a mesh hierarchy– Simplify geometry using existing techniques
[GH97]– Establish a mapping from each simplified mesh to
CPM u-v space
Preprocess
……
Mesh Hierarchyoriginal model simplified meshes
Original Model
![Page 22: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/22.jpg)
Preprocessing
• Build a CPM hierarchy– For each texel in CPM, we store• References to characteristic points• Corresponding weights• Wavelet coefficients for avis
– Bottom-up construction
×
×
×
+
+
α1
α2
α3
Preprocess
Original Model
+……
Mesh Hierarchyoriginal model simplified meshes
Characteristic Point Maps
…… level 0 level 1 level n
![Page 23: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/23.jpg)
Using CPMs
• Select a simplified mesh• Select CPM mip level• Look up a particular texel• Evaluate at characteristic
points ONLY!
![Page 24: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/24.jpg)
Results: Cylinder
Multi-sampled Normal Map Ground Truth CPMs Equal-time Budget
ωi
ωo
![Page 25: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/25.jpg)
Results: Bolts
Multi-sampled Normal Map Ground Truth CPMs Equal-time Budget
![Page 26: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/26.jpg)
Results: Wall
Multi-sampled Normal Map Ground Truth CPMs Equal-time Budget
![Page 27: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/27.jpg)
Results: Gargoyles
Close-up view Ground Truth CPMs Equal-time Budget
![Page 28: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/28.jpg)
Results
• Precomputed object-space adaptive sampling– CP density adapts to the complexity of filtered SV-
BRDFs
46
0
![Page 29: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/29.jpg)
Conclusions
• A general framework for efficiently computing and representing 6D spatially-varying average reflectance functions– No assumptions on geometry or BRDFs– Accelerates rendering
• A precomputed object-space adaptive sampling method
![Page 30: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/30.jpg)
Future Work
• Apply a low-pass filter• Incorporate indirect illumination• Apply to deformable objects
![Page 31: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/31.jpg)
Acknowledgements
• National Science Foundation Grant #0528204• Yale Graphics Group• Sumanta Pattanaik (UCF)• Li-Yi Wei (Microsoft)• Ping Tan (NUS)
![Page 33: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/33.jpg)
Back-up slides
![Page 34: Characteristic Point Maps](https://reader035.vdocument.in/reader035/viewer/2022081513/568157f0550346895dc568da/html5/thumbnails/34.jpg)
Back-up slidesGround Truth
Characteristic Point Maps
Multi-sampled Normal Map
ωi
ωo
(a) (b) (c)
(d) (e) (f)