image-space control variates for renderingwjarosz/publications/... · gdpt-l2 cvpt-uni 0.0098...
TRANSCRIPT
![Page 1: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/1.jpg)
Image-space Control Variatesfor Rendering
Fabrice Rousselle1 Wojciech Jarosz2 JanNovák1
1DisneyResearch2DartmouthCollege
![Page 2: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/2.jpg)
SPATIO-TEMPORAL COHERENCE
2
OriginalscenebyWig42,downloadedfromblendswap.com
64spp
![Page 3: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/3.jpg)
SPATIO-TEMPORAL COHERENCE
3
OriginalscenebyWig42,downloadedfromblendswap.com
96kspp
![Page 4: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/4.jpg)
SPATIO-TEMPORAL COHERENCE
4
OriginalscenebyWig42,downloadedfromblendswap.com
96kspp
![Page 5: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/5.jpg)
SPATIO-TEMPORAL COHERENCE
5
OriginalscenebyWig42,downloadedfromblendswap.com
96kspp
![Page 6: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/6.jpg)
SPATIO-TEMPORAL COHERENCE
6
OriginalscenebyWig42,downloadedfromblendswap.com
96kspp
![Page 7: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/7.jpg)
SPATIO-TEMPORAL COHERENCE
7
OriginalscenebyWig42,downloadedfromblendswap.com
96kspp
![Page 8: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/8.jpg)
• Irradiance caching[Ward et al. 1988, …]
• Photon mapping[Jensen 1995, …]
• Image-space denoising[Rushmeier and Ward 1994, …]
• Many more…
PREVIOUS WORKS
8
![Page 9: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/9.jpg)
PREVIOUS WORKS
9
Consistent scene editing [CSE], Günther and Grosch, EGSR 2015
Re-render
1024 spp
Previous Difference
64 spp
![Page 10: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/10.jpg)
PREVIOUS WORKS
10
Consistent scene editing [CSE], Günther and Grosch, EGSR 2015
Re-render
1024 spp
Previous
Gradient-domain path tracing [GDPT], Kettunen et al., SIGGRAPH 2015
16 spp
Noisy
16 spp
Difference (DY)
16 spp
Difference (DX) Poisson solver
Difference
64 spp
![Page 11: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/11.jpg)
OUR WORK
11
Scene editing
1024 spp
Previous
Gradient-domain rendering
16 spp
Noisy
• Unified framework• Control variates• Provably optimal
variance
![Page 12: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/12.jpg)
INTEGRATION WITH CONTROL VARIATES
12
! 𝑓 𝑥 𝑑𝑥&
![Page 13: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/13.jpg)
INTEGRATION WITH CONTROL VARIATES
13
! 𝑓 𝑥 − 𝑔 𝑥 𝑑𝑥 + 𝐺&
Controlvariate withknownintegral
![Page 14: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/14.jpg)
INTEGRATION WITH CONTROL VARIATES
14
! 𝑓 𝑥 − 𝑔 𝑥 𝑑𝑥 + 𝐺&
![Page 15: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/15.jpg)
INTEGRATION WITH CONTROL VARIATES
15
! 𝑓 𝑥 − 𝑔 𝑥 𝑑𝑥 + 𝐺&
![Page 16: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/16.jpg)
INTEGRATION WITH CONTROL VARIATES
16
! 𝑓 𝑥 − 𝑔 𝑥 𝑑𝑥 + 𝐺&
![Page 17: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/17.jpg)
INTEGRATION WITH CONTROL VARIATES
17
! 𝑓 𝑥 − 𝑔 𝑥 𝑑𝑥 + 𝐺&
![Page 18: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/18.jpg)
SCENE EDITING
18
Previous
1024 spp
Re-render
64 spp
![Page 19: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/19.jpg)
SCENE EDITING
19
Re-render
64 spp
Previous
1024 spp
𝐺! 𝑓 𝑥 − 𝑔 𝑥 𝑑𝑥 + 𝐺&
![Page 20: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/20.jpg)
20
Re-render
Previous
64 spp
SCENE EDITING
1024 spp
𝐺
𝑓
! 𝑓 𝑥 − 𝑔 𝑥 𝑑𝑥 + 𝐺&
![Page 21: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/21.jpg)
SCENE EDITING
21
Previous
Re-render
64 spp
64 spp
1024 spp
𝐺
𝑔
𝑓
! 𝑓 𝑥 − 𝑔 𝑥 𝑑𝑥 + 𝐺&
![Page 22: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/22.jpg)
SCENE EDITING
22
Previous
64 spp
64 spp
1024 spp
𝐺
𝑔
𝑓
! 𝑓 𝑥 − 𝑔 𝑥 𝑑𝑥 + 𝐺&
Re-render same random seed
![Page 23: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/23.jpg)
SCENE EDITING
23
Previous
Difference
64 spp
1024 spp
64 spp
𝑓
𝑔
𝐺
Re-render same random seed
![Page 24: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/24.jpg)
SCENE EDITING
24
Previous
Re-render twicesame random seed
Reuse
Re-render
Difference
64 spp
1024 spp
64 spp
𝑓
𝐺
![Page 25: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/25.jpg)
Reuse
Re-render
OPTIMAL COMBINATION OF ESTIMATORS
25
![Page 26: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/26.jpg)
Re-render
×
Weight
×
Weight
Weight
Weight
WeightWeight Reuse
OPTIMAL COMBINATION OF ESTIMATORS
26
![Page 27: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/27.jpg)
Re-render
×
×
Weight
Weight
Weight
Weight Reuse
OPTIMAL COMBINATION OF ESTIMATORS
27
Weight
Weight
=
=
Optimal
![Page 28: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/28.jpg)
OPTIMAL COMBINATION OF ESTIMATORS
28
Weight
Weight
?×
×
Re-render
Reuse
Optimal
![Page 29: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/29.jpg)
Limitations- Assumes hi-quality
previous image- User-defined threshold- Selection discards data
PREVIOUS WORK: SELECTION HEURISTIC [GG15]
29
Re-render
Reuse
Use if < τ
Use otherwise
Difference
![Page 30: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/30.jpg)
OPTIMAL COMBINATION OF ESTIMATORS
30
Re-render
ReuseIndependent
Re-render
ReuseVariance
Variance
-1
-1
=
Weight
=
Weight
![Page 31: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/31.jpg)
OPTIMAL COMBINATION OF ESTIMATORS
31
Re-render
ReuseIndependent
Variance
Variance
-1
=
Weight
-1
=
Weight
-1
Covariance
CovarianceVariance
Variance
Correlated
2x2 matrixper pixel
Weight
Weight
![Page 32: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/32.jpg)
COMPARISON TO PREVIOUS WORK [GG15] – relative MSE
32
Re-renderPrevious
1024 spp – HQ 64 spp – 0.363
![Page 33: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/33.jpg)
COMPARISON TO PREVIOUS WORK [GG15] – relative MSE
33
Re-renderPrevious
64 spp – 0.363
[GG15] Ours
0.230 0.0841024 spp – HQ
![Page 34: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/34.jpg)
COMPARISON TO PREVIOUS WORK [GG15] – relative MSE
34
Re-renderPrevious
64 spp – 0.363
[GG15] Ours
0.230 0.084
0.384 0.15364 spp – LQ 64 spp – 0.363
1024 spp – HQ
![Page 35: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/35.jpg)
GRADIENT-DOMAIN PATH TRACING
35
16 spp
Throughput
16 spp
Horizontal gradient
16 spp
Vertical gradient
![Page 36: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/36.jpg)
PREVIOUS WORK: POISSON RECONSTRUCTION
36
Poisson solver (L2)
16 spp
Throughput
16 spp 16 spp
Horizontal gradient Vertical gradient
![Page 37: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/37.jpg)
PREVIOUS WORK: POISSON RECONSTRUCTION
37
Poisson solver (L1)
16 spp
Throughput
16 spp 16 spp
Horizontal gradient Vertical gradient
![Page 38: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/38.jpg)
EXTENSION TO MULTIPLE ESTIMATORS: GDR
Hori. gradient
Vert. gradient
DX
DY
TH0 + DX
TH0 - DX
TH0 + DY
TH0 - DY
Throughput
TH0
Left neighbor
Right neighbor
Bottom neighbor
Top neighbor
TH0
None
Control Variate
![Page 39: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/39.jpg)
Hori. gradient
Vert. gradient
EXTENSION TO MULTIPLE ESTIMATORS: GDR
Hori. gradient
Vert. gradient
DX
DY
TH0
TH0 + DX
TH0 - DX
TH0 + DY
TH0 - DY
Hori. gradient
DX
Vert. gradient
DY
Throughput
TH0
Throughput
TH1
AVG . . .
TH1
TH1 + DX
TH1 - DX
TH1 + DY
TH1 - DY
TH50
Throughput [CVPT-uni]
39
![Page 40: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/40.jpg)
EXTENSION TO MULTIPLE ESTIMATORS: GDR
Hori. gradient
Vert. gradient
DX
DY
TH0
TH0 + DX
TH0 - DX
TH0 + DY
TH0 - DY
Hori. gradient
DX
Vert. gradient
DY
Throughput
TH0
Throughput
TH1
. . .
TH1
TH1 + DX
TH1 - DX
TH1 + DY
TH1 - DY
TH50
Throughput [CVPT-opt]
40
TH50
Throughput [CVPT-uni]
OPT
![Page 41: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/41.jpg)
RELATION TO POISSON SOLVER
41
TH50 uniform weights
Iterated reconstruction (Ours)L2Poisson Solver [GDPT]
≈
![Page 42: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/42.jpg)
COMPARISON TO PREVIOUS WORK [GDPT] – relative MSE
42
ReferenceInput
0.0282
OursCVPT-uniGDPT-L2
0.0034 0.0034
OursCVPT-wgtGDPT-L1
0.0032 0.0018
Sponza scene – 16 spp
![Page 43: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/43.jpg)
COMPARISON TO PREVIOUS WORK [GDPT] – relative MSE
43
Bookshelf scene – standard path tracing 0.0590
![Page 44: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/44.jpg)
COMPARISON TO PREVIOUS WORK [GDPT] – relative MSE
44
Bookshelf scene – L1 Poisson reconstruction 0.0094
![Page 45: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/45.jpg)
COMPARISON TO PREVIOUS WORK [GDPT] – relative MSE
45
Bookshelf scene – Ours with optimized weights 0.0044
![Page 46: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/46.jpg)
MORE IN THE PAPER: UNBIASED RECONSTRUCTIONS
46
![Page 47: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/47.jpg)
• Integration with control variates…• simple yet powerful tool• relatively unexplored in rendering• should be used with optimal weighting scheme
• Future work• animations, stereo rendering, light fields• better sampling of the difference buffer
CONCLUSION
47
![Page 48: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/48.jpg)
48
![Page 49: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/49.jpg)
RELATION TO POISSON SOLVER
49
TH50 optimized weights
Iterated reconstruction (Ours)L1Poisson Solver [GDPT]
![Page 50: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/50.jpg)
INTEGRATION WITH CONTROL VARIATES
50
! 𝑓 𝑥 − 𝑔 𝑥 𝑑𝑥 + 𝐺&
![Page 51: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/51.jpg)
INTEGRATION WITH CONTROL VARIATES
51
! 𝑓 𝑥 − 𝑔 𝑥 𝑑𝑥 + 𝐺&
![Page 52: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/52.jpg)
COMPARISON TO PREVIOUS WORK [GDPT] – relative MSE
52
ReferenceInput
0.206
OursCVPT-uniGDPT-L2
0.0365 0.0362
OursCVPT-wgtGDPT-L1
0.0314 0.0129
Bookshelf scene – 256 spp
![Page 53: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/53.jpg)
COMPARISON TO PREVIOUS WORK [GDPT] – relative MSE
53
ReferenceInput
0.0616
OursCVPT-uniGDPT-L2
0.0098 0.0099
OursCVPT-wgtGDPT-L1
0.0088 0.0070
Bathroom scene – 256 spp
![Page 54: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/54.jpg)
• Irradiance caching
LEVERAGING COHERENCE: PREVIOUS WORK
54
A ray tracing solution for diffuse interreflectionWard et al., SIGGRAPH 1988
ImagebyWojciech Jarosz
![Page 55: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/55.jpg)
• Irradiance caching• Photon mapping
LEVERAGING COHERENCE: PREVIOUS WORK
55
Global illumination using photon mapsJensen, EGSR 1996
ImagebyHenrik Wann Jensen
![Page 56: Image-space Control Variates for Renderingwjarosz/publications/... · GDPT-L2 CVPT-uni 0.0098 0.0099 Ours GDPT-L1 CVPT-wgt 0.0088 0.0070 Bathroom scene –256 spp • Irradiance caching](https://reader034.vdocument.in/reader034/viewer/2022050220/5f658c54f7acb00de51dcb3a/html5/thumbnails/56.jpg)
• Irradiance caching• Photon mapping• Image-space denoising
LEVERAGING COHERENCE: PREVIOUS WORK
56
ScenebyGuillermoM.LeanLlagunoImagebyBenedikt Bitterli
Energy-preserving non-linear filtersRushmeier and Ward, SIGGRAPH 1994