guiding indirect illumination - univerzita karlovajirka/path-guiding-in-production/2019/... ·...

30
Jiří Vorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 JIŘÍ VORBA WETA DIGITAL GUIDING INDIRECT ILLUMINATION Alita: Battle Angel |© 2018 Twentieth Century Fox Film Corporation

Upload: others

Post on 24-Jun-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

JIŘÍ VORBAWETA DIGITAL

GUIDING INDIRECT ILLUMINATION

Alita: Battle Angel |© 2018 Twentieth Century Fox Film Corporation

Page 2: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

GUIDED DIRECTIONAL SAMPLING

Page 3: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

• Jensen [1995]

HISTORY

• Lafortune and Willems [1995]

Learning from photons Learning from forward samples

Page 4: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

• Jensen [1995]

HISTORY

• Lafortune and Willems [1995]

Learning from photons Learning from forward samples

Page 5: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

• Jensen [1995]

HISTORY

• Lafortune and Willems [1995]

Learning from photons Learning from forward samples

Page 6: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

• Jensen [1995]

HISTORY

• Lafortune and Willems [1995]

Learning from photons Learning from forward samples

Page 7: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

• Jensen [1995]

• Hey and Purgathofer [2002]

• Vorba et al. [2014]

• Herholz et al. [2016, 2019]

HISTORY

• Lafortune and Willems [1995]

• Pegoraro et al. [2008]

• Bashford-Rogers et al. [2012]

• Müller et al. [2017]

• Dahm and Keller [2018]

• Simon et al. [2018]

Learning from photons Learning from forward samples

Page 8: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

2D DIRECTIONAL MODELSHey and Purgathofer [2002](Kernel density)

Jensen [1995](Histograms)

Vorba et al. [2014](Gaussian mixtures)

41

Page 9: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

Page 10: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

• How to learn from samples?

– Preprocess, interleaved tracing

• How to represent the knowledge?

– Mixtures of Gaussians cached in the scene

• How to exploit it in the simulation?

– Fetch nearest mixture

Preprocess Rendering

Page 11: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

The BFG|© 2016 Storyteller Distribution Co., LLC.

Page 12: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

The BFG|© 2016 Storyteller Distribution Co., LLC.

Page 13: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

The BFG|© 2016 Storyteller Distribution Co., LLC.

Page 14: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

Guided Russian roulette and splitting

OPTIMAL PATH LENGTH

Page 15: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

• Importance sampling of path length

• Splitting when expected contribution is high

• Vorba et Křivánek [2016]

GUIDED RUSSIAN ROULETTE AND SPLITTING

subsurface

Page 16: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

• Termination probability

ALBEDO BASED RUSSIAN ROULETTE

[Arvo & Kirk 1990]

Current path weight

User given threshold

Page 17: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

• Termination probability

ALBEDO BASED RUSSIAN ROULETTE

[Arvo & Kirk 1990]

[Jensen 2001]

Current path weight

Albedo

User given threshold

Page 18: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

• Termination probability

• Problem: it’s local

• Kill paths too early

• Waste time on long paths

ALBEDO BASED RUSSIAN ROULETTE

[Arvo & Kirk 1990]

[Jensen 2001]

Current path weight

Albedo

User given threshold

Page 19: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

• Input

– approximation of radiance field

– estimate of pixel values

• Output

– Termination probability / path split ratio

GUIDED RUSSIAN ROULETTE AND SPLITTING

Expected path contribution

(given current vertices)

Pixel estimate[Vorba a Křivánek 2016]

Page 20: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Path tracing (1h)

Page 21: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Path tracing (1h) Guided RR and splitting (1h)

Page 22: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Path tracing (1h) Guided RR and splitting (1h)

Page 23: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Path tracing (1h)

Guided RR and splitting (1h)

Page 24: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Path tracing (1h)

57

Guided RR and splitting + Directional guiding (1h)

Guided RR and splitting (1h)

Page 25: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

PIXEL VALUE ESTIMATES (Vorba et Křivánek [2016])

Estimate Reference

Page 26: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

• Can be simplified in practice

• Many possible approaches (low sample count -> denoising)

• MIP mapping of beauty image (at Weta)

PIXEL VALUE ESTIMATES (progressive rendering)

Page 27: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

• Minimal overhead

• Makes guiding cheap

• Better results than each method alone

SYNERGY

Directional guiding

Guided RR and splitting

+

Page 28: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

• Path guiding as adaptive sampling in path space

• Guide all the decisions

– Guided directional sampling

– Guided Russian roulette and splitting (Path length)

– Guided light sampling (Next-event estimation)

– Guided free flight (Ray-distance sampling)

Summary

Page 29: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Jiří Vorba | Path Guiding in Production - IntroductionWETA DIGITAL LTD.2019

THANK YOU

The BFG|© 2016 Storyteller Distribution Co., LLC.

Page 30: GUIDING INDIRECT ILLUMINATION - Univerzita Karlovajirka/path-guiding-in-production/2019/... · JiříVorba | Path Guiding in Production - Introduction WETA DIGITAL LTD.2019 • Jensen

Alita: Battle Angel |© 2018 Twentieth Century Fox Film Corporation

VISIT US AT THE JOB FAIR, BOOTH #1

Tuesday, 30 July, 9:30am - 6pm

Wednesday, 31 July, 9:30am - 6pm

http://careers.wetafx.co.nz

WETA DIGITAL IS HIRING

Jiří Vorba | Path Guiding in ProductionWETA DIGITAL LTD.2019