fast and robust normal estimation for point clouds with ...(sgp, 2003): jet fitting voronoï...

58
Fast and Robust Normal Estimation for Point Clouds with Sharp Features Alexandre Boulch & Renaud Marlet University Paris-Est, LIGM (UMR CNRS), Ecole des Ponts ParisTech Symposium on Geometry Processing 2012 1/37

Upload: others

Post on 25-Sep-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Fast and Robust Normal Estimation for PointClouds with Sharp Features

Alexandre Boulch & Renaud Marlet

University Paris-Est, LIGM (UMR CNRS), Ecole des Ponts ParisTech

Symposium on Geometry Processing 2012

1/37

Page 2: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Normal estimation

Normal estimation for point clouds

Our method

Experiments

Conclusion

2/37

Page 3: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Normal Estimation

Normal estimation for point clouds

Our method

Experiments

Conclusion

3/37

Page 4: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Data

Point clouds from photogram-metry or laser acquisition:

◮ may be noisy

Sensitivity to noise

Robustness to noise

4/37

Page 5: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Data

Point clouds from photogram-metry or laser acquisition:

◮ may be noisy

◮ may have outliers

Regression

Plane

P

4/37

Page 6: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Data

Point clouds from photogram-metry or laser acquisition:

◮ may be noisy

◮ may have outliers

◮ most often have sharpfeatures

Smoothed

sharp features

Preserved

sharp features

4/37

Page 7: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Data

Point clouds from photogram-metry or laser acquisition:

◮ may be noisy

◮ may have outliers

◮ most often have sharpfeatures

◮ may be anisotropic

Sensitivity to

anisotropy

Robustness to

anisotropy

4/37

Page 8: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Data

Point clouds from photogram-metry or laser acquisition:

◮ may be noisy

◮ may have outliers

◮ most often have sharpfeatures

◮ may be anisotropic

◮ may be huge (more than20 million points)

4/37

Page 9: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Normal Estimation

Normal estimation for point clouds

Our method

Experiments

Conclusion

5/37

Page 10: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Basics of the method (2D case here for readability)

Let P be a point andNP be its neighborhood.

6/37

Page 11: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Basics of the method (2D case here for readability)

Let P be a point andNP be its neighborhood.

We consider two cases:

◮ P lies on a planar surface

6/37

Page 12: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Basics of the method (2D case here for readability)

Let P be a point andNP be its neighborhood.

We consider two cases:

◮ P lies on a planar surface

6/37

Page 13: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Basics of the method (2D case here for readability)

Let P be a point andNP be its neighborhood.

We consider two cases:

◮ P lies on a planar surface

◮ P lies next to a sharpfeature

6/37

Page 14: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Basics of the method (2D case here for readability)

Let P be a point andNP be its neighborhood.

We consider two cases:

◮ P lies on a planar surface

◮ P lies next to a sharpfeature

6/37

Page 15: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Basics of the method (2D case here for readability)

Let P be a point andNP be its neighborhood.

We consider two cases:

◮ P lies on a planar surface

◮ P lies next to a sharpfeature

If Area(N1) > Area(N2), picking points in N1 × N1 is moreprobable than N2 × N2, and N1 × N2 leads to “random” normals.

6/37

Page 16: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Basics of the method (2D case here for readability)

Main IdeaDraw as many primitives as necessary to estimate the normaldistribution, and then the most probable normal.

◮ Discretize the problem

P

Normal

direction

N.B. We compute the normal direction, not orientation.

7/37

Page 17: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Basics of the method (2D case here for readability)

Main IdeaDraw as many primitives as necessary to estimate the normaldistribution, and then the most probable normal.

◮ Discretize the problem

◮ Fill a Hough accumulator

P

Normal

direction

N.B. We compute the normal direction, not orientation.

7/37

Page 18: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Basics of the method (2D case here for readability)

Main IdeaDraw as many primitives as necessary to estimate the normaldistribution, and then the most probable normal.

◮ Discretize the problem

◮ Fill a Hough accumulator

◮ Select the good normal

P

Normal

direction

N.B. We compute the normal direction, not orientation.

7/37

Page 19: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Robust Randomized Hough Transform

◮ T , number of primitives picked after T iteration.

◮ Tmin, number of primitives to pick

◮ M, number of bins of the accumulator

◮ pm, empirical mean of the bin m

◮ pm, theoretical mean of the bin m

8/37

Page 20: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Robust Randomized Hough TransformGlobal upper bound

Tmin such that:

P( maxm∈{1,...,M}

|pm − pm| ≤ δ) ≥ α

From Hoeffding’s inequality, for a given bin:

P(|pm − pm| ≥ δ) ≤ 2 exp(−2δ2Tmin)

Considering the whole accumulator:

Tmin ≥1

2δ2ln(

2M

1 − α)

9/37

Page 21: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Robust Randomized Hough TransformConfidence Interval

Idea: if we pick often enoughthe same bin, we want to stopdrawing primitives.From the Central LimitTheorem, we can stop if:

pm1 − pm2 ≥ 2

1

T

i.e. the confidence intervals ofthe most voted bins do not in-tersect (confidence level 95%)

10/37

Page 22: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Accumulator

Our primitives are planes direc-tions (defined by two angles).We use the accumulator ofBorrmann & al (3D Research,2011).

◮ Fast computing

◮ Bins of similar area

11/37

Page 23: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Discretization issues

The use of a discrete accumulatormay be a cause of error.

P

12/37

Page 24: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Discretization issues

The use of a discrete accumulatormay be a cause of error.

P

12/37

Page 25: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Discretization issues

The use of a discrete accumulatormay be a cause of error.

SolutionIterate the algorithm usingrandomly rotated accumulators.

P

12/37

Page 26: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Normal Selection

P

Normal directions

obtained by rotation

of the accumulator

Mean over all

the normalsBest confidence Mean over

best cluster

13/37

Page 27: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Dealing with anisotropy

The robustness to anisotropy depends of the way we select theplanes (triplets of points)

Sensitivity to anisotropy Robustness to anisotropy

14/37

Page 28: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Random point selection among nearest neighborsDealing with anisotropy

The triplets are randomly selectedamong the K nearest neighbors.

Fast but cannot deal with anisotropy.

15/37

Page 29: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Uniform point selection on the neighborhood ballDealing with anisotropy

◮ Pick a point Q in theneighborhood ball

P

Q

16/37

Page 30: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Uniform point selection on the neighborhood ballDealing with anisotropy

◮ Pick a point Q in theneighborhood ball

◮ Consider a small ballaround Q P

Q

16/37

Page 31: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Uniform point selection on the neighborhood ballDealing with anisotropy

◮ Pick a point Q in theneighborhood ball

◮ Consider a small ballaround Q

◮ Pick a point randomly in thesmall ball

P

Q

16/37

Page 32: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Uniform point selection on the neighborhood ballDealing with anisotropy

◮ Pick a point Q in theneighborhood ball

◮ Consider a small ballaround Q

◮ Pick a point randomly in thesmall ball

◮ Iterate to get a triplet

Deals with anisotropy, but for a high computation cost.

16/37

Page 33: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Cube discretization of the neighborhood ballDealing with anisotropy

◮ Discretize the neighborhoodball

P

17/37

Page 34: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Cube discretization of the neighborhood ballDealing with anisotropy

◮ Discretize the neighborhoodball

◮ Pick a cubeP

17/37

Page 35: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Cube discretization of the neighborhood ballDealing with anisotropy

◮ Discretize the neighborhoodball

◮ Pick a cube

◮ Pick a point randomly inthis cube

P

17/37

Page 36: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Cube discretization of the neighborhood ballDealing with anisotropy

◮ Discretize the neighborhoodball

◮ Pick a cube

◮ Pick a point randomly inthis cube

◮ Iterate to get a triplet

Good compromise between speed and robustness to anisotropy.

17/37

Page 37: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Normal Estimation

Normal estimation for point clouds

Our method

Experiments

Conclusion

18/37

Page 38: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Methods used for comparison

◮ Regression◮ Hoppe & al

(SIGGRAPH,1992):plane fitting

◮ Cazals & Pouget(SGP, 2003): jetfitting

Pla

ne

fitt

ing

Jet

fitt

ing

Noise X X

OutliersSharp fts

AnisotropyFast X X

19/37

Page 39: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Methods used for comparison

◮ Regression◮ Hoppe & al

(SIGGRAPH,1992):plane fitting

◮ Cazals & Pouget(SGP, 2003): jetfitting

◮ Voronoï diagram◮ Dey & Goswami

(SCG, 2004):NormFet

Pla

ne

fitt

ing

Jet

fitt

ing

Nor

mFet

Noise X X

OutliersSharp fts X

Anisotropy X

Fast X X X

19/37

Page 40: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Methods used for comparison

◮ Regression◮ Hoppe & al

(SIGGRAPH,1992):plane fitting

◮ Cazals & Pouget(SGP, 2003): jetfitting

◮ Voronoï diagram◮ Dey & Goswami

(SCG, 2004):NormFet

◮ Sample ConsensusModels

◮ Li & al (Computer &Graphics, 2010)

Pla

ne

fitt

ing

Jet

fitt

ing

Nor

mFet

Sam

ple

Conse

nsu

s

Noise X X X

Outliers X

Sharp fts X X

Anisotropy X

Fast X X X

19/37

Page 41: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Precision

Two error measures:

◮ Root Mean Square (RMS):

RMS =

1

|C|

P∈C

nP,refnP,est

2

◮ Root Mean Square with threshold(RMS_τ):

RMS_τ =

1

|C|

P∈C

v2P

where

vP =

{

nP,refnP,est if nP,refnP,est < τπ2 otherwise

More suited for sharp features

20/37

Page 42: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Visual on error distances

Same RMS, different RMSτ

21/37

Page 43: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Precision (with noise)

Precision for cube uniformly sampled, depending on noise.

22/37

Page 44: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Precision (with noise and anisotropy)

Precision for a corner with anisotropy, depending on noise.

23/37

Page 45: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Computation time

Computation time for sphere, function of the number of points.

24/37

Page 46: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Robustness to outliers

Noisy model (0.2%) + 100% of outliers.

25/37

Page 47: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Robustness to outliers

Noisy model (0.2%) + 200% of outliers.

26/37

Page 48: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Robustness to anisotropy

27/37

Page 49: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Preservation of sharp features

28/37

Page 50: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Robustness to “natural” noise, outliers and anisotropy

Point cloud created by photogrammetry.

29/37

Page 51: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Normal Estimation

Normal estimation for point clouds

Our method

Experiments

Conclusion

30/37

Page 52: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Conclusion

Pla

ne

fitt

ing

Jet

fitt

ing

Nor

mFet

Sam

ple

Conse

nsu

s

Our

met

hod

Noise X X X X

Outliers X X

Sharp fts X X X

Anisotropy X X

Fast X X X X

Compared to state-of-the-artmethods that preserve sharpfeatures, our normal estimatoris:

◮ at least as precise

◮ at least as robust tonoise and outliers

◮ almost 10x faster

◮ robust to anisotropy

31/37

Page 53: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Code available

Web sitehttps://sites.google.com/site/boulchalexandre

Two versions under GPL license:

◮ for Point Cloud Library(http://pointclouds.org)

◮ for CGAL (http://www.cgal.org)

32/37

Page 54: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Computation time

Tmin=700 Tmin=300nrot=5 nrot=2

w/o with w/o withModel (# vertices) interv. interv. interv. interv.

Armadillo (173k) 21 s 20 s 3 s 3 sDragon (438k) 55 s 51 s 8 s 7 sBuddha (543k) 1.1 1 10 s 10 sCirc. Box (701k) 1.5 1.3 13 s 12 sOmotondo (998k) 2 1.2 18 s 10 sStatuette (5M) 11 10 1.5 1.4Room (6.6M) 14 8 2.3 1.6Lucy (14M) 28 17 4 2.5

33/37

Page 55: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Parameters

◮ K or r : number of neighbors or neighborhood radius,

◮ Tmin: number of primitives to explore,

◮ nφ: parameter defining the number of bins,

◮ nrot : number of accumulator rotations,

◮ c : presampling or discretization factor (anisotropy only),

◮ acluster : tolerance angle (mean over best cluster only).

34/37

Page 56: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Efficiency

35/37

Page 57: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Influence of the neighborhood size

K = 20 K = 200 K = 400

36/37

Page 58: Fast and Robust Normal Estimation for Point Clouds with ...(SGP, 2003): jet fitting Voronoï diagram Dey & Goswami (SCG, 2004): NormFet Sample Consensus Models Li & al (Computer &

Precision (with noise)

Precision for cube uniformly sampled, depending on noise.

37/37