ee565:mobile robotics lecture 9 - lahore university of...

41
EE565:Mobile Robotics Lecture 9 Welcome Dr. Ahmad Kamal Nasir

Upload: others

Post on 24-May-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565:Mobile Robotics Lecture 9

Welcome

Dr. Ahmad Kamal Nasir

Page 2: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Probabilistic Map-based Localization

30.03.2015 Dr. Ahmad Kamal Nasir 4

Page 3: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Definition, Challenges and Approach

• Map-based localization – The robot estimates its position using perceived information and a

map – The map

• might be known (localization) • Might be built in parallel (simultaneous localization and mapping - SLAM)

• Challenges – Measurements and the map are inherently

error prone – Thus the robot has to deal with uncertain

information • Probabilistic map-base localization

• Approach – The robot estimates the belief state about its

position through an ACT and SEE cycle

30.03.2015 Dr. Ahmad Kamal Nasir 5

Page 4: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

SEE and ACT to improve belief state

30.03.2015 Dr. Ahmad Kamal Nasir 6

Page 5: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

SEE and ACT to improve belief state

30.03.2015 Dr. Ahmad Kamal Nasir 7

Page 6: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

SEE and ACT to improve belief state

30.03.2015 Dr. Ahmad Kamal Nasir 8

Page 7: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

SEE and ACT to improve belief state

30.03.2015 Dr. Ahmad Kamal Nasir 9

Page 8: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

SEE and ACT to improve belief state

30.03.2015 Dr. Ahmad Kamal Nasir 10

Page 9: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

SEE and ACT to improve belief state

30.03.2015 Dr. Ahmad Kamal Nasir 11

Page 10: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

SEE and ACT to improve belief state

30.03.2015 Dr. Ahmad Kamal Nasir 12

Page 11: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Using Motion Model and its Uncertainties

30.03.2015 Dr. Ahmad Kamal Nasir 13

Page 12: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Estimation of Position based on Perception and Map

30.03.2015 Dr. Ahmad Kamal Nasir 14

Page 13: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Fusion of Prior Belief with Observation

30.03.2015 Dr. Ahmad Kamal Nasir 15

Page 14: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

The Estimation Cycle (ACT-SEE)

• Information (measurements) is error prone (uncertain) – Odometry

– Exteroceptive sensors (camera, laser, …)

– Map

• Probabilistic map-based localization

30.03.2015 Dr. Ahmad Kamal Nasir 16

Page 15: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Belief Representation

• Continuous map with single hypothesis probability distribution 𝑝 𝑥

• Continuous map with multiple hypotheses probability distribution 𝑝 𝑥

• Discretized metric map (grid 𝑘) with probability distribution 𝑝 𝑘

• d) Discretized topological map (nodes 𝑛) with

• probability distribution 𝑝 𝑛

30.03.2015 Dr. Ahmad Kamal Nasir 17

Page 16: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

ACT - SEE Cycle for Localization

• SEE: The robot queries its sensors – finds itself next to a pillar

• ACT: Robot moves one meter forward – motion estimated by wheel

encoders – accumulation of uncertainty

• SEE: The robot queries its sensors – again → finds itself next to a pillar

• Belief update (information fusion)

30.03.2015 Dr. Ahmad Kamal Nasir 18

Page 17: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Refresher on Probability Theory: joint distribution

• 𝑝 𝑥, 𝑦 : joint distribution representing the probability that the random variable 𝑋 takes on the value 𝑥 and that 𝑌 takes on the value𝑦

• If 𝑋 and 𝑌 are independent we can write:

𝑝 𝑥, 𝑦 = 𝑝 𝑥 𝑝 𝑦

30.03.2015 Dr. Ahmad Kamal Nasir 19

Page 18: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Refresher on Probability Theory: conditional probability

• 𝑝 𝑥 𝑦 : conditional probability that describes the probability that the random variable 𝑋 takes on the value 𝑥 conditioned on the knowledge that 𝑌 for sure takes 𝑦.

𝑝 𝑥 𝑦 =𝑝 𝑥, 𝑦

𝑝 𝑦

• and if 𝑋 and 𝑌 are independent (uncorrelated) we can write:

𝑝 𝑥 𝑦 =𝑝 𝑥 𝑝 𝑥

𝑝 𝑦= 𝑝 𝑥

30.03.2015 Dr. Ahmad Kamal Nasir 20

Page 19: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Refresher on Probability Theory: theorem of total probability

• The theorem of total probability (convolution) originates from the axioms of probability theory and is written as:

• This theorem is used by both Markov and Kalman-filter localization algorithms during the prediction update.

30.03.2015 Dr. Ahmad Kamal Nasir 21

Page 20: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Refresher on Probability Theory: the Bayes rule

• The Bayes rule relates the conditional probability 𝑝 𝑥 𝑦 to its inverse 𝑝 𝑦 𝑥

• Under the condition that 𝑝 𝑦 > 0, the Bayes rule is written as:

• This theorem is used by both Markov and Kalman-filter localization algorithms during the measurement update.

30.03.2015 Dr. Ahmad Kamal Nasir 22

Page 21: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Markov localization: applying probability theory to localization

• Information (measurements) is error prone (uncertain) – Odometry

– Exteroceptive sensors (camera, laser, …)

– Map

• Probabilistic map-based localization

30.03.2015 Dr. Ahmad Kamal Nasir 23

Page 22: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Basics and Assumption

• Discretized pose representation 𝑥𝑡→ grid map • Markov localization tracks the robot’s

belief state 𝑏𝑒𝑙 𝑥𝑡 using an arbitrary probability density function to represent the robot’s position

• Markov assumption: Formally, this means that the output of the estimation process is a function 𝑥𝑡 only of the robot’s previous state 𝑥𝑡−1 and its most recent actions (odometry) 𝑢𝑡 and perception 𝑧𝑡.

• Markov localization addresses the global localization problem, the position tracking problem, and the kidnapped robot problem.

30.03.2015 Dr. Ahmad Kamal Nasir 24

Page 23: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Applying Probability Theory to Localization

• ACT | probabilistic estimation of the robot’s new belief state 𝑏𝑒𝑙 𝑥𝑡 based on the previous location 𝑏𝑒𝑙 𝑥𝑡−1 and the probabilistic motion model 𝑝(𝑥𝑡|𝑢𝑡, 𝑥𝑡−1) with action 𝑢𝑡 (control input)

– application of theorem of total probability / convolution

30.03.2015 Dr. Ahmad Kamal Nasir 25

Page 24: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Applying Probability Theory to Localization

• SEE | probabilistic estimation of the robot’s new belief state 𝑏𝑒𝑙 𝑥𝑡 as a function of its measurement data 𝑧𝑡 and its former belief state 𝑏𝑒𝑙 𝑥𝑡 : – application of Bayes rule

• where 𝑝 𝑧𝑡 𝑥𝑡, 𝑚𝑡 is the probabilistic measurement model (SEE), that is, the probability of observing the measurement data 𝑧𝑡 given the knowledge of the map 𝑚𝑡 and the robot’s position 𝑥𝑡. Thereby 𝜂 = 𝑝 𝑦 −1is the normalization factor so that ∑𝑝 = 1.

30.03.2015 Dr. Ahmad Kamal Nasir 26

Page 25: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

The Basic Algorithms for Markov Localization

• Markov assumption: Formally, this means that the output is a function 𝑥𝑡 only of the robot’s previous state 𝑥𝑡−1 and its most recent actions (odometry) 𝑢𝑡 and perception 𝑧𝑡.

30.03.2015 Dr. Ahmad Kamal Nasir 27

Page 26: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Using Motion Model and its Uncertainties

30.03.2015 Dr. Ahmad Kamal Nasir 28

Page 27: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Using Motion Model and its Uncertainties

30.03.2015 Dr. Ahmad Kamal Nasir 29

Page 28: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Estimation of Position based on Perception and Map

30.03.2015 Dr. Ahmad Kamal Nasir 30

Page 29: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Extension to 2D

• The real world for mobile robot is at least 2D (moving in the plane) – discretized pose state space (grid) consists of 𝑥, 𝑦, 𝜃 – Markov Localization scales badly with the size of

the environment

• Space: 10 m x 10 m with a grid size of 0.1 m and an angular resolution of 1° – 100 ⋅ 100 ⋅ 360 = 3.6 106 grid points (states) – prediction step requires in worst case 3.6 106 2

multiplications and summations

• Fine fixed decomposition grids result in a huge state space – Very important processing power needed – Large memory requirement

30.03.2015 Dr. Ahmad Kamal Nasir 31

Page 30: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Reducing Computational Complexity

• Adaptive cell decomposition

• Motion model (Odomety) limited to a small number of grid points

• Randomized sampling – Approximation of belief state by a representative subset of

possible locations

– weighting the sampling process with the probability values

– Injection of some randomized (not weighted) samples

– randomized sampling methods are also known as particle filter algorithms, condensation algorithms, and Monte Carlo algorithms.

30.03.2015 Dr. Ahmad Kamal Nasir 32

Page 31: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Kalman Filter Localization: applying probability theory to localization

30.03.2015 Dr. Ahmad Kamal Nasir 33

Page 32: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Basics and assumption

30.03.2015 Dr. Ahmad Kamal Nasir 34

Page 33: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

prediction (odometry) - ACT

30.03.2015 Dr. Ahmad Kamal Nasir 35

Page 34: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Observation - SEE

30.03.2015 Dr. Ahmad Kamal Nasir 36

Page 35: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Observations in Sensor Model Space

30.03.2015 Dr. Ahmad Kamal Nasir 37

Page 36: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Measurement Prediction

30.03.2015 Dr. Ahmad Kamal Nasir 38

Page 37: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Measurement Prediction in Model Space

30.03.2015 Dr. Ahmad Kamal Nasir 39

Page 38: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Matching in Sensor Model Space

30.03.2015 Dr. Ahmad Kamal Nasir 40

Page 39: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Estimation

30.03.2015 Dr. Ahmad Kamal Nasir 41

Page 40: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Kalman Filter Localization in summery

30.03.2015 Dr. Ahmad Kamal Nasir 42

Page 41: EE565:Mobile Robotics Lecture 9 - Lahore University of ...web.lums.edu.pk/~akn/Files/Other/teaching/mobile... · EE565: Mobile Robotics Module 4: Localization and Mapping SEE and

EE565: Mobile Robotics Module 4: Localization and Mapping

Questions

30.03.2015 Dr. Ahmad Kamal Nasir 43