art tracking vip
TRANSCRIPT
-
8/3/2019 ART Tracking VIP
1/16
page 1 - A.R.T. GmbHISMAR05
Startseite
The Achilles Heels of Optical Tracking Systems:
Occlusions and Optical Interferences -
A.R.T.s SolutionsDr.-Ing. Konrad Zrl
Am ferl 6D-82362 Weilheim
- GERMANY -Phone: +49 881 92530-00Fax : +49 881 92530-01
www.ar-tracking.de
http://www.ar-tracking.de/http://www.ar-tracking.de/ -
8/3/2019 ART Tracking VIP
2/16
page 2 - A.R.T. GmbHISMAR05
Motivtion
Optical tracking is accurate and reliable in limited measurement volumes
indoor for VR & AR applications
Line of sight: function principle
Achilles heels:
occlusions interferences
-
8/3/2019 ART Tracking VIP
3/16
page 3 - A.R.T. GmbHISMAR05
A.R.T. Tracking: Function Principle
grayscale image
IR flash
retro reflected light
grayscale image
tracking camera (ARTtrack1)
target with retro reflectivemarkers
-
8/3/2019 ART Tracking VIP
4/16page 4 - A.R.T. GmbHISMAR05
A.R.T. Tracking camera functionality
CCD cameraIR flash
Signal proc. RT Linux PC
Centers of gravity of all markerimages are calculated: 2dof data
2dof data
-
8/3/2019 ART Tracking VIP
5/16page 5 - A.R.T. GmbHISMAR05
A.R.T. Tracking: Function Principle
2 dof data is sent to PC DTrack calculates
3dof and 6dof data
3dof, 6dofEthernet
PC with DTrack:3 dof and
6 dof calculation
Ethernet Ethernet
2dof data 2dof data
-
8/3/2019 ART Tracking VIP
6/16page 6 - A.R.T. GmbHISMAR05
Occlusions
Occlusions:
1. Add more trackingcameras
2. Use large targets
3. Single camera tracking
-
8/3/2019 ART Tracking VIP
7/16page 7 - A.R.T. GmbHISMAR05
Occlusions
Two or more users in frontof a VR projection
Self-occlusions
Foto: Volkswagen, at IZB 2004 Foto: imagination & vrvis
-
8/3/2019 ART Tracking VIP
8/16page 8 - A.R.T. GmbHISMAR05
Multi-camera systems: mutual blinding
-
8/3/2019 ART Tracking VIP
9/16page 9 - A.R.T. GmbHISMAR05
Time multiplexing - no blinding
t=20...380us
Camera IR flash syncgroup 1
t=380us
CCD sensitive (exposure) syncgroup 1
t=20...380us
Camera IR flash syncgroup 2
t=380us
CCD sensitive (exposure) syncgroup 2
t=20...380us
Camera IR flash syncgroup 3
t=380us
CCD sensitive (exposure) syncgroup 3
syncgroup 1
syncgroup 2
syncgroup 3
-
8/3/2019 ART Tracking VIP
10/16page 10 - A.R.T. GmbHISMAR05
Occlusions: large targets
large redundant targetswith >4 markers
begin trackingif 4 markers are seen by2 cameras
maintain trackingif the same3 markers
are seen by 2 cameras maintain tracking
if any3 markers areseen by 2 cameras (or
similar conditions)
-
8/3/2019 ART Tracking VIP
11/16page 11 - A.R.T. GmbHISMAR05
Single camera tracking
+ Target geometry(body file)
+ Last 6 dof target
coordinates beforeocclusion+ 2dof information of
one camera___________________________________________________
6 dof target coordinatescan be calculated
However: larger errors(compared to normal2 camera tracking) in
z direction (opticalaxis)
-
8/3/2019 ART Tracking VIP
12/16page 12 - A.R.T. GmbHISMAR05
Targets: improved accuracy
Merging markers: less accuracy Improved pattern recognition algorithm
Test for roundness (marker quality) Feedback algorithm (adaptive pattern
recognition)
non-merging targets with Flat round markers on planes
Unidirectional active markers Addressable active markers
-
8/3/2019 ART Tracking VIP
13/16page 13 - A.R.T. GmbHISMAR05
Active markers and targets
Welding gunUnidirectional target planes
Finger tracking
Time sequentially addressedactive markers (wireless,controlled by camera IR flash)
diffusing sphereIR-LED
60o
LED
-
8/3/2019 ART Tracking VIP
14/16
page 14 - A.R.T. GmbHISMAR05
External Interferences
Unwanted reflections Retro reflecting objects:
sport clothes or sportshoes
car back lights
Car licence plate
Some metal surfaces
IR light sources Sun light
Light bulb illumination
Static reflex suppression
Dynamic reflex suppression
-
8/3/2019 ART Tracking VIP
15/16
page 15 - A.R.T. GmbHISMAR05
Hybrid (optical) tracking
outside in inside out
fixed cameras, moving target(s) fixed targets, moving camera(s)
high position accuracy high angular accuracywireless moving objects: simple wireless moving objects: difficult
(radio transmission in real time)
Tracked endoscope in minimal invasive surgery
Small angular error attarget transfers into alarge position error attip of instrument
Foto: University of ErlangenFlorian Vogt, sfb-603
-
8/3/2019 ART Tracking VIP
16/16
page 16 - A.R.T. GmbHISMAR05
Conclusions
A lot of special features must be implementedin an optical tracking system to be
accurate and reliable and
fast (realtime)
A.R.T. provides such tracking systems based
on our own hardware and software.