art tracking vip

Upload: rohit-bapat

Post on 06-Apr-2018

215 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/3/2019 ART Tracking VIP

    1/16

    page 1 - A.R.T. GmbHISMAR05

    Startseite

    The Achilles Heels of Optical Tracking Systems:

    Occlusions and Optical Interferences -

    A.R.T.s SolutionsDr.-Ing. Konrad Zrl

    Am ferl 6D-82362 Weilheim

    - GERMANY -Phone: +49 881 92530-00Fax : +49 881 92530-01

    www.ar-tracking.de

    http://www.ar-tracking.de/http://www.ar-tracking.de/
  • 8/3/2019 ART Tracking VIP

    2/16

    page 2 - A.R.T. GmbHISMAR05

    Motivtion

    Optical tracking is accurate and reliable in limited measurement volumes

    indoor for VR & AR applications

    Line of sight: function principle

    Achilles heels:

    occlusions interferences

  • 8/3/2019 ART Tracking VIP

    3/16

    page 3 - A.R.T. GmbHISMAR05

    A.R.T. Tracking: Function Principle

    grayscale image

    IR flash

    retro reflected light

    grayscale image

    tracking camera (ARTtrack1)

    target with retro reflectivemarkers

  • 8/3/2019 ART Tracking VIP

    4/16page 4 - A.R.T. GmbHISMAR05

    A.R.T. Tracking camera functionality

    CCD cameraIR flash

    Signal proc. RT Linux PC

    Centers of gravity of all markerimages are calculated: 2dof data

    2dof data

  • 8/3/2019 ART Tracking VIP

    5/16page 5 - A.R.T. GmbHISMAR05

    A.R.T. Tracking: Function Principle

    2 dof data is sent to PC DTrack calculates

    3dof and 6dof data

    3dof, 6dofEthernet

    PC with DTrack:3 dof and

    6 dof calculation

    Ethernet Ethernet

    2dof data 2dof data

  • 8/3/2019 ART Tracking VIP

    6/16page 6 - A.R.T. GmbHISMAR05

    Occlusions

    Occlusions:

    1. Add more trackingcameras

    2. Use large targets

    3. Single camera tracking

  • 8/3/2019 ART Tracking VIP

    7/16page 7 - A.R.T. GmbHISMAR05

    Occlusions

    Two or more users in frontof a VR projection

    Self-occlusions

    Foto: Volkswagen, at IZB 2004 Foto: imagination & vrvis

  • 8/3/2019 ART Tracking VIP

    8/16page 8 - A.R.T. GmbHISMAR05

    Multi-camera systems: mutual blinding

  • 8/3/2019 ART Tracking VIP

    9/16page 9 - A.R.T. GmbHISMAR05

    Time multiplexing - no blinding

    t=20...380us

    Camera IR flash syncgroup 1

    t=380us

    CCD sensitive (exposure) syncgroup 1

    t=20...380us

    Camera IR flash syncgroup 2

    t=380us

    CCD sensitive (exposure) syncgroup 2

    t=20...380us

    Camera IR flash syncgroup 3

    t=380us

    CCD sensitive (exposure) syncgroup 3

    syncgroup 1

    syncgroup 2

    syncgroup 3

  • 8/3/2019 ART Tracking VIP

    10/16page 10 - A.R.T. GmbHISMAR05

    Occlusions: large targets

    large redundant targetswith >4 markers

    begin trackingif 4 markers are seen by2 cameras

    maintain trackingif the same3 markers

    are seen by 2 cameras maintain tracking

    if any3 markers areseen by 2 cameras (or

    similar conditions)

  • 8/3/2019 ART Tracking VIP

    11/16page 11 - A.R.T. GmbHISMAR05

    Single camera tracking

    + Target geometry(body file)

    + Last 6 dof target

    coordinates beforeocclusion+ 2dof information of

    one camera___________________________________________________

    6 dof target coordinatescan be calculated

    However: larger errors(compared to normal2 camera tracking) in

    z direction (opticalaxis)

  • 8/3/2019 ART Tracking VIP

    12/16page 12 - A.R.T. GmbHISMAR05

    Targets: improved accuracy

    Merging markers: less accuracy Improved pattern recognition algorithm

    Test for roundness (marker quality) Feedback algorithm (adaptive pattern

    recognition)

    non-merging targets with Flat round markers on planes

    Unidirectional active markers Addressable active markers

  • 8/3/2019 ART Tracking VIP

    13/16page 13 - A.R.T. GmbHISMAR05

    Active markers and targets

    Welding gunUnidirectional target planes

    Finger tracking

    Time sequentially addressedactive markers (wireless,controlled by camera IR flash)

    diffusing sphereIR-LED

    60o

    LED

  • 8/3/2019 ART Tracking VIP

    14/16

    page 14 - A.R.T. GmbHISMAR05

    External Interferences

    Unwanted reflections Retro reflecting objects:

    sport clothes or sportshoes

    car back lights

    Car licence plate

    Some metal surfaces

    IR light sources Sun light

    Light bulb illumination

    Static reflex suppression

    Dynamic reflex suppression

  • 8/3/2019 ART Tracking VIP

    15/16

    page 15 - A.R.T. GmbHISMAR05

    Hybrid (optical) tracking

    outside in inside out

    fixed cameras, moving target(s) fixed targets, moving camera(s)

    high position accuracy high angular accuracywireless moving objects: simple wireless moving objects: difficult

    (radio transmission in real time)

    Tracked endoscope in minimal invasive surgery

    Small angular error attarget transfers into alarge position error attip of instrument

    Foto: University of ErlangenFlorian Vogt, sfb-603

  • 8/3/2019 ART Tracking VIP

    16/16

    page 16 - A.R.T. GmbHISMAR05

    Conclusions

    A lot of special features must be implementedin an optical tracking system to be

    accurate and reliable and

    fast (realtime)

    A.R.T. provides such tracking systems based

    on our own hardware and software.