3D Tracking and Social Media for Industry ApplicationsCharles Woodward, VTT Ltd.

Augmented Reality at VTTAR and 3D Tracking research at VTT VTT is the 3rd largest research institute in Europe with 2,300 employees AR / 3D Tracking team established in 2001, today 15 people in Espoo Leading edge tracking technology: ALVAR SDK

Application focus Industrial Maintenance, Assembly, Training Architecture, Engineering & Construction (AEC) Facility Asset Management, other wide area applications

Markerless 3D TrackingPoint cloud based tracking Point clouds created from photos Enabling fast, accurate, robust tracking Automatic initialization without user interaction Sensor fusion, extended tracking

Tracking targets Unity based AR authoring: tracking targets and content Several optimizations, number of points, outliers, lighting etc. Updating of point clouds: based on user taken photos, robots,

drones Wide areas: dynamic loading of point clouds, edge cloud

servers

Wide Area ApplicationsFacility asset management Building life cycle services: maintenance, operation & repair Mobile AR interaction with facility’s digital information systems

Example: Building maintenance Building Information Model (BIM) as framework to digital systems E.g. Facility Maintenance System, Building Automation, IoT

Example: Lean construction / renovation Mobile AR view and interaction with BIM based production plans Checking for daily work tasks, resources, schedules, etc.

Augmented Social MediaLinking real world objects to Social Media Attach social media posts to real-world objects and view them in mobile AR Objects are associated with unique hashtags to be used in existing social media

platforms Create new target objects by taking one or more reference image(s) Objects are recognized visually, no position information required

Industrial applications Collecting maintenance history and commentary Tweets may be moderated, analyzed and further processed Tacit knowledge, by maintenance people around the world

ALVAR Tracking SDK”A Library for Virtual and Augmented Reality” Computer vision based 3D tracking for AR World leading performance, accuracy, robustness, speed

Modules ALVAR 2D: marker, multimarker and template based tracking ALVAR 3D: point cloud based tracking, extended tracking, sensor fusion ALVAR Studio: Unity based content authoring, point cloud optimization

Platforms iOS, Android, Windows Phone, Windows, Mac, Flash, Silverlight

Thank you !Charles Woodward, VTT

charles.woodward@vtt.fi

www.vtt.fi/multimedia