are 2011 ar authoring
DESCRIPTION
Presentation by Mark Billinghurst at the ARE 2011 conference about Augmented Reality authoring toolsTRANSCRIPT
AR Authoring Tools
Mark Billinghurst HIT Lab NZ
University of Canterbury
1998 - My First AR Application custom tracking ~6,000+ lines C-code libVRML rendering no interaction 2 months programming
static void init( void ){ !"int i; !"ARParam wparam; !
/* open the video path */ ! if( arVideoOpen( vconf ) < 0 ) exit(0); !
/* find the size of the window */ ! if( arVideoInqSize(&xsize, &ysize) < 0 ) exit(0); ! printf("Image size (x,y) = (%d,%d)\n", xsize, ysize); !
/* set the initial camera parameters */ ! if( arParamLoad(cparam_name, 1, &wparam) < 0 ) exit(0); !
arParamChangeSize( &wparam, xsize, ysize, &cparam ); ! arInitCparam( &cparam ); ! printf("*** Camera Parameter ***\n"); ! arParamDisp( &cparam ); !
/* open the graphics window */ ! argInit( &cparam, 2.0, 0, 0, 0, 0 ); !
/* load in the object data - trained markers and associated bitmap files */ ! if( (object=read_VRMLdata(model_name, &objectnum)) == NULL ) exit(0); ! printf("Objectfile num = %d\n", objectnum); !
/* test render all the VRML objects */ ! glEnable(GL_TEXTURE_2D); !
for ( i = 0; i < objectnum; i++ ) !" arVrml97Draw( object[i].vrml_id ); !
glDisable(GL_TEXTURE_2D); !
/* initialize lights */ ! init_lights(); !} !
Initializing the AR Application
ARToolKit
Open source – computer vision based AR tracking
ARToolKit in the World
Hundreds of projects Large research community
AR Application Libraries
AR Application
Tracking
Video Cap Graphics
Models UI Events
Camera SDK
Low Level AR Libraries Tracking
ARToolKit, ARToolKitPlus, ARTag, SSTT, etc
Rendering OpenGL, DirectX, OpenGL ES, etc
Model Loading libVRML, lib3DS, etc
Audio, Networking, etc
High Level AR Authoring Software Libraries
OSGART, Studierstube, MXRToolKit
Plugin to existing software mARx, Experient Creator, Unity3D, etc
Stand Alone AMIRE, BuildAR, etc
Next Generation iaTAR (Tangible AR)
OSGART Programming Library www.osgart.org Integration of ARToolKit with a High-Level
Rendering Engine (OpenSceneGraph) OSGART= OpenSceneGraph + ARToolKit
Supporting Geometric + Photometric Registration
osgART:Features
C++ (but also Python, Lua, etc). Multiple Video Input supports:
Direct (Firewire/USB Camera), Files, Network by ARvideo, PtGrey, CVCam, VideoWrapper, etc.
Benefits of Open Scene Graph Rendering Engine, Plug-ins, etc
mARx Plug-in
3D Studio Max Plug-in Can model and view AR content at the same time
BuildAR
http://www.buildar.co.nz/ Stand alone application Visual interface for AR model viewing application Enables non-programmers to build AR scenes
AR Markerless Tracking
OPIRA Library Uses natural features for tracking Fast, robust performance
BuildAR Pro 2
Markerless tracking Video, audio, text objects
Esperient Creator AR Plug-in Esperient Creator – www.esperient.com
Authoring interactive 3D applications
Key features Model loading Scripting Publishing Animation
Plug-in library
Creator AR
ARToolKit Plugin Adding AR interactivity
Advanced Authoring: iaTAR
Immersive AR Authoring – authoring from within AR Using real objects to create AR applications
User Study Pilot User study
AR Workshop 24 subjects (16M/8F) Age: 9-50 IA vs Desktop tool Task: placing objects Observation
- Task completion time - Error count - Users’ Preference ▲ CATOMIR authoring tool
User Study Results
Task completion time - IA : μ=3:53, σ=2.24 - Desktop : μ=5:05, σ=2.97 - IA turned out 25% faster
• t(23)=2.84, p=0.00094
Error counts - IA : 21 (fatal:0) - Desktop : 36 (fatal:21)
Users’ Preference - IA : 42% (10) - Mixed : 33% (8) - Desktop : 25% (6)
Conclusions Need to move beyond low-level AR SDKs
Stand alone applications - BuildAR – simple scene assembly
Plug-in Software - mARx – modeling plug-in - Creator AR – interactive plug-in
High level SDKs - osgART – C++/scripting library
Research opportunities in Immersive AR Authoring
More Information • Mark Billinghurst
• Websites – http://www.hitlabnz.org/ – http://artoolkit.sourceforge.net/ – http://www.osgart.org/ – http://www.buildar.co.nz/