Download - ARE 2011 AR Authoring
![Page 1: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/1.jpg)
AR Authoring Tools
Mark Billinghurst HIT Lab NZ
University of Canterbury
![Page 2: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/2.jpg)
1998 - My First AR Application custom tracking ~6,000+ lines C-code libVRML rendering no interaction 2 months programming
![Page 3: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/3.jpg)
static void init( void ){ !"int i; !"ARParam wparam; !
/* open the video path */ ! if( arVideoOpen( vconf ) < 0 ) exit(0); !
/* find the size of the window */ ! if( arVideoInqSize(&xsize, &ysize) < 0 ) exit(0); ! printf("Image size (x,y) = (%d,%d)\n", xsize, ysize); !
/* set the initial camera parameters */ ! if( arParamLoad(cparam_name, 1, &wparam) < 0 ) exit(0); !
arParamChangeSize( &wparam, xsize, ysize, &cparam ); ! arInitCparam( &cparam ); ! printf("*** Camera Parameter ***\n"); ! arParamDisp( &cparam ); !
/* open the graphics window */ ! argInit( &cparam, 2.0, 0, 0, 0, 0 ); !
/* load in the object data - trained markers and associated bitmap files */ ! if( (object=read_VRMLdata(model_name, &objectnum)) == NULL ) exit(0); ! printf("Objectfile num = %d\n", objectnum); !
/* test render all the VRML objects */ ! glEnable(GL_TEXTURE_2D); !
for ( i = 0; i < objectnum; i++ ) !" arVrml97Draw( object[i].vrml_id ); !
glDisable(GL_TEXTURE_2D); !
/* initialize lights */ ! init_lights(); !} !
Initializing the AR Application
![Page 4: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/4.jpg)
ARToolKit
Open source – computer vision based AR tracking
![Page 5: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/5.jpg)
ARToolKit in the World
Hundreds of projects Large research community
![Page 6: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/6.jpg)
AR Application Libraries
AR Application
Tracking
Video Cap Graphics
Models UI Events
Camera SDK
![Page 7: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/7.jpg)
Low Level AR Libraries Tracking
ARToolKit, ARToolKitPlus, ARTag, SSTT, etc
Rendering OpenGL, DirectX, OpenGL ES, etc
Model Loading libVRML, lib3DS, etc
Audio, Networking, etc
![Page 8: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/8.jpg)
![Page 9: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/9.jpg)
High Level AR Authoring Software Libraries
OSGART, Studierstube, MXRToolKit
Plugin to existing software mARx, Experient Creator, Unity3D, etc
Stand Alone AMIRE, BuildAR, etc
Next Generation iaTAR (Tangible AR)
![Page 10: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/10.jpg)
OSGART Programming Library www.osgart.org Integration of ARToolKit with a High-Level
Rendering Engine (OpenSceneGraph) OSGART= OpenSceneGraph + ARToolKit
Supporting Geometric + Photometric Registration
![Page 11: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/11.jpg)
osgART:Features
C++ (but also Python, Lua, etc). Multiple Video Input supports:
Direct (Firewire/USB Camera), Files, Network by ARvideo, PtGrey, CVCam, VideoWrapper, etc.
Benefits of Open Scene Graph Rendering Engine, Plug-ins, etc
![Page 12: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/12.jpg)
mARx Plug-in
3D Studio Max Plug-in Can model and view AR content at the same time
![Page 13: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/13.jpg)
BuildAR
http://www.buildar.co.nz/ Stand alone application Visual interface for AR model viewing application Enables non-programmers to build AR scenes
![Page 14: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/14.jpg)
AR Markerless Tracking
OPIRA Library Uses natural features for tracking Fast, robust performance
![Page 15: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/15.jpg)
BuildAR Pro 2
Markerless tracking Video, audio, text objects
![Page 16: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/16.jpg)
Esperient Creator AR Plug-in Esperient Creator – www.esperient.com
Authoring interactive 3D applications
Key features Model loading Scripting Publishing Animation
Plug-in library
![Page 17: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/17.jpg)
Creator AR
ARToolKit Plugin Adding AR interactivity
![Page 18: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/18.jpg)
Advanced Authoring: iaTAR
Immersive AR Authoring – authoring from within AR Using real objects to create AR applications
![Page 19: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/19.jpg)
User Study Pilot User study
AR Workshop 24 subjects (16M/8F) Age: 9-50 IA vs Desktop tool Task: placing objects Observation
- Task completion time - Error count - Users’ Preference ▲ CATOMIR authoring tool
![Page 20: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/20.jpg)
User Study Results
Task completion time - IA : μ=3:53, σ=2.24 - Desktop : μ=5:05, σ=2.97 - IA turned out 25% faster
• t(23)=2.84, p=0.00094
Error counts - IA : 21 (fatal:0) - Desktop : 36 (fatal:21)
Users’ Preference - IA : 42% (10) - Mixed : 33% (8) - Desktop : 25% (6)
![Page 21: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/21.jpg)
Conclusions Need to move beyond low-level AR SDKs
Stand alone applications - BuildAR – simple scene assembly
Plug-in Software - mARx – modeling plug-in - Creator AR – interactive plug-in
High level SDKs - osgART – C++/scripting library
Research opportunities in Immersive AR Authoring
![Page 22: ARE 2011 AR Authoring](https://reader036.vdocument.in/reader036/viewer/2022062710/5599afe71a28ab0f2b8b4729/html5/thumbnails/22.jpg)
More Information • Mark Billinghurst
• Websites – http://www.hitlabnz.org/ – http://artoolkit.sourceforge.net/ – http://www.osgart.org/ – http://www.buildar.co.nz/