interaction techniques for 3d modeling on large...

13
Interaction Techniques for 3D Modeling on Large Displays Written By Tovi Grossman, Ravin Balakrishnan, Gordon kurtenbach, George Fitzmaurice, Azam Khan, Bill Buxton Presented By Nate Jackson Thursday, February 19, 2009

Upload: others

Post on 18-Jul-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Interaction Techniques for 3D Modeling on Large Displaysdavid/Classes/ICG/Talks/NJ_ICG_Presentation.pdfIntroduction • Can create smooth curves • Difficult to transfer to electronic

Interaction Techniques for

3D Modeling on Large DisplaysWritten By

Tovi Grossman, Ravin Balakrishnan, Gordon kurtenbach, George Fitzmaurice, Azam Khan, Bill BuxtonPresented ByNate Jackson

Thursday, February 19, 2009

Page 2: Interaction Techniques for 3D Modeling on Large Displaysdavid/Classes/ICG/Talks/NJ_ICG_Presentation.pdfIntroduction • Can create smooth curves • Difficult to transfer to electronic

Overview

• Introduction

• Briefly talk about the first prototype

• Describe the 3D modeling prototype

Thursday, February 19, 2009

Page 3: Interaction Techniques for 3D Modeling on Large Displaysdavid/Classes/ICG/Talks/NJ_ICG_Presentation.pdfIntroduction • Can create smooth curves • Difficult to transfer to electronic

Introduction

• Can create smooth curves

• Difficult to transfer to electronic format

• Put the Tape drawing in digital format

The Automobile industry uses several techniques for creating concept sketches of cars. One technique involves using a large scale upright surface(wall) that preserves a 1-1 scale factor between the sketch and the final physical car. This technique is called tape drawing which is done by putting black photographic tape on to the drawing surface.

Thursday, February 19, 2009

Page 4: Interaction Techniques for 3D Modeling on Large Displaysdavid/Classes/ICG/Talks/NJ_ICG_Presentation.pdfIntroduction • Can create smooth curves • Difficult to transfer to electronic

The First Prototype• 2D digital tape drawing system

• Design to work with large displays

• Created planar 2D drawings

• 2D drawing form the basis of the final 3D model

• Designers want more!!!

Thursday, February 19, 2009

Page 5: Interaction Techniques for 3D Modeling on Large Displaysdavid/Classes/ICG/Talks/NJ_ICG_Presentation.pdfIntroduction • Can create smooth curves • Difficult to transfer to electronic

!" #$%&%&'#(")')&(*

!+," -./0123

!"#$ %&'()&)*+,+%-*$".).$ ,$/"01).2345$67888$ 9%0%+,($ '#-:);+-#<%+1$ ,$ +#")$ 7=>8?78=@$ %&,0)$ A,;B$ '#-:);+)9$ -*+-$ ,$ ;-((,'.%A()>?CD+$.;#))*E$F1)$.%G)$-D$+1)$.;#))*$,*9$'#-:);+-#$)*."#).$+1,+$+1).H.+)&$ %.$ '-#+,A()I$ <1%;1$ %.$ %&'-#+,*+$ 0%J)*$ +1,+$ <)$ %*+)*9$ +-9)&-*.+#,+)$+1)$.H.+)&$,+$9%DD)#)*+$,"+-$9).%0*$.+"9%-.E$F1)$>?CD+.;#))*$#)'#).)*+.$+1)$&%*%&"&$.%G)$D-#$(,#0)$9%.'(,H.$".)9$%*$+1),"+-$ %*9".+#HI$ ,*9$ %.$ ."DD%;%)*+$ D-#$ ".$ +-$ %&'()&)*+$ %*+)#,;+%-*+);1*%K").$ <1-.)$ .;,()$ -D$ %*+)#,;+%-*$ %.$ J,.+(H$ 9%DD)#)*+$ D#-&9).B+-'$ .;,()$ %*+)#,;+%-*E$ L%&%(,#$ 9%.'(,H$ .%G).$ 1,J)$ ,(.-$ A))*".)9$%*$#).),#;1$.H.+)&.$.";1$,.$M#")0)#N.$4%9)-'(,;)$O>PE

!+!" 45067"-89.:8/

L%*;)$ -"#$ .H.+)&$ 1),J%(H$ "+%(%G).$ +<-Q1,*9)9$ %*+)#,;+%-*+);1*%K").I$<)$*))9$+-$A)$,A()$+-$.)*.)$+1)$'-.%+%-*$-D$A-+1$1,*9.-*$ +1)$9%.'(,H$ ."#D,;)E$ F1)#)$ ,#)$ '-+)*+%,((H$ .)J)#,($ .-("+%-*.$ +-+1%.$ .)*.%*0$ '#-A()&E$ F1).)$ %*;("9)$ -'+%;,($ +#,;B%*0$ +);1*%K").O@PI$ +1)$ ".)$ -D$ ,$ +#,*.',#)*+$ 9%0%+%G%*0$ +,A()+$ -*$ +1)$ 9%.'(,H."#D,;)I$ ,*9$ )();+#-&,0*)+%;2"(+#,.-*%;$ +#,;B)#.E$ !"#$ '#-+-+H')".).$ ,*$ R.;)*.%-*$ S(-;BQ-DQT%#9.$ .%?$ 9)0#))Q-DQD#))9-&$ +#,;B)#1)(9$ %*$ ),;1$ 1,*9E$ U,;1$ +#,;B)#$ %.$ ,"0&)*+)9$ <%+1$ ,$ .%*0()&-&)*+,#H$ .<%+;1E$ V)$ -*(H$ ".)$ +<-$ +#,*.(,+%-*,($ 9)0#)).Q-DQD#))9-&$ W"'29-<*$ ,*9$ ()D2#%01+X$ -D$ +1)$ +#,;B)#$ %*$ -"#$ '#-+-+H')EF<-$;"#.-#.$-*$+1)$.;#))*$%*9%;,+)$),;1$+#,;B)#N.$'-.%+%-*E

!+;" 4578<2:7.=5"&8:>5.?68/

!"#"$% !&%'()*+,-.+/()%012)3*%452+/21167)+38,2+39%/)%2%#&%:(1-;3

F1)$ A,.%;$ %*+)#,;+%-*$ &-9)($ -D$ -"#$ .H.+)&$ %.$ +-$ ,((-<$ D-#$ +1);#),+%-*$-D$YZ$&-9)(.$AH$9#,<%*0$,''#-'#%,+)$=Z$'#-D%()$;"#J).EL+,+".QK"-$ &-9)(%*0$ ,''(%;,+%-*.$ '#-J%9)$ +1%.$ D"*;+%-*,(%+H$ AH1,J%*0$.)',#,+)$=Z$-#+1-0#,'1%;$J%)<.$-D$+1)$YZ$&-9)($-*$<1%;1+1)$'#-D%()$;"#J).$,#)$9#,<*E$/-<)J)#I$A);,".)$+1).)$-#+1-0#,'1%;J%)<.$,#)$+H'%;,((H$.1-<*$%*$+1)%#$-<*$<%*9-<.$.)',#,+)$D#-&$+1)"*9)#(H%*0$ YZ$ &-9)(I$ %+$ %.$ *-+$ ),.H$ D-#$ ,$ ".)#$ +-$ .))$ +1);-##).'-*9)*;)$ A)+<))*$ +1).)$ 9%DD)#)*+$ J%)<.E$ V1%()$ ".)#."(+%&,+)(H$ ,''),#$ +-$ A)$ ,A()$ +-$ %*+)0#,+)$ +1).)$ J%)<.I$ +1%.$ %.,;1%)J)9$ -*(H$ ,D+)#$ &";1$ )?')#%)*;)$ <%+1$ .";1$ J%)<.E$ [*$ -"#.H.+)&I$ %*$-#9)#$ +-$&,%*+,%*$ ;-##).'-*9)*;)$<%+1$ +1)$"*9)#(H%*0YZ$&-9)($A)%*0$;#),+)9$,*9$ +-$),.)$ +1)$ (),#*%*0$'#-;)..I$ +1)$=Z'#-D%()$ ;"#J).$ ,#)$ ;#),+)9$ -*$ ;-*.+#";+%-*$ '(,*).$ 9%.'(,H)9$ ,..%9).$ -D$ ,$ ;"A-%9$ <1%;1$ ,;+.$ ,.$ ,$ A-"*9%*0$ J-("&)$ D-#$ +1)$ YZ&-9)($<%+1%*$ %+$ WS%0"#)$=XE$U,#(%)#$<-#B$ AH$ L,;1.$ O77P$ .%&%(,#(H".)$ ;-*.+#";+%-*$ '(,*).$ %*$ ,$ YZ$ <-#B%*0$ J-("&)$ +-$ ;#),+)$ YZ&-9)(.E$ !"#$ '#-+-+H')$ ,((-<.$ D-#$ +1#))$ '#%&,#H$ ;-*.+#";+%-*'(,*).I$#)'#).)*+%*0$+1)$+-'I$.%9)I$,*9$D#-*+$J%)<.$-D$+1)$YZ$&-9)(A)%*0$;#),+)9$WS%0"#)$=XE

!"#$%&'()'(*'+,-./%$0/",-'123-&.'"-'4*'1&%.1&0/"5&'5"&6)'78&'2&9/'":3#&'.8,6.'/8&'9%,-/;<30='123-&>'/8&':"??2&'":3#&'.8,6.'/8&

."?&'123-&>'3-?'/8&'%"#8/'":3#&'.8,6.'/8&'/,1;<,//,:'@8,%"A,-/32B'123-&)''C2/8,$#8'-,/'5"."<2&'"-'/8".'1"0/$%&>'/8&'"-/&%.&0/",-'1,"-/.<&/6&&-'/8&'123-&'3-?'/8&'4*':,?&2'3%&'8"#82"#8/&?'3.'&308'123-&':,5&.'/8%,$#8'/8&'0$<,"?'.130&)

!"#$%&'D)'4*':,?&2"-#',-'3'23%#&'?".123E)

The Display And Input Devices

• Hughes/JVC G1000 digital projector

• Size is 8x6FT

• Input depends on two hands

• The Hand held tracker has a button

• Tracker can monitor 6 degrees of freedom

• System uses 2 degrees of freedom(up/down and left/right)

• Support separate perspective and orthographic views

Thursday, February 19, 2009

Page 6: Interaction Techniques for 3D Modeling on Large Displaysdavid/Classes/ICG/Talks/NJ_ICG_Presentation.pdfIntroduction • Can create smooth curves • Difficult to transfer to electronic

!" #$%&%&'#(")')&(*

!+," -./0123

!"#$ %&'()&)*+,+%-*$".).$ ,$/"01).2345$67888$ 9%0%+,($ '#-:);+-#<%+1$ ,$ +#")$ 7=>8?78=@$ %&,0)$ A,;B$ '#-:);+)9$ -*+-$ ,$ ;-((,'.%A()>?CD+$.;#))*E$F1)$.%G)$-D$+1)$.;#))*$,*9$'#-:);+-#$)*."#).$+1,+$+1).H.+)&$ %.$ '-#+,A()I$ <1%;1$ %.$ %&'-#+,*+$ 0%J)*$ +1,+$ <)$ %*+)*9$ +-9)&-*.+#,+)$+1)$.H.+)&$,+$9%DD)#)*+$,"+-$9).%0*$.+"9%-.E$F1)$>?CD+.;#))*$#)'#).)*+.$+1)$&%*%&"&$.%G)$D-#$(,#0)$9%.'(,H.$".)9$%*$+1),"+-$ %*9".+#HI$ ,*9$ %.$ ."DD%;%)*+$ D-#$ ".$ +-$ %&'()&)*+$ %*+)#,;+%-*+);1*%K").$ <1-.)$ .;,()$ -D$ %*+)#,;+%-*$ %.$ J,.+(H$ 9%DD)#)*+$ D#-&9).B+-'$ .;,()$ %*+)#,;+%-*E$ L%&%(,#$ 9%.'(,H$ .%G).$ 1,J)$ ,(.-$ A))*".)9$%*$#).),#;1$.H.+)&.$.";1$,.$M#")0)#N.$4%9)-'(,;)$O>PE

!+!" 45067"-89.:8/

L%*;)$ -"#$ .H.+)&$ 1),J%(H$ "+%(%G).$ +<-Q1,*9)9$ %*+)#,;+%-*+);1*%K").I$<)$*))9$+-$A)$,A()$+-$.)*.)$+1)$'-.%+%-*$-D$A-+1$1,*9.-*$ +1)$9%.'(,H$ ."#D,;)E$ F1)#)$ ,#)$ '-+)*+%,((H$ .)J)#,($ .-("+%-*.$ +-+1%.$ .)*.%*0$ '#-A()&E$ F1).)$ %*;("9)$ -'+%;,($ +#,;B%*0$ +);1*%K").O@PI$ +1)$ ".)$ -D$ ,$ +#,*.',#)*+$ 9%0%+%G%*0$ +,A()+$ -*$ +1)$ 9%.'(,H."#D,;)I$ ,*9$ )();+#-&,0*)+%;2"(+#,.-*%;$ +#,;B)#.E$ !"#$ '#-+-+H')".).$ ,*$ R.;)*.%-*$ S(-;BQ-DQT%#9.$ .%?$ 9)0#))Q-DQD#))9-&$ +#,;B)#1)(9$ %*$ ),;1$ 1,*9E$ U,;1$ +#,;B)#$ %.$ ,"0&)*+)9$ <%+1$ ,$ .%*0()&-&)*+,#H$ .<%+;1E$ V)$ -*(H$ ".)$ +<-$ +#,*.(,+%-*,($ 9)0#)).Q-DQD#))9-&$ W"'29-<*$ ,*9$ ()D2#%01+X$ -D$ +1)$ +#,;B)#$ %*$ -"#$ '#-+-+H')EF<-$;"#.-#.$-*$+1)$.;#))*$%*9%;,+)$),;1$+#,;B)#N.$'-.%+%-*E

!+;" 4578<2:7.=5"&8:>5.?68/

!"#"$% !&%'()*+,-.+/()%012)3*%452+/21167)+38,2+39%/)%2%#&%:(1-;3

F1)$ A,.%;$ %*+)#,;+%-*$ &-9)($ -D$ -"#$ .H.+)&$ %.$ +-$ ,((-<$ D-#$ +1);#),+%-*$-D$YZ$&-9)(.$AH$9#,<%*0$,''#-'#%,+)$=Z$'#-D%()$;"#J).EL+,+".QK"-$ &-9)(%*0$ ,''(%;,+%-*.$ '#-J%9)$ +1%.$ D"*;+%-*,(%+H$ AH1,J%*0$.)',#,+)$=Z$-#+1-0#,'1%;$J%)<.$-D$+1)$YZ$&-9)($-*$<1%;1+1)$'#-D%()$;"#J).$,#)$9#,<*E$/-<)J)#I$A);,".)$+1).)$-#+1-0#,'1%;J%)<.$,#)$+H'%;,((H$.1-<*$%*$+1)%#$-<*$<%*9-<.$.)',#,+)$D#-&$+1)"*9)#(H%*0$ YZ$ &-9)(I$ %+$ %.$ *-+$ ),.H$ D-#$ ,$ ".)#$ +-$ .))$ +1);-##).'-*9)*;)$ A)+<))*$ +1).)$ 9%DD)#)*+$ J%)<.E$ V1%()$ ".)#."(+%&,+)(H$ ,''),#$ +-$ A)$ ,A()$ +-$ %*+)0#,+)$ +1).)$ J%)<.I$ +1%.$ %.,;1%)J)9$ -*(H$ ,D+)#$ &";1$ )?')#%)*;)$ <%+1$ .";1$ J%)<.E$ [*$ -"#.H.+)&I$ %*$-#9)#$ +-$&,%*+,%*$ ;-##).'-*9)*;)$<%+1$ +1)$"*9)#(H%*0YZ$&-9)($A)%*0$;#),+)9$,*9$ +-$),.)$ +1)$ (),#*%*0$'#-;)..I$ +1)$=Z'#-D%()$ ;"#J).$ ,#)$ ;#),+)9$ -*$ ;-*.+#";+%-*$ '(,*).$ 9%.'(,H)9$ ,..%9).$ -D$ ,$ ;"A-%9$ <1%;1$ ,;+.$ ,.$ ,$ A-"*9%*0$ J-("&)$ D-#$ +1)$ YZ&-9)($<%+1%*$ %+$ WS%0"#)$=XE$U,#(%)#$<-#B$ AH$ L,;1.$ O77P$ .%&%(,#(H".)$ ;-*.+#";+%-*$ '(,*).$ %*$ ,$ YZ$ <-#B%*0$ J-("&)$ +-$ ;#),+)$ YZ&-9)(.E$ !"#$ '#-+-+H')$ ,((-<.$ D-#$ +1#))$ '#%&,#H$ ;-*.+#";+%-*'(,*).I$#)'#).)*+%*0$+1)$+-'I$.%9)I$,*9$D#-*+$J%)<.$-D$+1)$YZ$&-9)(A)%*0$;#),+)9$WS%0"#)$=XE

!"#$%&'()'(*'+,-./%$0/",-'123-&.'"-'4*'1&%.1&0/"5&'5"&6)'78&'2&9/'":3#&'.8,6.'/8&'9%,-/;<30='123-&>'/8&':"??2&'":3#&'.8,6.'/8&

."?&'123-&>'3-?'/8&'%"#8/'":3#&'.8,6.'/8&'/,1;<,//,:'@8,%"A,-/32B'123-&)''C2/8,$#8'-,/'5"."<2&'"-'/8".'1"0/$%&>'/8&'"-/&%.&0/",-'1,"-/.<&/6&&-'/8&'123-&'3-?'/8&'4*':,?&2'3%&'8"#82"#8/&?'3.'&308'123-&':,5&.'/8%,$#8'/8&'0$<,"?'.130&)

!"#$%&'D)'4*':,?&2"-#',-'3'23%#&'?".123E)

The basic interaction model of this system is to allow the creation of 3D models by drawing 2D profile curves. The 2D profile curves are created on construction planes displayed as sides of a cuboids which acts as a bounding volume for the 3D model.

Interaction Model

Thursday, February 19, 2009

Page 7: Interaction Techniques for 3D Modeling on Large Displaysdavid/Classes/ICG/Talks/NJ_ICG_Presentation.pdfIntroduction • Can create smooth curves • Difficult to transfer to electronic

Interaction Techniques• Can switch planes by clicking on the colored tab

• A new plane move to its last position while the old plane moves away

• Construction planes may allow for symmetric reflections

• Construction planes are semi-transparent

• Intersection points are displayed on the active construction plane

Thursday, February 19, 2009

Page 8: Interaction Techniques for 3D Modeling on Large Displaysdavid/Classes/ICG/Talks/NJ_ICG_Presentation.pdfIntroduction • Can create smooth curves • Difficult to transfer to electronic

!"#$%&#'() *+$"++') %,'-$./%$#,') 012'+-) #-) 2%&#+3+4) *5) %1#%6#'(7/-#'() $&+)4,8#'2'$)&2'4) $.2%6+.9-)%/.-,.7),') $&+)%,1,/.+4) $2*),'$&+) %,.'+.) ,:) $&+) 012'+;) <&+') -"#$%&#'() *+$"++') 012'+-7) $&+0.+3#,/-)012'+)8,3+-)2"25) $,) $&+) +4(+),:) $&+) %/*,#47)"&#1+) $&+'+"15) 2%$#3+) %,'-$./%$#,') 012'+)8,3+-) $,) $&+) 0,-#$#,') #$) "2-) #'"&+') #$)"2-) 12-$) 2%$#3+;) =&#-) .+4/%+-) %1/$$+.) #') $&+) %/*,#4) -#'%+,'15)$&+)2%$#3+)012'+)#-)3#-#*1+)"&#1+)$&+),$&+.-)2.+)0/-&+4),::)$,$&+) 0+.#0&+.5;) =&#-) >%,'-$./%$#,') 012'+) 8+8,.5?) :+2$/.+) 211,"-$&+) /-+.) $,) -"#$%&) *+$"++') 4#::+.+'$) %,'-$./%$#,') 012'+-) "&#1+.+$2#'#'()$&+)0.+%#-+)1,%2$#,'),:)+2%&)012'+):,.)12$+.).+%211;

!"#"!$ %&''()*+,$-(./(,)+012

@+0+'4#'(),')$&+)$50+),:)A@)8,4+1)*+#'()%.+2$+47),'+),.)8,.+),:$&+) %,'-$./%$#,') 012'+-) 825) 211,") :,.) 2/$,82$#%) -588+$.#%.+:1+%$#,'-)2*,/$) $&+)8+4#21)2B#-;)C,.)+B2801+7)"&+')8,4+1#'()2%2.7) $&+) $,0D*,$$,8) &,.#E,'$21) %,'-$./%$#,') 012'+) 211,"-) :,.-588+$.5)2*,/$)$&+)8+4#21)2B#-)-,)$&2$)"&2$+3+.)#-)4.2"'),')$&+1+:$)-#4+)#-)8#..,.+4),'$,)$&+).#(&$;

!"#"#$ 31)(*2(,)+01$40+1)2$01$5012)*6,)+01$4/71(

=&+)%,'-$./%$#,')012'+-)#'),/.)-5-$+8)2.+)-+8#F$.2'-02.+'$)-,)$&2$$&+)A@)8,4+1)#-)',$),*-%/.+4)2-)$&+)012'+)#-)8,3+4)*2%6)2'4):,.$&$&.,/(&) $&+) %/*,#4;) =,) &#(&1#(&$) $&+) #'$+.-+%$#,') ,:) $&+) 2%$#3+%,'-$./%$#,') 012'+) "#$&) $&+) A@) 8,4+1) 2'4) $,) .+#':,.%+) $&+%,'-$./%$#,')012'+9-)0,-#$#,'7)"+)4#-0125) $&+).+1+32'$) #'$+.-+%$#,'0,#'$-),') $&+)012'+;)=&+-+)0,#'$-)2.+)45'28#%2115)/042$+4)2-) $&+012'+)#-)8,3+4;

!"#"8$ 91:71,(;$<*):0=*7>:+,$?+(@2

<&#1+) "+) %2') %.+2$+) G@) 0.,:#1+) %/.3+-) ,') $&+) .+1+32'$%,'-$./%$#,') 012'+-) "&#1+) #') 2) A@) 0+.-0+%$#3+) 3#+"7) #$) #-) ,:$+'8,.+) 2%%/.2$+) $,) 4.2") $&+-+) %/.3+-) #') 2') ,.$&,(.20&#%) 3#+";) H'-$2$/-FI/,)8,4+1#'()2001#%2$#,'-7),.$&,(.20&#%)3#+"-)2.+)$./15)G@3#+"-),:) $&+)A@)-%+'+;)J11)%/.3+-) #') $&+)G@)3#+")&23+) $&+)-28+>"+#(&$?) 2'4) 2.+) 3#-/2115) ',$) 4#-28*#(/2$+4) .+(2.41+--) ,:) $&+#.4#-$2'%+) 2"25) :.,8) $&+) %28+.2;) =,) %.+2$+) 2'4) 0,-#$#,') 2) '+"%/.3+) #')A@)-02%+) $&+)/-+.) $50#%2115)&2-) $,)",.6) #') $",),.)8,.+,.$&,(.20&#%) 3#+"-;) =&#-) #-) $&+) .+2-,') :,.) $&+) %,88,'%,':#(/.2$#,') ,:) &23#'() $,07) -#4+7) 2'4) :.,'$) ,.$&,(.20&#%) 3#+"--#8/1$2'+,/-15) 3#-#*1+) #') 8,-$) 2001#%2$#,'-;) <&#1+) $&#-%,':#(/.2$#,')#-)24+I/2$+7)#$).+-/1$-)#')4#3#4#'()$&+)/-+.9-)2$$+'$#,'*+$"++') -+3+.21) 3#+"-;) =&#-) 0.,*1+8)825) *+) +B2%+.*2$+4) "&+'",.6#'() ,') 2) 12.(+) -%.++') -#'%+) $&+) /-+.) %2'',$) +2-#15) 3#+") $&++'$#.+)4#-0125)"&+')/0)%1,-+;

=,).+4/%+)$&#-)4#3#4+4)2$$+'$#,')0.,*1+8)2'4)$,)211,"):,.)2)-#'(1+,.$&,(.20&#%)3#+")$,)*+)/-2*1+)"&+')4#-0125+4):/11)-#E+)2%.,--)$&++'$#.+)4#-01257)"+)4+3+1,0+4)-,8+)+'&2'%+8+'$-)$,)$&+)$.24#$#,'21,.$&,(.20&#%) 3#+";) C#.-$7) $&+) 0,-#$#,') ,:) $&+) 200.,0.#2$+%,'-$./%$#,')012'+)"#$&#')$&+)%/*,#4)4+$+.8#'+-)$&+)4+0$&)0,-#$#,'2$) "&#%&) '+") %/.3+-) 2.+) 4.2"';) <&+') $&+) 8,4+1) #-) 3#+"+4,.$&,(.20&#%21157)"+) 4#-0125) $&+) %/.3+-) #') $&2$) 3#+") 2$) 4#::+.+'$

(.+5) 1+3+1-) 4+0+'4#'() ,') $&+#.) 4#-$2'%+) :.,8) $&+) %/..+'$%,'-$./%$#,')012'+9-)0,-#$#,')KC#(/.+)AL;)=&#-)+--+'$#2115)0.,3#4+-2',$&+.) 4#8+'-#,') ,:) #':,.82$#,') "&+') #') ,.$&,(.20&#%) 3#+"721*+#$) 2$) 2) %,2.-+) (.2'/12.#$57) $&2$) #-) ',$) $50#%2115) 232#12*1+) #'-$2$/-FI/,)2001#%2$#,'-;)C/.$&+.8,.+7)"+)%2')8,3+)$&+)0,-#$#,'),:$&+)%,'-$./%$#,')012'+)"&#1+)-$#11)#'),.$&,(.20&#%)3#+")*5)%1#%6#'(,')2'5),:) $&+)%/.3+-) K2$)"&#%&)0,#'$) $&+) -+1+%$+4)%/.3+)*+%,8+-*12%6) 2'4) $&+) (.+5) 1+3+1-) ,') $&+) ,$&+.) %/.3+-) 2.+) 24M/-$+42%%,.4#'(15L;) J1$+.'2$#3+157) 2) -1#4+.) "#4(+$) 2$) $&+) *,$$,8) ,:) $&+-%.++')KC#(/.+)AL)211,"-):,.)0,-#$#,'#'(),:)$&+)%,'-$./%$#,')012'+;=&#-)-1#4+.7)"&#%&)#-),0+.2$+4)*5)$&+)4,8#'2'$)&2'47)%2')",.6)#'+#$&+.)%,'$#'/,/-)8,4+)$&.,/(&)$&+)+'$#.+)-02%+),:)$&+)%/*,#47),.#') 4#-%.+$+) 8,4+) "&+.+) #$) -'20-) *+$"++') $&+) 0,-#$#,'-) ,:) $&++B#-$#'() %/.3+-;) N') $&+) -1#4+.7) $&+-+) %/.3+) 0,-#$#,'-) 2.+.+0.+-+'$+4)*5)$#%6)82.6-;)=&#-)4#-%.+$+)-1#4#'()8,4+)0.,3#4+-)2'21$+.'2$#3+)"25)$,)+2-#15)8,3+)*+$"++')%/.3+-):,.)+4#$#'(;

!+%,'4157) 2-) #') $&+) 0+.-0+%$#3+) 3#+"7) "+) -&,") $&+) #'$+.-+%$#,'0,#'$-)*+$"++')$&+)%/..+'$)%,'-$./%$#,')012'+)"#$&)$&+)A@)8,4+1;=&+-+)#'$+.-+%$#,')0,#'$-)2.+)45'28#%2115)/042$+4)#:)"+)8,3+)$&+0,-#$#,') ,:) $&+) %,'-$./%$#,')012'+;)C/.$&+.7) $&+) 0,#'$-) 2.+) %,1,/.%,4+4) $,) #'4#%2$+) $&+) ,.#+'$2$#,') ,:) $&+) %/.3+-) $&2$) 2.+) *+#'(#'$+.-+%$+4;) =&#-) #-) /-+:/1) "&+') %.+2$#'() '+") %/.3+-) $&2$) 2.+) $,#'$+.-+%$) $",) ,.) 8,.+) +B#-$#'() %/.3+-) "&#%&) 825) *+) 1,%2$+4) #'4#::+.+'$)012'+-;)<+)&23+) 21-,) :,/'4) $&+-+) #'$+.-+%$#,')0,#'$-) $,*+) /-+:/1) #') ,.$&,(.20&#%) 3#+") 2-) $&+5) 2%$) 2-) 0,.$&,1+-) #'$,) $&+0+.-0+%$#3+)A@)8,4+17)0.,3#4#'()2)%,/01#'()*+$"++') $&+)G@)2'4A@)3#+"-)+3+')#:),'15),'+)3#+")#-)3#-#*1+)2$)2)$#8+;

<+)',$+) $&2$) $&+)2432'$2(+-),:),/.)+'&2'%+4),.$&,(.20&#%)3#+"-2.+)',$).+-$.#%$+4)$,)12.(+)-%21+)4#-0125-7)*/$)",/14)1#6+15)*+)/-+:/1,')-$2'42.4)4+-6$,0)-%21+)4#-0125-)2-)"+11;

!"#"A$ B1+'7)(;$C*712+)+012$D()@((1$?+(@2

=&+) $",) +'&2'%+8+'$-) 4+-%.#*+4) #') $&+) 0.+3#,/-) -/*-+%$#,') 2.++B2801+-) ,:) ,/.) +::,.$-) $,) 0.,3#4+) 2) -$.,'() %,''+%$#,') *+$"++'G@) 2'4) A@) 3#+"-) #') ,/.) -5-$+8;) H') %,8*#'2$#,'7) $&+-+) $",+'&2'%+8+'$-)211,"):,.)$&+)/-+.)$,)",.6)#')2)-#'(1+),.$&,(.20&#%3#+")"&+')'++4+47)"#$&,/$).+I/#.#'()$&+),$&+.)3#+"-)$,)*+)0.+-+'$#'),.4+.)$,)82#'$2#')%,'$+B$)"#$&)$&+)A@)8,4+1;) )O,"+3+.7)/-+.-"#11) ,:$+') -$#11) '++4) $,) (,) *2%6) $,) $&+) A@) 3#+") $,) +321/2$+) $&+8,4+1)#')#$-)+'$#.+$5;)=,)3#-/2115)#'4#%2$+)$&+).+12$#,'-&#0)*+$"++'$&+)G@)2'4)A@)3#+"-)2-)"+)$.2'-#$#,')*+$"++')$&+87)"+)-8,,$&152'#82$+) $&+) $.2'-#$#,') *+$"++') ,.$&,(.20&#%) 2'4) 0+.-0+%$#3+3#+"-;) KC#(/.+)PL;)<+)',$),'15)2'#82$+) $&+)"#'4,"),/$1#'+)2-) #-%,88,'15) 4,'+) #') 8,4+.') G@) "#'4,") 82'2(+.-7) */$) "+) 21-,2'#82$+) $&+) $.2'-#$#,') ,:) $&+) /'4+.15#'() 42$2;) =&#-) 0.+3+'$-) $&+,:$+') M2..#'() #88+4#2$+) -"#$%&) *+$"++') 3#+"-) $&2$) #-) 0.+-+'$) #'-$2$/-FI/,)8,4+1#'()-,:$"2.+;)=&+)-8,,$&)$.2'-#$#,')0.,3#4+-)5+$2',$&+.) %/+) :,.) $&+) /-+.) $,) 82#'$2#') $&+) 200.,0.#2$+) -02$#21%,..+-0,'4+'%+)*+$"++')$&+)$",)3#+"-;

!"#$%&'()'*+,-+.&/'0%1,0#%-2,".'3"&45)'6,&'.$%3&5'-%&'/%-4+'"+'/"77&%&+1'#%&8'9&3&95'/&2&+/"+#'0+',04'7-%'1,&8'-%&'"+'/&21,

7%0:'1,&'205"1"0+'07'1,&'.0+51%$.1"0+'29-+&)';5&%5'.-+'+-3"#-1&'<&14&&+'.$%3&5'&"1,&%'<8'5&9&.1"+#'1,&'.$%3&5'1,&:5&93&5'0%$5"+#'1,&'59"/&%'<&904)'=0"+15'07'"+1&%5&.1"0+'<&14&&+'1,&'.$%3&5'-+/'01,&%'.0+51%$.1"0+'29-+&5'-%&'"+/".-1&/'-5'4&99'>?01&'1,-11,&5&'20"+15',-3&'<&&+'&+9-%#&/'"+'1,"5'":-#&'70%'.9-%"18@)

• Problem – the user has work in multiple orthographic views• Solution -- Curves are displayed at different gray levels depending on their distance from the current construction planes position.

Orthographic View

Thursday, February 19, 2009

Page 9: Interaction Techniques for 3D Modeling on Large Displaysdavid/Classes/ICG/Talks/NJ_ICG_Presentation.pdfIntroduction • Can create smooth curves • Difficult to transfer to electronic

Marking Menus

• Menus are use to activate the transition between 2D and 3D views

• Menus appear at the location of the dominant hand

• Menus are activated by a button press on the dominant hand tracker

Thursday, February 19, 2009

Page 10: Interaction Techniques for 3D Modeling on Large Displaysdavid/Classes/ICG/Talks/NJ_ICG_Presentation.pdfIntroduction • Can create smooth curves • Difficult to transfer to electronic

!"#!$%&' (!#)!!$' #*!' #)+' ,-.&+.&/' 0!' .!1!.' #+' #*2&' 3&' #*!4-$13&#!$!%' #35!' &!67!$#8/' 9+:2$6' #*!' #)+' *3$%&' 3.+-$%!11!,#2:!;<'7+:!&'#*!'-$13&#!$!%'#35!'&!67!$#'+$'#*!'&,.!!$/'=*!%2&#3$,!' (!#)!!$' #*!' #)+' *3$%&' %!#!.72$!' #*!' ;!$6#*' +1' #*2&-$13&#!$!%'#35!'&!67!$#/

>$' +.%!.' #+' 13&#!$' 5+.#2+$&' +1' #*!' %262#3;' #35!?' #*!' $+$%+72$3$#*3$%'5.!&&!&'#*!'(-##+$'+$'2#&'#.3,@!.'A5-##2$6'2#'2$'413&#!$'7+%!8B/=*2&' ,+..!&5+$%&' #+' #*!' 3,#' +1' 5.!&&2$6' %+)$' +$' #*!' #35!' 2$' #*!5*<&2,3;':!.&2+$/'C!;!3&2$6'#*!'$+$%+72$3$#'*3$%'(-##+$',-#&'#*!#35!',-..!$#;<'(!2$6';32%'3#'#*!'5+&2#2+$'+1'#*!'$+$%+72$3$#'*3$%,-.&+./

>$' 3'73$$!.' &272;3.' #+'%.3)2$6')2#*'5*<&2,3;' #35!?' &#.326*#' ;2$!&3.!' ,.!3#!%' (<' *+;%2$6' #*!' %+72$3$#' *3$%' &#!3%<' )*2;!' #*!$+$%+72$3$#' *3$%?')2#*' #.3,@!.' (-##+$' 5.!&&!%?' &;2%!&' 3;+$6' #*!-$13&#!$!%'#35!'&!67!$#?'13&#!$2$6'#*!'#35!'3&'2#'7+:!&/'0*2;!'2$#*!' 5*<&2,3;' :!.&2+$' #*!' #35!' 2#&!;1' &!.:!&' 3&' 3' ,+$&#.32$#' 1+.,.!3#2$6'&#.326*#' ;2$!&?'+-.'%262#3;':!.&2+$'!$1+.,!&' #*2&',+$&#.32$#2$' &+1#)3.!' (<' .!&#.2,#2$6' #*!' $+$%+72$3$#' *3$%' ,-.&+.' #+'7+:!+$;<' 3;+$6' #*!' -$13&#!$!%' %262#3;' #35!' &!67!$#?' #+)3.%&' #*!%+72$3$#' *3$%' ,-.&+./' =*2&' !$&-.!&' #*3#' +$,!' %262#3;;<' 13&#!$!%?#*!' %262#3;' #35!' ,3$$+#' (!' -$13&#!$!%' 2$3%:!.#!$#;<' A)2#*+-#2$:+@2$6' 3$' !%2#' +5!.3#2+$' #+' (!'%!&,.2(!%' ;3#!.B/' >1' #*!' 3(&+;-#!$+$%+72$3$#' *3$%' #.3,@!.' 5+&2#2+$' &#.3<&' 1.+7' #*!' -$13&#!$!%%262#3;'#35!'&!67!$#?'2#&',-.&+.'5+&2#2+$'2&'%!#!.72$!%'(<'3'&275;!5.+D!,#2+$' +1' #.3,@!.' 5+&2#2+$' #+' #*!' $!3.!&#' 5+2$#' +$' #*!-$13&#!$!%'#35!'&!67!$#/

E.!3#2$6' ,-.:!&' 2$' +-.' %262#3;' &<&#!7' 3;&+' 7272,&' #*!' 5*<&2,3;!F-2:3;!$#/'G$;2@!' #*!',.!3#2+$'+1'&#.326*#' ;2$!&?'(+#*'*3$%&'7-&#7+:!'3#'#*!'&37!'#27!/'=*-&?'#*!'-$13&#!$!%'#35!'&!67!$#'7+:!&)*2;!' #*!' $+$%+72$3$#' *3$%' 13&#!$&' #*!' #35!/' =*!' ;!$6#*' +1' #*!-$13&#!$!%' #35!' &!67!$#' !11!,#2:!;<' &!.:!&' #+' .!6-;3#!' #*!&7++#*$!&&' +1' #*!' .!&-;#2$6' ,-.:!/' H2$,!' #*!' $+$%+72$3$#' *3$%,-.&+.'2&',+$&#.32$!%'#+'7+:!'3;+$6'#*!'-$13&#!$!%'#35!'&!67!$#?3';+$6!.'&!67!$#'!11!,#2:!;<'.!%-,!&'#*!'.3$6!'+1'7+:!7!$#'+1'#*!13&#!$2$6'5+2$#' ,+$#.+;;!%'(<' #*!'$+$%+72$3$#' *3$%?' .!&-;#2$6' 2$&7++#*!.',-.:!&' A2/!/?' 3',-.:!')*+&!' #3$6!$#',*3$6!&'6.3%-3;;<B/I' &*+.#' A355.+3,*2$6' J!.+B' -$13&#!$!%' #35!' &!67!$#' ;!$6#*.!%-,!&' #*!' #!,*$2F-!' #+' #*!' !F-2:3;!$#' +1' 1.!!K*3$%' &@!#,*2$6)2#*' #*!' $+$K%+72$3$#' *3$%/' I$' 2$#!.!&#2$6' 3&5!,#' +1' #*2&#!,*$2F-!' 2&' #*3#' 2#' !11!,#2:!;<' -&!&' ,+$&#.32$!%' #)+K*3$%!%6!&#-.!&' #+' ,+$#.+;' #*!' &7++#*$!&&' +1' ,-.:!&/' >$' ,+$#.3&#?' 7+&#

,+75-#!.' #++;&' 1+.' 6!$!.3#2$6' ,-.:!&' .!;<' +$' 73#*!73#2,3;355.+3,*!&'1+.'&5!,21<2$6'&7++#*$!&&/

L.+7' #*!' 5!.&5!,#2:!' +1' #)+K*3$%!%' 2$#!.3,#2+$?' +-.' %262#3;' #35!;3<2$6' #!,*$2F-!&' 3.!' 2$#!.!&#2$6' 2$' #*3#' #*!<' 3;;+)' 1+.' #*!6!$!.3#2+$' +1' &#.326*#' ;2$!&' 3$%' ,-.:!&' )2#*+-#' 3' ,+$:!$#2+$3;7+%!' &)2#,*/' =*!' &275;!' 3,#' +1' 7+:2$6' +.' $+#' 7+:2$6' #*!%+72$3$#'*3$%')*2;!'#*!'%262#3;'#35!'2&'(!2$6'13&#!$!%'%!#!.72$!&)*!#*!.'3'&#.326*#';2$!'+.',-.:!'2&'6!$!.3#!%/'=*-&?')*3#')!'*3:!2&'3'&275;!',-.:!'!"#$;2$!'%.3)2$6'#!,*$2F-!'2$#!6.3#!%'2$'3'&2$6;!#++;' #*3#' %+!&' $+#' .!F-2.!' #*!' -&!.' #+' -$%!.&#3$%' #*!' -$%!.;<2$66.35*2,3;'.!5.!&!$#3#2+$'+1'#*!',-.:!'3$%' 2#&',+75+$!$#&'A,+$#.+;:!.#2,!&?'!%2#'5+2$#&?'!#,B/

M-.' #35!' %.3)2$6' #!,*$2F-!' 3;&+' &-55+.#&' !%2#2$6' +1' ,-.:!&' 3$%;2$!&?' 2%!$#2,3;' #+' #*3#' %!&,.2(!%' 2$' NOP/'L2.&#?')*2;!' ;3<2$6' %+)$#35!?' #*!' -&!.' ,3$' (3,@K-5' 3$%' -$%+' 3#' )2;;/' H!,+$%?' 3' ,-#+5!.3#2+$'2&'5.+:2%!%'1+.'.!7+:2$6'&!,#2+$&'+1'#35!'31#!.'#*!<'*3:!(!!$';32%'%+)$/'=*!'.!3%!.'2&'.!1!..!%'#+'NOP'1+.'#*!'%!#32;&/

0!' $+#!' #*3#' #*!.!' 3.!' &+7!' 275+.#3$#' %211!.!$,!&' (!#)!!$' +-.!;!,#.+$2,' #35!' %.3)2$6' #++;' 3$%' #*!' #.3%2#2+$3;' #!,*$2F-!' -&2$6.!3;'#35!/'L2.&#?'2$'+-.',-..!$#'&<&#!7'#*!',+;;35&2(;!'&,.!!$')!'-&!%+!&'$+#'*3:!'3' .262%' &-.13,!/'I&' &-,*?' -$;2@!' 2$' #.3%2#2+$3;' #35!%.3)2$6?'-&!.&',3$$+#'5.!&&'3632$&#' #*!'%.3)2$6'&-.13,!' A2/!/?' #*!&,.!!$B/'0*2;!' #*2&' 2&' &+7!)*3#' +1' 3' %.3)(3,@?' )!' *3:!' 1+-$%#*3#'-&!.&'3.!'3(;!'#+'3%35#'(<'*+;%2$6'#*!'2$5-#'%!:2,!&'D-&#'3(+:!#*!' &-.13,!'+1' #*!' &,.!!$/'=*!' -&!' +1' 3' .262%' &,.!!$')+-;%' &+;:!#*2&' 5.+(;!7/' Q+)!:!.?' #*2&' )+-;%' (!' 3#' #*!' !"5!$&!' +1' &<&#!75+.#3(2;2#<' #*3#' 2&',.-,23;'3#' #*2&'&#36!'+1'+-.'!"5;+.3#2+$' 2$'+.%!.1+.' -&' #+' (!' 3(;!' #+' %!7+$&#.3#!' +-.' &<&#!7' 3#' %211!.!$#' %!&26$&#-%2+&')+.;%)2%!/'I$+#*!.'%211!.!$,!'(!#)!!$'#*!'!;!,#.+$2,'3$%#.3%2#2+$3;'7!%23' 2&' #*3#' 2$' #*!' #.3%2#2+$3;' #!,*$2F-!' #*!'-&!.'6!#&@2$!&#*!#2,' 1!!%(3,@' 2$' #*!' 1+.7' +1' #!$&2+$' 2$' #*!' #35!?')*!.!3&#*!'!;!,#.+$2,':!.&2+$'5.+:2%!&'+$;<':2&-3;'1!!%(3,@/'0*2;!')!'%+$+#' (!;2!:!' #*3#' #*!' ;3,@' +1' 5*<&2,3;' #!$&2+$' 2$' #*!' !;!,#.+$2,:!.&2+$' 2&' 3' &!.2+-&' *3$%2,35?' )!' *3:!' !"5!.27!$#!%' )2#*5.+:2%2$6'5*<&2,3;'#!$&2+$'-&2$6'&5.2$6';+3%!%',+.%&'A7-,*';2@!'3&5.2$6' ;+3%!%' #35!' 7!3&-.!B/' M-.' 2$2#23;' !11+.#&' 2$%2,3#!' #*3#5.+:2%2$6'5*<&2,3;'#!$&2+$'2$'#*2&'73$$!.' 2&' .3#*!.'%211!.!$#' 1.+7#*!' #!$&2+$' 2$' .!3;' #35!' 3$%' #*!.!1+.!' %!#.3,#&' 1.+7' #*!' %.3)2$6#3&@/'>$'&+7!'&!$&!?'2#'355!3.&'#*3#'2#' 2&'(!##!.' #+'$+#'5.+:2%!'3$<@2$!&#*!#2,' 1!!%(3,@' #*3$' #+' 5.+:2%!' 1!!%(3,@' #*3#' 2&' 2$1!.2+.' +.:3&#;<'%211!.!$#'#+'#*3#'+1'.!3;'#35!/

!"#$%&'()'*+,&'-%+."/#!"'0"1'*2'34+%4'4+,"/#5'46&'/2/728"/+/4'6+/7'4%+9:&%';$442/'"3',%&33&7)'0""1'<6"=&'82>"/#'46&728"/+/4'6+/75'46&'/2/728"/+/4'6+/7'=+?3'72./'4+,&'+3'"4'3="7&3'+=2/#'46&'$/@+34&/&7'4+,&'3&#8&/4';&4.&&/'46&'4.29$%32%3)'A2>&8&/4'2@'46&'/2/728"/+/4'6+/7'9$%32%'"3'92/34%+"/&7'42'46&'$/@+34&/&7'4+,&'3&#8&/4'"/'46&'7"%&94"2/'42.+%73

46&'728"/+/4'6+/7'9$%32%)'B'=2/#'$/@+34&/&7'4+,&'3&#8&/4'%&3$=43'"/'382246'9$%>&3'."46'+'#%+7$+==?'96+/#"/#'4+/#&/4)0"""1)'C&7$9"/#'46&'=&/#46'2@'46&'$/@+34&/&7'4+,&'3&#8&/4',&%8"43'46&'#&/&%+4"2/'2@'6"#6&%'>+%"+4"2/'9$%>&3'."46'+'82%&%+,"7=?'96+/#"/#'4+/#&/4)'*6&'=&/#46'2@'46&'$/@+34&/&7'4+,&'3&#8&/4'9+/';&'96+/#&7'2/D46&D@=?';?'3"8,=?'82>"/#'46&'4.2

9$%32%3'9=23&%'2%'@+%46&%'+,+%4)'0">1'E."496"/#'@%28'4+,"/#'9$%>&3'42'4+,"/#'34%+"#64'="/&3'"3'+96"&>&7';?':&&,"/#'46&728"/+/4'6+/7'9$%32%'"/'+'@"F&7',23"4"2/'.6"=&'4+,"/#'."46'46&'/2/728"/+/4'6+/7)'B/'&F,="9"4'827&'3."496'"3'/24'%&G$"%&7)0>1'%&=&+3"/#'46&'/2/728"/+/4'6+/7'4%+9:&%';$442/'9$43'46&'4+,&)

!"#

!"$

%&' %&&'

!"#

!"$

%&&&' %&('

!"#

!"$

!"#

!"$

%('

!"$!"$

)*+*,-. /012*,*-3204*

5,6012*,*-3204*31*+7*,2

!"$332809:*83!;22<,3,<2348*11*-

!"#332809:*83!;22<,348*11*-=<,-<7&,0,23>0,-39;81<8

?<7&,0,23>0,-39;81<8

Both hands are used to draw a line. The dominant hand curser represents the roll of tape and the non- dominant hand cursor represents the end of the tape. The distance between the two hand determines the length of the tape. This line is referred as the “unfastened tape segment”.

Tape Drawing

Thursday, February 19, 2009

Page 11: Interaction Techniques for 3D Modeling on Large Displaysdavid/Classes/ICG/Talks/NJ_ICG_Presentation.pdfIntroduction • Can create smooth curves • Difficult to transfer to electronic

Tape Drawing

• Press the button on the tracker to put it in fasten mode

• Curves can be created by moving both hands

• Curves and lines can be edited, a cut operation is supported

• Back-up and Undo are supported

Thursday, February 19, 2009

Page 12: Interaction Techniques for 3D Modeling on Large Displaysdavid/Classes/ICG/Talks/NJ_ICG_Presentation.pdfIntroduction • Can create smooth curves • Difficult to transfer to electronic

Camera Control

• Can pan and zoom when in 3D perspective view

• Pan and zoom are two handed operation

• Pan is activated by pressing both trackers buttons and moving the non dominant hand

• Zoom is activated by pressing both trackers buttons and moving the dominant hand

Thursday, February 19, 2009