massachusetts institute of technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti...

64

Upload: others

Post on 11-Aug-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

� � ������� � ��������������� ����������� � �!� �#"%$���&�'��( )��*�+�,�-.0/

13254�687:9 ;,<>=

?*@BA3@DCFEHGJILK,MONQPRMTS�MVUDURWXKZY[K�P]\QMOI_^`P]a / C�b�Pca`a_^ .ed I`NQfgC�b�MVK�K�^ / U]\JGhK�PiGejlk�mXmenpoA d,.eq P]aLaLMVrsa_Wta_f,MTu[MVv8G�I`a q MVKQaHWXw-x�URMVyzaLILPDyVGhU{x�K,NQPRK,MVMOILPDK,N

GhK�r|E%W q v d aLMVI}A~yOPRMVK�yOMPRK�v8GJI�a_PiGhUFw d U]�8UDU q M�KQa%WXw a_f,M�I`M�� d PRI`M q M�KQa_^%w�WXI�a�f,M�r,MONXI`MOM�WXw

S|GJ^�aLMOI�WXw�A~yOPRMVK�yzMG�a�a_f,M

SZ��A�A~�[EH��Y�A�x��}�[As����A~� ��� Y*� x������ x%EH������� ���[�� d K,MtkJmhmX�

y� S�Gh^`^LGhy�f d ^�MOa`a_^}�lK�^�a_P]a d aLM�WXw � M�y�f�K,WXURWXN / kJmXmX��@���URU{I_PcNQfQa�^%I`M�^�MOI`\XM�rg@

� d a_f,WXI%@�@z@O@z@V@z@O@O@O@z@V@z@O@z@V@z@O@O@O@z@V@z@O@z@V@z@O@O@O@z@V@z@O@z@V@z@O@O@O@z@V@z@O@z@V@z@O@O@O@z@V@z@O@z@V@z@O@O@O@z@V@u[MOv8GJI�a q M�KQaHWhw�x�URMVyzaLILPDyVGhU�x�K,NXPDK,MOMVILPDK,N�GhK�r|E%W q v d aLMVI�A~yOPRMVK�yOM

S�G / kJ�JILrgC8kJmXmX�E%MOI`a_P]�eM�r .+/ @z@O@z@V@z@O@O@O@z@V@z@O@z@V@z@O@O@O@z@V@z@O@z@V@z@O@O@O@z@V@z@O@z@V@z@O@O@O@z@V@z@O@z@V@O@z@V@z@O@O@O@z@V@z@O@z@V@

�}P q Wha_f / �0G q MV^}��G��VMVK �MV^`M�GJILy�f�A~yVPcM�KQa_PD^a�}f,MV^`PD^[A d v3MOI�\,PR^�WXI

E%MOI`a_P]�eM�r .+/ @z@O@z@V@z@O@O@O@z@V@z@O@z@V@z@O@O@O@z@V@z@O@z@V@z@O@O@O@z@V@z@O@z@V@z@O@O@O@z@V@z@O@z@V@O@z@V@z@O@O@O@z@V@z@O@z@V@A~yzWha`a�E / vef,MVIL^

 �MV^`M�GJILy�f�A~yVPcM�KQa_PD^a�}f,MV^`PD^[A d v3MOI�\,PR^�WXI

��yOyzMVv,aLMVr .0/ @O@z@V@z@O@z@V@z@O@O@O@z@V@z@O@z@V@z@O@O@O@z@V@z@O@z@V@z@O@O@O@z@V@z@O@z@V@z@O@O@O@z@V@z@O@z@V@z@O@O@O@z@V@z@O@z@�*I`a_f d I*A q P]a_f

E�feGhPcI q GhKgC+u[MVv8G�I`a q MVKQa�GJUgE%W qsq Pca`aLMVM WQK¡��I_Ghr d G�aLMTA0a d r,MVK0a_^

Page 2: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl
Page 3: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

� � ���������� ������������������������� !��� �#"%$���&('��)+*��,�-�.�/

.0/A / ?�WXI10 GhK,N

243.5.6�7988;:=<>8@?A8;B.:DCE:GF.HJI8@6K:=L-8�?�M�N�OP:=Q=8@I@7PQGHJORN�L.ST79L.:G:[email protected].<VUW?T6�F.3�8@:GI,24QG79:GL.Q=:

?TLYXZH\[^]J_JI<R`a]JbJbT_�`.79L^[email protected]�O9OP6�:GLg8�?�Mh8@B.:I@:=i-3.7PI:G6�:GLg8;j�Me?TI�8;B�:D<�:GSTI:G:(?JM

XZHJjk8;:GI�?JMl24Q=7P:GL�QG:

�m���n��$���)o�p 798@BqI@:=QG:=L-8KHJ<4rJH�L.QG:=jA7PLs8@:GQtB.L.?JOP?TSJ[J`�j@?JMu8�vWHJI:>HJF.F.O97PQ\Hw8;7P?JL.jxH�I@:1MyHJQ=:G<zv�798@Bs8;B�:{QtB�HJO}|OP:=L.ST:(?JMhQGI:\H�[email protected]�L.:�~n8,ST:GL�:GI;Hw8;7P?JL^B-3.6KHJL^QG?T6�F.3�8@:GI�7PLg8@:GIMyH�QG:Gj�8;B.H�8�?J�o:=I�3.j@:=I@j,STI@:GH�8;:=I:�~4F.I:Gjj@79rJ:1Fd?�vW:=IG`�L.H�8;3.I@HJOPL�:Gj@j=`�H�L.<�Fd?TIk8tHJ5.79OP7}8�[T����B.:=j@:Kj[nj8@:G6�jDv�79OPOlQ=?T6�5.79L.:AL�H�[email protected];HJO7PL�F.3�8�6�?4<�:GjWj3.QtBYHJj�j@Fd:G:=QtBR`�Fd:GLR`.B.HJL.<{ST:=j8;3�I@:Gj=`�:=[J:DSTHJ�G:�`.HJL.<{B�:\HJ<^HJL.<{5d?n<�[16�?�rT:�|6�:GLg8�?JI�?JI@7P:=Lg8tH�8@7P?TLR`.8@?KQ=I@:GH�8;:xH�6�:\HJL�7PL.SJMe3�O�6�3.O98@7P6�?4<.HJO�79L.F.3�8G����B.:�[VH�I@:�HJOPj?K�-L.?�v�LHJj��6x3.O98@7P6�?4<�H�OP��j[njk8;:G6�jG�%��B.:�<.:=j@79STL>?JM/6�3.O98@7P6�?4<.HJO�j[nj8@:G6�j�<.:GFd:GL.<�j�B�:\H\rn7PO9[K?TL{8;B�:�-L.?�v�OP:=<.ST:�?JM#8@B.:�L�H�[email protected];HJO�7PLg8;:=STI;H�8@7P?TL�F.H�8@8@:GI@L�jD8@B�H�8(I@:=F.I@:=j@:=L-8xF�:=?TF.O9:J��jDQ=?T6�5.79L.:G<�3.j:?JMh<.79��:GI:GLg8�7PL.F�3�8�6K?n<.:=jG�

��B.:��(HJOcH�~4[��,[email protected]}8;:=Q=8;3�I@:J`�<.:�rT:=OP?TFd:G<�5g[�8;B.:Z24F�?J�J:GL�� HJL.SJ3�HJST:V2n[nj8@:G6�j>�(I?T3.FR`F.I?�rn79<.:GjDH1MeI;H�6K:�vW?TI�YMe?TI,8;3.IL�5.HJj@:=<�Q=?TLgrT:GIj;H�8@7P?TL.HJOlj[njk8;:G6�j�� �\¡T¢£��¤¥8�B�H�jD:=L�HJ5.O9:G<�8;B�:QGI:\H�8@7P?TL�?JM�HJF�F.OP79Q\H�8@7P?TL.j�79LqH>rJH�I@7P:�8�[�?JM�<.?T6KHJ79L.jG�^¦EL.:K?JM�8;B�:Gj@:1<.?gHJ6�7PL.j(79jD§�?�[gH�ST:GI=`v�B.79QtB�F.I@?�rn7P<.:=jEL�H\rn7PSgHw8;7P?JLZHJjj@7Pjk8tHJL�QG:AHJL�<Z8;I;Hw¨KQ�j8;H�8;3.j�79L�Me?TI61H�8@7P?TL{Me?TI�©W?Tjk8;?TLVrn7PHªHv#:G5ª79L-8@:GIkMyHJQG:���«,j:GI@j#7PLg8;:=I;HJQ�8#v�7}8;B�§�?�[THJST:=I#3.j7PL.SxHDjF�?J�J:GL17PLg8;:=IMyHJQ=:J`-v�B.7PQtBK7Pj%OP:Gjj#:�¨A|QG79:GLg8�8;B�H�L1HJL�7PLg8@:GIMyH�QG:�8;B�Hw8WH�OPj@?(F.I?�r479<.:Gj%Fd:GLKHJL.<�j@Fd:G:GQtB17PL.F.348\�l¤�Lg8;I?4<�3.QG79L.S�[email protected].<�j�J:[email protected]�SYST:[email protected]@:=j(8@?ª8;B.:�jk[4jk8;:=6¬Q\HJL�6KHJ�J:�rJ:GI5�HJOP79�G79L.Sª[email protected]�8;7PHJO�79L.j8@[email protected]�8;7P?JL.j�j@796�|F.O9:GIG`d:=rJ:GL�:=OP7P6�7PL.H�8;79L.Sx8;B�:xL.:=:G<Z8;?K3.j@:�j@Fd:G:=QtB�79LYj?T6�:x7PL�j8tH�L.QG:=jG����B.:Gj:�ST:Gjk8;3.I:Gj�v�79OPO6KHJ�J:�§�?�[gHJST:=IlH�6K?JI@:�L�H�[email protected];HJOnHJL�<xFd?�v#:GIkMe3.OnL�H\r479SgH�8@7P?TL(7PLg8@:GIMyH�QG:J�h��B.7Pj 8;B�:Gj@79jlHJ<�<.jhFd:GLn|5�HJj:G<YF�?T79Lg8;7PL�SAHJL.<^j@��:=8;QtB�7PL.SKST:Gjk8;3.I:Gj�8;?�§�?�[THJST:=IG`aHJL.<YHJ<.<�j�Q=?T6�F.OP:=6K:=L-8;HJI[KMe:\H�[email protected]@:=j8;?�8;B�:�jk[4jk8;:=6­v�B.79QtBYv#:GI:xL.?J8�F.I:=rn7P?J3.j@O}[>F�[email protected]:�v�798@B.?T3�8�8@B.:�SJ:[email protected]@:D6�?4<�H�OP798@7P:=jG��¤�L8;B�:EF.I@?nQG:=j@j=`�Hx6�3.O}8;796K?n<�HJO�MeI@HJ6�:=v#?TI@�AMe?TI#7PLg8;:=STI;H�8@7P?TL�v�H�j�<.:Gj7PSTL�:G<R��«�j@:GIW:�~4F�:=I@796K:=L-8@jv#:GI@:AOPH�8;:=IEQG?JL.<.3.Q�8;:G<�8@?>HJL�HJO}[4�=:�B.?�v+vW:=OPO�SJ:[email protected]@:=j(Q\HJL�5d?4?Jj8E8@B.:Aj@Fd:G:=QtB�I:GQG?JSTL.798@7P?TLj@Q=?TI@:=j,?�M�<.:=7PQ�8;7PQEv#?TI<.jG�

��B.:=j@7Pj�243.Fd:GIkrn7Pj@?JIG®���7P6�?J8@B-[ª¯gHJ6�:Gj�°�HJ�=:GL��798@OP:�®�±�:=j@:GHJI@QtBZ24QG79:GLg8;79j8

��B.:=j@7Pj�243.Fd:GIkrn7Pj@?JIG®%24Q=?J8@8�U#[nF.B.:=I@j��798@OP:�®�±�:=j@:GHJI@QtBZ24QG79:GLg8;79j8

Page 4: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

��(�������� ��� ��"� ���}�,�

¤ vW?T3�OP<�OP79�J:W8@?E8;B�HJL���6x[�j3.Fd:GIrn79j@?TIj%��� ¯.�g°,HJ�G:=L1HJL�<12nQG?J88#U#[4F�B.:GIj�Me?JIl8;B.:=7PIl�-7PL�<KH�L.<F�H�8@7P:=L-8EST3.7P<.HJL.QG:�7PLZB�:GOPF�7PL.Sª6�:�H�QGQG?J6KF.O97PjBZ6x[^8;B.:=j@7Pj=����B.:GI:AB�H\rT:A5d:G:=L�6KHJLg[^8;7P6�:Gjv�B.:=Ls¤�Q=?T6�6K7}8@8;:=<�j@79OPO9[Y6�7Pj8;HJ�J:=j(?TIEv�H�j�jOP?�v H�8(SJ:=8@[email protected]{[email protected]�<.?TL.:�`h5.348D8@B.:=[�v#:GI:rT:=I[>F�Hw8;7P:=Lg8�HJL.<^:GL.Q=?T3.I;H�ST7PL.SAv�B.79OP:E8@:\HJQtB.79L.S�6K:E8@B.:(j@�-7PO9OPj�L.:=QG:=j@j;H�I[>8;?�QG?J6KF.O9:=8@:�798\�

¤lvW?J3.OP<1HJOPj?xOP79�J:�8;?D8;B�H�L.��6x[KHJ<�rn7Pj?TIW¯T796 �(OPHJj@j=`gMe?TI#B�7Pj%�n79L.<1j3.F.Fd?TI8�HJL.<1Me3�L.<.7PL�S?JM/8;B.:(F.I?��:GQ�8\�

XY[�OcH�5A61H�8@:Gjlv#:GI:,I:\HJO9O9[DvW?TL�<.:GIkMe3.O �l¤¥M�L.?J8�Me?TIl8@B.:G79IlB.:=OPFR`-¤hHJ6 L.?J8�j3.I@:�B.?�v 6�3.QtB¤EQ=?T3.OP<�B�H\rT:�<.?TL�:�Me?TI�[email protected]�8;B�:Gj@79jG�ªN�<�7PO97Pj@��?ªv�H�jDrJ:GI[�B.:=OPF�Me3�O#H�L.<�I:\HJ<�7PO9[ZH\rJH�7POcH�5.OP:H�8ªHJOPO�8@7P6�:Gj�v�B.:GL.:�rT:=I^¤AL�:G:G<�:G<�B.:=OPF ?TL 8;B.:YQG?TLg8;:�~n8{I@:=j@?TO93�8;79?TLR��XV7PL ��HJL�Ss8tHJ3�STBg86�:�3.j@:�Me3.O/HJ<�rn7PQ=:D79LYU�F.I?TSTI;H�6K6�7PL.S�HJL.<��(HJI@:=LV��79rJ:GjQG3YvWHJj�I@:GHJ<.79O9[{H\r�HJ79OcHJ5.O9:,Me?TI�H�L-[ST:=L.:GI7PQxB�:GOPFY8;B�H�8,¤�B�HJ<V8@?1ST:�8E6x[>8@B.:Gj7PjEI3.L.L.79L.S.�,¯T?TL�H�8@B�HJL�� HJ3�H�OPj@?KB.:GO9F�:=<Z6�:�?T3487PL^¯gH\r�HAF.I@?TSJI;HJ6�jG�

��L.<{8@?�6�[1F�H�I@:GLg8@jG`�6x[K8�vW?�:GO9<.:GIWj@7Pjk8;:=I@j�Me?TIW8@B.:G79I�3.L.<�[[email protected]�F�?TIk8�8;?�6x[�vW?JI@�ª79LXV¤����

��B.79jlI@:=j@:\H�I@QtB�v�HJj�j3.F.Fd?TI8@:G<�5g[�H�LA7PL.<.3�j8;I7cHJOnQG?JL.j@?TIk8;793.6 [email protected]@B.:�XV¤�� ¦,~n[4SJ:GL��O9OP7PHJL.QG:��

Page 5: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

� �����������

� �� ������������������� ����T�}� ©�HJQt�-STI?T3.L.< �D�D���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ��]�T� ] ¦E3�8;O97PL.:,���D���D�D���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ��]

!"�$#&%('�)*�,+"%- �%*.���'�%/������ 0�1 ���)*�324%5�6) �$7]4�}� 2n[nj8@:G6 CE:Gj7PSTL>?JM/§�?�[gHJSJ:GI �D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� �98

]4�}�T�9� :�I?4Q=:[email protected]«,j7PL.SK24Fd:G:=QtBZHJL�<Y�/:�~n8,¤�L.F.3�8����D�D���D�(���D���D�D� �9;]4�}�T� ] :h:GLZ�(:=j8;3�I@:(¤�L.F.3�8 �D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� �9;]4�}�T� _ 2-[4L�QtB.I@?TLg[^?JM/8;B.:(79L.F.3�8�6�?4<.HJOP7}8;7P:=jK�D�D���D���D�D���D�(���D���D�D� �9;]4�}�T� ¡ �3.j7P?TL>6�:GQtB�H�L.7Pj6 �D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ��<]4�}�T�=8 �(«,¤ �D�D���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ��<

]4� ] >,:�v UW?T6�F�?JL.:GLg8;j�?JM/8;B�:Djk[nj8;:=6 �D���D�(���D�D���D���D�D���D�(���D���D�D� ��<? @BA�)�CD��%/E�A��F�6%/GIHKJ�)L�M�� ���)*�324%5�6)�NOCPHQ�9R S�

_��}� UW?T6�F�?TL�:GLg8;j�?JM/8;B.:��(«,¤ ���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ]4�_�� ] � H�[J?T3�8,CE:Gj7PSTL^±�H�8;79?TL�HJO9: ���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ]J__�� _ �%[nFd:�?�M�79L.F.3�8�6�?4<�:Gj ���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ]J_

_�� _��9� «�L.7P6�?n<�HJO�§�:=I@5�H�O�¤�L.F.3�81���D���D�(���D�D���D���D�D���D�(���D���D�D� ]�¡_�� _�� ] «�L.7P6�?n<�HJO�2-8;I@?J�n79L.S�¤�L.F.3�8D�D���D�(���D�D���D���D�D���D�(���D���D�D� ]�¡_�� _�� _ XY3.O98@7P6�?4<�H�O�¤�L.F�3�8����D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ]68

_���¡ CEI;H\v�5�HJQt�-j����D�D���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ]�TU VW�X�3�5Y&)[ZD)\�6��'� ��]������ �^

¡.�}� ¦�rT:GIkrn7P:=v��D���D�D���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ]6;¡.� ] �(:[email protected]@: �3.L.Q�8;7P?JL.j��(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ]6;¡.� _ �(:[email protected]@: �?TI@6�j��D���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ]�_

¡.� _��9� �`:h?T7PLg8�UWOP79Qt� ���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ]�_¡.� _�� ] �+UW79I@Q=OP: ���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ]�_¡.� _�� _ � ��79L.: �D���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� _Tb¡.� _�� ¡ ¦�8@B.:GII:�?Jj@[email protected]:D��:Gjk8;3.I:Gj �D���D�(���D�D���D���D�D���D�(���D���D�D� _��

¡.��¡ �:\H�[email protected]@:(©�H�j@:G<V±�:=QG?TSJL.798@7P?TL �D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� _��¡.�a8 CEI;H\v�5�HJQt�-j����D�D���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� _*8

8

Page 6: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

7 �`��G]����� �S��%(G��Q%/��%�� %5J�) ?�^84�}� ¤�QG?TLV24:=OP:GQ�8;79?TL¬�D���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� _*;84� ] ¤�QG?TLY°,79STB.O97PSTBg8>�D���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� _6<84� _ �(:[email protected](24:GO9:GQ�8;7P?JL ���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� _6<84��¡ �(:[email protected]���?4QGH�8;79?TL ���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ¡gb84�a8 ±�:=QG?TI<.7PL�S�8@B.:(:=rJ:GLg8;j����D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ¡gb

� @BA�)��`��G]����������%/G �� W��)��W�,ZM)$J��&G�� ������ � )\�9A�%/ ��1J�� U�?T��}� XV3.O}8;7P6�?n<�HJO�±�:=j@?TO93�8;79?TL>XV:GQtB.HJL.7Pj6 �D�(���D�D���D���D�D���D�(���D���D�D� ¡T¡

^ HPJX)*����SE )*����� )L W�9J U��;4�}� XV?J8@79r�H�8;79?TL����D�D���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ¡*_;4� ] 24QG?JI@7PL�S�v�7}8;BY24Fd:G:=QtBZ±�:GQG?JSTL.798@7P?TL ���D�(���D�D���D���D�D���D�(���D���D�D� 8Jb;4� _ ©[email protected]�±�:GQ=?TSTL.7}8;7P?JL^24QG?TI:Gj�v�798@BZ��:Gjk8;3.I:Gj��D���D���D�D���D�(���D���D�D� 84�;4��¡ Nl~�Fd:GI7P6�:GLg8I:�I@?nQG:=<.3.I@: �D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� 8J_;4�a8 ±�:[email protected]}8;j����D���D�D���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� 8J_;4� T UW?TL.Q=OP3.j7P?TL����D�D���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� 8�T

� B�& ��6G�� J��1�� �J,%( �������������)�� �5��Y 7��<��}� 243.6�61H�I[ ���D�D���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� 8�_<�� ] �3�8;3.I: p ?JI@�V�D�D���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� 8�_<�� _ UW?TL.Q=OP3.j7P?TL����D�D���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� TTb

T

Page 7: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

� � � ��� � ����� �

]�|t� UW?T6�F�?TL�:GLg8;j,?JM�8@B.:x:�~�[email protected]ª�(��� �� � 2n[nj8@:G6­F.I@?nQG:=j@[email protected]ª?TL�O9[{jF�:=:GQtBHJL.<{8;:�~n8 �D���D�D���(�D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� ��T

]�|k] UW?T6�F�?TL�:GLg8;j�?JM/8;B.:">�:=v 2-[4jk8;:=6 v�7}8;B{8;B�:D79Lg8;I@?n<.3.Q�8;79?TL{?JMhF�:=LYST:[email protected]@:=j ]Jb_w|t� ��B.:��([email protected]\HJOR«,j@:=I�¤�L-8@:GIkMyHJQG:������D���D�(���D�D���D���D�D���D�(���D���D�D� ]T]¡�|t� ��L^:�~�HJ6�F.OP:�?�MlHAFd?T7PLg8�QGO97PQt� �D���D���D�(���D�D���D���D�D���D�(���D���D�D� ]�_¡�|k] ��L^:�~�HJ6�F.OP:�?�MlHAQG79I@Q=OP:�j8@I@?T��:DHJL.<^798;j�79Lg8;:GIF.I@:�8tH�8@7P?TL�j1�D���D�(���D���D�D� _Tb¡�| _ ��L^:�~�HJ6�F.OP:�?�MlHAOP79L.:Ejk8;I@?J�J:�HJL.<^798;j�79Lg8;:GIF.I@:�8tH�8@7P?TL �D�D���D�(���D���D�D� _��¡�|�¡ 243.6 ?�M�2479<.:���L�STOP:=j �D���D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� _g]¡�| 8 UW?TLgrT:�~Z°�3.OPO�§E7P?JOcH�8@7P?TL �D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� _T_¡�| T ��B.:DCE:GQ=7Pj@79?TL>�hI:G:(?JM/8;B.:���:Gjk8;3.I:�±�:GQ=?TSTL.79�G:=IG� �D���D�D���D�(���D���D�D� _J¡¡�| ; XV3.O}8;7PF�OP:�8�[nFd:Gj�?JMlHAQ=7PI@Q=OP:(HJL�<YH�L.?TLn|�QG79I@Q=OP:Ejk8;I@?J�J:J� �D�D���D�(���D���D�D� _J¡8�|t� Nl~.H�6KF.O9:�ST:Gjk8;3.I:Gj,HJL.<{8;B�:G7PI�79L-8@:GIF.I@:�8tH�8@7P?TL.j�H�j��¤�QG?TLV24:=OP:GQ�8;79?TL.��:=rJ:GLg8;j=� _6<8�|k] ��7P6�7PL.S�<.7PHJSTI;H�6 ?JMl8;B�:�7PLg8;:[email protected]:=8;H�8;79?TL.j�5g[^8;B.:�<�H�8;HJ5�HJj:AHJL.<V8@B.:G79I�Q=?TIk|

I@:=OcH�8@7P?TL18@?�8@B.:(j8@I@?T��:Gj,HJL.<^6K?T3�j@:�OP?nQ\Hw8;7P?JL �D���D���D�D���D�(���D���D�D� _6_Tw|t� CE:GQ=7Pj@79?TLª8;I:G:(?JMh6�3.O}8;7P6�?n<�HJOdI@:Gj?TOP348;7P?JL ���D�D���D���D�D���D�(���D���D�D� ¡L8Tw|k] ��L^:�~�HJ6�F.OP:�?�M�6�3�O98;796K?n<�HJOa<.:=7PQ�8;7PQ�I:Gj?TOP3�8@7P?TL ���D���D�D���D�(���D���D�D� ¡*T;�|t� >�|¥5�:=j8EBg[nFd?J8;B.:=j@:=j�ST:GL.:=I;H�8@:G<Z5g[^8;B.:�2�«�XVXV¤�� j@Fd:G:GQtB�I:GQG?JSTL.7P�=:GI�v�798;B

8;B.:DHJQ�8;3�H�ORj@Fd?T�J:=LV3�88;:=I;HJL.Q=:�3�L.<.:GIOP79L.:G<R�h���D�D���D���D�D���D�(���D���D�D� 8Jb;�|k] p ?JI@<>:GII@?TI�I;Hw8;:Gj�H�8�r�HJIk[n7PL.S�5d?4?Tjk8�vW:=7PSTBg8@j�Me?JI�<.:G79Q=8;79Q�3�8@8@:[email protected]:=j �D�D� 868

;

Page 8: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

<

Page 9: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

� � � ��� � ��� ���

;4�}� ±�:[email protected]}8;j�8;HJ5.3.OPH�8;:=<>HJQGQ=?TI@<.79L.S�8;?A<�:G7PQ�8;79QE3�8@8@:[email protected]:=j�HJL.<><.:G79Q=8@7PQEBg[nF�?�8;B.:=j@:Gj 8�¡;4� ] �(:[email protected]@:�[email protected].<Z7}8;j�796KF.HJQ=8�?TLZv#?TI@<V:GI@I?TIEI@H�8;:DMe?TIEHJO9O 3�8@8@:GI;H�L.QG:=j

HJL.<><.:=7PQ=8@7PQ�3�88;:=I;HJL.Q=:Gj �D���D�D���D���D�(���D�D���D���D�D���D�(���D���D�D� 868

_

Page 10: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

��b

Page 11: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

� � ��� ��� �

� ��� ��� � � � � ���

p 798@BqI@:=QG:=L-8KHJ<4rJH�L.QG:=jA7PLs8@:GQtB.L.?JOP?TSJ[J`�j@?JMu8�vWHJI:>HJF.F.O97PQ\Hw8;7P?JL.jxH�I@:1MyHJQ=:G<zv�798@Bs8;B�:{QtB�HJO}|OP:=L.ST:(?JMhQGI:\H�[email protected]�L.:�~n8,ST:GL�:GI;Hw8;7P?JL^B-3.6KHJL^QG?T6�F.3�8@:GI�7PLg8@:GIMyH�QG:Gj�8;B.H�8�?J�o:=I�3.j@:=I@j,STI@:GH�8;:=I:�~4F.I:Gjj@79rJ:1Fd?�vW:=IG`�L.H�8;3.I@HJOPL�:Gj@j=`�H�L.<�Fd?TIk8tHJ5.79OP7}8�[T����B.:=j@:Kj[nj8@:G6�jDv�79OPOlQ=?T6�5.79L.:AL�H�[email protected];HJO7PL�F.3�8�6�?4<�:GjWj3.QtBYHJj�j@Fd:G:=QtBR`�Fd:GLR`.B.HJL.<{ST:=j8;3�I@:Gj=`�:=[J:DSTHJ�G:�`.HJL.<{B�:\HJ<^HJL.<{5d?n<�[16�?�rT:�|6�:GLg8�?JI�?JI@7P:=Lg8tH�8@7P?TLR`.8@?KQ=I@:GH�8;:xH�6�:\HJL�7PL.SJMe3�O�6�3.O98@7P6�?4<.HJO�79L.F.3�8G����B.:�[VH�I@:�HJOPj?K�-L.?�v�LHJjK�6�3�O98;796K?n<�HJO9��jk[nj8;:=6Kj=�

[email protected]{B-3.6KHJL�Q=?T6�6�3.L.79Q\H�8@7P?TLR`�798(79j�?JMu8;:=L�8@B.:�Q\HJj:�8@B�H�8(j?T6K:�79<.:\HJj(H�I@:A6�?TI@:A:�Mc|Me:GQ�8;7}rT:GO}[qQ=?TLgrT:=[J:G<�79Lz?TL.:>6K?n<.:18@B�HJL�7PL�?J8@B.:GIjG��24F.H�8;7PHJOW79L�Me?TI@6KH�8@7P?TL�7PjA6�?TI@:{:GHJj@79O9[QG?J6K6�3�L.7PQGH�8;:=<A5-[xF�?J7PLg8;79L.S�H�8�?J5 �:GQ�8;j�8;B�H�L�5g[�rT:GI5�HJO�<.:=j@Q=I@7PF48;7P?JLA?TL.O9[J`Jv�B.79OP:�I:GOcHw8;7P?JL�HJO7PL4Me?TI@6KH�8;79?TL�7Pj�6�?TI@:,:\HJj7PO}[1<.:=j@Q=I@7P5d:G<>5g[1v#?TI<.j�8;B�HJL{5g[1F�?T79Lg8;7PL�S.�lCE7}�o:=I@:GLg8�6�?n<�HJOP7}8;79:GjQ\H�LZHJO9j@?�5�:D3.j@:=<Z7PL^QG?JL��3.L.Q�8;7P?JL^v�7}8;BV:GHJQtBV?�8;B.:=IG��CE3.I7PL.S�QG?JL-rJ:GIj;H�8@7P?TL.j=`oFd:G?TF�OP:(?JMu8;:=LL.?n<V8;B�:G7PI�B.:GHJ<.jE8;?K:�~4F.I:Gj@jDHJSJI@:G:=6K:=Lg8�v�B.79OP:Dj;H\[n7PL.Sªj?T6�:=8;B�7PL.S1H�¨�I@6KH�8;7}rT:xj7P6�3�O98tH�L.:�|?T3.jO9[J�W�/?1:�~4F.I:GjjEI@:�Me3.j;HJO£`�F�:=?TF.O9:DQGHJLVj@H\[Yj?T6�:=8;B�7PL.S�L.:=SgH�8;7}rT:(v�B.7PO9:�8;B.:=7PI�B�HJL.<�j�vWH\rT:rT:=B.:G6�:GLg8@O9[T�%2n7PL.Q=:�8@B.:Gj:�L�H�[email protected];H�O.Me?TI@6�j�?JMR79L-8@:GI@HJQ=8@7P?TL�7PLgrT?JO9rT:�<.7}�o:=I@:GLg8#6K?n<.:=j%?�MR7PL�F.3�8\`6�3.O}8;796K?n<�HJO%7PLg8;:=IMyHJQ=:Gj�?TI�j[njk8;:G6�j�8;B�H�8�:=L�HJ5.O9:^L.H�8;3.I@HJO�B-3.6KHJL Q=?T6�F.3�8;:=I�7PLg8;:=I;HJQ�8;7P?JLB�H\rT:D5d:G:GL^j8@3.<.79:G<YHJL.<^<.79��:GI:GLg8�8�[4Fd:Gj�?JMh7PLg8;:=IMyHJQ=:Gj�B�H\rT:D:G6�:GIST:G<o�

�T�

Page 12: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

����� � ��(���"%$��%� ���

N�rT:=I%j7PL.Q=:�©W?TO98G� j�� :�3�8���B�H�8���B.:=I@:=�a� �\¢.<.:G6�?TL.jk8;I;Hw8;7P?JLAj[nj8@:G6^`-v�B�7PQtB�F.I@?nQG:=j@j:G<1jF�:=:GQtBHJL.<^6KHJL-3�[email protected]�j7P6�3�O98tH�L.:G?T3�j@O9[J`.HAr�HJI@79:=8�[ª?�M�6�3�O98;796K?n<�HJOajk[4jk8;:=6Kj�B�H\rT:D:G6�:GIST:G<R�24?T6�:^j[nj8@:G6�j{I@:GQ=?TSTL.79�G:Yj@Fd:G:GQtB v�B�7POP:^<.:�8;:GI6K79L.7PL�S�8;B�:VOP?nQ\Hw8;7P?JL�?�M(F�?T79Lg8;7PL�S�MeI?T6 H3.j:GIG��j�6KHJL-3�HJOaST:=j8;3�I@:GjW?TIWSgH��G:g� <�¢£�l��B.:��E3.79Qt�-j@:=8�j[nj8@:G6V� ]w¢�7PLg8@:GSTI@H�8;:=jWj@Fd:G:=QtBªv�798@BªF�:=L7PL�F.3�8x8@B�H�8x7PL.Q=OP3.<.:=jx<.I@H\v�LzSTI;HJF�B.7PQ=jG`�j[n6�5d?TO9jG`lST:[email protected]@:=jG`%HJL.<[email protected]��V¯T?TB�L.j8@?TLzI@:�|QG:=Lg8;O9[�<.:�rT:=OP?TFd:G<{XY����U�°�� XY3.O98@7P6�?4<�H�O.��Q=QG:Gjj��/?AUW798�[�°�:GO9F�� ;w¢£`�HD6K?T5�7POP:W6�3.O98@7P6�?4<.HJOj@Fd:G:=QtB4|�Fd:GLz79Lg8;:GIkMyHJQG:�8;?^I@:=j8;HJ3.I;H�L-8�HJL.<�[email protected]�[�7PL4Me?TI@6KH�8;79?TLVMe?TIB>,:�v �%?TI��UW798�[T�{�,OPO8;B�:Gj@:1j[nj8@:G6�jxj@B�?�v 8@B�H�8D8;B.:K6K?n<�HJO9798;79:GjE?�M�j@Fd:G:=QtB�HJL.<s?�8;B.:=I�ST:[email protected]@:=j�B�H\rT:ª<�79��:GI@:=Lg8j8@I@:=L.SJ8;B�j#H�L.<�v#:\H��nL�:Gj@j:Gj=`.5.3�8�Q=?T6�5.79L.:�8;?�Q=I@:\Hw8;:�H�j[nL.:GISJ[Av�B.:=I@:�:\HJQtB�6�?4<�H�OP798�[DQ=?T6�|F.O9:G6�:GLg8;jx8@B.:ª?J8@B.:GI=��¤�Lz8;B.:ªF�I@?nQG:GjjG`�8;B�:ª3.j@:=I@j�HJI:ªF.I?�rn79<.:G<qv�7}8;BzSTI:\H�8@:GIx:�~4F.I@:=j@j@7}rT:Fd?�v#:GI=`aL�H�8;3�I;HJO9L.:Gjj,H�L.<���:�~47P5�7POP7}8�[T�

��B.:%<.:Gj7PSTL�?JM�6x3.O98@7P6�?4<�H�O�jk[4jk8;:=6Kjh<.:GFd:GL.<�j�B.:GH�rn79O9[�?TL(8;B�:#�-L.?�v�OP:=<.ST:%?JMn8;B.:%L�H�[email protected];HJO7PLg8@:GSTI@H�8;79?TL�F�H�8@8@:GIL.jD8@B�H�8DI@:=F.I@:=j@:=L-8xF�:=?TF.O9:J��j�Q=?T6�5.79L.:G<�3.j@:K?JM�<�79��:GI@:=Lg8�79L.F.3�8D6�?4<�:GjG���B.: ��3�7PQt�-j@:�8�j[nj8@:G6 3.j@:=jEH1j:G6KHJLg8;7PQD3.L.7}f�Q\Hw8;7P?JLYF.I?4Q=:Gjj�8;?KQG?T6�5�7PL.:(8;B.:�6K:GHJL.79L.SJMe3.O6�3.O}8;796K?n<�HJO�79L�Me?TI@6KH�8@7P?TL�Q\HJII@79:G<{5g[18�v#?�7PL.F.348�j@79STL�HJO9jG`-v�B.7PO9:EXV����U�° 3.j:Gj�f�L.7}8;:Ejk8tH�8@:6�:=8;B�?4<.j�Me?TI�8@B.:ª6�3.O}8;796K?n<�HJOl79Lg8;:GSJI;H�8@7P?TLqF�I@?nQG:GjjG����Q=QG?TI<.7PL�SV8;?�¦�rn7cH�88\`�8@B.:ªQ=3.I@I:GLg8QtB�HJO9OP:=L.ST:x79LV6�3�O98;796K?n<�HJOoj[nj8@:G6�jE7Pj,<.:=8@:GI@6�7PL�7PL.S�8;B.:�7PLg8;:=STI;H�8@7P?TLVHJL.<Zjk[nL.QtB.I@?JL.7P�GH�8;79?TLI@:=i-3.7PI:G6�:GLg8;j�Me?TI�Q=?T6�5.79L.7PL.SA<4[4L.HJ6K79Q\HJO9O9[K<.79��:GI:GLg8�6�?4<.:=j�v�798;B�7PL{j[njk8;:G6�jG�P� ��bJ¢

����� � ���,�� ���

��B.:��(HJOPHw~n[��,[email protected]}8;:=Q=8;3�I@:�<.:�rT:GO9?TFd:G<A5g[x8@B.:�24Fd?T��:GL�� HJL.ST3�H�ST:�2n[njk8;:G6�j%��I@?T3.FxF.I@?�rn7P<.:=jHªMeI;HJ6�:=v#?TI�VMe?TIE8;3�I@L�5�HJj@:=<sQ=?TLgrT:GIj;H�8@7P?TL.HJO�j[nj8@:G6�j�� �\¡T¢£��¤¥8DB�H�jD:=L�HJ5.O9:G<�8;B�:KQ=I@:\Hw8;7P?JL?JM�HJF.F.O97PQGH�8;79?TL.jx79L�H�r�HJI7P:�8�[q?JM,<.?T6KHJ7PL�jG`�j@3�QtB HJj�H�I@:=j8;HJ3.I;H�L-8�ST3�7P<.:T� 8w¢�HJL.<�vW:GH�8;B.:=I7PL4Me?TI@6KH�8;79?TL � �98G¢ ����B�:Djk[nj8;:=6 3.j@:=<Yv�7}8;B.79Lª8;B.79j�8;B.:=j@7Pj�79j�§�?�[THJST:=IG`.v�B.79QtBYF.I?�r479<.:Gj�L�H\rn7}|SgH�8@7P?TL>H�j@j@79j8;HJL.QG:�HJL.<{8@I;H�¨�Q(j8;H�8;3.j�79L�Me?TI@6KH�8@7P?TL1Me?JI�©W?Tj8@?TLR�

§�?�[gHJST:=I,QGHJL^I@:GjF�?JL.<Y8@?KI:Gi-3.:Gjk8;j,[email protected]�H�jG`%�;24B�?�v 6K:(<.I79rn7PL.S�<.79I@:=Q=8;79?TL.j�MeI?T6 XV¤��8;?�°,HJIr�HJI<R` �A?JIG`��;2nB.?�v 6�:�HA61HJF{?�M�©#?Tj8@?TLR���s� 6KHJFªv�798@Bª8;B.:(<.:=j@7PI:G<>I@:[email protected]}8�v�7PO9Oo5d:

��]

Page 13: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

<[email protected]�[J:G<^?TL^H p :G5^7PLg8@:GIMyH�QG:J����B�:Gj@:�i-3.:GI7P:Gj�QGHJLY5d:�j@Fd?T��:GLV?JI�8�[nFd:G<^7PLg8;?�H�8;:�~n8,5d?\~��¤�Lg8;:=I;HJQ�8;7PL�SEv�798;B�8;B.:=j@:�6KHJF.j�3�j@7PL�S�?TL.O9[(8@:�~n8�?TIhj@Fd:G:GQtB�B�HJj�j@?T6�:�OP796K7}8tH�8@7P?TL�jG�R�/:G6�F�?JI;[email protected]�8;7PHJOa7PL�Me?TI61Hw8;7P?JL�L�:G:G<�jW8;?�5d:�Q=?TLgrT:�[T:G<^7PL1Hx<.:�8tHJ79OP:G<KOP:=L.SJ8;Bg[�6KHJL.L.:=IG��UW?T6�F.O9:�~4798@7P:Gj7PLgrJ?TO9rn7PL�S18;B.:A:�~4F.I@:=j@j@79?TL�?JM%<.I@7}r479L.Sª<.79I@:=Q=8;79?TL.jE5d:=8�v#:G:=L�3�L.�-L.?�v�L�I:GST79?TL.jE?TL�8@B.:A61H�FI@:=i-3.7PI:,O9?TL.SD<.:GjQGI@79F�8;79?TL.j=� a?JI%:�~�HJ6KF�OP:J`nHD3.j@:=IW6KH�[�L�:G:G<K8;?xj@H\[q�@24B.?�vm6K:�8;B�:,<.I79rn7PL�S<.79I@:GQ�8;79?TL.jEMeI@?J6 8;B�:K©#?Tj8@?TL�<�?�v�Lg8@?�v�LsHJI@:GH{QGOP?Jj@:A8;?^©W?Tjk8;?TLsUW?T6�6K?JL.j�8;?{8@B.:�:GL.<�?JMXZHJjj;HJQtB-3.j:=88;j(�,rJ:GL-3.:x8@B�H�8,7Pj�j@?T3�8@BV?JM�°�HJIkrJH�I@<R��� ¤¥MlF�?T79Lg8;7PL�S1HJL�<Vj@��:[email protected]:Gjk8;3.I:GjHJI:�B�HJL�<.OP:=<15g[K8@B.:�jk[nj8;:=6Y`n8;B.:=L1rT:=I@5�H�OP7P�=7PL.SD8;B.:=j@:,7PL.jk8;I@3�Q=8;79?TL.j#QG?T3.O9<15d:�j7P6�F.OP:=IG`g:=rJ:GL:GO97P6�7PL�Hw8;7PL�S(8@B.:EL.:=:G<{Me?TI�jF�:=:GQtB^7PLªj?T6�:E7PL.jk8tHJL�QG:Gj=� a?JIW:�~�HJ6�F.O9:J`48@B.:E3.j:GI�Q=?T3.OP<{Fd?T79L-88;?�H�OP?nQ\Hw8;7P?JLz?TLz8;B.:>6KHJF�HJL.<�j;H\[T`��;24B.?�v 6�:ª8;B�:^I:Gjk8tHJ3.I@HJLg8;j�?�rT:=IKB.:=I@:�` �z?TIAQ=7PIQGOP:8�v#?AI@:GSJ7P?TL.j%?TL18@B.:E6KHJFªH�L.<ªj;H\[J`��;24B�?�v�6�:,8@B.:�<.I79rn7PL�Sx<.79I@:GQ�8;79?TL.j�MeI@?T6 B.:=I@:�8@?xB.:=I@:J�����B.:K7PLg8;I?4<.3�Q=8;79?TL�?JM�8@B.:Gj:1ST:=j8;3�I@:GjDv�7PO9O�61HJ��:�§�?�[THJST:GI�HY6�?TI:�L.H�8;3.I@HJO%HJL.<�F�?�v#:GIMe3�OL�H\rn7PSgHw8;7P?JL{7PLg8;:=IMyHJQ=:J�

��j(§�?�[gHJST:=I�v�HJjD7P6�F.O9:G6�:GLg8;:=<Zv�798;B�H{j@Fd?T�J:=Lq7PLg8@:GIMyH�QG:A3.j7PL.S>8;B.:K�(HJOcH�~4[�2n[nj8@:G6^`8;B�:{ST?gHJO�?�M�[email protected]�8@B.:Gj7PjA79jx8;?�7PLg8@:GSTI@H�8;:{H�L.<�j[nL.QtB.I?TL.7P�=:YFd:GL�ST:[email protected]@:=j�v�7}8;BzF.I?4Q=:Gj@j:G<j@Fd:G:=QtB v�[email protected] §�?�[THJST:GI=� �h? HJQtB.79:=rT:�8;B�7PjG`�Hz6�3.O98@7P6�?4<.HJO�MeI@HJ6�:=v#?TI@� Me?JI{7PLg8;:=STI;H�8@7P?TLvWHJj,<�:Gj@79STL.:=<R�W��B.79j�MeI@HJ6�:=v#?TI@�1vWHJj�7P6�F.OP:=6K:=Lg8;:G<{v�7}8;B^j@:=rJ:GI@HJOhL�:=v j:GIrJ:GIj,v�[email protected]>8;B�:���E��� �� [email protected]}8;:=Q=8;3�I@:J� ��B.:Gj:�79L.QGO93.<.:G<mH+�6x3.O98@7P6�?4<�H�OP��<�H�8;HJ5�HJj:J`EHzL.:�v 6�?n<.3.OP:v�[email protected]�8;B�:�QG?JL-8@:�~n8�I:Gj@?JOP3�8@7P?TL�j@:=IrT:=I�Me?TI�7PLg8;:=STI;Hw8;7PL�S�jk8;I@:GHJ6�j#MeI@?J6 6�[email protected]:�6K?n<�HJO9798@7P:Gj=`HJL.<YHAL.:=v STI;H�F.B.7PQGHJOR3.j:GI�7PLg8;:=IMyHJQ=:E8;B�Hw8,:=L�HJ5.O9:Gj�Fd:GL^7PL.F.348;jG�

��_

Page 14: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

�\¡

Page 15: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

� � ��� ��� �

� ��� � � � � � � ��� ��� � � � ��� � ����� � � � �

����� )��*�+�,�- ���-�,��" � ��� ���%��"#�-$

��L�79<.:\HJO%L�H\rn7PSgHw8;7P?JLq7PLg8;:=IMyHJQ=:ªj@B�?T3.OP<z5d:{Q\H�F�HJ5.O9:ª?JM�<[email protected]�[n79L.SZ6KHJF.jG`�O9?4QGH�8;79L.SVOPHJL.<4|6KHJI@�-jG`aF.I?�r479<.7PL�S�<�[email protected]<�7PI@:=Q=8@7P?TL.j�HJL�<YF.I?�r479<.7PL�SKI:\HJO�8;796K:E8@I;H�¨�QDI@:=F�?TIk8;j=�W��B.:�F.I@:�|:�~479j8;79L.S>§�?�[THJST:=I�jk[4jk8;:=6 Me3�O9f�O9OPjE8;B�:Gj@:�Q\H�F�HJ5.79OP798@7P:=jG��¤¥8DB�HJj�H^6KHJF�<.7PjF.OcH\[T`/H{8;:�~48x5�?\~Me?TI(<�H�8;HY:=L-8@I[J`lHJL.<sH^Me:�v 5.3�88;?TL.jDMe?TI(QG?TLg8@I@?TO£�ª��B.:�j[nj8@:G6 :GL.SgH�ST:Gj�7PL�H>[email protected]@L4|¥5�HJj:G<<.7PHJOP?TSDv�798@Bª8;B.:�3.j:GI=`.v�B.?�:G798@B.:GIWj@Fd:\HJ�-j�8;?A7}8�<.7PI:GQ�8;O9[K?TIW8�[nFd:Gj�i-3.:Gjk8;79?TL.j�7PLg8;?�8;B.:E8@:�~n85d?�~����,O98@[email protected]�j[nj8@:G6 B�HJj�B.HJ<�QG?TL.j7P<.:=I;HJ5�OP:Aj@3�QGQG:=j@j�7PL�j@:=Irn7PL�S>8@B.:A3.j:GIG��j(L.:G:=<.j7PL�L�H\rn7PSTH�8;79?TLR`R8;B�:�3�j@:GI=� j�7PLg8;:=I;HJQ�8;79?TL�v�798;B�8@B.:Kjk[nj8;:=6 7Pj�6KHJ7PL.O}[YrJ:GI5�HJO �1¦�8;B.:=I(7PL.F.3486�?4<�H�OP798@7P:=jlHJI:�6�?Tjk8;O9[x3.L-3.j@:=<R� �?TI�:�~�HJ6�F.OP:�`gj@F�H�8@7cHJO�j:GO9:GQ=8@7P?TLKHJL.<�STI@H�¨�8;7�QG?J3.OP<�L.?J8%5d:F.I?4Q=:Gj@j:G<Y5-[{8@B.:(j[nj8@:G6^�

¤�L�B-3.61H�LV8;?ªB-3.6KHJL�79L-8@:GI@HJQ=8@7P?TL.j=`dv#:Aj@Fd:\H��VHJL�<�ST:Gjk8;3.I:x8;?ª:GHJQtB�?J8@B.:GIEj7P6�3�O98tH�L.:�|?T3.jO9[J`#H�L.< 79L�Me?TI61H�8@7P?TL�MeI@?T6 ?T3.IAST:[email protected]@:=jKH�L.<�j@Fd:G:GQtB 61H\[sQG?T6�F.OP:=6K:=Lg8�:\HJQtB�?J8;B�:GIG�p 798@B�§�?�[THJST:GI=`4j3.QtBªST:[email protected]@:=jWQG?J3.OP<�5�:�:�~�F�I@:Gjj@:=<YH�j%Fd:GLKj8@I@?T��:GjW?JI%SJI;H�¨�8;7�?JLK8;B�:,6KHJFR�p [email protected]�HYv#:\HJO}8;Bq?JM�L.:=v [email protected]@7P:=jG`�vW:1<.:GQ=7P<.:=<s8;?Y7PLg8;I?4<.3�QG:1Fd:GLsST:Gjk8;3.I:GjA7PLg8@?§�?�[gHJSJ:GIG�#2479L.QG:�Fd:GL^ST:=j8;3�I@:Gj�HJI:DH�L�:=v 79L.F.3�8�6K?n<�HJO9798�[�Me?TI�§�?�[gHJSJ:GI�8;B�Hw8�61H\[15�:(3.j:G<v�798@B�?TI�v�7}8;B.?T348�j@Fd:G:=QtBs7PL�F.3�8\`�8;B.:A<.:=j@79STL�?JM�§�?�[gHJST:=I�L.:G:=<.:G<�8;?{5d:AI@:�|�jk8;I@3�Q=8;3�I@:G<o��¤�L8;B�:DF�I@?nQG:GjjG`aj@?J6K:�L.:�v QG?J6KFd?TL.:=L-8@j�vW:=I@:�HJ<.<.:=<VHJL�<Y?J8@B.:GIj�vW:=I@:D6K?n<.79f.:G<R�

�98

Page 16: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

Speech Text

AudioServer

Recognizer

Dialog Manager

ContextResolution

Database

Text +Graphics

Audio

NaturalLanguageGenerationUnit

Input

Output

GUI

UnderstandingLanguageNatural

Unit

ServerAudio

Synthesiszer

�79ST3.I@:�]�|t�J®lUW?T6�Fd?TL.:GLg8@j�?JMa8;B.:�:�~�[email protected](���E���� � 2n[nj8@:G6 F�I@?nQG:[email protected](?TL.O9[�j@Fd:G:=QtB1H�L.<8;:�~n8

��T

Page 17: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

��������� � $���)�� �������E"� �����E" *�&�� � )�' ���E �K�R��� ���E&(�,�

24Fd:G:=QtB�H�L.< 8;:�~48>79L.F.3�8@j{HJI:VF.I?4Q=:Gj@j:G<�5g[ 8;B�:Z:�~47Pjk8;79L.S��(HJOcHw~n[�MeI;H�6K:�vW?TI�a�+24F�:=:GQtB7PL�F.3�8�79jW<.79ST798@7P�=:G<KHJL.<{j@:=Lg8�8;?x8@B.:(2�«,XZXV¤�� 24F�:=:GQtB>I@:=QG?TSJL.7P�=:GI�� ¡J¢d8;?�F�I@?nQG:Gjj�8;B.:EHJ3.<.79?vWH�rJ:=Me?TI6 HJL�<qST:GL�:GI;Hw8;:ªH^vW?TI<[email protected]?JM�Bg[nFd?J8;B.:=j@:=jG����B.:�vW?TI<zSTI;H�F.Bq7PjDF�HJIj@:=<z5-[��¤ >,��� �\_J¢ `d8;B.:�L�H�8;3�I;HJO/OcHJL�ST3�HJST:D3.L.<�:GI@jk8tHJL�<.7PL.S{jk[nj8;:=6Y`�v�B.7PQtB�j:GOP:=Q=8@j�HJL.<ZF.HJI@j:GjE8;B�:5d:Gj81Bg[4Fd?J8@B.:Gj7Pj{HJL�< :GL�QG?n<.:Gjª7}8ªH�j1Hsj:G6KHJLg8;79Q^MeI@HJ6K:�����B.:Zj:G6KHJLg8;7PQ>MeI;H�6K:>7Pj�8;B�:GLF.I?4Q=:Gj@j:G<�5g[q8;B.:{Q=?TLg8;:�~48�I:Gj@?JOP3�8@7P?TLqj:GIkrT:GI�8;?�I:Gj?TO9rJ:{<.7PjQG?T3.Ij@:>F.B.:=L.?T6�:GL�H�j3.QtB H�jF.I?TL.?T6�7PL�H�O�I@:�Me:GI:GL.Q=:GjG`�HJL�HJF�B.?TI;H�j#H�L.<K:=OPO97PF.j7Pj�� _�¢ �l��B�:,I:Gj@?JO9rT:=<Kj:G6KHJLg8;79Q�MeI@HJ6�:�7Pjl8;B�:GLj@:=Lg8�8;?�8@B.:�<.7cH�OP?TS�61H�L�HJST:=IG`�v�B�7PQtB�<.:=8@:GI6K79L.:Gj�8@B.:�HJF�F.I@?TF�I@7cHw8;:WI:GF.O}[T�h��B.7PjlI:GF.O}[D7Pjlj:GLg88;?{8@B.:�L�H�8;3�I;HJO�OPHJL.ST3�H�ST:�ST:=L.:GI@H�8;79?TL�3.L.798G`Rv�B.7PQtB�QGI:\H�8@:Gj(8;B.:A8@:�~n8D?T3�8;F�3�8D?JM#8@B.:�I@:=F.O9[HJL.<KB�HJL.<�j#7}8%8@?�8@B.:,jk[nL-8@B.:Gj7P�=:GIG�%«�j@7PL�S�8;B�7Pj�8;:�~48#?T3�[email protected]�8G`n8@B.:,jk[nL-8@B.:Gj7P�=:GI�F.348;j#8@?TST:�8;B.:=IHJL^HJ3.<�7P?�I@:=F.I@:=j@:GLg8;H�8;79?TLY?�M�7}8�HJL.<^j@:GL�<.j�8@B.:DHJ3.<.79?�v�H\rJ:=Me?TI6 8@?A8;B.:DHJ3.<�7P?�j@:=IrT:=IG�

�h:�~n8�7PL.F.348�7PjhF.I@?nQG:=j@j@:=<K79L�H�j@796K79OcHJI 6KHJL.L.:=IG`T:�~4QG:GF48%8@B�H�8�798l79jlF�HJjj@:=<�<�7PI@:=Q=8@O9[D8;?E8;B�:L�H�[email protected];H�OdOPHJL.ST3.HJST:�3.L.<.:=I@jk8tHJL.<�7PL.S�3.L.798#5g[nF�[email protected]�8;B.:�j@Fd:G:=QtB{I@:GQ=?TSTL.79�G:=IG��¦ELK8@B.:�?J3�8;F.348j@79<.:J`48;B.:E8@:�~n8�?T3�[email protected]�8�5g[nF�HJj@j:Gj�8;B.:�jk[nL-8@B.:Gj7P�=:GI,HJL.<>HJ3.<�7P?Aj@:=IrJ:GI�HJL.<>7PjW<.7PjF.OcH\[T:=<>?TL>[email protected]\HJOR79Lg8;:GIkMyHJQG:�� �7PSJ3.I@:D]�|;��j@B.?�v�j�8;B.: ��?�v <�7cHJSTI@HJ6 [email protected]�jk[nj8;:=6Y�

��������� � ��� ��� �n�.�E$������E&(�,�

«,L�OP7P��:�8;:�~n8WHJL.<Kj@Fd:G:GQtBo`�Fd:GL1SJ:[email protected]@:=j�HJI:�:�~4F.I@:=j@j:G<{[email protected]}[AHJL.<�6KH�[�79L.QG?JI@Fd?TI;H�8@:�j@F�H�|8;7PHJO�7PL4Me?TI@6KH�8;79?TLR�#CE79��:GI:GLg8�ST:Gjk8;3.I:GjEQ=?TLgrT:=[Y<.7}�o:=I@:GLg8�6K:GHJL.7PL�STjG� �?TI�:�~.H�6KF.O9:J`dHKQ=7PIQGOP:7P6�F.O97P:Gj#Me?4Q=3.j�?�rJ:GI�8;B.:(:GL�QGOP?Jj@:G<YI@:=ST7P?TL>v�B.79OP:(H�OP7PL�:�7P6�F.OP79:GjWMe?nQG3.j�?�rT:=I,8@B.:(I@:GSJ7P?TL^L.:\H�I798G�s� ST:=j8;3�I@:>I@:=QG?TSTL�7P�G:=I�v�H�j�796KF�OP:G6�:GLg8@:G<q8;?�I:GQG?JSTL.7P�=:{[email protected] ST:Gjk8;3.I:Gj=��� j:G6KHJLg8;79QI@:=F.I@:=j@:=L-8;H�8;79?TL�Me?TI�8@B.:�ST:=j8;3�I@:Gj�vWHJj�<.:�f�L.:G<o`hH�L.<Z8;B.:AQ=?TLg8;:�~48(I:Gj?TOP3�8@7P?TLVF.I@?nQG:[email protected]�|6�:GLg8;:=<�8;?Y7PL.Q=?TI@Fd?TI@H�8;:�8@B.:1H�<.<.798@7P?TL.HJOl7PL4Me?TI@6KH�8;79?TLR`Rj?Y8@B�H�8�j@Fd:G:GQtBo`lST:Gjk8;3.I:1H�L.<�8@:�~n8QG?J3.OP<>5d:DQ=?T6�5.79L.:G<>79LYHAQ=?TL.j@79j8@:GLg8�6KHJL.L�:GI�8;?�<.79j;HJ6x5.7PST3.H�8;:�8@B.:(3.j@:=IG��j,79Lg8;:GLg8@7P?TL.j=�

��������� *����E)�'E$������ ���ª�.'E� ���E&(�,� ��� ����@�����k� �

��B.:(QG?J6�5.7PL.H�8;79?TLª?JMh7PL�Me?JI@6KH�8;79?TLKMeI?T6 jF�:=:GQtBZH�L.<YSJ:[email protected]@:=j,I:Gi-3.79I@:Gj�8@B�H�8�5d?J8;B>6�?4<�H�O}|798@7P:=j�HJI@:(j[nL.QtB�I@?TL.79�G:=<Yv�798@BY:GHJQtBV?�8;B.:=IG����B.:(vW?TI<[email protected]�?JMhBg[nF�?J8@B.:Gj:Gj,ST:GL.:=I;H�8@:G<Y5-[

�9;

Page 18: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

8;B�:�I@:GQ=?TSTL.79�G:=IlQG?TLg8;HJ7PL�8@B.:�j8;HJI8�H�L.<�:GL.<A8;796K:=j�?JMd:GHJQtBAvW?TI<R� :h:GL�ST:Gjk8;3.I:Gjlv#:GI@:�O9?TSTST:=<7PL^H�<�H�8;HJ5�HJj:J`�v�B.7PQtB>v#:�QGHJOPOR8@B.:Y�6�3.O}8;7P6�?n<�HJOd<�H�8tH�5�HJj@:�� �s��B.:D8@7P6�:Gj�8@B.:(ST:Gjk8;3.I:Gj�?nQ�|QG3�I@I@:=< HJL�< 8;B�:G7PI�796KF.O97P:=<q6K:GHJL.79L.S�HJI@:^j8@?TI@:=<R� ��B.79jK<.H�8tHJ5.HJj@:>7Pj�H�L.:=v­H�<.<.798@7P?TLq8@?§�?�[gHJSJ:GIG����B�:x7PL4Me?TI@6KH�8;79?TL1MeI?T6 8;B.:DST:=j8;3�I@:Gj,7Pj�3.j@:=<Z5g[{8;B.:�QG?TLg8@:�~n8EI:Gj@?JOP3�8@7P?TL>j@:=IrJ:GIMe?TI�Me3.j7P?TL>?JMhST:=j8;3�I@:Gj�v�798@B>j@Fd:G:GQtBV7PL�Me?TI61Hw8;7P?JLR�

��������� � �E�.�k��� �� )d'E�������

��B.:(:�~479j8;79L.S�QG?TLg8@:�~n8�I@:Gj?TOP348;7P?JL{6K?n<.3.O9:EI@:=j@?TO}rT:G<YHJ6�5�7PST3.?J3.j�I@:�Me:GI:GL.Q=:Gj�j@Fd?T�J:=LY5g[{8;B�:3.j:GIE5g[^7PL.Q=?TI@Fd?TI@H�8;79L.SK79L�Me?TI61H�8@7P?TLªMeI?T6 8;B.:�3.j@:=IG��jEF.I:=rn7P?T3�j�B.79j8;?JI[^?JM�3�88;:=I;HJL.Q=:Gj=�E¤�LHqFd:GL4|¥5�HJj@:=<m6�3.O98@7P6�?4<.HJO�j[njk8;:G6^`,8@B.:Z796KF.O97P:=< 6�:\HJL�7PL.Sq?�M(F�:=L�SJ:[email protected]@:=j{L.:G:=<�8;?z5d:7PL�QG?TIF�?TI@H�8;:=<s79L-8@?Y8@B.:1j:G6KHJLg8;7PQ�MeI;H�6K:�?JM�8@B.:13�88;:=I;HJL.Q=:{HJj(vW:=OPO£� �?TID:�~�HJ6�F.O9:J`�7}M�8;B�:3.j:GI%j;H\[njG`��°,?�v <.?D¤�SJ:=8�8;B.:=I@:�MeI@?T6 XV¤����\�.`n8@B.:�j[nj8@:G6 L.:=:G<.j%8;?D<.:=8@:GI@6�7PL�:�7}M�8@B.:�3.j@:=I7Pj,I@:�Me:[email protected];?{H1I:GST79?TLVB�:�QG79I@QGO9:G<Z?JLV8;B.:x61HJFo`o?TI�8;?{H1O9?4QGH�8;79?TL^B.:�B�HJ<�jF�?J�J:GL�H�5�?T3487PLZ8@B.:AF.I:=rn7P?T3�j�3�8@8@:GI;H�L.QG:�����B.:AMe3.j@79?TL�6�:GQtB�HJL�7Pj@6­8;?>I@:=j@?TO}rT:�[email protected]�79j@j@3�:AL.:G:=<.:G<�8;?>5d:7P6�F.O9:G6�:GLg8;:=<R�

��������� � � �

��F.HJI8�MeI?T6 8;B.:�7PL.F.348�F.I@?nQG:=j@j:GjG`.8@B.:E<[email protected]\[K?�M/§�?�[THJST:GI�HJOPj?�L.:G:=<.:G<{8@?A5�:EI:�|¥<.:Gj7PSTL.:=<HJj�vW:=OPO ����B.:xL.:=v+7PLg8@:GIMyH�QG:�H�QGQG:=F�8;j�F�:=LZST:Gjk8;3.I:Gj�MeI?T6 8;B.:�3.j@:=I�HJL.<VF.I@?�rn7P<.:=jEHKrn79j@3�HJOMe:G:=<.5�HJQt�>H�5�?T348�v�B�H�8�v�H�j,<.I@H\v�LY?TL>8;B�:D6KHJFR�

����� � � � � �% & � ��� ����� �� ��'�� �~�*�~�,�

¤�Lsrn7P:�v ?JM�8;B�:Gj@:1<.:Gj7PSTLqQ=?TL.j7P<.:=I;H�8@7P?TL.j=`�HYL�:=v MeI;HJ6�:=v#?TI��?�M�§�?�[THJST:=I�vWHJj�F.I?TF�?Jj@:G<o���B.79j�L�:=v §�?�[THJST:GI,2n[njk8;:G6 B�H�j�8@B.:�Me?TOPO9?�v�7PL.S�Q=?T6�F�?TL�:GLg8;j=®

��I;HJF�B.7PQGHJO�«�j@:GI�¤�Lg8;:=IMyHJQ=: � �D«�¤ D|D��B�:^L�:=v­�(«,¤t`�v�B�7PQtB�Q\HJL�B�HJL�<.OP:{Fd:GL�5�HJj:G<79L.F.3�8G����O9Olj8@I@?T��:KST:[email protected]@:=jxHJI:A<.I;H\v�L�?TL�8;B.79j�7PLg8;:=IMyHJQ=:J�A¤¥8DHJO9j@?>QG?TLg8;HJ7PL.j(Hª8@:�~n8:=L-8@I[�5d?\~o`/H>OP79j8�5d?\~�Me?TI�OP79j8;79L.SªI:Gj@3�O98;j(MeI@?J6 <�H�8;HJ5�HJj:J`hHJL.<�H{6K:=j@j;H�ST:�v�79L.<.?�v

��<

Page 19: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

<[email protected]\[479L.S�8;B.:�I:GF.O}[{MeI@?T6 8@B.:x<.7PHJOP?JSK6KHJL�HJSJ:GIG��¤�LZ?JF�:=I;H�[email protected][nj8@:G6�j�v�798@B.?T3�8�HFd:GLR`.8@B.:(6K?J3.j@:DHJQ�8;j�HJj�H�[email protected];7}8;3�8@:J�

��:Gjk8;3.I:�±�:GQ=?TSTL.79�G:GI�|/8;B.:,ST:Gjk8;3.I:,I:GQ=?TSTL.79�G:GI%7PLg8@:GI@F�I@:=8@jWj7P6�F.OP:�ST:[email protected]@:=jWj@[email protected]:=<?TL(8;B�:#79L-8@:GIkMyHJQG:�����8/8;B.79j 8@7P6�:J`�?TL.O}[�QG79I@Q=OP:Gj=`JO97PL.:=j HJL.<xFd?T79L-8@j/HJI@:%I@:=QG?TSTL�7P�G:=<R��2n7PL.Q=:8@B.:Gj:�ST:Gjk8;3.I:Gj�HJI:EI;H�8@B.:GIW:\HJj7PO9[�<[email protected][email protected]:�`�H�B.:G3.I7Pjk8;7PQ�6K:�8;B.?n<ª7PjW:G6�F.OP?�[T:=<8@?�I:GQ=?TSTL.79�G:�8;B.:=j@:[email protected]:Ej8@I@?T��:Gj=�

XV3�O98;796K?n<�HJOd<�H�8;HJ5�HJj:(|%[email protected]�<�Hw8tHJ5�H�j@:Dj@:GIkrT:=jEHJj,HA6K?T3�j@:(:=rJ:GLg8EO9?TSTST:=IG`.I:GQG?JI@<.79L.SHJO9O�8@B.:�6K?J3.j@:�6�?�rT:G6�:GLg8@jhH�L.<�8;B.:=7PIR796KF.O97P:=<E6K:GHJL.79L.S�<.3.I7PL.S�8@B.:�3.j@:=IG��j 7PLg8;:=I;HJQ�8;7P?JLv�7}8;B{8;B.:(3.j:GI=�

«�F�<�Hw8;:G< UW?TLg8;:�~n8ª±�:Gj?TOP3�8@7P?TL�j:GIrJ:GIA|(8;B.79j�j@:GIkrT:=I�v�79OPO�I:Gj@?JO9rT:>I:=Me:GI:GL.Q=:[email protected]?J8;B{8@B.:(7P6�F.OP79:G<16�:\H�L.7PL.SA?�Mh8@B.:(F�:=L^SJ:[email protected]@:=j�H�L.<^8@B.:�I@:�Me:GI:GL.Q=:Gj�79Lª8;B.:(B.79j8@?TI[?JM/8;B�:D<�7cHJO9?TS.�

� ��?�v­<.7PHJSTI;H�6 ?JM�8;B.:Vj[nj8@:G6 79j1j@B�?�v�Lm79L �7PSJ3.I@:V]�|k]���B.:�L.:�~n8ªMe:�v­QtB�HJF�8@:GI@jªv�79OPOQG?�rJ:GI(8;B.:A<.:=j@79STL�?JM#8@B.:�L.:=v QG?T6�Fd?TL.:GLg8@j�H�L.<�8;B.:A6�?4<�79f�:=<�?TL.:Gj=`hL.HJ6K:=O9[J`o8;B.:�[email protected]|7PQGHJO�3�j@:GI>79L-8@:GIkMyHJQG: �¥UWB�HJF48;:GI^_ ;`�8@B.:�ST:=j8;3�I@:�I@:=QG?TSTL�7P�G:=I � UWB�HJF�8@:GI>¡ t`�8;B�:�6�3.O98@7P6�?4<.HJO<�H�8;HJ5�HJj: � UWB�HJF�8@:GI 8 #HJL.<>8;B.:(6�3�O98;796K?n<�HJOaQ=?TLg8;:�~n8,I@:=j@?TO93�8;79?TL{6K:=QtB�HJL.79j@6 �¥UWB�H�F�8;:=I T t�

��_

Page 20: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

Speech Text Pen

AudioServer

Recognizer

GestureRecognizer

MultimodalDatabase

Dialog Manager

ContextResolution

Database

Text +Graphics

Audio

Synthesiszer

UnderstandingLanguageNatural

Unit

NaturalLanguage

UnitGeneration

Input

Output

GUIServerAudio

�79ST3.I@:D]�|k]4®%UW?T6�Fd?TL.:GLg8@j�?�Mh8@B.:">,:=v 2n[nj8@:G6 v�798@B>8@B.:(7PLg8;I?4<�3.Q=8@7P?TL{?JMhFd:GL^ST:Gjk8;3.I:Gj

]Jb

Page 21: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

� � ��� ��� �

� � � � ��� � � � � � � � � ����� � � � ����� � ���

� ��� � �% & � ��� ����� �� ��'�� ���

�79ST3.I@:W_w|t�Wj@B.?�v�j%HJLA7P6KHJST:#?JMa8;B.:WL.:=v STI;H�F.B.7PQGHJO�3�j@:GI�79Lg8;:GIkMyHJQG:�����B.79j�7PLg8;:=IMyHJQ=:�QG?JL-8;HJ7PL�jH�61H�FA<.7PjF.OcH\[T`-HE��:=[n5d?gHJI@<K:GLg8;Ik[A5d?�~�`-H�6�:Gj@j@HJST:�5d?�~AHJL.<�H�OP79j8�5d?\[email protected]:Gj3.O98@jlMeI@?T6§�?�[gHJSJ:GIG�

�`%/E �Q�1J�E G�%*#� ��B.79j�<�7Pj@F�OcH\[{j@B�?�v�j�HJL^7P6KHJST:EQ=?TLg8tHJ79L.7PL.S�8@B.:DI@:Gi-3.:=j8@:G<Z6KHJFR��¤¥M8@B.:,3�j@:GI#HJj�nj%Me?TI�OcHJL�<.61H�I@�-j�?TL�8;B.:�61H�FR`-7PQG?JL.j�I@:GF�I@:Gj:GLg8;79L.Sx8@B.:Gj:,OPHJL.<.6KHJI@�-j%HJI:<[email protected]\[T:G<ZHJjEj@i-3�H�I@:Gj=� p B.:=LZ8;B.:�6K?T3�j@:x79j�?�rT:=I�8;B�:�<.7PjF.OcH\[J`�7}8�jkv�798;QtB�:Gj�MeI?T6­HJLHJII@?�v 79QG?TL�8;?VH^j61HJO9Olv�B.798@:KFd?T79L-8G`hO97P��:�8@B.:�8;7PF�?JM�H>Fd:GLR`hj@?Y8@B�H�8D8;B.:�3.j:GI�v�[email protected].��?JM 8;B�:�6K?T3�j@:EFd?T7PLg8@:GI�HJj�H�Fd:GL{Me?TI#<.I;H\v�79L.S�?TLª8;B.:�6KHJFR����Lg[ª6�?T3.j:�QGOP79Qt�-j?TI(6�?T3.j:K<.I@HJSTjD?TL�8;B.:�61H�F�v�79OPO�5d:KI:GF.I:Gj@:=Lg8;:G<�H�jDv�B.7}8;:�Fd?T7PLg8;jD?TI�8;B�7PL�v�B.798@:jk8;I@?J�J:Gj�I@:=j@Fd:GQ�8;79rJ:GO}[T`�v�B.7PQtB^j@:=IrJ:GjEH�j�rn79j@3�HJO�Me:G:G<�5�HJQt�ª8;?�8;B�:D3�j@:GI=�

�� �1J���� ���� ��B�:DO97Pjk8�5�?\~ªj@B.?�v�j�<�H�8tH�5�HJj@:�I:Gj3.O98@j�?JI�OcHJ5d:GO9jWI@:=F.I@:=j@:[email protected]�8;B.:�79QG?TL�j?TLK8;B.:E6KHJFR� p B.:GLª8@B.:E3.j:GI�6�?�rJ:GjW8@B.:E6�?T3.j:�?�rT:=I�8;B.:E79QG?TLK?JM 7PLg8@:GI@:=j8G`�8;B.:�7PQG?JLHJL�<K8;B�:�OP79j8%798@:G6 HJI:�B.79STB.O97PSTBg8;:=<R�/��B.7Pj#B.:GO9F.j#8@B.:�3.j:GI#�nL�?�v�8@B.:�Q=?TI@I:GQ�8�OP79j8%798@:G6I:GF.I:Gj@:=Lg8;7PL�S�8@B.:(7PQG?JL.jG�

�`)\J�JX%('�) ���� ������� ��B.:�6�:Gj@j@HJST:xv�79L.<.?�v+<.7PjF.OcH\[nj,8@B.:xrJ:[email protected]�I:Gj@Fd?TL.j:A?JM�8;B�:Q=?T6KF�3�8;:=IG� ��B�:YI:GF.O97P:GjAMeI?T6!8;B�:YQ=?T6KF�3�8;:=IKH�I@:^<.7PjF.OcH\[T:=< j:GF�HJI@H�8;:=O9[qMeI?T6 8;B�:

]4�

Page 22: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

�79ST3.I:�_w|t�J®���B.:��([email protected]\HJO�«�j@:=I�¤�Lg8@:GIMyH�QG:J�

]T]

Page 23: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

<�Hw8tHJ5�H�j@:(I@:[email protected]}8;j�5�:=Q\HJ3�j@:[email protected]:,8;3�[email protected]�QG?T3�OP<>?4Q=QG3.I�v�B.79QtBY348;7PO97P�=:�8;B.:Dj;H�6K:�O97Pj8?JMh<�H�8;HJ5�HJj:(I@:Gj3.O98@jG�

�� )L# � �&%$��� � W���9# � ���� ��B�7Pj�8;:�~48�5d?\~>7Pj�Me?TI���:=[n5d?gHJI@<Y:GLg8;Ik[>?JM�H�j:GLg8;:=L.QG:��

�� HP �� ��� � � ������ J ��B.:=j@:>�«,L.<.?J�x5.3�88;?TL�j�HJI:,Q=?TLgrT:GL�7P:GLg8@O9[�OP?nQ\H�8@:G< �3.j8#5�:=OP?�v8@B.:A61H�FR`Rj@?{8@B�H�8E8@B.:A3.j@:=I(Q\HJL�:\H�j@7PO}[V3�L.<.?>HJLg[�3.L�<.:Gj7PI@:=<�j8;I?T�J:=jG�A��B.:=I@:�HJI:�]5.348@8;?JL.jG`4?TL.:E5.348@8;?JLªMe?TI#I:G6�?�r479L.Sx8@B.:EOcH�j8#j8;I?T�J:E8@B.:E3.j:GI�<�I@:=v�?TLK8;B.:E6KHJF{H�L.<HJL�?J8;B.:=I�5.3�8@8@?TL{Me?TI�I@:=6K?�rn7PL�SKH�OPORjk8;I@?J�J:Gj�?TL{8;B�:D6KHJFR�

� ��� � �>�%�%��� ���-�,��" � � ���,��� �������

��B.:�OPHJ5�:=OPj�Q=?T3.O9<{B�H\rT:(5�:=:GL>F.OPHJQG:=<{L.:�~n8�8;?�8@B.:�QG?TII@:=j@Fd?TL.<.79L.SA7PQ=?TL.jG`.HJj�8;B�Hw8�vW?J3.OP<>5d:QGO9:\HJI:GID8;B�HJL�OP79j8;79L.S>8;B.:KOcHJ5d:GO9jDj:GF�H�I;H�8@:GO9[�7PLsHYO97Pj8D5d?\~o�V°,?�v#:=rT:=IG`�F.OPHJQG79L.S^8@B.:1OPHJ5d:GOPjL.:�~48K8;?�8;B.:^7PQ=?TL.j�7PLg8;I?4<�3.QG:=< 6�?TI@:>QGO93�8@8@:GI�?TL�8;B.:^61H�F <[email protected]\[T� ¤¥ME8@B.:GI:VH�I@:^61HJLg[OcH�L.<.6KHJI@�-j�L.:GHJI�:GHJQtB ?�8;B.:=IG`�798x7PjxrJ:GI[q<.79¨�QG3�O98�8@?�ST:GL.:=I;H�8@:>HZOP:=ST7P5.O9:1OPH�[J?T3�8A?�M,79QG?TL�jHJL.< OcHJ5d:GO9jG����7Pjk8;7PL�S�8@B.:^OcHJ5d:GO9jA7PL H�j:GF�HJI@H�8;:^OP79j8�5d?\~�ST:GL.:=I;H�8@:G< H�L.:GH�8;:=I1H�L.< 6�?TI@:F.O9:\HJj@HJLg8�H�F.F�:GHJI;H�L.QG:��W��L�?J8;B.:=I�HJF.F.I?gHJQtBYv#?T3.O9<Y5d:�8;?�3.j@:D<.7}�o:=I@:GLg8�[email protected]�:=j�?TI�F�[email protected]@:=j8;?YI@:=F.I@:=j@:GLg8A8@B.:179QG?TL.j=�VCE3�:K8;?Y8;B.:1HJI8@7Pj8@7PQ�QG?J6KF.O9:�~4798�[�?�M�ST:GL.:=I;H�[email protected]^8;B.:=j@:ª<�79��:GI@:=Lg88�[nF�:=j�?JMa7PQ=?TL.j=`J8;B.:Wj@7P6�F.O9:GIlH�F.F.I@?THJQtBA?JMaI@:=F.I@:=j@:[email protected]�8@B.:G6 HJjljin3.HJI@:=jlv�HJj�3�j@:G<�79L.j8@:\HJ<R�¤�L1SJ:GL.:=I;HJO£`-8@B.:�<.:[email protected]:=j#8@B�H�8#HJOPO�79Lg8;:GI@HJQ=8@7P?TL�j�v�7}8;B�8;B.:�7PLg8@:GIMyH�QG:J`nj@Fd:GQ=79f�QGHJOPO}[�8;B�:j8@I@?T��:Gj,HJL.<>8;B.:(6�?T3.j:D6�?�rT:=6K:=L-8@jG`�jB.?T3.O9<Y5d:�7PLg8;3�798;7}rT:(HJL�<Yj7P6�F.OP:��

� � � � �*& � � ��� ��&���� � ���-�

24?T6�:D7PL�Me?TI61Hw8;7P?JL{7Pj�6K?TI:�Q=OP:GHJI@O}[>HJL.<Z:�¨�QG7P:=Lg8;O9[^Q=?TLgrT:=[J:G<�v�798@BZH�j@7PL�STOP:D7PL.F�3�8�6�?n<.:J`v�B.79OP:E?J8@B.:GIj�HJI@:�5d:=88;:GI�Q=?TLgrT:=[J:G<Z3�j@7PL�SKH�Q=?T6�5.79L�H�8@7P?TLR���h?�6KHJ�J:E§�?�[gH�ST:GI ��:�~�795.OP:(H�L.<F.I?�rn79<.:K3�j@:GIj�v�7}8;B�STI@:GH�8;:=ID:�~4F.I@:=j@j@7}rT:ªFd?�vW:=IG`h6�[email protected]:A7PL.F�3�8D6K?n<.:Gj�v#:GI:17PLg8@I@?n<.3.QG:=<7PL�8@B.:K79Lg8;:GIkMyHJQG:�����B.:Gj:17PL�F.3�8(6�?4<.:=jDHJI@:�j@Fd:G:=QtBzHJL.<�Fd:GL�ST:Gjk8;3.I:GjG�K��O}8;B.?T3�STB�H^��:=[g|5d?gHJI@<A:=Lg8;I[�5�?\~x7PjlF.I?�r479<.:G<o`n3�j@7PL�S�798lj7P6�3�O98tH�L.:G?T3�j@O9[(v�7}8;B�HE6K?J3.j@:�79jlQG3�6�5�:=I@j?T6K:�H�L.<7PL�:=¨�QG79:GLg8\�K¤¥8x79j�H�j@j@3�6K:=<�8;B.H�8Dj@Fd:G:GQtB�H�L.<�8@:�~n8�j@:GIkrT:18@B.:�j;HJ6�:�Me3.L.Q=8@7P?TLo`/5�3�8xjF�:=:GQtB

]J_

Page 24: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

7Pj�6K?JI@:1L.H�8;3.I@HJO#Me?JIxB-3.6KHJL.j�<.3�I@7PL�SZQG?TLgrJ:GI@j@H�8;79?TL�HJO#7PLg8;:=I;HJQ�8;79?TLR�Z��B.:{Q=?T6�5.79L�H�8@7P?TL�?JMFd:GLsSJ:[email protected]@:=j�HJL�<sj@Fd:G:=QtBzST79rJ:GjD3.j@:=I@jxHJ<.<.7}8;7P?JL�HJO ��:�~47P5.79OP798�[^Me?TID:�~4F.I:[email protected];B.:=6Kj:GO9rJ:Gj=�XV3.O}8;79F.OP:#7PL.F.348�6K?n<.:GjlHJOPO9?�v�8@B.:�3.j@:=I�8;?(QG?T6�6�3.L�7PQ\Hw8;:W79LA8;B.:�6�?Tj8l:=¨�QG79:GLg8#HJL.<�L�H�[email protected];HJO6KHJL.L.:=I�Me?TI�H�r�HJI7P:�8�[ª?JMhi-3.:GI7P:Gj=�

� ��� ��� � ������ �������� $������ ���E&(�,�

UW:GIk8tHJ79LYi-3.:=I@79:Gj,HJI@:D6K?Jj8�:=¨�QG79:GLg8;O}[{ST7}rT:GLY7PL^j@Fd:G:=QtBZ?TI�8;:�~48G��243�QtBZi-3.:GI7P:Gj,HJI:�3.j3�HJO9O9[HJ5d?T3�8��-L.?�v�LR`d3.L�HJ6�5�7PST3.?J3.j�I@:�Me:GI@:=L.QG:=jG� �?TI�:�~.H�6KF.O9:J`�7}Mh8@B.:�3�j@:GI�vWHJLg8;j�<�[email protected]�<.7PI:GQ�|8;79?TL.j�MeI?T6­°�HJIkr�HJI@<Z8@?>XV¤���`R5d?J8;B�?JM�v�B.79QtB�HJI@:�3�L.7Pi-3.:�O9?4QGH�8;79?TL.j,7PLV8@B.:�©W?Tjk8;?TL�HJI:\H�`8;B�:K3.j:GIDQ\HJL�j@796KF�O9[Zj@H\[T` �;24B.?�v 6�:A<.I@7}r479L.S><.7PI:GQ�8;7P?JL.j�MeI@?T6 °,HJIr�HJI<�8@?^XV¤���� �Y¤¥M�8;B�:3.j:GI�vWHJLg8;jE8@?ªQG?TLgrJ:=[V8@B.:�j@HJ6K:�6K:GHJL.79L.S13.j7PL.S1?TL.O9[^ST:[email protected]@:=jG`o8@B.:�3.j:GIEQ=?T3.OP<Yf�L.<Z8;B�:OP?nQ\Hw8;7P?JLV?JM#°�H�Ir�HJI@<�H�L.<�XV¤��+?TL�8;B.:�6KHJFR`oQGOP79Qt�Y?JL�5�?J8@B�?JM�8;B.:=6Y`o?TIE<.I@H�v HJL�HJII@?�v?TI7PST79L�H�8;79L.S�MeI@?T6­°�H�Ir�HJI@<Z8@?>XV¤���� 24796K79OcHJIO9[J`.8;?{<.?ª[email protected],6�3.O98@7P6�?4<.HJOPO}[T`�8@B.:A3.j@:=I�6�3.jk8QGO97PQt��?JL�8@B.:�j@QtB.?n?TOPj=�-OP?nQ\H�8@7P?TL.jlHJL.<�j;H\[T`��@°,?�v�<�?�¤hST:=8�MeI@?J6 B.:GI:�8@?�B�:GI@: �\��§�:=I@5�H�OP7P�=7PL.S8;B�:Di-3.:=I[>79j�8;B.:(6�?Tj8�:�¨KQ=7P:=L-8�6�:=8@B.?4<>79L>[email protected]�QGHJj@:��

¦�8;B.:=I,H�Q=8;79?TL.j�v�B.79QtBVH�I@:(6K?Jj8�:=¨�Q=7P:GLg8�rT:=I@5�H�OPO9[ª?TI�5g[ª8�[nF.7PL.SKHJI:J®

�;2nB.?�v 6�:�6�3.j@:=3.6�j�79L^©W?Tj8@?TLR���

�;��79rJ:�6K:(H�LY7961HJSJ:�?JM�©W?Tjk8;?TLR���

���o?n?T6 7PL{8;?A8@B.:�Me?T3.I8@BY?JL.:J��� �y7 ��:J�}`.�G?n?T6 79L{8;?�¡J8;B>79QG?TL>7PL{8@B.:(OP7Pjk8\�

� ��� ��� � ������ ����1*��.$��������E" ���E&(�,�

�E3.:GI7P:=jW8;B�Hw8�HJI@:�6K?Tjk8�:=¨�Q=7P:GLg8@O9[ª:�~4:GQG348;:G<^5g[ªj?TOP:=O9[�j8@I@?T�-7PL�SA?�rJ:GI�8@B.:�61H�Fª?TI�O97Pj8W5�?\~3.j3�HJOPO}[E79L-rJ?TO9rJ:%f.L.<.7PL�S�8@B.:�OcHJ5d:GOTMe?TI H�L�79QG?TL(v�798@BxH��-L.?�v�[email protected]�8;7PHJOgOP?nQ\H�8@7P?TL�?TI�r479QG:�rT:=I@j;H4��?TI�:�~�HJ6�F.OP:�`�7}M�8;B�:x3.j:GIE79j,79L-8@:GI:Gj8@:G<Z79LYf�L�<.7PL.SK?T3�8�6K?TI:xH�5�?T348EH�F�HJI8@7PQ=3.OcHJI�79QG?TLY?TL8;B�:�6KHJFR`�5�3�8DB.:�<.?4:=j@LR� 8��nL�?�v 8;B.:�L�H�6K:�?JM%8;B.:�79QG?TLR`�B�:�QGHJL�QGOP79Qt�V?TL�8;B�:�79QG?TLo�A��B.:QG?J6KF.348;:GI�796K6�:G<�7cH�8@:GO9[D�-L.?�v�j�8;B.:�3.j:GIG��j%7PLg8;:=L-8@7P?TL�j�HJL.<�8;B.:�7PQ=?TL�HJL.<�798@j�QG?TII@:=j@Fd?TL.<.79L.SOcH�5�:=ORv�7POPOo5�:(B.79STB.OP79STBg8;:=<^79L^8@B.:(OP79j8�5d?�~���°�?�vW:�rT:GI=`o7}Mh8@B.:�3�j@:GI�QtB.?n?Tj@:=j,8@?�f�L�<V?T3�8�8;B�:L�HJ6�:�?�M/8@B.:E79QG?TLª5g[KrT:GI5�HJO9O9[KHJj@�-79L.S�8;B.:�j[nj8@:G6^`.B.:EB�H�j�8;?�j@H�[1j@?T6�:[email protected]�S�OP79�J:J`�� p B�Hw8

]�¡

Page 25: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

7Pj�8@B.:(L�HJ6�:�?JM/8;B.:(OcH�L.<.6KHJI@��8�vW?�5.O9?4Qt�-j�j@?T348;B^?JMh8@B.:�QGI?Tj@j �3.L.Q�8;79?TL>?JMlXVHJj@j��,rJ:xH�L.<:�I@?TjF�:=Q=8D2-8;I@:=:=8 ��� v�B.7PQtBZ79j�rJ:GI5�?Tj:AHJL.<VQG3.6�5d:GIj@?T6�:J��N�rT:=L�79Ml8@B.:x3.j:GI,:�~4:GQ=3�8;:=jE8;B.79ji-3.:GIk[z6�3.O}8;796K?n<�HJO9O9[T` 6�?Tj8�O97P��:GO9[�5g[zQ=OP7PQt�-79L.SZ?TLz8;B�:{7PQG?JL�HJL.<�j;H\[n7PL.S�`x� p B�H�8�7Pj�8;B.79j7PQ=?TL �\�.`�8;B�:{j@Fd:G:GQtB 7PL.F�3�8A7PjAI:G<.3�L.<�HJLg8\�z¦E8@B.:GI�H�Q=8;79?TL.j�v�B.79QtBz8;B.:>3.j:GI�Q\HJL�<.?�6�?Tj8:=¨�Q=7P:GLg8@O9[{5g[{jk8;I@?J�n79L.SKHJI@:�®

XV?�rJ:�8;B�:x6�?T3.j@:D?�rT:=I,8;B�:�79QG?TL^?JM�79L-8@:GI:Gj8��yv�7}8;B.?J3�8EH�L-[>Q=OP79Qt�n79L.S �|#7PQ=?TLVH�L.<V7}8\��j79L�Me?TI@6KH�8@7P?TLK7PL{8;B.:(O97Pj8Wv�7POPO�5�:(B.79STB.O97PSTBg8;:=<{7PL>6KHJST:GLg8;H��

UW79I@QGO9:�?�rT:GI#H(STI@?T3�FK?JM�7PQ=?TL.j�?JMo7PLg8;:=I@:Gjk8�|h8@B.:Gj:,79QG?TL�j#H�L.<�8@B.:G79I�7PL�Me?JI@6KH�8;79?TL�7PL�8;B�:O97Pj8Wv�7POPO�5�:(B.79STB.O97PSTBg8;:=<{7PL>5.O93.:J�

� ��� ��� � ���������� ���� ���E&(�,�

¤¥M�H�L�3�L.OcHJ5d:GO9:G<�I@?THJ<�7Pj�?TL�8;B.:�6KHJF�<.7PjF.OcH\[ZHJL.<�8;B.:�3.j:GI�v�H�L-8@jD8@?Y�-L.?�v B.?�v 8;?>ST:�88;?�7}8\`�B.:{QGHJL�?TL.O}[sI:=Me:GI�8@?�798A5g[s?T3�8;O97PL.79L.SV?JI�[email protected]�L.<�j;H\[n7PL.S.`��@°�?�v <.?�¤DST:�88;B�:GI@:AMeI?T6¬XV¤����\�>?TI^�@°�?�v <.?>¤,ST:=8�8@B.:GI:�MeI@?T6 B.:GI: �\� H�L.<�j8;I?T�J:�?�rT:=I(B.7Pj�jk8tHJIk8;7PL�S<.:=j8;79L�H�8@7P?TLR� «,j7PL.Sz?TL�O9[ 8@B.:�j@Fd:G:=QtB ?TI1F�:=L�ST:[email protected]@:�6�?4<.HJOP7}8�[�8@?�:�~4F.I@:=j@j>8;B.:�j@HJ6�:i-3.:GIk[>v�7POPO�5d:DQG3.6�5d:GIj@?T6�:(8;?�8;B.:�3.j@:=IG��¤¥Ml8@B.:�3�j@:GI,?TL.O}[{j@Fd?T�J:�`�B�:�v#?T3.OP<YL.:G:=<V8;?�j;H\[J`�@°�?�v <.?>¤�ST:=8EMeI?T6 8@B.:AI@?THJ<�I@79STBg8�5�:=OP?�v p 7PL.QtB.:=j8@:GI�2n8;I:G:�8DHJL.<�HJ5d?�rJ:�2n8tHw8;:�2n8@I@:G:�88;?^XV¤����\�V°,:�6�3.jk8�5d:�HJj(<.:GjQGI7PF�8@79rT:KHJj([email protected]:�8;?>:GL.j3.I@:�8;B�Hw8�8;B.:�I@?gH�<�O9?4QGH�8;79?TLZ79j3.L�H�6�5.7PSJ3.?T3.j=� ¤¥M�B.:Yj7P6�F.O9[s3.j@:=< ST:=j8;3�I@:Gj=`�B.:>vW?J3.OP<�L.:G:=< 8;?�<.I@H�v H�O97PL.:{?TI�HJII@?�vj8;[email protected]@?T6 XV¤�� ST?T7PL�SY8;?Z8@B.:{3.L.�-L.?�v�L�I@?THJ<R`l8;B�?T3.STBq8@B.:{6K:GHJL.79L.SV?JM,HVO97PL.:K61H\[j8@7PO9OW5d:>HJ6�5.79ST3.?T3.j=�s��B.:>O97PL.:ª6�7PSJB-8x7P6�F.O9[�Me?nQG3.jA?TLz8@B.:{OcHJL�<.61H�I@�-jA?JM�7PLg8;:=I@:=j8�L.:\H�I798G`�v�B.79QtBY6�7PSTBg8�O9:\HJ<{8;?KHJL^7PL.Q=?TI@I:GQ�8�7PLg8;:[email protected]:=8tHw8;7P?JLR�#�(:=j8;3�I@:Gj,HJI:D6�?Tjk8�:=¨�QG79:GLg8,v�B�:GL3.j:GI@j�vWHJLg8�8;?�I@:�Me:GI�8;?�3.L��nL�?�v�LYj@F�Hw8;7cH�OoOP?nQ\Hw8;7P?JL.jW?TL{8@B.:(61HJFo��24?T6�:=8@7P6�:GjG`4:=rJ:GLYv�B�:[email protected]�8;7PHJO�O9?4QGH�8;79?TL.j,HJI@:��-L.?�v�LR` ST:[email protected]@:=jD6KH\[Vjk8;79OPO/5�:�6�?TI:�<.:[email protected]:x5�:=Q\HJ3.j:A8;B.:�OPHJ5d:GOPj?JM�8;B.:��-L.?�v�LªOP?nQ\H�8@7P?TL�jl61H\[A5d:�<.79¨�QG3�O98�8;?DF.I@?JL.?T3.L.Q=:,?JI �3�j8#OP:GL�SJ8;Bg[A8;?(rT:=I@5�H�OP7P�=:J� �?TI:�~�HJ6�F.O9:J`.3�88;:=I@7PL�S.`%�@°,?�v <.?�¤WST:�8�MeI?T6 8@B.:(¤�j;HJ5d:GO9OcH�2n8@:=vWHJI8E�DH�I@<.L.:=I�XV3.j:G3.6 8;?�8;B�:UWB�HJIOP:=j�XZHJjj;HJQtB-3.j:=88;j���:GL.:=I;HJO�°,?TjF.798;HJOa�W|�jk8;?TF �\�.`n7Pj%6�?TI@:�QG3�6�5�:=I@j?T6K:�8;B�H�L1QGO97PQt�-7PL�S?TL{8�v#?1OP?nQ\Hw8;7P?JL.jW?TL>8;B�:D6KHJF{v�B.79OP:Ej@H�[n79L.S.`%�@°�?�v <.?�¤#ST:�8�MeI@?T6�B.:GI:D8@?�B�:GI@: �\�

¦�8;B.:=I,H�Q=8;79?TL.j�8@B�H�8�8;B.:(3.j:GI�Q\H�LYFd:GIkMe?TI@6�?TF�8;7961H�OPO9[�6�3�O98;796K?n<�HJO9O9[�H�I@:J®

]68

Page 26: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

«�j@:GI�j;H\[njG`W�@°�?�v <.?K¤#ST:=8�8@B.:GI:DMeI?T6 XV¤����\�Kv�B�7POP:(Q=OP7PQt�-79L.S�?TLg8;?KHJLY79QG?TL^?TI �3.jk86�?�r479L.S�8;B�:D6�?T3.j:(?�rJ:GI,HJL>7PQ=?TLR�

«�j@:GIDj;H\[nj�� �o?4?T6 7PL�B.:GI:J`��Zv�B.7PO9:AQGOP79Qt�-7PL.S^?TI(6K?�rn7PL�S>8@B.:�6K?T3�j@:�8;?>8;B.:�<.:Gj7PI:G<O9?4QGH�8;79?TLª?TL>8;B.:(6KHJFR�

«�j@:GI�j;H\[nj{�°,?�v <.?�¤WST:�8,MeI?T6 B.:=I@:(8;?�B.:GI: �\��HJL.<YQGO97PQt�-j�8�vW?K<.79��:GI:GLg8�O9?4QGH�8;79?TL.j?TL{8@B.:(61HJFo�

«�j@:GI/<.I:=v�H�QG?T3�F.OP:�?JM�j8;I?T�J:=jG��°�:%vWHJLg8;j/8;?�3.L.<�?�B.79j/OPHJj8 jk8;I?T�J:WHJL.<Dj;H\[nj��@«�L.<.?.���

� ��� ��$e� � ����(��}�

��B.:�<.:=j@79STL{61H\[�5.I7PL.SAH�5�?T348�j@?T6�:�<�I;H\v�5�HJQt�-j�Me?TIW8@B.:E3.j:GIG� �?TI#:�~�HJ6�F.OP:�`4v�B.79OP:,8@I[n7PL�S8;?�6KHJ��:ª8;B.:>6KHJFz<.7PjF.OcH\[�OP?n?T��[email protected]:ª5g[qj:GF�HJI@H�8;79L.S�8;B.:{79QG?TLzOPHJ5d:GOPjDMeI@?T6 8;B.:{79QG?TL�j798@j@:=O9M `�8@B.:AQG?JSTL.798@79rJ:xOP?THJ<Z?JM%j@796�3.O}8tHJL.:=?T3.jO9[^OP?n?T�-7PL.S1H�8E8@B.:AOP79j8E?�M#OPHJ5d:GOPj�HJL.<Z8@B.:A61H�F<[email protected]�[�8;?Zf�L�<�8@B.:{61Hw8;QtB.79L.S�7PQ=?TLz61H\[s5�:ª8@?4?�B.79STBR�q«�[email protected]�H�<.79��:GI:GLg8AMe?TLg8AMe?TI�8;B�:6�:Gj@j@HJST:�v�7PL.<�?�v�j�HJL.<�8;B�:KO97Pj8(5d?\~�6KH�[�5d:�3.L.Q=?T6�Me?JI8tH�5.OP:�8@?^8@B.:K:�[T:��ª��B.:�F.I@:=j@:GL�QG:?JM�Hq�J:�[n5�?gH�I@<m:GLg8;Ik[ 5d?\~ Me?TIª<�:G5.3.SJST7PL.SsF.3.I@Fd?Tj:Gj>61H\[ QG?TL4Me3.j@:�3.j:GIj^79Lg8;?q3.j7PL.Sz7}8\`HJL.<�jk8;I@?J�n79L.S�?TLz8;B.:>6KHJF�H�8�8@B.:>j;HJ6�:ª8;796K:{H�j�8@B.:=[s8�[4Fd:>7PjAL.?�8�H�L.H�8;3.I@HJO�6�?4<�:ª?JMQG?J6K6�3�L.7PQGH�8;79?TLR�#±�:=F.I@:=j@:[email protected]@B.:x79QG?TL�j�HJj�j@i-3�H�I@:Gj,?TLY8@B.:x6KHJF^7Pj�8;?n?Kj7P6�F.OP79j8@7PQJ� p :QG?J3.OP<�I@:=F.I@:=j@:=L-817PQ=?TL.jA?JM,<.79��:GI:GLg8�8�[nF�:=j�v�7}8;B�j@Fd:GQ=7cHJO97P�G:=<�j[n6�5d?TOPj=� a?JI�:�~�HJ6�F.OP:ªMe?JII@:=j8;HJ3.I;H�L-8@jG`Rv#:�QG?J3.OP<�I:GF.I:Gj@:=Lg8(798�v�7}8;B�HK�nL�79Me:AHJL�<�HKMe?TI@�a`dMe?TI�B.?�8;:GO9j�v#:�QG?T3�OP<�3.j:AHB.?T3�j@:J����B.:=j@:�7Pj@j3.:Gj�Q=?T3.OP<^5d:�:�~4F.OP?JI@:G<>Me3.Ik8;B.:=I�79L{8;B.:�Me3�[email protected]@:��

]�T

Page 27: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

� � ��� ��� �

� � ��� � � � � � � � � � � ���

� ��� ��� �-$ � ��� �

��B.:1�D«�¤�I:Gi-3.7PI:Gj�H^SJ:[email protected]@:�I@:=QG?TSJL.7P�=:GI(8;B�H�8D3.L�<.:GIj8tH�L.<.jxjk8;I?T�J:=jx<.I@H�v�L�?TL�8;B.:�61H�F<[email protected]�[J�l��B.:=I@:(HJI:E61H�L-[�ST:[email protected]@:=j�8;B�H�8�Q\HJL{5d:�<.I@H\v�L^?JL-8@?AH�6KHJFR��24Fd:GQ=79f�Q,8�[4Fd:Gj�B.H�rJ:5d:G:GLKQtB.?Tj:GLªj?�8;B.H�8#8@B.:�ST:Gjk8;3.I:,I:GQG?JSTL.7P�=:GI%Q\HJLKI@:=QG?TSTL�7P�G:�8@B.:G6 :\H�j@7PO}[AHJL�<1i-3.7PQt�-O}[T� p :8;?n?T�ª79Lg8;?�QG?TL�j@7P<�:GI;Hw8;7P?JL>8@B.:�8�[nF�:=j,?JM�ST:Gjk8;3.I:Gj�3.j@:=<V<.3�I@7PL�SKH�I8;79QG3.OPH�8;79?TL{HJL�<YB.?�v 8@B.:Gj:ST:=j8;3�I@:Gj�QG?JL-rJ:=[J:G<�HJL^H�¨�I@6KH�8@79rT:(H�Q=8;79?TLR�

� ��� ���-�~�,��$�� � � ��(g�,��� ���

XV79OP?J8;H�HJL.<ª©#OcH�88;L.:=I�� _�¢aB.H�rJ:�QGH�8;:=ST?TI@79�G:=<KFd:GL�ST:Gjk8;3.I:Gj%8;B�H�8%?nQGQ=3.I�[email protected];HJL.:G?J3.j@O}[xv�798@Bj@Fd:G:=QtBV79L-8@?�_�8�[nFd:GjG®

�Q)L�1�����1� CQ)\J���� ��)$J |KF�?T79Lg8;7PL�S�SJ:[email protected]@:=jY8@B�H�8YHJI@:�3.j:G< 79L�Q=?TL��3.L.Q�8;79?TL�v�7}8;B�HjF�?T��:GLYI@:=Me:=I@:=L-8G��N�~�HJ6�F.O9:Gj�[email protected]:Gjk8;3.I:GjG®

� 2nF�:=QG79f.QE<.:G79Q=8@7PQ�|�[email protected]�8;?�H�j@Fd:GQ=79f�Q,?T5 �:=Q=8�v�7}8;BK8@B.:�F�3.I@Fd?Tj@:,?JM I@:�Me:GII@7PL�S8@?Z8;B�Hw8A?T5 �:=Q=8\`%[email protected]�8;79?TLq?TIAHw8@8;I7P5.348;:Gj=��¤�Lq§�?�[THJST:GI=� j�QGHJj@:�`�[email protected]?T5 �:GQ�8Q=?T3.O9<Y5d:(H�SJI;HJF.B�7PQ\H�Oo7PQ=?TL>?TI�H�8;:�~n8@3�HJO�<[email protected]�[J�

� ��:GL�:GI@79Q�<.:G79Q=8@7PQ#|/[email protected]�8@?(H�QGOcH�j@j�?JMd?T5 �:=Q=8@jG`g8;B.:=7PIlMe3.L�Q=8;79?TL.j�?TIlH�8@8@I@7P5�3�8;:=j5g[�Fd?T7PLg8;79L.S{8;?YHJL�?T5 �:GQ�8�79L�8@B�H�8DQGOPHJj@j=�>243.F.Fd?Tj:�8@B.:GI:K79j�H>[email protected]�<.7PjF.OcH\[

]6;

Page 28: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

79LVH��-7P?Tj�a�#�+3.j@:=I,6KH\[{5d:[email protected]�8@?1H�[email protected]\HJOR79QG?TL^7PL{8@B.:�<�7Pj@F�OcH\[T`�5.348I:=Me:=I@[email protected];?KHJOPO�7PQ=?TL.j�?JM/8;B.:(j;H�6K:E8�[nFd:J�

� XY7P6�:=8;79Q(CE:G79Q=8;79Q,|%Fd?T7PLg8;79L.S�v�798@B^HJ<.<.7}8;7P?JL�HJOo6�?J8@7P?TLª8@B�H�8�j@:=OP:=Q=8;j,HJ6�?TL.S�?T54|�:=Q=8@jE?TL�H1jQGI:G:GLo� �?TI,:�~�HJ6KF�OP:J`d8;B.:�6K?�8;7P?JLY?JM�Me?JOPOP?�v�79L.S�H1OP79L.:�v�798;BZH1F�:=L8@?K<�[email protected]ª8;B.:(OP79L.:�MeI?T6 ?J8@B.:GI�?T5 �:GQ=8@jG�

�� ������� � � ���].&) CQ)\J���� ��)\J |�ST:[email protected]@:=j�8;B�H�8WI@:�Me:GIW8@?AH�8@8@[email protected]�8;:=jW?JM ?J5 �:GQ�8;jG����B.:�[ªQGHJL5d:W3.j:G<xv�7}8;B�?JI/v�7}8;B.?T348�<.:=7PQ�8;7PQ%I@:�Me:GI:GL.Q=:GjG����3.j:GIlQGHJL�F.3�8�B.7Pj/Fd:GL�?�rT:=I�HJL�?T5 �:GQ�8HJL�<ª<.I;H�S�8;B�:EF�:=L{HJQ=I@?TjjW8;B.:,j@Q=I@:G:=Lª8;?�79L.<.79Q\H�8@:,B.:�v�H�L-8@jW8;?x6K?�rT:,798G��24QGI@H�8;QtB�7PL.S.`8@B.:�6�?J8;79?TL�?JM�I;H�F.7P<.O}[A6�?�rn79L.S�HDF�:=Lª5�HJQt�KHJL.<1Me?JI8;BK?�rT:GI�H�<[email protected]�[J:G<{?T5 �:GQ=8G`�QGHJL79L.<.7PQGH�8;:�79L-8@:GL.j798�[(8;?JST:=8@B.:GI/v�798;BD8;B.:#j@:=OP:GQ�8;79?TLR�/� 3.j:GIl6KH\[(j;H\[T`��61H��J:�8;B.79jhF.OPHJL.:�85.O93.:J`��Av�B.7PO9:Ej@Q=I;H�[email protected]�SKI:GFd:\H�8@:G<.O}[{?TL{8;B.:(F.OPHJL.:�8�7PQ=?TLR����B.:DI@:=F�:GH�8;:=<YjQGI;Hw8;QtB.79L.SHJQ�8;79?TL>Q\HJL>7PLg8@:GL.j79Mu[ª8@B.:(QG?TO9?TI�?JM/8;B.:(F.OPHJL.:�8��\�XZHJ�J:(7}8�5.OP3.:=I@� ;�

V�E %(�6�1��'5��%/E�A��1�3+��B�1������� �����F� CD)$J ������)\J |,jF�[email protected]:Gjk8;3.I:GjxQtB.HJI;HJQ�8;:=I@7P�=:HJL�?T5 �:=Q=815-[�7}8;j�[email protected]�:�� ��B.:�[ QGHJL 5d:>3.j@:=< v�798@B 79L.:�~�HJQ�81SJ:[email protected]@:=jK8@?�79L.<.7PQGH�8;:HJF�F.I@?\~47P6KH�8;:Kj@B�H�F�:�� p B.:=L.:=rJ:GI�F�[email protected]:1rJ:GI5�HJO�79L.F.3�8�v#?T3.O9<�<.7Pj@HJ6�5.79ST3�H�8@:K8;B�:ST:[email protected]@:�� a?JI%:�~�HJ6KF�OP:J`4H(3.j@:=IW6KH�[�<�I;H\vmHD8@[email protected]:�Me?TI%8@B.:�F.3.I@Fd?Tj:�?JM�f�L.<.79L.Sx?TL�:?TI�HJOPO 8;I7cHJL�STOP:=j,79L�H1<�H�8;HJ5�HJj:�?TIE<.I@H\v+8@B.:�Q=?TI@I:GQ=8(jB�HJFd:�?JM#H1Q=3.IrJ:�5g[Y<.I;H\v�79L.SHJL�?J8;B.:=I�QG3.IkrT:D?�rJ:GI�798G�

¤�L�8@B.:1�D«�¤t`/OPHJL.<.6KHJI�nj(H�I@:�I@:GF�I@:Gj:GLg8;:=<�HJjDj@i-3�HJI:�|�jB�HJFd:G<q79QG?TL�j�?TL�8;B�:16KHJF�<.7PjF.OcH\[T���B.:=j@:�7PQ=?TL.jEQGHJL.L.?J8(5d:�I:[email protected]�:=<�?JIE6K?�rJ:G<R`�j?{ST:Gjk8;3.I:Gj(I@:�Me:[email protected]ª8@?ª8;B.:=6¬HJI:�6KHJ7PL.O}[<.:=7PQ=8@7PQ�?TI#H�8@8@[email protected]�8;7}rT:�7PL�L�H�[email protected]@:�� a?JI%I:=Me:=I@[email protected]�8@[email protected]:�OPHJL.<.6KHJI@�a`g8;B�:,6�?Tj8#[email protected]@79rT:HJL.<1j@7P6�F.O9:,ST:[email protected]@:E79j#8@B.:EFd?T7PLg8#QGOP79Qt�a����O98@:GIL�H�8;7}rT:=O9[T`4HxQ=7PI@Q=OP:�Q\HJL{5d:�<�I;H\v�L>HJI@?J3.L.<ª8;B�:7PQ=?TLR�h�h?DI@:�Me:GI�8;?DH�STI@?J3.FK?�MoOPHJL.<.6KHJI@�-j=`g:GL.Q=OP?Tj7PL.SDHJO9O�?JM�8;B.:=6 7PL�H�QG79I@QGO9:�7Pjl8@B.:�j@7P6�F.O9:Gj8ST:=j8;3�I@:J����B.:�6KHJFª<�7Pj@F�OcH\[ªH�OPj@?xQG?TLg8tH�7PL.j�O97PL.:=j�HJL�<{QG3.IkrT:Gj�8;?x7POPO93.j8@I;H�8@:,I?gHJ<.j=`.B.79STBgv�H\[njHJL.<Yj8@I@:G:�8;j=���h?KI@:=Me:=I�8@?1H�F�HJIk8;7PQ=3.OcH�I�j8;I:G:�8\`a8;B.:D3.j@:=I,QGHJLVj7P6�F.O9[ª<.I;H\v H�OP79L.:DHJOP?TL�S�7}8\���8E8@7P6�:GjG`dOcH�L.<.6KHJI@�-j�?JM�7PLg8;:=I@:=j8(HJI:xF.OPHJQG:=<�HJO9?TL.SªHKj8;I:G:�8\��� 3�j@:GI�QGHJLZ:GHJj@79O9[^I@:�Me:GI,8@?HJO9OR?JM/8;B.:=6 5g[{<.I;H\v�79L.S1HAO97PL.:E?JLY7}8\`�HJj�?JF.F�?Jj@:G<^8;?�<.I@H�v�79L.S�HJL^7PI@I:GST3�OcHJI#QG7PIQGO9:(HJI@?T3�L.<8;B�:,jk8;I@:=:=8G� p 798;BA8@B.:Gj:,Q=?TL.j@79<.:GI@H�8;79?TL.j=`4H(Fd?T7PLg8�QGO97PQt�a`nHDQ=7PIQGOP:�H�L.<1H(OP79L.:�HJI:�<�:=8;:=I@6�7PL.:=<8;?�5d:�8;B.:(6�?Tj8�796KFd?TI8;HJLg8�ST:=j8;3�I@:Gj�8;B�:DI:GQ=?TSTL.79�G:GI�jB.?T3.O9<Y79<.:GLg8@79Mu[T�

]�<

Page 29: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

Key

Mouse Click

Icons near the mouse click

Selected Icon

Unselected Icon

StreetELM ST

are considered selected

�7PST3�I@:E¡�|;�T®���L^:�~�HJ6�F.O9:�?JMlHAFd?T7PLg8�Q=OP7PQt�

� � � ���-�~�,��$�� �}�%$8 �

� ��� ��� � � �#���W���q�@�k) �

��B.:=I@:ªH�I@:�8�vW?ZFd?Tjj@7P5�OP:�7PLg8;:[email protected]:=8tHw8;7P?JL.j�Me?TIxH^F�?J7PLg8DQGOP79Qt��?TL�8@B.:�61HJFo�{«,j:GI@jx61H\[�5d:QGO97PQt�-7PL�S�?TLKHJLK7PQG?JLK?JMR7PLg8;:=I@:Gjk8�H�L.<1I:Gi-3.:Gjk8;79L.S�6�?TI@:�<.:�8tHJ79OPj%HJ5d?T3�8�8;B�Hw8W79QG?TLR�h��B.7Pj%QGO97PQt�5d:GQG?J6K:=j,H�j@:=OP:=Q=8;79?TL^?JMlH�LY79QG?TLR`.8@B.:GI:G5g[{Me?nQG3.j7PL.S�8;B.:DH�88;:=L-8@7P?TL>?JMh8;B.:(<.7PHJOP?JSA61HJL.HJST:GI?TL{8;B�:DOPHJL.<.6KHJI�KI:GF.I:Gj@:=Lg8;:G<V5-[18;B.:(7PQ=?TLR� �79ST3.I:E¡�|t��79OPO93.j8@I;H�8@:[email protected]�79<.:\H���«�j@:=I@j�61H\[HJO9j@?ªQ=OP7PQt�YHªFd?T7PLg8�?TLZ8@B.:A6KHJFVv�B.:=I@:A8;B.:=I@:�HJI:�L.?{79QG?TL.jEHJL.<�j;H\[m� �o?4?T6 79LZB.:GI:J��� ¤�L8;B�7Pj�QGHJj@:�`R8;B.:xF�?T79Lg8EQGO97PQt�>I@:�Me:GIjE8;?{HªjF�:=QG79f.Q�ST:G?JSTI;HJF�B.7PQ�OP?nQ\H�8@7P?TL^L.?J8(H�j@j@?nQG7PH�8;:=<Vv�798@BH�j@Fd:GQ=79f�Q�OPHJL.<.6KHJI�d�h��B.:�Fd?T7PLg8�Q=OP79Qt�Kj:GIrJ:Gj�HJj�Hx<�:G7PQ�8;79QEj@:=OP:GQ�8;79?TL{?JM/H�[email protected]:�I@:�Me:GI:GLg8\�

� ��� ��� � �z�k$�) ��

24?T6�:=8@7P6�:Gj�3�j@:GIj�H�I@:�7PLg8@:GI@:=j8@:G<^7PL>HASTI@?J3.F>?JM�OPHJL.<.6KHJI�nj�<�7Pj@F�OcH\[T:=<^?JL>8@B.:(61H�FR����B.:=[v�7PO9O�<.I@H\v H�QG7PIQGO9:�HJI@?J3.L.<m8;B.:�7PQ=?TL.j>HJL�<�Fd:GIB�HJF.j>j;H\[J`>��/:GOPO�6�:�6�?TI@:�HJ5d?T3�8{8@B.:Gj:I@:=j8;HJ3.I;H�L-8@jG���z��B.:xQ=7PIQGOP:�I:GF.I:Gj:GLg8;j�H�<.:=7PQ=8@7PQ�j:GOP:=Q=8@7P?TL^?JM�H�STI?T3.F^?JMl79QG?TL.j �yj@:G: �79ST3.I@:¡�| ] t�h°,?�v#:=rT:=IG`Tv�B.:=L�3.j:GI@j�<.I;H\v�H,Q=7PIQGOP:�v�7}8;BxL�?�7PQ=?TL.j/7PL�798\`�8;B�:=[D61H\[(796KF.O}[�H�I@:GSJ7P?TLD?JM7PLg8@:GI@:=j8�HJL.<�j;H\[T`R���I:%8@B.:GI:WHJLg[(I:Gj8;HJ3.I@HJLg8;j�?�rJ:GI�B�:GI@: �\�.`�v�B.79QtBx5d:GQ=?T6K:=j�H�L�H�88;[email protected]�8@79rT:

]�_

Page 30: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

Selected Icon

Unselected Icon

���� ������������������������

Key

Icons in the circle areconsidered selected

�7PSJ3.I@:�¡�| ]4®���L>:�~.H�6KF.O9:�?JM�HAQ=7PI@Q=OP:�jk8;I@?J�J:DHJL.<^798@j�7PLg8;:[email protected]:=8tHw8;7P?JL.j

ST:=j8;3�I@:J����B.:�<.7PHJOP?TS161HJL.HJST:GI�6x3.j8D5d:�H�vWHJI:K?JM%8;B�7Pj�<.7}�o:=I@:GL�QG:�7PL�j8@I@?T��:K6�:\H�L.7PL.Sª8@?<.79I@:GQ�8�8;B�:{QG?TLgrT:=I@j@H�8;79?TL�QG?TII@:GQ�8;O}[T�sUW:GI8;HJ7PL�HJ6x5.7PST3�798;79:Gj(6KH�[qHJI@79j@:�� �?TIx:�~�HJ6�F.OP:�`�HJL7PQ=?TL{7PjWQG7PIQGO9:G<{5.3�8�8@B.:�3.j:GI�j;H\[njG`%���o?n?T6 7PL{B.:=I@:�� �sCE:GFd:GL.<.79L.SA?TLª8@B.:(j@7P�=:E?JM/8;B.:�Q=7PIQGOP:HJI?T3.L.<�8;B.:�7PQ=?TLR`R8@B.:K3�j@:GID6KH�[Z7P6�F.O9[Y�G?n?T6�7PL.Sª8@?>8@B.:�7PQG?JL�?�M�7PLg8@:GI@:=j8D?JM �3.j8Dj@796KF�O9[�G?n?T6�7PL.Sx7PLg8;?A8;B�:D:=L.QG79I@Q=OP:G<^I@:=ST7P?JLR�

� ��� ��� � �K���E�

¤�L 6KHJLg[ 79L.j8;HJL.Q=:Gjª<.3�I@7PL�Ss6KHJF L�H\rn7PSTH�8;79?TLR`Wv#:Z6KH�[�5d:V79L-8@:GI:Gj8@:G<m7PL OcHJL�<.61H�I@�-jK?JIMe:\Hw8;3.I:Gj{HJO9?TL.SsHsj@:=Q=8;79?TL ?JMDH�j8;I:G:�8{?TI1B�7PSTBgvWH�[J� «,j:GIj{61H\[�<.I;H\v HJO9?TL.SqH�I@?gHJ< ?JM7PLg8@:GI@:=j8�H�L.<�HJj@�a`��;24B�?�v 6�:K8@B.:{I@:=j8tH�3.I;HJLg8@j�HJOP?TL�SY8;B�7PjxI?gHJ<R`���?TIxi-3.:=I[T`�� p B.H�8�HJI:8;B�:�8@I;H�¨�Q�QG?JL.<.798@7P?TL�j�?�rJ:GI�8;B�:GI@: �\�.� h7PST3.I:�¡�|�_>SJ79rT:=jDHJL�79OPO93.j8@I;H�8@7P?TLY?JM#[email protected]�:�~�HJ6KF�OP:J���B.79jAOP7PL�:ª7Pj�79Lg8;:GIF.I@:�8;:=< HJj�H�L Hw8@8;I7P5.348;79rJ:ªST:=j8;3�I@:ªMe?TI�HZI?gHJ<�?TIAH�I@:=ST7P?JLz?JM�7PLg8;:=I@:Gjk8HJI?T3.L.<�8;B.:�OP79L.:J��¦�8;B.:=I@j%61H\[A<�I;H\vmH(OP7PL�:�8;?(<.:GjQGI7P5d:�H�8;I@H �:GQ�8;?TIk[�?TL�8@B.:�61HJF�HJL�<1HJj�a`�@°�?�v <.?V¤�ST:�8�MeI?T6 B.:=I@:�8;?Y8@B.:GI: �\� ¤�L�8;B.79j�QGHJj@:�`h8@B.:1O97PL.:�7PL�<.7PQGH�8;:=j(8@B.:1j?T3.IQG:ªH�L.<<.:=j8;79L�H�8@7P?TL>OP?nQ\Hw8;7P?JLR�

_Tb

Page 31: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

���������������� ���

distance are considered selectedIcons near the line up to a threshold

Key

ELM ST

PRO

SPE

CT

ST

Selected Icon

Unselected Icon

Line Stroke

Street

�7PSJ3.I@:E¡w| _�®��,LY:�~.H�6KF.O9:�?JM�H�O97PL.:�jk8;I?T�J:DHJL.<^798@j�7PLg8;:[email protected]:=8;H�8;79?TL

� ��� ��� ��'E� $ � �%������(�k� � � �-���E$�� �

��O}8;B.?J3.STBVFd?T79L-8�Q=OP7PQt�-j=`�Q=7PI@Q=OP:=j�HJL�<VOP79L.:Gj,HJI:�j3�¨�QG7P:=Lg8EMe?TI�<.:G79Q=8;79Q(ST:Gjk8;3.I:GjG`oj@?T6�:�?�8;B.:=IB.79STB.:GI�OP:�rT:GO#j8@I@?T��:Gj�Q\HJLsQG?TLgrT:�[z6�?TI@:K3.j@:�Me3.O�6�:\HJL.79L.STj=� �?TIx:�~�HJ6KF�OP:J`lHVj@i-3�HJI:{61H\[7PL�<.7PQGH�8;:(8;B.:xj@B�HJFd:�H�L.<Z5d?T3.L.<�H�I[Y?JM%HK5.3�7POP<�7PL.S.`dHJL�<�HJL�HJII@?�v 6KH�[^79L.<.7PQGH�8;:�H1j?T3.I@Q=:HJL.<^<.:=j8;79L�H�8@7P?TLR� p :(6KH�[1I@:=QG?TSTL�7P�G:�8@B.:Gj:�ST:[email protected]@:=j,79L>8@B.:�Me3�8;3�I@:J�

� ��� �}� ���,��$�� � �����-� � �-( �#" �����,��� �

��j8;I?T�J:�7Pj%[email protected]�:G<�8;?(8tHJ��:�F.OPHJQG:�v�B.:=L18;B�:�6�?T3.j:,79j�F.I@:=j@j@:=<{HJL.<KOcH�8@:GI�I:GOP:GHJj@:=<R��N%HJQtB8;796K:�8;B.:16K?T3�j@:ª79jxI@:=OP:GHJj@:=<R`%HVj8@I@?T��:^79jxI:GQG?JSTL.7P�=:G<R��2479L.QG:1?TL.O9[�_Z5�H�j@7PQ1ST:Gjk8;3.I:Gj�HJI:3.L.<�:GI@jk8;?n?4<o`oH�B.:G3�I@7Pjk8;79Q�<.:=QG79j@7P?JL^8@I@:G:�6K:�8;B.?n<^?JM�Me:GH�8;3.I:x5�H�j@:G<VI@:GQ=?TSTL.7}8;79?TL{v�HJj,<.:=rJ:GO |?TFd:G<R��XV?Tjk8A?JM�8;B�:Gj@:ªMe:GH�8;3�I@:Gj�H�I@:{j@796K79OcHJIE8@?ZMe:\H�[email protected]@:=jAF.I@?JF�?Tj:G<�5g[z±�3.5.79L.:g� ��]w¢£����B.:Me:\Hw8;3.I:Gj�3.j@:=<V79L>[email protected]�v#?TI�>HJI@:�®

�,I@:\HV|(8@B.:ª8;?J8;HJO�HJI:\H�5d?T3.L.<.:=< 5g[q8@B.:>6K79L.7P6x3.6 HJL.<�61H�~�796�3.6 ­HJL.< �­QG?w|?TI<.7PL.H�8;:=j�?JMh8@B.:(j8@I@?T��:J�

±�H�8;79? +|#8;B.:�I;H�8@7P?�?JMl8@B.:D<.7Pjk8tHJL.Q=:x5d:=8�v#:G:=LZ8;B.:D6K79L.7P6x3.6 HJL.<Z6KHw~47P6x3.6 �|Q=?�|�?TI<.7PL.H�8;:E8@?�8@B.:(<.7Pjk8tHJL.Q=:(5�:�8�vW:=:GLZ8;B�:(f.I@j8,Fd?T7PLg8\��j HJL.<>8;B.:(OcH�j8�F�?J7PLg8\��j |Q=?�|�?TI<.7PL.H�8;:��

_��

Page 32: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

a

b

c

d

e

side angle

Sum of Side Angles = a + b + c + d + e

�7PSJ3.I@:�¡�|¥¡.®�243�6 ?JMl247P<.:(�,L.STOP:=j

±�H�8;79? � |�8;B.:(j@HJ6K:DHJj�±�H�8;79? �`.:�~4QG:GF48�3.j7PL.S ��|¥QG?�|¥?TI@<�7PL�H�8@:Gj�79L.j8@:\HJ<o�

2479<.:D��L.STO9:�243.6 |[email protected]:D8;B.:=I@:�7Pj�HJL[>�|�j7P<.:=<VFd?TO9[nST?TLo����8�:GHJQtBVrJ:GI8@:�~�`ov#:xQGHJLQ=?T6KF�3�8;:�8;B�:,:�~48@:GIL�HJOdHJL.STO9: �yj@:G: �79ST3.I:�¡w|�¡ ;����B.:�[email protected] ?�Mo8;B�:Gj@:,HJL.SJOP:Gj�79j�8@B.:,247P<�:�,L.STOP:D2n3.6Y�

±�:GOPH�8;7}rT:�CE7Pjk8tHJL.Q=:�©W:=8�v#:G:=L �7PIj8#HJL.<K� HJj8 :�?T79Lg8%|/8;B�:,<.79j8;HJL.QG:�5d:=8�v#:G:GLK8;B.:�f�I@jk8HJL�<YOPHJj8�Fd?T79L-8�L�?TI@6KHJOP79�G:=<>HJSgHJ79L.j8�8@B.:�8;?J8;HJORO9:GL.SJ8@B>?JMh8@B.:(j8@I@?T��:J�

UW?TLgrJ:�~�°,3.O9OT§E7P?JOcH�8@7P?TL�8@7P6�:GjR|d8;B.:%L-3.6�5d:GI/?JM�8@7P6�:Gj�8;B�:#jk8;I@?J�J:�r479?TOcHw8;:Gj�8@B.:#Q=?TLgrT:�~B-3.O9O � ��QG?TLgrT:�~�B-3.O9OTrn7P?TOPH�8;79?TLE?nQGQG3�I@j v�B.:GLD8;B.:%[email protected]�8@I;H �:=Q=8;?JI[�?JM48;B.:#HJIQ%5d:GL�<.j8@?�8;B.:E?JF.F�?Jj@798@:E<.79I@:GQ�8;79?TLR`4HJj�j@B.?�v�L>7PL h7PST3.I:�¡�| 84�lN%HJQtB>5d:GL.<>7PjWQG?TL.j7P<.:=I@:=<YH�j�HQ=?T3.Lg8�7PL{8;B.:�rn7P?JOcH�8@7P?TLR�

��<�7cHJSTI@HJ6 ?�M#8@B.:K<�:GQG79j@79?TL�8;I@:=:K79j(j@B.?�v�Ls79Lh7PST3.I:A¡�| T4��N%HJQtB�L.?TL4| 8;:=I@6�7PL�HJO�L.?4<�:I@:=F.I@:=j@:=L-8@j�HVi-3.:Gjk8;7P?JL�HJ5�?J3�8�?TL�:1?JM�8@B.:1Me:\Hw8;3.I:GjG����B�:18;:=I@6�7PL�HJO�L.?n<.:=j�I@:=F.I@:=j@:GLg8�8;B�:[email protected]:�f.L�HJO�<.:GQ=7Pj7P?TL.j=� �?TI(:�~�HJ6�F.O9:J`/79M%8;B.:�j8@I@?T��:1j;Hw8;7Pjkf�:GjDQG?JL.<.798@7P?TL�� �£7£� :��9` 7Pj(8;B�:I@:=Q=8;HJL.ST3.OPHJI(HJI:\H{5�?J3.L.<.:=<�5g[Z8@B.:Aj8@I@?T��:KSTI:\H�8@:GIE8@B�HJLs]Jb��(F.7}~4:=OPj � ;`R8;B.:�j8@I@?T��:�6K?�rT:=j

_g]

Page 33: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

convex hull violation

OriginalTrajectory

�79ST3.I:�¡�| 84®�UW?TLgrT:�~V°�3.OPOo§�7P?TOPH�8;79?TL

7PLg8@?>8@B.:�L.?n<.:�OcHJ5d:GO9:G<�� :#¦E¤ >,���.` H�L.<�5d:GQ=?T6�:Gj(I@:=QG?TSTL�7P�G:=<sH�j�H{Fd?T7PLg8G� p B.:GL �@±,Hw8;7P?E�1HJL.<m�±,H�8@7P? ���1HJI@:�5�?J8@BV6�?TI@:(8;B.HJLZb�� _1H�L.<V8;B�:xj@79<.:�H�L.STOP:(j3.6 79j,O9:Gjj,8;B.HJLZb�� _���`8;B�:Djk8;I?T�J:D7Pj�<.:�8;:=I@6�7PL.:=<>8@?K5d:(H�OP7PL�:J�«,L�OP7P��:�8@B.:�F�I@:=rn79?T3.jWjk8;I?T�J:=jG`�8@B.:GI:EHJI:�8�v#?AF�?Jj@[email protected]:�vWH\[4j�HDj8@I@?T��:�Q\H�Lª5�:=QG?T6�:EHDQG79I@QGO9:J®

p B.:=Lq8;B.:Kj@79<.:{HJL.SJOP:�[email protected] 7Pj�5�:�8�vW:=:GLm�T� <��mHJL.<z]4� _���HJL.<q8@B.:1I:GOPH�8;7}rT:1<�7Pj8;HJL.Q=:5d:=8�v#:G:=LV8;B.:��\jk8�HJL.<^OcHJjk8�F�?J7PLg8�7Pj�O9:Gj@j�8@B�HJLYb��a84�

p B.:=LZ8;B.:�j@79<.:�HJL�STOP:[email protected]­7Pj,5�:�8�vW:=:GL���HJL�<�]4�a8��zHJL�<V8;B.:xQG?TLgrT:�~�B-3.O9O/rn7P?JOcH�8@7P?TLQ=?T3.Lg8�7Pj�OP:=j@j�8;B.HJLV_4�

��B.:�QG7PIQGO9:�[email protected]:ZF�?Jj@[email protected]@7P:Gj15�:=Q\HJ3.j:s3.j:GIjV<.? L.?J8VHJO9vWH\[4j^<.I@H�v H�Fd:GIMe:=Q=8G`3.L.7}Me?TI@6�O9[�Q=3.IrJ:G<>QG79I@Q=OP:EH�L.<ªvW:�B.H�rJ:E8;?AQGH�8;:=IW8;?�<�79��:GI@:=Lg8�r�HJI@7PH�8;79?TL.j%?JM B.?�v 3�j@:GIj�61H\[<.I@H�v�HDQ=7PI@Q=OP:�����j%j@B�?�v�L17PL �7PST3�I@:�¡�| ;4`gr479j@3�H�OPO9[xj@Fd:\HJ�-79L.S.`-j8@I@?T��:x�,HJL.<�j8;I?T�J:E](jB.?T3.O9<5d:xHJQ=QG:=F�8;:=<�HJj�HKQ=7PI@Q=OP:�jk8;I@?J�J:J`d5.3�8,j8@I@?T��:�_�`aH�O98;B�?T3.STB^798�<.?n:Gj�6KHJ�J:�HJL^:GL.Q=OP?Tj3.I@:�`�B�H�j_�7PL�j8tH�L.QG:=j�?JM/QG?TLgrJ:�~>B-3.O9Odrn7P?JOcH�8@7P?TL.j=`nHJL.<{j@:=:G6�j�OP79�J:EH�L{[email protected]@79rT:,j@B�H�F�:EMe?TIWH�QG79I@QGO9:J�

_T_

Page 34: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

POINT

LINEUNIDEN−TIFIED

CIRCLEUNIDEN−TIFIED

UNIDEN−TIFIED CIRCLE

!EE

A !A

B

D!D

!B

C!C

!E E

F and G !F or !G

A: Area > 20 pixels^2B: ratio X > 0.9 and ratio Y > 0.9C: 1.8pi <= side angle sum <=2.3piD: side angle sum < 0.9piE: relative distance between 1st and last point < 0.5F: pi < side angle sum < 2.5piG: convex hull violation count < 3

�79ST3.I@:�¡w| T�®l��B�:xCE:=QG7Pj7P?TL{�/I@:=:(?JM�8@B.:��(:=j8;3�I@:D±�:=QG?TSJL.7P�=:GIG�

!A and !Band C and E

!A and !Band !C and Fand G and !E

Convex Hull violation = 3

Stroke 1 Stroke 2 Stroke 3

h7PST3.I:�¡�| ;n®�XV3.O}8;7PF�OP:�8�[nFd:Gj�?JMlHAQ=7PI@Q=OP:(HJL�<VHAL.?TLn|�QG79I@Q=OP:�j8@I@?T��:J�

_J¡

Page 35: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

� ��� ��$e� � ����(��}�

��B.:�61H�7PL�<.I@H�v�5.HJQt��?JM%8;B.:�ST:Gjk8;3.I:�I@:GQ=?TSTL.79�G:=ID79jE8;B�Hw8�7}8(7PjE8@?4?>j@796KF�OP7Pjk8;79QJ��XVHJLg[�F�?�|8;:=Lg8;7cH�OPO9[>796KFd?TIk8tHJLg8�H�L.<�3.j@:�Me3.OlST:[email protected]@:=j(8@B�H�8�B-3.6KHJL.j�Q=?T3.O9<�3.j@:�Me?TI�Bn3�61HJLn|�QG?J6KF.348;:GI7PLg8@:GI;H�Q=8;79?TLsQGHJL.L.?�8�5d:ªI@:=QG?TSTL�7P�G:=<zHJL.<zB�:GL.Q=:ªQ\HJL�L.?J8A5d:13.j:G<z5g[�8;B.:ª79Lg8;:GIkMyHJQG:��V�,jAHj8;HJI8G`R8;B.:=j@:A8;B�I@:G:ASJ:[email protected]@:=jDHJI@:Aj3�¨�QG7P:=Lg8\` F.I@?�rn7P<�7PL.Sª8@B.:A<.:G79Q=8@7PQAHJL�<�Hw8@8;I7P5.348;79rJ:�7PL4Me?TIk|6KH�8;79?TLYv�7}8;BZj7P6�3.O}8tHJL�:G?T3.j�j@Fd:G:=QtBR��24?T6�:=8@7P6�:Gj�jk8;I?T�J:=jE8;B�H�8�OP?n?T�{[email protected].?J3.j@O}[VO97P�J:xHQG79I@Q=OP:W?JIlH�O97PL.:WHJI@:#I@:GQ=?TSTL.79�G:=<A7PL.Q=?TI@I:GQ=8@O9[J��¤�L�8;B�:WMe3�8;3�I@:J`J?T3.I�B�:G3.I7Pj8@7PQ�6�:=8@B.?n<�?JMaj8@I@?T��:I@:=QG?TSJL.798@7P?TL�v�79OPO.5d:�I@:GF�OcHJQ=:G<Kv�7}8;B�H(<.7PjQGI@796K79L�H�8@:GO9[(8@I;HJ79L.:G<�<.:GQ=7Pj7P?TLA8;I:G:�?TI�H(j8tHw8;7Pjk8;79Q\HJOHJF.F�I@?gHJQtB�j3.QtB�HJj(�(HJ3.j@j7cHJLV6K7 [email protected]@:�6K?n<.:=OPjG����B�:AI@:GQ=?TSTL.79�G:=I�v�7PO9O 8@B.:GL�5d:x8;I@HJ7PL�:G<Z?J�<�H�8;H�MeI@?T6 Fd:G?JF.OP:�<.I@H\v�7PL.S�QG79I@Q=OP:Gj=`.OP79L.:Gj�H�L.<YFd?T79L-8@jG�

_*8

Page 36: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

_6T

Page 37: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

� � ��� ��� �

� ��� ��� ��� � � � � � ��� � �

� 6K:GHJL.j�?JMhj8@[email protected];B.:(6�?T3.j@:(:�rT:GLg8@j�7PL{8@B.:��D«�¤W7Pj�I:Gi-3.79I@:G<o`dj?A8;B�H�8�8@B.:(6�3.O98@7P6�?4<.HJOQG?JL-8@:�~n8%I@:=j@?TO93�8;79?TLAQG?T3�OP<A3.j:�7}8;jl79L�Me?TI61H�8@7P?TLDMe?TIl<.:=7PQ�8;7PQ�I:Gj?TOP3�8@7P?TLo��°�?�v#:=rJ:GI=`4I:GQG?JI@<.79L.SHJO9Oa8@B.:�O9?�vmOP:=rJ:GOd:=rJ:GLg8;j=`�[email protected]>HJj%8;B.:�~n| [�QG?�|¥?TI@<.79L�H�8@:Gj%?JM�8;B.:,6K?J3.j@:,F�?Tj798@7P?TLKH�8�H�OPO.8;796K:7PL�j8tH�L.QG:=jG`w7PjRL.?�8/HJL(:=¨�QG79:GLg8/6K:�8;B.?n<R�h243.QtBD:=rJ:GLg8;jh<.?�L.?J8 :�~�F�OcHJ79LEv�B�H�8 8;B.:�6�?T3.j:�?TIR8;B�:j8@I@?T��:�7Pj#<.?T7PL�S.����B.:=I@:�jB.?T3.O9<{5�:,ST:Gjk8;3.I:�7PLg8;:[email protected]:=8tHw8;7P?JL.jW?JM�8@B.:Gj:E:=rJ:GLg8;j=�#��8W8;B.:Ej@HJ6�:8;796K:�`.8;B.:=j@:�ST:Gjk8;3.I:�79L-8@:GIF.I@:�8tH�8@7P?TL.j�j@B�?T3.OP<^5d:�j7P6�F.OP:(HJL�<Vj8@I;HJ79STBg8@Me?TIkv�H�I@<^7PL^6K:GHJL.7PL�Sj@3�QtBs8;B�Hw8�8@B.:K6x3.O98@7P6�?4<�H�OhQ=?TLg8;:�~n8xI@:Gj?TOP348;7P?JL�Q=?T6KFd?TL.:=Lg8�QGHJLs:GHJj@79O9[�Q=?T6�5.79L.:�798�v�798@B8;B�:�j@:G6KHJLg8;79Q�79L�Me?TI@6KH�8@7P?TL�:�~n8;I@HJQ=8@:G<>MeI@?T6 8;B�:Ej@Fd:G:=QtBR�#¤�L{rn7P:�v�?JM 8;B.:=j@:�QG?JL.j@79<.:GI@H�8;79?TL.jG`HJO9Og6K?T3�j@:W:�rT:=L-8@j�HJI@:#HJjj@?nQG7cHw8;:G<Dv�798@Bx¡EB.79STB.:=I/O9:=rJ:GO�79Lg8;:GIF.I@:�8tH�8@7P?TL�jG`wL�HJ6�:GO9[(¤�Q=?TL�24:=OP:=Q=8\`¤�QG?JLV°�7PSTB.O97PSTBg8G`.��:G?TSJI;HJF.B�7PQD24:=OP:GQ�8;79?TL^HJL.<Y�(:[email protected](� ?nQ\Hw8;7P?JLR�

����� �0(g� � )}�-���-(g�,��� �

��B.:�6�?Tj8{H�¨�I@6KH�8;7}rT:Z6�?T3.j:Z:=rJ:GLg8;jYHJI@:VQGOP79Qt�-j>HJL.<�j8@I@?T��:Gj �yv�B�7PQtBm7PLgrT?JO9rT:VF.I@:=j@[email protected];B�:16�?T3.j@:1HJL.<q<�I;HJSTSJ7PL.S^798�?�rT:GID8;B.:K61H�Fs<[email protected]�[ ;�Y¤¥M�H�L-[�7PQ=?TL.j�HJI@:Kj@:=OP:GQ�8;:=<z5-[�8;B�:ST:=j8;3�I@:J`l8@B.?Tj:17PQ=?TL.jxHJI@:KQG?TL.j7P<.:=I@:=<s8;?Z5d:1j:GO9:GQ=8@:G<R�Y��B.7Pj�QtB�HJL.SJ:ª7PL�Me?4Q=3.jx79jDrn7Pj3�HJO9O9[Me:G<�5�HJQt�Y8;?^3.j@:=ID5g[�B.79STB.O97PSTBg8;79L.SK8@B.:�j@:=OP:GQ�8;:=<s7PQ=?TL�7PLZ8@B.:�61HJF�<[email protected]\[T�A��B.:�F�?Jj@[email protected]:7PLg8@:GI@F�I@:=8;H�8;79?TL.j#HJI@:,j@B.?�v�L{79L �79ST3.I@: 8�|;�T�l��B.:=j@:E79Lg8;:GIF.I@:�8tH�8@7P?TL�jW7PL�QGOP3�<.:,79QG?TL�j#5d?T3.L.<�:G<5g[�H^Q=7PIQGOP:�`h79QG?TL�jDL�:\HJIDHYO97PL.:�H�L.<�79QG?TL�j�L.:GHJIDH^6�?T3.j:KQ=OP79Qt�d`/HJI:KI:=Me:=I@I@:=<�8@?VHJjV�¤�Q=?TL24:=OP:GQ�8;79?TL.��:=rJ:GLg8;j=�

_*;

Page 38: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

����

Selected Icon

Unselected Icon

���� ����������

consered selectedIcons in the circle areInterpretation 1

�� ���� ��

distance are considered selectedIcons near the line up to a thresholdInterpretation 2

����

� �� �� �� �� �� �

Mouse Click

are consdered selectedIcons near the mouse clickInterpretation 3

Key

h7PST3.I:"8�|t�J®lNl~.H�6KF.O9:�ST:Gjk8;3.I:Gj,HJL.<>8;B.:=7PI�79L-8@:GIF.I@:�8tH�8@7P?TL.j�H�j1�k¤�QG?TLV24:GO9:GQ�8;7P?JL.�A:=rJ:GLg8;j=�

����� �0(g� � � ��"%'����"%'��

p B.:=LxH�3.j:GI 6K?�rJ:Gj B.7Pj�6�?T3.j:�L.:\H�I HJL(7PQG?JLD5�3�8 <.?n:Gj L.?J8 j:GOP:=Q=8 7}8\`�8;B.:�79QG?TL(QtB�H�L.ST:Gj Q=?TOP?TI8;?{79L�Me?TI6 8@B.:A3.j:GIE8;B.H�8E8;B�:��D«�¤�B�HJj�F.OPHJQG:=<�798;j,QG3.II@:=L-8(Me?nQG3.j�?TLZ8;B.:A79QG?TLo��°�?�vW:�rT:GI=`[email protected]:�L�?�6�?T3.j:EQGO97PQt�-j�HJI:�7PLgrT?TO}rT:=<R`�8;B�:�H�Q=8;79?TLª79j�L.?J8�Q=?TL.j@79<.:GI:G<>8;?A5d:(H�¨�I@6KH�8;7}rT:�H�L.<Q\H�L.L.?J8{5d:VQ=?TL.j7P<.:=I@:G<�Hs<�:=f�L.7}8;:Y7PQG?JL j@:=OP:GQ�8;79?TLR� °�:GL.Q=:J`�798K7Pj1Q=OcHJjj@7}f�:G<mHJj1HJL �¤�Q=?TL°,79STB.O97PSTBg8;�x:=rT:=Lg8\�

��� � ��� �#"%$���&�'��( )}�-���-(g�,��� �

24?T6�:=8@7P6�:Gj=`n8@B.:E3.j:GI�6KH�[K:�~4F.I:Gjj�79Lg8;:GI:Gjk8�7PL{H�jF�:=QG7}f�Q�I@:=ST7P?TLK?TI�O9?4QGH�8;79?TL1?TLK8;B.:�6KHJFR�°,:x61H\[YQGOP79Qt�VHªjF�?�8�?TLZ8;B�:�61H�F�?TI�<.I@H\v ?TL�HªQ=7PIQGOP:�?TLZ8;B�:�I@:=ST7P?TL�?�M�7PLg8;:=I@:Gjk8�v�B.:GI:L.?�79QG?TL.j�HJI@:{F.I:Gj:GLg8\��¤�L�j3.QtB�:=rJ:GLg8;j=`#8;B�:{5�?T3�L.<.7PL�S�5�?\~s?JM�8;B.:{jk8;I@?J�J:{F.I?�rn79<.:GjA8;B�:ST:=?TSTI;H�F.B.7PQ�I:GST79?TLA?JMd8;B.:�3.j:GI=� j%7PLg8;:=I@:=j8\��247PL.Q=:�[email protected]:=rT:=Lg8;j%7PLgrT?TO}rT:�<[email protected]�?TI�QGO97PQt�-7PL�S8;B�:�6�?T3.j@:�`�7}8#79j�[email protected]�:G<K8;?�5d:EHJL1H�¨�I@6KH�8;7}rT:�:=rJ:GLg8�HJL.<ª79j#Q=OcHJjj@7}f�:G<{H�j�HZ�@�(:=?TSTI;H�F.B.7PQ24:=OP:GQ�8;79?TL.��:=rJ:GLg8\�

_6<

Page 39: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

MIT Museum

MIT Museum

2.5441.689

1.689 2.544

Circle

1.689 2.544

Circle

Time(secs):

Time(secs):

1.876 2.544

2.544 2.7860

0

Time(secs):0

MIT Mueseum

Selection event:Geographic

Time(secs):0

Time(secs):0

Time(secs):0

Line:

Circle:

Point Click:

1.6890.745

Time(secs):0

Mouse Button:

Mouse Location:

Line

Line

Icon Selection event:

Icon Highlight event:

Inte

rpre

tatio

n L

evel

Stro

ke L

evel

Raw

Dat

a

2.957

2.957

2.957

�79ST3.I@: 8�|k]n®���7P6�7PL�Sx<.7PHJSTI;H�6 ?�M�8;B.:E79Lg8;:GIF.I@:�8tH�8@7P?TL�j�5g[K8@B.:�<�H�8;HJ5�HJj:�HJL.<ª8@B.:G79IWQG?JI@I@:=OcHw|8;79?TL{8;?A8;B�:Djk8;I?T�J:=j�HJL�<Y6�?T3.j:�OP?nQ\H�8@7P?TL

_6_

Page 40: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

����� ��� �#"%$���&�'��( � � ( ������� �

� 3.j:GI(61H\[ �3.j8D6�?�rJ:�8;B.:�6�?T3.j:�8;?^H{OP?nQ\H�8@7P?TLZ?�M#79Lg8;:GI:Gjk8\`�v�798@B.?T3�8DHJLg[�<�I;HJSTSJ7PL.Sª?JIQGO97PQt�-7PL�S.`�v�798@BzL.?�L.:\H�I@5g[q79QG?TL.j=����B�7PjAHJQ�8;79?TLz7Pj�L.?J8�HJjAHw¨KI61Hw8;79rJ:{HJjAHm�@�(:=?TSTI;H�F.B.7PQ24:=OP:GQ�8;79?TL.��:=rJ:GLg8\`a5.3�8�8@B.:(ST:G?TSJI;HJF.B�7PQ�OP?nQ\Hw8;7P?JLªI@:=F.I@:=j@:GLg8@:G<Z5g[ª8@B.:(6K?T3�j@:(OP?nQ\H�8@7P?TL1j8;79OPOF.I?�rn79<.:Gj 3.j:=Me3.OT79L�Me?TI61H�8@7P?TLo��°,:=L.QG:�8;B�7Pj�:=rJ:GLg8/7Pj�79L-8@:GIF.I@:�8;:G<DHJj��@�(:=?TSTI;H�F.B.7PQl� ?nQ\Hw8;7P?JLR� �

����� � � ( �%$e��� ��" �,'�� � � � ���,�

��jxj@B.?�v�Lz7PL�7PSJ3.I@:D8�|k]4`/8;B.:=I@:K7Pj�HYB.7P:=I;HJIQtB-[sHJjj@?nQG7cHw8;:G<�v�798;BsQG?TLgrT:[email protected]@B.:ª6�?T3.j::=rJ:GLg8;j�79L-8@?A7PLg8;:[email protected]:=8;H�8;79?TL.jG����8�8;B.:EO9?�vW:=j8�OP:�rT:=OR7Pj%8;B.:�6�?T3.j:EOP?nQ\H�8@7P?TL1HJL.<{6�?T3.j:E5.3�8k|8;?JL HJQ�8;7P?JLR� ��8�8;B.:Yj8;I?T�J:YOP:�rT:GO£`#8@B.:VST:[email protected]@:YI@:GQ=?TSTL.79�G:=IKQ=OcHJjj@79f.:Gj�8;B.:Y6K?T3�j@:^:=rT:=Lg8;j7PLg8@?KHAFd?T7PLg8G`.OP79L.:E?TI�Q=7PI@Q=OP:���CE:GFd:GL.<.79L.S�?TL{8;B.:(F.I?\~�796K7}8�[ª?JM/8;B�:D79QG?TL�jG`�8@B.:(6�3.O98@7P6�?4<.HJO<�H�8;HJ5�HJj:A7PLg8;:[email protected]:=8@j�H�L.<�Q\H�8@:GST?TI7P�=:GjE8;B�:Gj@:�jk8;I@?J�J:GjD7PLg8@?��¤�QG?TL�24:=OP:=Q=8;79?TL.�.`��¤�QG?TL�°�7PSTB4|OP79STBg8;�.`x�;��:G?TSJI;HJF.B�7PQ^24:=OP:GQ�8;79?TL.��HJL.< �@�(:=?TSTI;H�F.B.7PQ^��?nQ\H�8@7P?TL.��N�rT:=Lg8;jG� >,?�8;:>8;B�H�8�8;B�:�;��:G?TSJI;HJF.B�7PQ���?nQ\H�8@7P?TL��ª:=rJ:GLg8x79jEj@796KF�O9[>8;B.:�XY?T3.j@:���?nQ\H�8@7P?TL�H�L.<�B.:GL.Q=:�798E79jEL.?J8(<�7Pjk|F.OPH�[J:G< HJj�H�j:GF�HJI@H�8;:>79L-8@:GIF.I@:�8tH�8@7P?TLzMeI@?J6 6K?J3.j@:>OP?nQ\Hw8;7P?JLR�q¤�L [email protected]�f.ST3.I@:�`#v�B.:=L 8;B�:6�?T3.j@:EvWHJj�6K?�rn7PL�SA?�rJ:GI�8;B�:D6KHJFªMeI?T6 b��a;�¡L8x8@?^�J�aT6<�_�j@:GQ=?TL.<.j �yv�7}8;B.?J3�8�HJLg[{QGO97PQt�-7PL�S t`XV¤�� XY3.j@:=3.6 v�HJjKB.7PSJB.OP79STBg8;:G<z?JL 8;B�:^6KHJFR����B.79jK:�rT:GLg817Pj�7PLg8;:[email protected]:=8@:G< H�jKH�L �¤�Q=?TL°,79STB.O97PSTBg8;�K:=rJ:GLg8\�K°,?�v#:=rT:=IG` v�B.:GL�8;B�:�6�?T3.j:A5.3�88;?TL�v�H�jDF�I@:Gjj@:=<R`h<�I;HJSTSJ:G<�HJL.<�8;B�:GLI@:=OP:GHJj@:=<�MeI@?J6 �T� T6<6_�j@:GQ=?TL.<.j/8;?�]4�a868�¡�j@:=QG?TL.<�jG`gH�QG79I@QGO9:�v�HJj/<.I@H�v�LxHJL.<D8;B.:#XV¤��zXV3�j@:G3�67PQ=?TL�vWHJj�j@:GO9:GQ�8;:G<o�V��B.79j�:�rT:GLg8�79j�79L-8@:GIF.I@:�8;:G<qHJj�HJL �¤�QG?JL�24:GO9:GQ�8;7P?JL.�Y:�rT:=L-8G�Z©W:=Q\HJ3�j@:8;B�:K3.j:GI�61H\[�HJO9j@?YHJO98@:GIL�H�8;7}rT:=O9[Z5d:�I@:=Me:[email protected]>8;?>8;B.:�ST:=?TSTI;H�F.B.7PQ�I:GST79?TL�L�:\HJI(8;B.:KXV¤��XV3.j:G3.6 � H�L.<YL�?J8,8@B.:D6�3.j@:=3.6 798@j@:GO}M ;`�8;B�:xQG79I@Q=OP:�7Pj,HJO9j@?�I@:=ST7Pjk8;:GI:G<VHJj�H�F�?Jj@[email protected]:Y�;��:�|[email protected]ª2n:GOP:=Q=8@7P?TL.�Y:=rJ:GLg8\� �I?T6 ]4�a_686;^j:GQG?JL.<.j�HJL.<s5�:�[T?TL.<o`�HYOP79L.:�v�HJjx<.I;H\v�LR`�[email protected]:AL�?^79QG?TL�vWHJj�7PL�Q=OP?Tj:�F.I@?\~47P6�798�[Y?JM%8;B.:AO97PL.:�`o8;B�:A:=rT:=Lg8x5d:GQ=?T6K:=j�7PLg8;:[email protected]:=8@:G<�HJj(H�;��:G?TSJI;HJF.B�7PQ(24:=OP:=Q=8;79?TL.��:=rJ:GLg8\�

¦EL.QG:W8@B.:�6�?T3.j:W:=rJ:GLg8;j%HJL�<�j8@I@?T��:Gj�HJI:�QG?TII@:=Q=8;O}[D7PLg8;:[email protected]:=8;:=<R`T8;B�:=[xHJI@:#j8;?JI@:G<A79Lx8;B�:6�3.O}8;796K?n<�HJO <�H�8;HJ5�HJj:J��N%HJQtB�:=rJ:GLg8xjk8;?TI:Gj(<.7}�o:=I@:GLg8(79L�Me?TI@6KH�8@7P?TLR�(¤�L�8;B�:�QGHJj@:�?JM��¤�Q=?TL24:=OP:GQ�8;79?TL.�E:�rT:GLg8@jG`n7PL�Me?TI61Hw8;7P?JL�O97P�J:%8;B.:Wj8tH�I8l8@7P6�:GjlH�L.<�:GL.<�8@7P6�:Gj�?�Md8@B.:�jk8;I@?J�J:�?TI�Q=OP79Qt�d`

¡gb

Page 41: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

8;B�:,L�H�6K:�HJL.<K<.:GjQGI7PF�8@7P?TL�?JMo8@B.:�OcHJL.<�61HJI�a`-HJL.<K8@B.:�8�[4Fd:�?�MRj8@I@?T��:�j:GOP:=Q=8@7P?TLKHJI@:�jk8;?TI:G<7PLg8@?Y8;B�:1<�H�8;HJ5�HJj:J� a?JIZ�¤�Q=?TLz°�7PSTB.O97PSTBg8@�^:�rT:=L-8@jG`�8;B.:Kj8;HJI8�8;7P6�:GjD?JM�8@B.:1B�[email protected]�8;7P?JLR`w8@B.:WL.HJ6K:WHJL.<�<.:GjQGI@79F�8;79?TLx?�M�8;B.:#OcHJL.<�61HJI��HJI:#jk8;?TI:G<A7PL�j8;:GHJ<R� �?TIE�@�(:=?TSTI;H�F.B.7PQ24:=OP:GQ�8;79?TL.��:=rJ:GLg8;j=`d8@B.:(j8;I?T�J:�8�[nFd:J`dHJL.<>8;B.:(5d?T3.L.<�7PL.S�5d?�~{?JMh8@B.:(j8@I@?T��:D79j�I@:=QG?TI<.:G<R�

¡.�

Page 42: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

¡-]

Page 43: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

� � ��� ��� �

� � � � ��� ��� � � � � � � ������� �

� � � � � � � ��� � � � � � � �

��O9Oh8@B.:�j@Fd:G:GQtB�7PL�MeI@HJj8@[email protected]�8;3.I:�Me?TI�§�?�[gH�ST:GI(7Pj�F�I@?�rn7P<.:=<�5g[Z8@B.:K�DH�OcHw~n[Yj[nj8@:G6V� �\¡�¢ ���,jj@B�?�v�L�79L �7PSJ3.I@:ª]�|k]4`/v�B.:GLz8@B.:ª3.j:GIAj@Fd:\H��nj�8@?V8;B�:{j[nj8@:G6^`l8;B.:ª348@8;:=I;HJL�QG:{j@:=L.<.jA8;B�:j@Fd:G:=QtBqv�H\rJ:=Me?TI6 8@?^8@B.:1jF�:=:GQtBqI:GQG?JSTL.7P�=:GI=`hv�B.79QtBqQGI:\H�8@:Gj�H{v#?TI@<qSJI;HJF.B�?JM�Bg[nFd?J8;B.:�|j@:=jG����B.7Pj�7PL4Me?TI@6KH�8;79?TLz7Pj�8;B�:GL <.79j@F�Hw8;QtB.:=< 8;?�8;B.:YL�H�8;3�I;HJO�OcH�L.ST3�HJSJ:^3�L.798G`Wv�B.:GI:V8;B�:v#?TI@<ZSJI;HJF.B^7Pj�F�HJIj@:=<Z5g[{8;B.:���¤ >,�A� ��_�¢/L�Hw8;3.I@HJO OcHJL.SJ3�HJST:(3.L.<�:GI@jk8tHJL�<.7PL.SKj[nj8@:G6^����B.:5d:Gj8DBg[nF�?�8;B.:=j@7Pj=`�:=L.QG?n<.:G<�7PL�H{j@:=61HJLg8@7PQAMeI;HJ6�:AI@:=F.I@:=j@:=L-8;H�8;79?TLR`/7Pj�j:GLg8�8@?{8;B.:�QG?TLg8@:�~n8I@:=j@?TO93�8;79?TL j:GIkrT:GI=� ��B.7PjKj@:=IrT:=I{I@:=j@?TO}rT:Gj{3�L.�-L.?�v�L�I:=Me:=I@:GL�QG:Gj{79L [email protected]@:G6KHJLg8;79QYMeI@HJ6K:5g[{7PL�QG?TIF�?TI@H�8;79L.SAHJO9O�796KF�OP7P:=<ª7PL4Me?TI@6KH�8;79?TL�MeI@?T6 8;B.:(3.j:GIG��j�j@:=61HJLg8@7PQEMeI;H�6K:=j�7PL{F.I:=rn7P?J3.j8;3�[email protected]�?JM�8;B�:1<.7PHJOP?TS�`/v�B.79QtBzHJI:Kjk8;?TI:G<z7PLsHYB.79j8@?TI[o� _�¢ �^±�:=Me:=I@:GL�QG:Gj�8@B�H�8�L.:G:=<.:G<q8@?Z5d:I@:=j@?TO}rT:=<VQ\H�LY5d:�vW?TI<.j�OP79�J:^�B.:=I@:=�.`#�k8;B.:=I@:=�.`�?TI��[email protected]��v�B�7PQtBYHJI@:(QG?JL-8@:�~n8;3.HJO F.I@?TL�?T3.L.j=���B.:�I:Gj@?JO9rT:=<{j@:=61HJLg8@7PQ�MeI@HJ6K:=j�HJI:EF�HJjj@:=<>8@?�8;B.:�<.7cHJO9?TSx6KHJL.SJ:GIG`-v�B.79QtB^<�:=8;:=I@6�7PL.:=jW8;B�:HJF.F�I@?TF.I7cH�8@:YI:GjF�?TL�j@:Z8;?�8;B.:Z3�j@:GI=� ¤�L 8;B�:ZL.:=v rJ:GI@j7P?TL�?�M�§�?�[THJST:=IG`�8;B.79j16�:=8@B.?4< ?JMI@:=j@?TO93�8;79?TL{6KH�[ªST:GL.:=I;H�8@:(j@?T6�:�:GII@?TIjG�#243.F.Fd?Tj:D8@B.:(3.j@:=I�j@H\[4j=`

«�8@8;:=I;HJL�QG:��T® �@°�7 `TjB.?�v 6�:�8;B.:�O9?4QGH�8;79?TL�?JMd8;B�:�XV¤�� XV3�j@:G3�6Y��� �£L.?(6�?T3.j@:�6�?�rT:�|6�:GLg8�?TL>8;B.:��(«,¤

«�8@8;:=I;HJL�QG:�]4® �k¤�HJ6 SJ?T7PL.S�8;B.:=I@:x8@?T6�?TI@I?�v(`�Q\HJLY[T?T3�j@B�?�v+6�:�8@B.:�<.I79rn7PL.S1<.7PI:GQ�|8@7P?TL.j�MeI?T6 6�[{B.?T6�: �\� �¥]�L.<>3�88;:=I;HJL.Q=: �£L.?�6�?T3.j:D6�?�rT:=6K:=L-8�?TL{8@B.:��D«�¤

¡g_

Page 44: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

�I@?T6 8;B.:,f�I@jk8�3�8@8@:[email protected]:�`.QG?JL-8@:�~n8�I@:=j@?TO93�8;79?TL179j�H\v�H�I@:E8;B.H�8�8;B�:�8;?TF�7PQ�79L1Me?nQG3.j�79jW8;B�:XV¤�� 6�3.j:G3.6^��¤�Lq8@B.:^]�L.<z348@8;:=I;HJL�QG:J`%798xQ\HJLz3�j@:ª8;B�7Pjx8@?TF.7PQK8;?�I@:=j@?TO}rT:ª8@B.:ª3.L.�-L.?�v�LI@:�Me:GI:GL.Q=:Z�k8@B.:GI:J���q°�?�v#:=rJ:GI=`�7}M/8@B.:(3.j@:=I,j@H\[4j=`

«�8@8;:=I;HJL�QG:��T® �@°�7 `TjB.?�v 6�:�8;B.:�O9?4QGH�8;79?TL�?JMd8;B�:�XV¤�� XV3�j@:G3�6Y��� �£L.?(6�?T3.j@:�6�?�rT:�|6�:GLg8

«�8@8;:=I;HJL�QG:�]4® �k¤�HJ6 SJ?T7PL.S�8;B.:=I@:x8@?T6�?TI@I?�v(`�Q\HJLY[T?T3�j@B�?�v+6�:�8@B.:�<.I79rn7PL.S1<.7PI:GQ�|8@7P?TL.j�MeI?T6 6x[qB.?T6�: �\� �£H�6�?T3.j:>QGOP79Qt�s79jAI@:GSJ7Pj8@:GI:G< ?JL�8@B.:^61HJFo`#H�O98;B�?T3.STB�7986KH\[45d:�L.:GHJI�8;B.:(7PQ=?TL>I@:=F.I@:=j@:[email protected]¤�� XV3�j@:G3�6Y`�8;B�:D79QG?TL>79j�L.?J8�j@:=OP:=Q=8;:=<

¤�L{8;B.79j�Q\HJj:J`.8@B.:(3.j@:=I�6�:\H�L-8K� 8;B.:=I@:G��HJj�8@B.:�OP?nQ\H�8@7P?TL1B.:(B�HJ<>QGO97PQt�J:=<Y?JL>8@B.:�6KHJFR����B.79jF.I?TL.?T3.L^L.?�v j:GIrJ:Gj�H�<.:=7PQ�8;7PQ�79L.j8@:\HJ<^?JM�HJLYHJL�HJF.B�?TI;H�����B.:DQG?JL-8@:�~n8,I@:Gj?TOP348;7P?JL^QGHJL.L.?�8QG?JI@I@:=Q=8@O9[�I@:=j@?TO}rT:Y<.7PjQG?T3.Ij@:^8;B.79jK<.:=7PQ�8;7PQ{v�7}8;B H�8;?TF�7PQ{MeI@?T6 8@B.:s�Gj8K3�8@8@:GI;H�L.QG:�� 2n7PL.Q=:QG?J6KF.O9:�~ª6K?T3�j@:�:=rJ:GLg8;j�?TL{8;B�:D6KHJF>HJL�<>8@B.:��D«�¤#L�:G:G<>8;?�5d:E8tHJ��:GL^7PLg8;?�Q=?TL.j@79<.:GI@H�8;79?TLR`HAF.I@:�|�<.:�f�L.:=<VF.I:=Me:GI:GL.Q=:�6�:GQtB.HJL.7Pj6 vWHJj�<.:=rJ:GOP?JF�:=<Y8;?�I:Gj@?JO9rT:�8@B.:Gj:�<.7}�o:=I@:=L-8�8�[nFd:Gj�?JMI@:�Me:GI:GL.Q=:GjG�

� ��� � �������� � ����� � �-�~����������� � � �-(3'�� ����,

¤�QG?JL.j^HJj@j?4Q=7cH�8@:G<mv�798;Bm6�?T3.j:�:�rT:=L-8@[email protected]�B.79OP:�Hz<.:=7PQ=8@7PQZv#?TI@<�7Pj>3�88;:=I@:G<�HJI:8;I:\H�8@:G<{H�j#8;B�:E<.:G79Q=8@7PQ�I@:=Me:=I@:=L.QG:��#°�?�vW:�rT:GI=`�61H�L-[�6�?T3.j:,:�rT:GLg8@j�6KH\[�?4Q=QG3.IWH�8W8@B.:�j@HJ6�:8;796K:�`/HJL.<qH^F.I@79?TI@7}8�[ZO97Pj8D79jDL�:G:G<�:G<q8;?^QtB.?n?Tj@:�8;B.:KHJF.F�I@?TF.I7cH�8@:�?TL.:J�{�,j�6�:GLg8@7P?TL.:=<s79LUWB�HJF48;:GI 84`�8@B.:W6�?T3.j:W:=rJ:GLg8;j�B.H�rJ:�5d:G:GLAQGH�8;:=ST?TI7P�G:=<AHJjE�¤�QG?TLA24:GO9:GQ=8@�.`��k¤�QG?TL�°�7PSTB.O97PSTBg8@�.`�;��:G?TSJI;HJF.B�7PQ�2n:GOP:=Q=8@7P?TL.�(H�L.<��;��:[email protected]���?4QGH�8;79?TL.�.�,�¤�Q=?TLK24:GO9:GQ�8;7P?JL.��:=rJ:GLg8;j%B�H\rT:�8;B�:B.79STB.:Gjk8�F.I@79?TI@7}8�[1v�B.79OP:>�@�(:=?TSTI;H�F.B.7PQE� ?nQ\Hw8;7P?JL.�A:=rJ:GLg8;j,B�H\rT:(8;B.:(OP?�v#:Gjk8,F�I@7P?JI@798�[J� �79ST3.I@:Tw|;��:�~4F.OcH�7PL.jW8@B.:�<.:=QG7Pj7P?TL{F�I@?nQG:Gjj�7PL{I@:=j@?TO}rn7PL.Sx8@B.:�<.:=7PQ=8@7PQ�����B.:�j@:=61HJLg8@7PQEMeI;H�6K:EF.HJj@j:G<8;?^8;B.:K<.7PjQG?T3�I@j@:Kj@:=IrT:=I�QG?JL-8;HJ7PL�j�8;B�:Kjk8tHJIk8x8;796K:�HJL�<s:GL�<s8;796K:�?JM�[email protected]<.:=7PQ=8@7PQ�F.B.I@HJj@:�`HJL.<�8;B�7Pj�8;796K79L.Sª7PL4Me?^79j(3.j@:=<�8;?^<.:�8;:GI6K79L.:A79MWHJLg[�rn7cHJ5�OP:A6�?T3.j@:�:�rT:GLg8@j�HJI:KF.I:Gj:GLg8�8@?I@:=j@?TO}rT:D8;B.:�<.:G79Q=8;79Q(:�~4F.I@:=j@j7P?TLR��� <�7cHJSTI@HJ6 79OPOP3�j8;I@H�8;79L.Sx8@B.:x<.7}�o:=I@:=L-8�j8@I@:\H�6Kj�?JM�6�?T3.j::=rJ:GLg8;jW7Pj�j@B.?�v�LK7PL �7PST3�I@:ITw| ]4����B.:,3.j@:=I#j@H\[4j=`��@°�?�v <.?�¤�ST:�8%8@B.:GI: �\��HJL.<[email protected].?j@Fd:G:=QtBKI:GQ=?TSTL.7}8;7P?JL�:GII@?TIjG`T8;B�:�j@:G6KHJLg8;79Q�MeI;HJ6�:WF.HJI@j:G<�5-[�8;B.:�L.H�8;3.I@HJO�OPHJL.ST3.HJST:�3.L�798�B�H�j

¡T¡

Page 45: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

Yes

No

No

No

No

No

Yes Yes

Multimodal Context Resolution

Use this event to resolve the deictic

spoken?

present?

HighlightIs an Icon

Is aGeographicSelection

Is aGeographic

event

event

or pronoun

Yes

Existing Context Resolution

discourse phenomenasresolve the otherLook at the history to

the history to resolve itanaphora and look atTreat the pronoun as an

Is an IconSelection

event

Location

present?

present?

eventpresent?

Is a deictic

Yes

START

�79ST3.I: Tw|t�T®lCE:GQG79j@79?TL{8;I@:=:(?JM�6x3.O98@7P6�?4<�H�OdI:Gj?TOP3�8@7P?TL

¡L8

Page 46: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

How do I get there

MIT Museum

MIT Museum

1.876 2.544

1.876 2.544

Utterance :

Time(secs):

Time(secs):

Time(secs):

2.033 2.342

1.876 2.544

2.7860

0

0

MIT

seumHarvard

Time(secs):0

Geographic Selection event:

1.3011.092

Circle

Time(secs):2.7860

Mouse Location:

x,y

Mu−

Icon Highlight event:

Icon Selection event:

�7PSJ3.I@: T�|k]4®��,LY:�~.H�6KF.O9:�?JMh6�3.O98@7P6�?4<.HJOa<.:G79Q=8;79Q�I@:=j@?TO93�8;79?TL

¡*T

Page 47: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

8;B�:�:�~.H�Q=8Ej@HJ6�:�F.B�I;HJj:J����L��¤�QG?TLZ24:GO9:GQ�8;7P?JL.�K:�rT:=L-8�v�HJj,F.I@:=j@:=L-8,v�[email protected]>8;B.:Dj8;HJI8�8;796K:�¥]n� bT_J_1j@:=QGj ,H�L.<Z:GL�<�8@7P6�: � ]4� _J¡-]�j:GQ=j �?JM�8@B.:�<.:=7PQ=8@7PQZ�k8;B.:=I@:�` �^HJL.<Z8@B.:AXV¤��+XV3�j@:G3�6vWHJj�j:GOP:=Q=8@:G<R��2n7PL.Q=:A�¤�Q=?TLA24:=OP:=Q=8;79?TL.�,:=rT:=Lg8;jlB�H\rJ:W8;B.:#B.7PSJB.:Gjk8�F.I7P?TI798�[J`[email protected]/:=rJ:GLg8�7Pj/3.j:G<8;?{I:Gj?TO9rJ:�8;B.:�<�:G7PQ�8;79QJ��¦�r47PH�8@8�� �\bw¢�v�I?J8;:�8@B�H�8�L�?J8�:=rJ:GIk[T?TL.:�6KHJ�J:=j(Hªj@:=OP:GQ�8;79L.S{ST:Gjk8;3.I:j8@I@79Q=8;O}[�v�798;B�7PLK8@B.:�8@7P6�:,[email protected]:�H�8Wv�B.79QtBª8;B.:�<.:G79Q=8;79Q�79jW3�88;:GI:G<R`�j@?AHJLg[q�¤�QG?JL^24:GO9:GQ=8@7P?TL��:=rJ:GLg8�8@B�H�8�?nQGQG3�I@I@:=<Yv�7}8;B.79L��J�=;�j@:=QG?TL�<.j�5d:=Me?TI:(?TI�H�Mu8;:=I�8@B.:D<.:G79Q=8;79Q(HJI@:DHJQ=QG:=F�8;:=<R����B.79j8;796K:�I;HJL.SJ:D6KH\[ª5d:DH�O97988;OP:�8;?n?�j8;I7PL.SJ:GLg8,HJL.<{v�7PO9OR5�:EMe3�I8;B�:GI�:�~4F.O9?TI@:=<Y79L>8@B.:�Me3�8;3�I@:J�

¤¥M�8�vW?A?JIW6�?TI@:�3.L.79in3�:>�¤�QG?JL>24:GO9:GQ�8;7P?JL.�x:�rT:GLg8@j�vW:=I@:�I@:=ST7Pjk8;:=I@:G<17PL.jk8;:\H�<{H�8W8@B.:�j@HJ6�:8;796K:�`d8@B.:AQG?JL-8@:�~n8(I@:=j@?TO93�8;79?TLYv#?T3.O9<�5�:x3.L�HJ5.O9:x8;?1I@:Gj?TO9rJ:�8;B.:x<.:G79Q=8;79Q�8@?>H1<.:=f.L.798@:�I@:�Mc|:GI:GL.Q=:J��¤¥81v�7PO9O�F�HJj@j�8;B.79jK79L.<.:�8;:GI6K79L�H�8@:YI:Gj@3�O98�8;?s8@B.:V<.7PHJOP?JS�6KHJL�H�ST:GI=`Wv�B.7PQtB QG?T3.O9<[email protected]}[ZHJj�V8;B�:A3.j@:=IG`,� p B.79QtB�?JL.:�HJI@:�[J?T3�I@:=Me:[email protected]ª8@? �\� ��B.7Pj�v�7PO9Oh5d:A7P6�F.O9:G6�:GLg8;:=<7PL{8@B.:�Me3�8;3.I:J�

¡L;

Page 48: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

¡*<

Page 49: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

� � ��� ��� �

� � � � � � ��� � ���

� ��� � � ��� � ���,��� �

��B.:%7PLg8;:=STI;Hw8;7P?JL�?JM.jF�:=:GQtBAHJL�<�Fd:GL�ST:Gjk8;3.I:Gj/B�HJj ST:GL�:GI;Hw8;:G<�6�3.QtB�7PLg8;:=I@:Gjk8�79L�8;B.:�I@:=j@:GHJI@QtBQG?J6K6�3�L.798�[J�x��B.: �E3.7PQt�-j:=8�j[nj8@:G6V� ]w¢�79Lg8;:GSJI;H�8@:Gj�j@Fd:G:=QtB�v�7}8;B�F�:=L�7PL.F.348�8;B�H�8(79L.QGO93.<.:=j<.I@H�v�L1STI;HJF�B.7PQ=jG`-j[n6�5d?TOPj=`4SJ:[email protected]@:=jG`�HJL.<[email protected]�����B.: ��3�7PQt�-j@:�8�j[njk8;:G6 3.j:Gj�H(j@:=61HJLn|8;79QE3.L.7}f�Q\Hw8;7P?JLªF.I@?nQG:=j@j�8;?AQ=?T6�5.79L.:�8@B.:�6K:GHJL.79L.SJMe3.Od6�3.O}8;7P6�?n<�HJOa7PL�Me?JI@6KH�8;79?TLKQGHJI@I7P:=<{5-[8�v#?A7PL.F.348Wj7PSTL�H�OPjG� ��3�7PQt�-j@:�8�3.j@:=j�?TL.:�6K?n<�HJO9798�[x8@?�<.79j;HJ6�5�7PST3�Hw8;:�6K:GHJL.79L.Sx79LK8;B�:E?J8;B�:GIG�¯T?TB.L�j8;?JL1I@:=QG:=L-8@O9[�<.:�rT:=OP?TFd:G<1XV����U�° �£XV3.O}8;7P6�?n<�HJOn��QGQ=:Gjj��h?xUW798�[A°,:GO9F�� ;�¢£`nHD6�?T5.79OP:6�3.O}8;796K?n<�HJO4j@Fd:G:GQtBn|�Fd:GL{7PLg8@:GIMyH�QG:,8@?xI:Gj8;HJ3.I@HJLg8�HJL.<[email protected]\[ª7PL4Me?TI@6KH�8;79?TL�Me?TI >,:�v �%?TI@�UW798�[J`�v�B.7PQtB�3.j@:=j�f�L�798;:Ajk8tH�8@:A8;I;H�L.j@<.3�QG:GIj�Me?TIE8@B.:�6�3.O}8;7P6�?n<�HJO 7PLg8;:=STI;Hw8;7P?JL�F.I@?nQG:=j@jG�K¤�L8;B�:Gj@:xj[nj8@:G6�jG`o3�j@7PL�S16�3.O}8;796K?n<�HJO�7PLg8;:=STI;H�8@7P?TL>8;?KI@:=j@?TO}rT:xF�I@?TL.?J3.L.j�O97P��:Z�[email protected]�.`#�k8;B�:GI@:=�HJL.< �B.:=I@:=��79jKH�QG?J6K6�?TLzF.I?4Q=:Gj@j=� CE:=F�:=L.<.7PL�S�?TL�8;B�:^Q=?TLg8;:�~48K?JM,8;B.:>j[njk8;:G6�jG`[email protected]#?TI@<.j�QGHJLzMe3.L.Q=8@7P?TLz:=798@B.:GI�HJjA<�:G7PQ�8;79QGj�?TI�HJj�HJL�HJF�B.?TI;H�jG�s��B�:^<�79��:GI@:=Lg8A8;:GQtB�L.7Pi-3.:=jK79L6�3.O}8;796K?n<�HJO#I@:Gj?TOP348;7P?JL�j:GIkrT:V8@?�<.:�8;:=I@6�7PL.:>8;B.:>Me3.L.Q�8;79?TL ?�M�[email protected] vW?TI<.jªH�QGQG?JI@<.79L.S�8@?8;B�:G7PI�Q=?TLg8;:�~48G�

¦EL.:�[email protected]:�Q=3.:,8@?�<.:=8@:GI6K79L.:�8@B.:,Me3�L.Q=8@7P?TLª?�M�F.I@?JL.?T3.L.jW?TI#?�8;B.:=IWI@:�Me:GI:GLg8;7PHJOdv#?TI<.j7Pj�<.:�8;:GQ�8;79L.S18;B�:xF.I:Gj@:=L.QG:A?�M�ST:Gjk8;3.I:Gj=����B.:�F�I@:Gj:GL.Q=:�?JM%H�ST:Gjk8;3.I:x<.3.I7PL.S1HJLZ3�88;:=I;HJL.Q=:7P6�F.O97P:Gj�8;B�H�8hH�<.:=7PQ=8@7PQ�v#?TI@<Dv�HJj/6�?TI@:�O97P�J:=O9[�j@Fd?T�J:=LR� p 798@B�8;B.79jhH�j@j@?nQG7PH�8;79?TLR`�79Mn8;B�:%jF�:=:GQtBI@:=QG?TSJL.7P�=:GI�B.HJj�Fd?4?JI�Fd:[email protected]=:xI:GQG?JSTL.7P�=7PL.S�<.:=7PQ=8@7PQ(vW?JI@<.j=`o5d?4?Tjk8;79L.S�8@B.:�I:GQG?JSTL.798@7P?TL?JM/j@3�QtB>v#?TI<.j�v�798;BK8;B.:�F.I:Gj:GL.Q=:D?�MhSJ:[email protected]@:=j�j@:G:=6Kj�F�OcHJ3.j7P5.O9:J� a?JIW8;B.79jW8;B�:Gj@79jG`.<�79��:GI@:=Lg8

¡*_

Page 50: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

{5.365} zoom {4.672} in {5.035} right {−7.827} {−5.935}

{5.377} zoom {4.642} in {5.007} Brighton {−8.068} {−5.967}

{5.345} zoom {4.653} in {5.016} right {−11.449} here {−5.981} −2.417

{5.390} zoom {4.662} in {5.025} ride {−12.367} here {−4.064} −3.225

0.9911.31

Total

�79ST3.I@: ;�|;�T®�>�|�5d:Gjk8WBg[nFd?J8;B.:=j@:=j�ST:GL.:=I;H�8@:G<K5-[�8@B.:E24«�XZXV¤��mjF�:=:GQtBªI:GQG?JSTL.7P�=:GI�v�798@BK8;B�:HJQ�8;3�HJO�jF�?J�J:GLY3�8@8@:[email protected]:(3.L�<.:GIOP7PL�:G<R�

5d?4?Tjk8;79L.Ss6�:GQtB�H�L.7Pj6Kj�B�H\rT:Z5d:G:=LmHJF.F.O97P:=< HJL.< HJL�HJO}[4�=:G< 8@?qj@:=:ZB.?�v v#:GOPO,:\HJQtB QG?T3.O9<5d?4?Tjk8�8;B.:(Fd:[email protected]=:�?JMh8@B.:(j@Fd:G:=QtBZI@:=QG?TSTL�7P�G:=IG�

� ��� ) (g�%$e� ��" �5����' ) & � �-(F' � �-(g�#" ��������� �

UW3.II@:GLg8@O9[T`�HJOPO�3�j@:GI=� jW3�8@8@:GI;H�L.QG:=j�HJI@:�F.I?4Q=:Gj@j:G<^HJL.<KI@:=QG?TSTL�7P�G:=<ª5g[�8;B.:E2�«�XZXY¤���jF�:=:GQtBI@:=QG?TSJL.7P�=:GI�� ¡J¢£`Tv�B.7PQtB�ST:=L.:GI@H�8;:=j#H�L >�|�5d:Gjk8%OP7Pjk8l?JMdBg[nF�?�8;B.:=j@:Gj#?JMdF�?Jj@[email protected]:Wj@:GLg8@:GL.Q=:GjG�W243.Fn|Fd?Tj@:^H�3.j@:=I�j;H\[njG`A� �o?4?T6 7PLzI7PSTBg8�B.:=I@:J`��sv�B.79OP:ªQ=OP79Qt�n79L.S�?TL H�OcHJL.<�61HJI��?JL�8@B.:>61H�F<[email protected]�[1?JM/8;B.:�§�?�[gHJSJ:GIG��j�STI;H�F.B.7PQGHJOR79L-8@:GIkMyHJQG:�����B.: >�|�5d:Gjk8�OP7Pjk8�?JMhBg[4Fd?J8@B.:Gj:Gj�SJ:GL.:=I;H�8@:G<MeI@?J6 8@B.:�I:GQG?JSTL.7P�=:GI,7Pj�SJ79rT:=L�7PL �7PST3�I@: ;�|t�T�,��B.:�L-3.6�5d:GI�8@?18;B�:�I@79STBg8�?JM�:GHJQtBZv#?TI@<�79j8;B�:DQ=?TL�f�<�:GL.Q=:�jQG?TI:�?JM/8;B�:(v#?TI<q� T�¢£�%��B�7Pj�v#?TI@<Yj@QG?JI@:(7Pj�:�~�F�I@:Gjj@:=<�HJj(®

������������� � � OP?JS � ��� ��������������������� ��� � ��� ��������������������� �4;4�9�

��B.:�8;?�8tHJORjQG?TI:�?�M�:GHJQtBYBg[nFd?J8;B.:=j@79j,79j�8;B.:(j@3�6 ?JM�HJOPOo8@B.:Gj:(Ln3�6�5�:=I@j=�#�,j�jB.?�v�LV79Lª8;B.79jf�ST3�I@:J`.8@B.:(QG?TII@:=Q=8,B-[nFd?J8;B�:Gj@79j�?TL.O9[1B�HJj�8;B.:�[email protected]<^5d:Gjk8�j@QG?JI@:J�#°,?�v#:=rJ:GIG`d79MhH�F�?J7PLg8�QGO97PQt�?TI�HKj8@I@?T��:�ST:=j8;3�I@:xvWHJjEF.I:Gj:GLg8(<.3.I7PL.S�8;B.:�<�:G7PQ�8;79Q�3�88;:=I;HJL.Q=:J`o8@B.:xjQG?TI:�?JMl8@B.:�<.:=7PQ�8;7PQv#?TI@<��B�:GI@:=�{QG?T3�OP<Z5d:�5d?4?Tjk8;:=<Zv�798;BZHJL�HJ<.<.7}8;79?TL�HJO�jQG?TI:�MeI@?T6 8;B�:�ST:Gjk8;3.I:J` HJL�<�B.:GL.Q=:I;H�7Pj@:(8;B�:D8@?J8tHJO�jQG?TI:x?JM�8;B.:DBg[4Fd?J8@B.:Gj7Pj�Q=?TLg8tHJ79L.7PL�S�[email protected]�vW?JI@<R���/?1:[email protected]:xQ=OcHJI798�[{79LY8;B�:I@:=j8�?JM/8;B.79j�QtB�HJF�8@:GIG`�B�:GI@:D7Pj�j?T6�:E8;:GI6K79L.?TO9?TSJ[d®

CE:=7PQ=8@7PQ�«�8@8@:GI;H�L.QG:�|%3�8@8@:[email protected]:�8@B�H�8�QG?TLg8;HJ7PL.j�<�:G7PQ�8;79Q�I@:=Me:=I@:=L.QG:=jG�

CE:=7PQ=8@7PQ(��:Gjk8;3.I:Gj�|�8;B.:([email protected] �wj@:GO9:GQ�8;7PL�S�ST:Gjk8;3.I:J�

8Jb

Page 51: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

CE:=7PQ=8@7PQ#°�[nFd?J8;B.:=j@79jh|R8@B.:WBg[nF�?�8;B.:=j@7Pjl8@B�H�8�QG?TLg8tH�7PL.jh?TL.:�?TI/8�vW?�<�:G7PQ�8;79Q#v#?TI@<.j=�l��B.79jBg[nF�?�8;B.:=j@7Pj�7Pj�?JL.O9[1?TL.:(?JM/8;B.:(:GLg8@I@7P:=j�?TL{8;B.:">�|¥5�:=j8�OP79j8G�

� � � � �}�%�~�,� ��" � �-(g�#" ��������� � ) ( �%$��-� � ����' ���-�~�,��$e� �

��Lg[V6K?J8@7P?TLY?JM�8;B�:�6K?J3.j@:�?�rJ:GIE8;B�:�61H�FZ<.7PjF.OcH\[^7Pj�QG?TL.j7P<.:=I@:=<�HªST:Gjk8;3.I:J�(��B.:A3.j:[email protected]�:G<18@?�5d:�QGOP79Qt�-7PL.S.`-<[email protected](?TI �3.j8#6K?�rn7PL�SD8@B.:,6�?T3.j:,?�rJ:GI#8@B.:�6KHJF�<.7PjF.OcH\[A?JL.O9[v�B.:=LYB.:(79j�7PLg8;:=I@:=j8;:=<Y79L>j@?T6�:�OcHJL�<.61H�I@�a`�jk8;I@:=:=8G`�?TI�HJI@:GH�����j�6�:GLg8@7P?TL.:=<>7PL^UWB�HJF48;:GI 84`8;B�:Gj@:�ST:=j8;3�I@:Gj�HJI:�<�79rn7P<.:=<�79Lg8;?{8;B.I:G:A8�[nF�:=j�?�M�:=rJ:GLg8;j=®��¤�Q=?TLs24:GO9:GQ=8@7P?TL��.`��¤�QG?JLs°�7PSTB4|OP79STBg8;�.`/�@�(:=?TSTI;H�F.B.7PQ,24:=OP:=Q=8;79?TL.��HJL.<��@�(:=?TSTI;H�F.B.7PQ���?nQ\H�8@7P?TLR��� �?TI��¤�QG?JL{24:=OP:GQ�8;79?TL.��H�L.<�;��:G?TSJI;HJF.B�7PQ�24:=OP:GQ�8;79?TL.�>:=rJ:GLg8;j=`l:\HJQtB�7PL.<�79rn7P<.3.HJOl:=rJ:GLg8�79j(QG?TL.j7P<.:=I@:=<qH>j@7PL�STOP:AST:[email protected]@:���?TI��¤�Q=?TL °�7PSTB�OP7PSJB-8@�Z:=rJ:GLg8;j=`�v�B.:GL�8;B.:^6�?T3.j@:>79jAQGOP?Jj@:{8;?�HJL�7PQ=?TLR`�8;B.:=L 8;B�:^79QG?TL�79jB.79STB.OP79STBg8;:=<YH�L.<V7}8,79j�I@:GSJ7Pj8@:GI:G<ZH�j�HJLY:=rJ:GLg8\��°,?�v#:=rJ:GIG`�[email protected]:D8;B.:x�D«�¤�I@:=ST7Pjk8;:=I@j�:=rT:=Lg8;jv�B.:=L.:=rJ:GIK8@B.:>6K?J3.j@:>7PjA6�?�rT:=<R`W6KHJLg[+�¤�Q=?TL °�7PSTB�OP7PSJB-8@�Z:=rJ:GLg8;jKHJI:^I:GQ=?TI@<.:=<R��¤¥M�8;B�:3.j:GI�7PLg8@:GL.<.j�8@?AB.7PSJB.OP79STBg8�H�jF�:=QG79f.Q�7PQG?JLR`�7}8�7Pj�[email protected]:=<{8;B�H�8W8;B.:�6�?T3.j:Ev�7POPOd5d:E6K?�rn7PL�SQG?JL-8@7PL-3.?T3�j@O9[�L.:GHJIx8;B�:ª7PQ=?TLqMe?TI�Hw8�OP:GHJj8x8;B.I:G:18@7P6�:KMeI;H�6K:=jG`�v�B.79QtB�I@:Gj3.O98@j�7PLqH�8�O9:\HJjk88;B�I@:G:�Q=?TL.j@:=QG3�8@79rJ:K79L.j8;HJL.QG:=j�?JM%8;B.:Aj@HJ6K:A79QG?TL�B�7PSTB.O97PSTBg8�:=rT:=Lg8\��°,:=L.QG:�` [email protected]@:=:�QG?TL.j:GQ=34|8;7}rT:(B.79STB.OP79STBg8�:�rT:GLg8@j,Me?TI�8;B�:Dj@HJ6�:�7PQG?JLYQ=?TL.j8@798@3�8;:=j�?JL.:(ST:Gjk8;3.I:J�%��B.:�j@HJ6�:�H�F.F.OP79:GjWMe?JI�;��:G?TSJI;HJF.B�7PQK� ?nQ\Hw8;7P?JL.�Y:�rT:=L-8@jG`�:�~4Q=:GF�8A8@B�H�8xf�rT:ªQ=?TL.j@:=QG3�8@79rJ:��;�(:[email protected]��?nQ\H�8@7P?TL.�:=rJ:GLg8;j#QG?TL�j8;7}8;3�8@:�?TL.:�ST:Gjk8;3.I:J��¤¥M�8;B.:�6�?T3.j@:�79j�?TL�8@B.:�61H�F�<�7Pj@F�OcH\[T`-L.?(7PQ=?TL.j%HJI:�L�:\HJI5-[HJL.<^798�7Pj�L.?J8�6�?�r479L.S�H�8�H�ST79rJ:GL{8;796K:�`.L.?�:=rJ:GLg8;j�HJI@:(79L-8@:GIF.I@:�8;:G<o�

CE79��:GI:GLg8�6K:�8;B.?n<.jAB�H\rJ:^5d:G:=L F�I@?TFd?Tj@:=<�Me?JI�5�?n?Tjk8;7PL�SZ8;B.:{I:GQG?JSTL.798@7P?TLzjQG?TI:GjAv�798@B8;B�:Gj@:�ST:=j8;3�I@:Gj=� ¤�L�ST:GL�:GI;H�O `�Me?TIª8@B.:�<.79��:GI:GLg8^5�[email protected]�:=8@B.?n<.jG`�8@B.:�8;?J8;HJO�j@Q=?TI@:�79j:�~4F.I:Gjj@:G<ZHJjG®

������������� �������������� ��������� ����� ������������� �"!#�$�%� &'�)(*������� �+��� ���

v�B.:=I@:(8;B.:�r�HJI@7PH�8;79?TL.j#?4Q=QG3.I�7PL{8@B.:(5�?n?Tj8�jQG?TI:J�

XV:�8;B.?n<1��|h5�?n?Tjk8;7PL�SD:=798@B.:GI�v�[email protected]�5d:GI%?JMo<.:G79Q=8;79Q�vW?TI<.jW79L�8@B.:�<.:G79Q=8;79Q�B-[nFd?J8;Bn|:=j@7Pj�?TI�8@B.:(L-3.6�5d:GI�?JMhST:Gjk8;3.I:GjG��?TI�:GHJQtBY:=Lg8;I[>79L{8;B.:(Bg[nF�?J8@B.:Gj:Gj=` �y7PL{F.j:G3.<.?nQG?n<.:

�-,.��/10����$�2�3,4�5� � ��/1��� �)67��/80����$�2�3,:9'�$���;��:!#� �39 �.�<�=&5>@?A����&1� �@�B�

84�

Page 52: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

������� �+��� ��������/80����$�2�3,:9'�$������:!#� �39 �.�<�=&5> ?A����&1� �@�B�

�� ��

������� �+��� ��������/80����$�2�3,:9'�$������ �5� � �;/8��� �

�� 0 ? /1� �2������������� � �

XV:�8;B.?n<�©z|�5�[email protected]�5.HJj@:=<K?TLA8@B.:�L-3.6�5d:GI�?JMd<.:G79Q=8@7PQGj�79L�B-[nFd?J8;B�:Gj@79jG`g8;B�:�L-3.6x5�:=I?JMhST:=j8;3�I@:Gj,HJL.<>8;B�:(8�[nFd:(?JM�SJ:[email protected]@:���?TI�:GHJQtBY:=Lg8;I[>79L{8;B.:(Bg[nF�?J8@B.:Gj:Gj=` �y7PL{F.j:G3.<.?nQG?n<.:

�-,:� �5� � �;/8���2�B� ? ��� ��$� �#��� 9 ��&1�$���2�B�:� 9'�$������:&5> ?A����&1� �@�B� �������� � ��� � �.� 0 �����;�5� � �;/8��� ��> ?A� , �'��� ����( ��/10����$� �3,+�5� � �;/8��� �2( ��/80�

���$� �3, 9'�$������:!#� �39 � �<� &5>@?A���;&1� �@�B�

�� ��

������� �+��� �������� 0 ? /1� �2������������� � �

�5� � �;/8��� �;>@?A�#, �'� � � ����� �-,������ ��� �� ������� ����������� �-,������ ���4�%� &'� �%� &'�������� !�"� �-,��$# ����� �3�$? &5��&% �� ���;��� ���:� �'�$# ����� �3�$? &5��(� �� ������� �����

XV:�8;B.?n<�U |[email protected]�5�HJj:G< ?JL�8@B.:YL-3.6x5�:=IK?JM�Bg[4Fd?J8@B.:Gj7P�G:=< <.:=7PQ=8@7PQ=j1HJL�< 8;B�:L-3.6�5d:GI�?JMhST:=j8;3�I@:Gj�?TL.O}[T�

�?TI�:GHJQtBY:=Lg8;I[>79L{8;B.:(Bg[nF�?J8@B.:Gj:Gj=` �y7PL{F.j:G3.<.?nQG?n<.: �-,:� �5� � ��/8� �2�B� ? ��� ��$� � ��� 9 ��&1�$� � �B�2� 9'�$���;��:&5>@?A����&1� �@�B� �

������� � ��� ��� � ��/80����$� �3, �5� � ��/8� � � ( ��/10����$� �3, 9'�$���;�� !#� �39 � �<� &5>)�?A����&1� �@�B�

�� ��

������� �+��� �������� 0 ? /1� �:� ������� ��� � �

XV:�8;B.?n<�C�|(5d?4?Tjk8;79L.SZ5�HJj:G<�?TLq8@B.:{L-3.6�5d:GIA?JM�Bg[nF�?�8;B.:=j@7P�=:G<�<.:G79Q=8@7PQGjx?TL.O9[J`�I@:�|SgH�I@<.O9:Gj@j�7}MlHAST:[email protected]@:(v�H�j�F�I@:Gj:GLg8\�

8T]

Page 53: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

�?TI�:GHJQtBY:=Lg8;I[>79L{8;B.:(Bg[nF�?J8@B.:Gj:Gj=` �y7PL{F.j:G3.<.?nQG?n<.: ������� � ��� ��� � ��/80����$� �3,.9'�$���;��2!#� �39 �.�<�=&5>@?A���;&1� �@�B�

�� 0 ? /1� �:� ������� ��� � �

� ��� � �[& � $8�� � ����� $e� (g�-����$��

C�H�8;HY?TLz3.j:GI�79Lg8;:GI@HJQ=8@7P?TL�v�798;B�§�?�[THJST:=Ixv�H�j�QG?TO9OP:=Q=8;:=<R��«�j@:GIj�vW:=I@:{79L.j8@[email protected]�8;:G<q8@?�HJQ�|QG?J6KF.O97PjBª8;B.:�Me?TO9OP?�v�7PL.S�8tHJj�nj=`a:G798@B.:GI�5g[>jF�:=:GQtBV?JI�F�:=LY?TI�5d?J8@BYj7P6�3.O}8tHJL�:G?T3.jO9[d®

[email protected]�[1H�61HJF{?�MlH�QG7}8�[ª7PL{8@B.:D©W?Tj8@?TLYHJI@:GH��

[email protected]�[�HD61H�FªQG?TLg8;HJ7PL.79L.S�HxF�HJIk8;7PQ=3.OcH�I�8�[nFd:E?JM OPHJL.<.6KHJI@� �y:J��S.��6�3�j@:G3�6Kj=`�B.79j8;?JI@7PQj798;:=jG`�F.3�5.OP79QESgHJI<.:GL.j�:=8@Q ;�

�o?n?T6 79L>HJL.<^?T3�8�?JM�?TL.:�?JMh8;B.:(OPHJL.<.6KHJI@�-j�?JI�j@:GO9:GQ�8;:G<Y798@:G6�jG�

±�:=8@I@7P:�rT:(<.I79rn7PL.SA<�7PI@:=Q=8@7P?TL.j�MeI?T6 ?TL�:�<.7PjF.OcH\[T:=<YOPHJL.<.6KHJI�K8;?�HJL�?J8;B.:=IG�

�,j@�1Me?TI�8@I;H�¨�Q�7PL4Me?TI@6KH�8;79?TL1Me?TI�HA6KH �?TI�I?gHJ<>?TI�B.79STBgv�H\[ªrn7Pj7P5.O9:�?TL{8;B.:(6KHJFR�

«,j:GIj(v#:GI:A8;?{5d:GB�H\rT:�HJj�7}M�8;B.:Ajk[nj8;:=6 vWHJj(F�:=IMe?TI6K79L.S1Fd:GIkMe:GQ=8@O9[V:=rT:=L�7}M%798ESJ:GL.:=I;H�8@:G<:GII@?TL�:G?T3.j�I:Gj@Fd?TL.j:Gj=� p B.79OP:ª8@B.:>3.j@:=I@j�vW:=I@:>F�:=IMe?TI6K79L.SZ8;B�:Gj@:>8tH�j@�-jG`%8;B.:K>�|¥5�:=j8�O97Pj8ST:=L.:GI@H�8;:=<Z5g[^8@B.:DI@:GQ=?TSTL.79�G:=I,Me?TI�:=rJ:GIk[V3.j:GI=� jE348@8;:=I;HJL�QG:�H�L.<Y8@B.:xST:[email protected]@:=j�F.I?4<.3�QG:G<V?TL8;B�:D6KHJF{v#:GI@:DQG?JOPOP:=Q=8@:G<R�

� ��� � � �,�������

��B.:=I@:Kv#:GI:{H^8@?J8tH�O%?�M 8Jb6T>3�8@8@:[email protected]:=j�QG?JOPOP:=Q=8@:G<�MeI@?T6 ]4�K3.j@:=I@j=�Y��B.:1H\rT:GI@HJST:ªL-3.6x5�:=I?JM�3�88;:=I;HJL.Q=:Gj�Fd:GIx3.j@:=Ixv�H�j�]�¡.�}�T�s�G¡*_ �¥]3_�� ¡*8�� �?�M�8;B.:=j@:{3�88;:[email protected]=:Gj�Q=?TLg8tHJ79L.:G<z<.:=7PQ�8;7PQI@:�Me:GI:GL.Q=:GjG�#��B.:DH\rT:GI@HJST:DL-3.6�5d:GI�?JM/vW?TI<.j�j@Fd?T�J:=LVFd:GI�j@:=Lg8;:GL�QG:�vWHJj 84� T��

��B.:�j8tHw8;7Pjk8;79QGj>HJI:Z8tHJ5.3�OcH�8@:G<m7PL �79ST3.I@: ;4�9�J� ��j>j@B.?�v�L�7PL�8;B.:�8;HJ5.OP:�` _*8q<.:=7PQ�8;7PQI@:�Me:GI:GL.Q=:Gj�v#:GI:KL�?J8DQG?TII@:GQ�8;O}[�Bg[4Fd?J8@B.:Gj7P�G:=<qHJj�8@B.:Y�Gj8(:GLg8@I[�7PL�8;B�:,>�|�5d:Gjk8�O97Pjk8\�A��B.79j7Pj�HJL�HJO9Oh?TI,L.?TL.:xI@:Gj3.O98E?�rJ:GI(HJO9Oh<�:G7PQ�8;79QxI@:�Me:GI:GL.Q=:GjG�x¦�M�8;B.:=j@:A7PL�QG?TII@:GQ�8EBg[nF�?�8;B.:=j@:Gj=`h]68?JM�8@B.:G6 �£QGHJj@:(U�� �B�HJ<1<.:G79Q=8;79Q�I:=Me:GI:GL.Q=:Gj�Bg[nF�?�8;B.:=j@7P�=:G<>7PLK?J8;B�:GI�:=L-8@I@79:GjW?�M�8;B.:=7PI >�|�5d:Gjk8

8J_

Page 54: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

hypotheses as 25 have deictic

other entries oftheir N−best list

their N−best list

70 do not have

as other entries ofdeictic hypotheses

Yes No

Yes

No

Was Deictic hypothesized?

54 95

3561

Was

Dei

ctic

Spo

ken?

��H�5.OP:";4�}�T®�±�:Gj3.O98@j�8;HJ5.3.OPH�8;:=<^HJQGQ=?TI@<.79L.SA8;?�<.:=7PQ=8@7PQ�3�88;:=I;HJL.Q=:Gj,HJL.<^<.:G79Q=8@7PQ�Bg[nF�?J8@B.:Gj:Gj

OP79j8G`�v�B.7PO9:Q;JbZ?�M�8@B.:G6 �£QGHJj@:^U�] �B�HJ<zL.?TL�:J����B.:{j@Q=?TI@:=jA?JM�Q\HJj:{�x`�© HJL�<�U��{QG?T3.O9<5d:�5d?4?Jj8;:=<ZHJj�8;B.:�[^QG?TLg8tH�7PLYH�8�O9:\HJjk8�?JL.:�<�:G7PQ�8;79QDBg[nFd?J8;B.:=j@79j�7PLY?TL.:D?JMl8@B.:G79I >�|�5d:Gjk8�O97Pj8:GLg8@I@7P:=jG��«�j@7PL�S�8;B.:E6�:=8@B.?n<.j�6�:GLg8;79?TL.:G<ªHJ5�?�rJ:J`�8@B.:E?�rT:=I;HJO9Ooj@Q=?TI@:�?JM 8;B.:EBg[nFd?J8;B.:=j@:=j,H�L.<8;B�: p ?TI<AN�I@I@?JI�±,Hw8;:Gj�?�MoH�OPO-8;B.:�3�88;:=I;HJL.Q=:Gj�HJL�<�<�:G7PQ�8;79QW3�88;:[email protected]=:Gj�?TL.O}[�v#:GI:�Q=?T6�F.3�8;:=<HJL.<>8;B�:DI:Gj3.O98@j,H�I@:�j@B�?�v�LY7PL>�hHJ5.OP:";n� ]4�

p B.:GLªHJOPO�3�88;:=I;HJL.Q=:GjWv#:GI:,8;HJ�J:=L{7PLg8;?DQG?TL�j@7P<�:GI;Hw8;7P?JLR`g8;B.:�vW?JI@<ª:=I@I@?JI#I@H�8;:�v�H�j�_6<�� _ ���\bg]6;�:GI@I?TI@j�ov�7}8;B.?J3�8�[email protected].� ¤¥8�7P6�F.I@?�rT:=<�8@?�_*;n�9� � �F_*;�_�:GII@?TIj HwMu8;:GI/5d?4?Tjk8;79L.S�[email protected];B�:�5�:=j8�6�:=8@B.?4<{������B.:�I:GOPH�8;7}rT:,v#?TI<^:=I@I?TI�I;Hw8;:EI:G<.3.Q�8;79?TL{7Pj�?JL.O9[�¡.�a;��ª`�v�B.79QtB{7Pj�L.?�8rT:=I[[email protected]�QGHJLg8\�h°,?�v#:=rT:=IG`-v�B.:GLA?JL.O9[D<.:=7PQ=8@7PQ#3�8@8@:GI;H�L.QG:=jlvW:=I@:�8tH��J:GLA79Lg8;?EQ=?TL.j@79<.:GI@H�8;79?TLR`8;B�:�v#?TI<x:GII@?TI I@H�8;:�vWHJj�_684� _�� �k�9;6;�:GII@?TIj dv�798@B.?T3�8/5d?4?Jj8;79L.S.��¤¥8h7P6�F.I@?�rJ:G<�8;?�]684�a;������]3_:GII@?TIj /HwMu8;:GIh5�?n?Tjk8;7PL�[email protected]�8@B.:�5d:Gj8l6K:�8;B.?n<��x����B.:�I@:=OcH�8@79rJ:#v#?TI@<A:=I@I@?JI�I;Hw8;:�I:G<.3.Q�8;79?TLvWHJjE]�;4� ] �{`.H�6x3.QtBY6�?TI:�[email protected]�QGHJLg8�7P6�F.I@?�rJ:G6�:GLg8\�

��B.:�I@:[email protected]}8;j�?JM#HJF.F�O9[n7PL.S1<.79��:GI:GLg8�5d?4?Tjk8Ev#:G7PSJB-8@j(?TL�<.79��:GI:GLg8(6�:=8;B�?4<.j�7PjEjB.?�v�L�79L�79ST3.I@: ;�| ]4�h��B�:WvW?JI@<�:=I@I@?JI�I;Hw8;:W<�:GQGI:\HJj:Gj�6�?TL.?J8@?TL.79Q\HJO9O9[�8@?EHJL�HJj[n6�F�8;?J8@:�HJj/8;B.:#5�?n?Tjk8v#:G7PSJB-8#7PL�QGI@:GHJj@:=jG����B.79j#jB.?�v�jW8;B.H�8�H(B.79STB�r�HJO93.:�?JM�5d?4?Jj8�vW:=7PSTBg8%v�7PO9O�L.?J8#Bn3�I8%8;B.:�vW?JI@<:GII@?TI,I;H�8@:J`�HJL.<V8@B�H�8�8;B.:x5�:=j8E5d?n?Tj8�vW:=7PSTBg8,Me?TI�:GHJQtBZ6�:=8;B�?4<YQ\HJL�5d:�HJF�F.OP79:G<R��XV:�8;B.?n<�+HJL.<VC+B�H�<Yv#?TI@<Y:GI@I?TI�I;H�8@:Gj�?JMl_*;4�}� � v�B.79OP:�6�:=8;B�?4<Y©�H�L.<�UmB�HJ<Yv#?TI<Y:=I@I@?JI,I@H�8;:=j?JM�_*;4� ]��ª�K��B.79j(<.79��:GI:GL.Q=:K79jD?�MWO9798@8@OP:�j7PSTL�79f�QGHJL.QG:�HJL�<�796KF.O97P:=j�8;B�Hw8�6�:=8@B.?n<.j(�x` ©�`hUHJL.<YC+HJI@:ErJ:GI[>j7P6�7POPHJIG�

8�¡

Page 55: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

No Boosting

Method B

Method A

Method C

Method D

DeicticUtterances

AllUtterances

37.125.7

26.3

26.3

26.3

35.3 38.9

37.2

37.2

37.1

Word Error Rates (%)

�hHJ5.OP:";n� ]4®%��:Gjk8;3.I:(5�[email protected]�H�L.<>798;j�796KF.HJQ=8�?JL>v#?TI<Y:=I@I@?JI�I;H�8@:EMe?TI�HJOPO�3�8@8@:[email protected]:=j�H�L.<<.:=7PQ=8@7PQ�3�88;:=I;HJL.Q=:Gj

0 10 20 30 40 50 60 7024

26

28

30

32

34

36

Boost Weight (log x)

Wor

d E

rror

Rat

e (%

)

Performance of different boosting mechanisms

Method AMethod BMethod CMethod D

�7PSJ3.I@:";�| ]4® p ?TI@<^:GII@?TI�I@H�8;:=j�H�8�r�HJI[n7PL�S�5d?n?Tj8�v#:G79STBg8;j�Me?TI�<.:G79Q=8@7PQ�3�88;:[email protected]=:Gj

868

Page 56: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

� � � � � ��( �����,��� �

¤�L{ST:=L.:GI@HJO `n8;B.:=j@:�I@:[email protected]}8;j�jB.?�v�8@B�H�8�SJ:[email protected]@:=j�Q\HJL{5d?n?Tj8�8@B.:EI:GQG?JSTL.798@7P?TLKj@Q=?TI@:�?JM/<.:=7PQ�8;7PQv#?TI@<.j�HJL.<�B.:GL�QG:�7P6�F.I@?�rT:A8@B.:�v#?TI<s:GII@?TI(I@H�8;:�� p B.:=LqHJF.F�OP7P:=<�8;?YHJOPOl348@8;:=I;HJL�QG:Gj=`�8;B�:7P6�F.I?�rJ:G6�:GLg8 7PLEv#?TI<D:=I@I?TI�I;H�8@:�j@:=:G6�j/[email protected]}f�Q\HJLg8 � HWI:GOcHw8;79rJ:lvW?JI@<(:GII@?TI�I@H�8;:�I:G<.3.Q�8;79?TL?JM#¡.�a;�� Me?TIE8@B.:�5�:=j8D6�:=8;B�?4<;�A°,?�v#:=rJ:GIG`/8;B.:�3�88;:=I;HJL.Q=:Gj(8;B�Hw8(QG?T3.O9<�5�:A5d?4?Jj8;:=<�v#:GI:?TL.O}[>8;B.:�?TL.:Gj,v�B.:GI:AST:Gjk8;3.I:GjEv#:GI@:xF.I@:=j@:GLg8(j7P6�3.O}8tHJL�:G?T3.jO9[{v�7}8;B�H1<�:G7PQ�8;79QxBg[nF�?J8@B.:Gj7Pj=`v�B.79QtBq8tHJ��:GjA3.FzH�F.F.I@?\~47P6KH�8@:GO9[�_Jb �¬?JM�HJOPO%3�88;:[email protected]=:GjG� �?TI(8;B�:Gj@:ª8�[nFd:GjA?JM�QGHJj@:=jG`�8;B�:5d:Gj8�6�:=8@B.?4<>I:G<.3.Q=:G<^8;B.:�v#?TI@<^:GII@?TI�I;Hw8;:�5g[Y]6;4� ]��ª`�v�B.79QtBY79j�H�j7PSTL.7}f�Q\H�L-8�H�6K?T3�L-8G�

��O9On8@B.:�6�:=8;B�?4<.jh?JM�5d?4?Jj8;79L.S,8@B.:�I:GQG?JSTL.798@7P?TL�j@Q=?TI@:=j�vW:=I@:�<.:=F�:=L.<.:=L-8�?JLx8;B.:WF.I@:=j@:GL�QG:?JMWH{<.:G79Q=8;79QABg[4Fd?J8@B.:Gj7PjD7PL�?TL.:�?JM%8;B�:�:=Lg8;I@79:Gj(?JM%8;B.: >�|�5d:Gj8DBg[nF�?�8;B.:=j@:Gj=�1�,jDjB.?�v�Ls79L�hHJ5.OP: ;4�}�T`a8;B.:=I@:�v#:GI: ;Jb�<.:G79Q=8;79Q�348@8;:=I;HJL�QG:Gj �¥U�HJj:�U�] #8;B�H�8�B�HJ<YL.?ª<.:=7PQ=8@7PQDBg[4Fd?J8@B.:Gj:Gj7PL�8@B.: >�|¥5�:=j8�OP79j8G`Jv�B.7PQtBAvWHJj%HJOP6�?Tjk8�8;B�I@:G:�8@7P6�:Gjl6�?TI@:#8;B�HJLA8@B.:�<.:G79Q=8@7PQ�3�88;:[email protected]=:Gj�8;B�Hw8QG?JL-8;HJ7PL�8;B.:=6 � U�HJj@:�U�] t�l�,OPOg8;B.:W6K:�8;B.?n<.jlB�H�<AHE61H �?TI ��H�v(®h79M�L�?E<.:G79Q=8@7PQ#v#?TI<.jlvW:=I@:�79L8;B�:,3�88;:=I;HJL.Q=:J`45.3�8#H�<.:=7PQ�8;7PQ�vWHJj#HJL1:=L-8@I[�?JM�8;B.: >�|¥5�:=j8#OP7Pjk8\`-HJL�<ªH(ST:Gjk8;3.I:,vWHJj#F�I@:Gj:GLg8<.3.I7PL.S(8;B�:�348@8;:=I;HJL�QG:J`n8;B.:�79L.QG?TII@:=Q=8%<.:G79Q=8@7PQ�Bg[4Fd?J8@B.:Gj7Pj�v�7POPO�5�:�5�?n?Tjk8;:G<�8;?(8;B�:�8@?TFKjQG?TI:HJL.<z79L.QGI:\HJj:ª8;B.:KvW?TI<z:GII@?TI�I@H�8;:���¤�Lq8;B.79j�<�H�8;HVj@:�8\`�8;B.:=I@:ªvWHJjA?TL.:[email protected]�7PL�j8tH�L.QG:{79LU�HJj:�C��4¤¥8WQG?T3�OP<15d:�HJIST3.:=<18;B�Hw8�[email protected]:,[email protected]>79L.j8;HJL.QG:=j�B�H\rT:EHx6�3.QtB{O9?�v#:GI#?4Q=QG3.II@:=L.QG: ��3�88;:[email protected]=: l8@B�HJLª79L.j8;HJL.Q=:GjWO97P��:�QGHJj@:EU�� �¥]�8D3�88;:[email protected]=:Gj ;`�8;B�:�?�rT:=I;HJO9Oav#?TI<ª:GII@?TI%I;H�8@:�v�79OPOj8@7PO9OR7P6�F.I@?�rJ:J��°�?�vW:�rT:GI=`o<.3�I@7PL�S�8@B.:(<�H�8tH�QG?TO9OP:=Q=8;79?TLR`�HJOP6�?Tj8�H�OPOR3.j:GIj,v#:GI@:�?T5.j:GIrJ:G<V8@?5d:E7PL>HJL>Hw8@8;:=Lg8;79rJ:�j8;H�8;:�v�B�:GL^7PLg8;:=I;HJQ�8;7PL�Sxv�798@Bª8;B.:Ejk[nj8;:=6Y�#¦EL.:�6�7PSTBg8Wj@Fd:GQG3�OcH�8@:�8;B�Hw88;B�:Gj@:�3.j@:=I@j�Me:GO98,H�Bn3�ST:�Q=?TSTL.7}8;7}rT:(OP?gH�<^v�B.79OP:�MyHJQ=7PL.S�8;B.:DQG?J6KF.348;:GI�j@Q=I@:=:GLR`�5.3�8�8;B.:D3.j@:=Iv�B.?�Q=?TLg8;[email protected]�8@:G<�8;B�:�j@Fd:GQ=7cHJO4Q\HJj:�7PL�QGHJj@:�C vWHJj�HJQ�8;3�H�OPO9[D79L-8@:GI@[email protected]�v�798;B�8@B.:�Q=?T6KF�3�8;:=I�?�rn7cHJO9O9[T`�v�B.7PQtBKj@B.?T3�OP<�5�:�8;B.:�7P<�:\HJO�Q=?TL.<.7}8;7P?JL.jlMe?TI�B-3.61H�L4|�Q=?T6KF�3�8;:=I%Q=?T6�6�3.L.79Q\H�8@7P?TLR�/¤¥M3.j:GI@j,vW:=I@:�79L-8@:GI@[email protected]�v�798@BY8;B�:xj[njk8;:G6 7PLVHK6�?TI@:DL�H�[email protected];HJO/HJL�<ZI@:=OcHw~4:G<V61HJL�L.:GI=`�6�?TI@:7PL�QG7P<�:GL.Q=:Gjª?JM([email protected]\HJj:�61H\[ HJI@79j@:�� ��B.7Pjª:�~4F�:=I@7P6�:GLg8>H�OPj@?sB�HJj18@?q8tHJ��:Z7PLg8;?qHJQGQ=?T3.Lg88;B.H�8�HJO9O�]4��3.j:GIj�v#:GI:�STI;H�<.3�H�8@:�j8;3�<.:GLg8;j�?TI�I:Gj:\HJIQtB.:GIj�79Lª8;B.:(XY¤�� 24Fd?T�J:=L^�/H�L.ST3�HJSJ:2n[nj8@:G6�j,I:Gj:\HJIQtBVSTI?T3.FR�%��B.:Gj:�3�j@:GIj�H�I@:(:�~4Fd:GI@79:GL.Q=:G<Z79L>[email protected]�j@Fd:G:GQtBn|�5�HJj:G<Zjk[nj8;:=6Kj=`B.:=L.QG:�8;B.:K<�H�8tH>QG?JOPOP:=Q=8@:G<s6KH\[�L.?J8xHJQ=QG3.I@H�8;:=O9[�I@: ��:GQ�8x8@B.:KF.H�8@8@:GI@L�jx?JMW5�:=B�H\r479?TID?JM�8;B�:ST:=L.:GI@HJO�F�?JF.3.OcHw8;7P?JLR�

8�T

Page 57: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

p B.:GLYQG?T6�F.3�[email protected]@B.:�vW?TI<V:=I@I@?JI�I@H�8;:=j�Me?TI�Q\HJj:Gj�v�B.:GI:�ST:[email protected]@:=j,B�H�<Y?nQGQ=3.I@I:G<ZH�L.<H�<.:=7PQ=8@7PQEBg[nFd?J8;B.:=j@79j�:�~47Pj8@j�HJj�?TL.:�:=Lg8;I[ª7PLª8;B�: >�|�5d:Gjk8�OP79j8\`46K:�8;B.?n<{� jB.?�vW:=<ZH�]6;4� ]��I@:=OcH�8@79rJ:>v#?TI< :GII@?TI�I@:=<.3.Q�8;7P?JL I@H�8;:�`Wv�B.7PO9:{6K:�8;B.?n< C j@B�?�v#:G<mH�]684�a8�� I:GOPH�8;7}rT:{vW?JI@<:GII@?TIWI@:G<�3.Q=8@7P?TL>I;Hw8;:J����B�7Pj�796KF.O97P:=j%8@B�H�8�6�:=8@B.?4<>C B�H�<^5d?n?Tj8@:G<ª8;B�:�I@:GQ=?TSTL.7}8;79?TLªj@Q=?TI@:=j?JM�Q\H�j@:Gj�v�B�:GI@:ª8@B.:GI:ªvW:=I@:{L.?�SJ:[email protected]@:=j�5.3�8�v#?TI@<�jAOP7P��:��k8@B.:GI:G�ZvWHJjAj@Fd?T�J:=LR��¤�[email protected]�j8tH�L.QG:=j�8@B.:Gj:{vW?TI<.jAMe3.L.Q�8;7P?JL�HJj�HJL�HJF�B.?TI;H�jA7PL.jk8;:\H�<R� �?TIA:�~.H�6KF.O9:J`l8@B.:>3.j@:=IAQG?T3.O9<B�H\rT:�j;HJ79<R`h�;24B.?�vm6�:�8@B.:�6KHJF�?JM XV¤�������7PL�8;B�:,f�Ij8�348@8;:=I;HJL�QG:EH�L.<ªOcHw8;:GI�j@HJ7P<R`h�@°�?�vm<.?¤WSJ:=8�8;B�:GI@:(MeI@?J6 °�H�Ir�HJI@<>3.L�79rT:=I@j798�[ �\�.`a7PLª8;B�:Dj:GQ=?TL.<V348@8;:=I;HJL�QG:J�

��B.:(<.79��:GI:GLg8�6�:=8;B�?4<.j�?�M�5d?4?Jj8;79L.S�F.I?4<�3.QG:=<[email protected]\HJLg8�<.7}�o:=I@:=L.QG:=j�Me?JI�HJOPO�3�8@8@:GI |HJL.Q=:Gj=�#XY:=8;B�?4<.j�� H�L.<^C B�HJ<^HJL{?�rT:=I;HJO9OovW?JI@<>:GII@?TI�I@H�8;:�?JMh_*;4�}� � v�B�7PQtB>7Pj _6;�_�:GII@?TIjv�B.79OP:(6K:�8;B.?n<.j�© H�L.<ZU�B�HJ<ZH�LY?�rT:=I;HJO9O�vW?TI<V:=I@I@?JI�I@H�8;:D?JMl_*;4� ]�� v�B.79QtBV7Pj _6<T]A:=I@I?TI@j=`8;B�I@:G:�6K?JI@:�8;B�H�LV6�:=8;B�?4<^� H�L.<ZC���>�:=rT:=I8@B.:GO9:Gj@j=`R7PL�QGI@:[email protected]�8;B.:D5�?n?Tjk8�v#:G79STBg8;j�Me?TI�HJOPO6�:=8;B�?4<.j#B�H\rT:�I:Gj@3�O98;:=<{7PL{H�QG?TL.j7Pjk8;:GLg8�6�?TL.?J8@?TL.79Q,<.:=QGI:\HJj:�7PL18@B.:,v#?TI@<>:=I@I@?JIWI;Hw8;:J���,OPO8;B�:EvW?TI<Y:=I@I?TI�I;H�8@:Gj�I:\HJQtBYHJL^HJj[n6�F�8;?�8;:Ev�B.:=L^8@B.:�5�?n?Tjk8�vW:=7PSTBg8�I@:GHJQtB.:=j�H�B.79STB{r�HJOP3.:?JM�_Tbw| TTb��

¦�rT:GI@HJOPO£`�8@B.:Gj:�I:Gj3.O98@j�j@B.?�v+8;B�H�8�HJO98@B.?T3.STBV5�[email protected];B.:AjF�:=:GQtB�I@:GQ=?TSTL.7}8;79?TLZj@Q=?TI@:=jv�798@BAST:Gjk8;3.I:Gj�7P6�F.I?�rJ:Gj�8@B.:�?�rT:=I;HJO9O4v#?TI@<�:GII@?TI�I;H�8@:�5g[AHJL�7PL�[email protected]�QGHJLg8�HJ6�?T3.Lg8�?JM/�T�a<��{`8;B�:Kv#?TI@<�:GI@I?TIDI;H�8@:K?JM�6�3.O98@7P6�?4<.HJO�3�88;:=I;HJL.Q=:GjDv�HJjxHJQ=8@3�HJO9O9[�I:G<.3.Q=:G<z5g[�HYj7PSTL.7}f�Q\H�L-8HJ6�?T3.Lg8�� ]6;4� ]�� t�l�,O98@B.?T3.STB�8;B�:�ST:=j8;3�I@:Gj�HJI@:,?TL.O9[�3�j@:=Me3�O�Me?TI�8;B.:,<.7Pj@HJ6�5.79ST3�H�[email protected](<.:=7PQ�8;7PQv#?TI@<.j^OP79�J:��B.:=I@:=�.`^�k8;B�:GI@:=�.`>�[email protected]� H�L.< � 8;B�H�8@�.`�v�B.79QtB Q=?TL.j8@798@3�8;:=jVH�j@6KHJOPO�QGOcH�j@j>?JMv#?TI@<.jA79LqHJO9O%8@B.:1Fd?Tjj@7P5�OP:1N�L.SJOP7PjBsv#?TI@<.j�8;B�H�8�QG?T3.O9<q5d:1j@Fd?T��:GLR`�8;B�:Gj@:ªv#?TI<.j�6KH�[�5d:rT:=I[>Q=?T6K6�?TL{79L^6x3.O98@7P6�?4<�H�Odjk[nj8;:=6Kj=�

86;

Page 58: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

8�<

Page 59: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

� � ��� ��� �

� ��� ���� �� ��� ��� � � ����� ��� �����

����� �!#" " $&%('

)+*-,/.1032546*-7�8:9<;=,?>6;=,3@A25,37B46CD*->FEHGI;=,3@�@<*-4J>FKIL6*M4NGO2QP5*R0:*M*-,S257373*-7T>F9U>FGI*WVX9ZY<25@<*-L[4JY\4J>6*M]_^`aG3*b@<L62583G3;cEQ25de;c,f>6*MLhgi25EM*&jk254[]R9/7I;clO*-7m>F9n;c,3EM95L68:9<LF2D>6*o8:*M,B2D,37#]p95K346*W@5*M4J>6K3L6*-4[9<,T>FGI*]p258b73;=4J83dq2QYW25,37R2[4J>FLJ9<C5*rLJ*MEM95@<,3;=s-*MLjk254X73*-P5*Md=958t*-7R>69[L6*ME-9<@<,3;csM*a>FGI*M46*r@<*-4J>6K3L6*-4M^`aG3*-46*@<*-4J>FKIL6*M4k25,37R>FG3*-;=LXEM9<,?>6*vu\>FKO2Ddw]R*Q25,3;c,3@<4jx*ML6*yL6*-EM9<LJ73*M7U;c,A2N,3*vjz]WK3dc>6;=]R9/7325d/732D>H25032546*D^`{9pLJ*M4695dcP<*NK3,IC\,I9Zjr,m468:*M*-EHGTL6*vg|*ML6*-,3EM*-4}K34J;=,3@b>6G3*NEM9<,?>F*~u\>FKO25de*vP<*M,?>64};=,n>6G3*N7O2D>H2D0O2546*D��2,3*vj�]&K3dc>6;=]R9/7O2Dd<EM9<,?>6*vu\>L6*-469<dcKI>F;c9<,&]R*MEHG325,3;=4J]�jk254(7I*-P<*-d=9<8:*M7W>69[25K3@5]p*-,f> >FG3*k*vu/;=4h>F;=,I@EM95,f>6*vu\>oL6*M4J9<d=K/>F;=95,�^bVX9ZY<25@<*-Lo;c4[,39�j�EQ25832503d=*�95gk73;=4J83dq2QY\;=,I@n]A258I4M�edq25,I73]A2DL6Cf4M�eG3;c4J>F95L6;=E46;�>F*-4M��L6*M4h>H25KILF25,?>F4�2D,37�83K303dc;=Em@?25L67I*M,34�25,I7�K346*-L64nEQ2D,�46K3E-EM*M4J4Jg|K3dcdcY��\KI*MLJY�g|9<LA73LJ;cP\;=,I@73;cL6*MEv>F;c9<,34rg|L69<]�9<,I*od=25,373]p25L6Cp>F9p>6G3*&9D>FG3*-L}*M;�>FG3*-Ly]&K3dc>6;=]R9/7O2Dd=dcY�95L�JK34h>�K34J;=,3@p468:*M*-EHG�^�y4J*ML{*vu/8:*ML6;c]p*-,?>F4ejk*-L6*kE-9<,373KIE->F*-7&>F9�46*-*xGI9Zj�@<*M4h>FK3LJ*M4+EM25,&0:9\9<4J>�>6G3*x4J8t*-*MEHGbLJ*MEM95@<,3;c>6;=9<,46E-9<L6*N95g+73*M;cE->6;=E}jx9<L67I4y4J8t9<CD*M,m0fY�KI46*MLJ4M^

���~� ��!��!#%��� �R%X�

� K3LJL6*M,?>6dcY<�KI46*MLJ4WEQ2D,�9<,3dcYS]p25C5*p46K3E-EM*-464Jg|KIda�\KI*ML6;c*M4&>69�VX9�Y?25@5*ML&95,3dcYS;cgk>FG3*vY�4J8t*M25CS>69;c>o9<Lo468:*Q25CB>F9m;c>�jrG3;=dc*p73L62Qjr;=,3@T95,�>FG3*p73;=4J83dq2QY5^��1,�257I73;c>6;=9<,��e>FGI*U8t*-,�@<*-4J>FKIL6*M4bKI46*MLJ4EQ2D,�73L62�j�95,_VX9�Y?2D@<*ML}25L6*�*M4J46*M,?>6;q25dcdcYn73*-;=Ev>F;=EN9<,I*M4M^y�}P\;q2D>J>Z�¡ �¢�£{jrLJ95>F*�>FGO2¤>y4J;=,3E-*&73*-;=Ev>F;=E@<*-4J>FKIL6*M4X2DEMEM95K3,?>g|9<L(9<,3d�YR Q¥f¦§95gt25d=d\468:9<,?>H25,I*M9<K34]&K3dc>6;=]R9/7O2Dd?KI>6>6*MLF2D,3EM*-4M�f4JY\4J>6*M]R4(>FGO2¤>

¨5©

Page 60: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

468:*ME-;q25dc;=s-*n;=, 83L69\EM*-4646;c,3@�4J8t*M25Cf;=,3@¤.18:9<;=,?>F;c,3@#L6*-dq2D>6;=9<,I4Wjr;=d=daG32�P5*mdc;=]R;c>6*M7�83L625E->6;=EQ2DdaK346*D^`aG3;c4bG3;=@<GId=;=@5Gf>64�>6G3*n;=]R8:9<LJ>F25,3EM*A95g�4JY\4J>6*M]R4R0:*M;c,3@B2503dc*p>69Bg|KI,3E->6;=9<,�0:95>FG�KI,3;=]R9/7325d=d�Y25,37m]WK3d�>F;=]R9\7O25d=d�Y<^ � 4}46KIEHG��w]R9<L6*[g|K3,IE->F;c9<,O25dc;c>1YUg|95L�@5*M4J>6K3L6*-4�46GI9<K3d=7m0t*�83LJ9ZP\;c73*M7m46K3EHG>FG32D>y>6G3*&KI46*MLyEQ25,m]A2DC5*&�fK3*-L6;c*M4}0?Y_@<*-4J>FKIL6*M4}46K3E-EM*M4J4Jg|K3dcdcY5^ � 4}]R*M,?>F;c9<,3*M7_83LJ*-P\;=9<KI46dcY_;c,� GO258/>F*MLr¥3�O4J8O25E-;=9<@<L62583G3;cE[25,37m2D>J>FL6;c03KI>6;cP<*[@5*M4J>6K3L6*-4y4JG39<K3dc7m0:*�257373*-7_>69b>FG3*N4JY\4h>F*M]_^ �K34J*MLNEM9<KId=7B73LF2Qj 2n4J�\K325L6*�73*vlO,3;=,I@_>6G3*�0t9<KI,37O25LJ;=*M4[9Dg 2�03K3;cd=73;c,3@U9<,#>FGI*R]p258�^ � dc;=,3*;=,I;c>F;=25d=d�Yb73L62�jr,_>F9�;=,I73;=EM2D>F*}>6G3*N469<KIL6EM*o25,37_73*-4J>F;c,O2D>6;=9<,��/EM9<KId=7�0t*N73L625@<@<*-7m95La4J>FLJ*->6EHG3*M7jrG3*-, >6G3*B]p9<KI46*#;=4A9ZP5*ML_;c>�2D,37�>FG3*#]R9<K34J*#03KI>6>69<, G3*Mdc7�739�jr,�^���*-dq2D>6;=9<,I4U0t*v>1jk*-*M,73;��w*-L6*M,?>N4JGO258:*M4�EQ25,B0:*b*M4J>F2503dc;=46GI*M7S46K3EHGB>FGO2¤>NG3;=@<GI*ML[d=*vP<*-d(9<0\�J*-E->F4�EQ2D,S0:*bL6*-EM9<@5,3;=4J*M725,37RK3,37I*ML64h>F9\9/7w^��O9<LX*vuI25]R83d=*D�?;cg:>FG3*rK34J*ML 73LF2Qjr4x2�4J;=]R83d=*�39Zjx*ML-�I;�>X]A2QYW;c]p8IdcYo;=,?>F*-L6*M4h>;=,�O9�jx*ML�46G395834�2�PD25;cdq250Id=*}95,_>6G3*N73;=4J83dq2QY<*-7m]p258�^

�z;c>6GR>6G3*�257373;�>F;=95,b95g�]R9<L6*aE-9<]R83d=*~ub@<*-4J>FKIL6*M4 g|L69<] 8t*-,A4h>FL695C5*M4-�I2NEM95]p83dc*vuW]p*M25,3;=,I@L6*-83L6*-46*-,f>F2D>F;c9<,ng|9<L ]WKIdc>F;c]p9\7O25dO;c,?>F*M@5LF2D>6;=9<,UG3254 >F9b0:*�73*vP<*Mdc9<8:*M7�^ � 8325LJ>ag|LJ9<] LJ*M4J9<dcP\;=,I@73*-;=E->6;=EULJ*-g|*-L6*M,IEM*M4-� EM95,f>6*vu\>RL6*-469<dcKI>F;c9<,�jr;=dcdk,3*-*M7�2T,3*-j g|LF25]R*-jx9<L6CS>FGO2¤>�EQ25, EM95]W03;=,I*46*-]A2D,f>6;=E�25,I7 @5*M4J>6K3L6*�]R*Q25,I;=,3@3^�)+*-L6GO258I4p@<L62583G3;cEQ25dx]p9\73*-d=4��¡ < ~£rEQ25, 0:*n73*-P5*Mdc9<8t*-7 >694J>6L6K3Ev>FK3LJ* >FG3*k73*M8:*M,37I*M,3E-*�9Dg�73;��t*MLJ*M,?>@<*-4J>FKIL6* ]R*Q25,I;=,3@<4{jr;c>6GW73;��t*MLJ*M,?>(>69<83;=E-4+;c,W468:*M*-EHG�^

���� � �������M!����M���

`aG3* ;c,?>FL69\73K3Ev>F;c9<,o9DgO8t*-,/.1032546*-7b@<*M4h>FK3LJ*M4+>69yVX9�Y?25@5*ML(GO2D4+9��t*MLJ*M7WK34J*MLJ4(@<L6*M2D>F*-L *~u/83L6*-4646;�P<*8:9Zjx*MLk25,37p,O2D>FKILF25dc,3*M4J4M^`aG3*���25d=2¤u\Y � LJEHG3;c>6*MEv>FK3LJ*yjk254x7I*-P<*-d=9<8:*M7p>F9&*-,O2503dc*y7I*-P<*-d=9<8:*MLJ4>F9�257I7�,I*-j�4J*MLJP5*ML{EQ25832503;=dc;c>6;=*M4:*Q2D46;=d�Y}jr;�>FG39<K/>e73;=4JL6K38I>6;=,3@ >6G3*X*vu/;=4h>F;c,3@r468:*M*MEHG�g|LF25]R*-jx9<LJC:�03KI>rlO@5K3L6;c,3@�9<KI>r>FG3*N;c,f>6*M@<L62D>F;c9<,�25,37_4JY\,3EHGIL69<,3;csQ2D>6;=9<,_L6*-�fK3;=LJ*M]R*M,?>F4rg|9<LaEM95]W03;=,I;=,3@b>FGI*468:*M*-EHGW]R9/73*X2D,37�>6G3* @<*M4h>FK3LJ*x]R9/7I*4J>FL62D>F*-@<;=EM25d=d�Y};c,?>F9y2r7/Y/,325]p;cEjrG39<d=*X4hY/4h>F*-]�G3254e0t*-*M,2T@<LJ*Q2D>&EHGO25d=dc*M,3@5*5^B`aG3*n73*vP<*Mdc9<83]R*M,?>b95gr>6G3;=4W]&K3dc>6;=]R9/7O2Dd(;=,?>F*-@<LF2¤>F;=95,�g|LF25]R*-jx9<LJC�EM25,46*-LJP5*N254 2�]p9\73*MdOg|9<L 95>6G3*MLx]p9\7O25dc;c>F;c*M4(>69&0:*�25737I*M7A>69���2Ddq2¤u\Y�;=,R>FG3*�g|KI>FKIL6*5^��OLJ9<]�K346*-L*vu/8:*MLJ;=]R*M,?>F4-�OKI>6>6*MLF2D,3EM*-4yjr;c>6G�73*M;cE->F;cE[@<*M4h>FK3LJ*M4�46G39�jx*M7T@59/9\7n;=]R83L69�P5*M]R*M,?>F4r;=,�LJ*MEM95@<,3;�.>F;c9<,�;cg+0t9\9<4J>6*M7_0?Ym@5*M4J>6K3L6*-4M^ `aGI;=4�46G39�jr4y>6GO2D>r>FGI*o83LJ*M4J*M,3E-*W95g(7I;��t*ML6*-,?>y]R9\7O25d=;�>F;c*M4 EM25,G3*-d=8 73;=4625]W03;c@<KO2D>6*A>FGI*_9D>FG3*-LM^ � d�>FG395K3@<G�>FGI*ML6*_25LJ*�,395>�]WK3EHG g|K3,3Ev>F;c9<,O25dc;c>1YS83L69�P\;=7I*M7>F9p8t*-,�@<*-4J>6K3L6*-4�9<,3d�Y<�O>FG3;c4r,3*-j�;c,f>6*M@<L62D>F*-7�]WKIdc>F;c]p9\7O25d:VX9�Y?25@<*-L}4hY/4h>F*-] GO2D4y4JK3838:9<LJ>6*M7

� ¢

Page 61: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

*M,?>6;=L6*-dcY�,3*vjzEQ25832503;=dc;c>6;=*M4 >FGO2D>xGO2QP<*y,395>x0t*-*M,U4JK3838:9<LJ>6*M7n2¤> 25dcd30?Y�>FG3*y83L6*vP/;c9<K34XVX9�Y?25@<*-L4JY\4h>F*M] 25,37n]R9<L6*}jx9<LJCAEM95K3d=7U0:*[739<,I*}>F9b*-,3GO25,3E-*[>FG3;c4k]WK3d�>F;c]p9\7O25dOEM258O2503;cd=;�>1Y<^ � 7373;c,3@,3*vj§]p9\7O25dc;c>6;=*M4Xjr;=dcdw]p25C5*[VX9�Y?2D@<*ML�2b]p95L6*[L69503K34J>�]WKIdc>F;c]p9\7O25d�4hY/4h>F*-]m^

�  

Page 62: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

���

Page 63: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

� ��� �� ��������� ��

�¡ M£ ��^ � ^�k9<d�>Q^T)XKI>&>FGO2D>&>FG3*-L6*5�(P59<;=E-*n25,37�@5*M4J>6K3L6*�2¤>&>FGI*n@<LF258IG3;=E-4&;=,?>6*MLJgi2DEM*5^ �������������������� �!�#"���$&%('*),+.-3��  ©0/ ¢I^

� � £�)+^ � 9<G3*-,��21�^43<9<GI,34J>69<,��25,I765W^71�E �N*-*5^98�K3;=EHCf46*v>.:;1�KIdc>F;c]p9\7O25d ;=,?>F*-LF25Ev>F;c9<,Sg|95L73;=4h>FLJ;=03KI>6*M7�258383dc;=EM2D>F;c9<,34M^ �1,=<>%@?A�B$ ����� CAD������ADE"0�B%(��DE"0FG�H�IFJ�B%K�L�NMO%B"P����DQ?����R��DS'T�M�Uy*vj=V 9<LJC:��UWVb��  ©5©&X ^ � � 1 )XL6*M4J4M�EUYVW^

�[ZD£]\r^ �+;cd=;=4JC593^ � E-9<,?>F*vu\>�LJ*M4695d=KI>6;=9<, 4J*MLhP<*MLUg|95Lp>FGI*_^a`cb7`edef E-9<,?P<*MLJ4F2D>6;=9<,325d}4hY/4 .>F*-]p4-^g1T254h>F*-Lih 4x>FGI*M46;c4M�I1��1`j5�*M8325LJ>6]p*-,f> 95gk\Xd=*MEv>FLJ;=EQ2Ddl\ ,I@<;=,3*-*MLJ;=,3@o25,37 � 9<]p8IKI>F*-Lm EM;c*M,3E-*5� � 25]&03L6;c73@<*5�n1 � ��1T2QY � ¢5¢ � ^

� ¥5£,33^ �Nd=25464-^ � 83L69<032503;=dc;=4h>F;=E g|L625]R*-jx9<L6CWg|9<LX4J*M@<]R*M,?>J. 0O254J*M7U4J8t*-*MEHGnL6*-EM9<@5,3;c>6;=9<,�^!�����;o���������qp0���T�T'�$r"ODEM sk"ODIt���"ut&�M��  X�v � .wZyxN:c .Z XQz   ¨ � � � ¢<¢0ZI^

� ¨ £,5W^ �[9\7373*Q2DK��g\r^gkLJ;=dcd �E33^ �[dq254J4M� � ^�)(259I�{1�^w)XG3;cd=dc;=834-�k33^t)+9<dc;cg|L695,3; � m ^ m *M,3* �+�e2D,37VW^g|wK3*5^ ��2Ddq2¤u\Y}: � GfK3]p25,#dq25,I@<KO25@<*o;=,?>F*-LJgi25E-*W>F9n9<,Id=;=,I*o>FL62QP<*Md;c,Ig|9<LJ]A2D>6;=9<,w^��1,CAD������ADE"0�B%(��DE"0F{����DQ?����R��DS'T�a�#?Yp0���T�T'�$ "ODEM,sk"ODIt��n"ut&�e~G�R�Q'T�*)T)A%KDIt5�OV 9<C595GO25]p2I�y3?258O25,��  ©<© ¥I^

� � £�`[^G�}25s-*M,�� m ^ m *-,3* � �r25,37�33^X)+9<dc;cg|L695,3; ^ ��*-EM9<@5,3;c>6;=9<, EM95,IlO73*-,3EM*T4JEM9<LJ;=,3@�25,37�;c>64K346*�;=,R468:*M*-EHGUK3,37I*ML64h>H25,I73;=,3@o4JY\4J>6*M]R4M^Y���������I������p0���T�T'�$ "ODEM�sk"ODIt��n"ut&�M�O  � : ¥ ©Qz �&X �� ¢<¢ � ^

� X £,1�^23<9<GI,34J>69<,�� m ^2 2D,3@?25dc9<L6*D� � ^ m >6*M,?>Q��b^ V 254J;=L6*-737IY5�x2D,37 )+^>\XG3,�^_1�K3d�>F;=]R9\7O25ddq25,I@<KO25@<*N83LJ9/E-*M4J46;=,I@Ag|9<L}]R9<03;cd=*[;c,Ig|9<L6]p2D>6;=9<,_25E-EM*M4J4M^��1,�CAD������*DE"0��%(��DE"0FG����DQ?����R��DS'T��#?�p0���T�T'�$r"ODEM sk"ODIt���"ut&�q~G�R�Q'T�*)T)A%KDIt5�l5�*M,?P<*-LM� � 9<dc9<LF257I93� � ¢5¢ � ^

� / £,5W^W}^��[9/95,34M� � ^�33^ m 8O25LJL6*-d=d �}25,37=�b^ �N^a`aG39<LJ;=464J9<,�^�CAD����iFKF�%�t&��D����9�IFJ�B%K�L�NMO%B"�CTD�o������?*"�'T�*)v�rEHGO258/>F*ML��1,?>F*-@<LF2¤>F;=,I@�46;=]&K3dc>F25,3*M95K34U;=,I83KI>ng|L695] 4J8t*-*MEHG��[@?2DsM*B25,37zGO2D,37@<*M4h>FK3LJ*M4-^c��8O25@5*M4 �<¨0XQz �0X�� ^21m�1`�)XL6*-464M�E1�*-,3d=9R)(2DL6C�� � � ��  ©5© ZI^

� © £ � ^45W^41�;=dc95>H2_25,3761�^�1�^�kd=2D>6>6,3*ML-^r1�K3d�>F;=]R9\7O25d;=,?>6*MLJgi2DEM*M4oK346;c,3@�8:*M,�25,37�P59<;=E-*;=,38IKI>Q^r�1,�CTD������ADE"0��%(��DE"0F�����DQ?����N��DS'T�;��D�pl�u)*������)T�G��"OD_"ODEM����&�T���ADS�i��%('*)v� � 2D,O257O2I�V 25,3E-9<KIP<*-LM�:��E->69<0:*MLN  ©<©?¨ ^

�¡ �¢D£ m ^:�}P\;q2D>J>Q^k`{*M,m]&Yf>FG34�95g+]WK3dc>6;=]R9/7325dt;c,?>F*ML625E->6;=9<,w^����������yDl%('N"0�B%(��Dn),�#?q��$I�q�����T�  ©<©<© ^

� Z

Page 64: Massachusetts Institute of Technology · ¤ vw?t3 op< op79 j:w8@?e8;bhjl 6x[ j 3.fd:gi rn79j@?ti j% ¯. g°,hj g:=l1hjl

�¡ < M£,33^?)+*M25L6d ^7~G�R�&�N"���%�F�% )*�B%('�� �N"�)i��Dl%KDIt]%KDLCTD����iFKF�%�t&��D��7pl�u)*������)v�?EHGO2D8I>F*-L!ZI�f8O2D@<*M4 X0XQz  QZI <^1�9<LJ@?25, �N25KIg|]p25,3,�����9<4 � ,3@<*-d=*M4-� � � ��  ©5©0/ ^

�¡  � £,5W^ �rK303;=,I*5^ m 8:*ME-;cg Y\;=,3@�@<*-4J>6K3L6*-4y0?Yn*~u32D]p83dc*5^q���������I�����L�!�#"���$&%('*)v� �<¨Iv ¥IxF�w  ©<©  <^�¡ QZD£ m ^ m *M,3* �+^������ : � ,32D>FK3L625d{dq25,3@5KO25@<*�4JY\4J>6*M]�g|9<Ly4J8t95C5*M,Bd=25,3@<KO2D@<*&2D8383d=;cEQ2D>6;=9<,I4M^

�����������("0��%(��DE"0FSs4%KDIt��I% )*��%('*)v��  /nv  �xT: �   zy/ � �w  ©<©�� ^�¡ Q¥5£ m ^ m *M,3* �+��\r^ ��K3L6dc*-Y<� �N^ �e25Kw� � ^x)(259I��) ^ m EHG3]p;c7���25,37�V&^W|wK3*D^ �N25dq2¤u\Y?. � : �

L6*vg|*ML6*-,3EM*A25L6EHGI;c>F*-E->6K3L6*Rg|9<LNEM9<,?P<*-L6462D>F;c9<,O25d 4JY\4J>6*M] 73*-P5*Mdc9<83]R*M,?>Q^��1,�CTD������ADE"0��%(��DE"0F����DQ?����R��DS'T���#?�p0���T�T'�$r"ODEMLsk"ODIt���"ut&�q~G�R�Q'T�*)T)A%KDIt5� m Y\73,3*vY<� � K34h>FL625d=;=2I�w  ©5©0/ ^

�¡  ¨ £NVW^S|wK3*D^�������������� : � >F*-d=*-83G39<,3*~.10O2D46*M7�EM9<,?P<*-L6462D>F;c9<,O25d{;=,?>F*-LJgi25E-*�g|95L�jx*Q2D>6G3*MLy;=,/.g|9<L6]p2D>6;=9<,�^�p0���T�T'�$r"ODEM;�e��MO%(�;~G�R�Q'T�*)T)A%KDIt5� /nv   xH� � ¢5¢<¢I^

� ¥