department of computer science, columbia universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [...

149

Upload: others

Post on 04-Aug-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

����� ��������� �������������������������������! "�$#%����

& �������� ')(!*+�-,.��

/103234�57686:9�;<57=?>A@CB86D5E@CFHGI03F7J3FKFK4�9=L6NMCGO6DP39BD9�QR0S5KBD9�4T9�=L6:UVGIM�BW6:PS9$;S9X�B899MCG�YZMR[�6DM�BWMCG]\%P35KF7M�UDMC>3PL^

57=_6:P39a`�B:@C;303@b6:9$/1[cPSM1M�FdMbG]e-B86:U"@C=S;�/1[�5K9�=3[9�U

�gfh*ji�k lnmpo i�q�msrutwvyx_mOz|{

}C~�~��

Page 2: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

[� }C~�~��Y�@CB8BD57=?\����d9�� 57U

e F7F�� 5KX�PL6:U� 9U89B��9;

Page 3: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� � ��� � � � �

� �� ��� ��� �� � ���� ������ ����� � ��� �!�"�$#&%'�)(*�+�,

& �������� ')(!*+�-,.��

YZB:@ � 57=3XT57=SGI9B89=3[�9U GIB8M�4 FE@bBDX�9.-HPS9�6:9�BDM�XC9=39�M�03UZ;A@ 6c@TU89�6DUZBD9�QR0S5KBD9�UZ@ 6:P39�M�BD9�6:5K[@CFdGIB:@C4�90/� M�B21?6:PA@ 6Z5KU"[@b>A@C23F79 MCG%B89>3B89U89=L6:57=3X3- GIM�B"904S@C4�>3F795-sY76"e|@b=3;�>3B8MC6:9�5K=�U89Q 039=S[9U8-p>3BDM./6:9�5K=aU86:B803[�6D03BD9�U9- 4�5K[B8ML@CB8B:@^�9041>3B89U8UD5KMC= ;A@b6c@�- b@CBD57M�03Up6 ^R> 9�U%MCGA5K=L6D9B:@b[�6:57M�= =S9�6 � M�B21 U9-L9�6:[ �� 9[9�=L6:F7^5- @?[�FE@CU8U�MCGN@CFKX�MCBD576DP34�U:1 =3M � = @CU<;+=0>0?@=0ACBD=0EGFIH9JLK-PA@bU$9�4T9�BDX�9�;!@CU @_> M � 9B8GI0SFGIB:@b4T9 �NM�BM1 GIM�BV[�M�4�2357=35K=3X ;35 C9BDU89$6 ^R>H9U"MCGO;A@b6c@ �N P39!> M � 9B @C=3; [03B8BD9=L6 > MC>303FE@bBD576 ^ MCG"1C9B8=39F$4�9�6:PSM1;3U?U 6:94 57= >A@CB86?GIB8M�4 6DP3957B

@C2357FK5 6 ^ 6:M PA@C=3;SFK9�;35 C9BDU89 GIM�B84TU MCGVU 6:B803[�6D03BD9�;+5K=3>3016:U9-O5K=3[�FK03;S5K=3X �9�[�6:MCBDU9-]X�B:@C>SP3U9-%@b=3;U86DBD57=3X�U � N P39?UD03>S> M�B 6 �9�[�6:MCB�4T@C[cP357=39)O /QP!RTS�@CF7X�M�B8576:PS4 57U 6:PS9_4TM�U 6 > MC>303FE@bB*1C9�BD=39�F4�9�6:PSM1;U-%;S039 6:M�5 6:U 6DP39M�B89�6D5K[@bFN03=3;S9BD>S5K=3=357=3X�U @b=3;+U86DBDM�=3X 9�4T>357BD57[@CF�>H9B8GIMCBD4T@C=3[9 M�=@ � 57;39 b@CB85K9�6 ^ MbG%[FK@CUDU857JA[@b6:57M�=<6:@CU21 U�� �"9�[9�= 6DF7^5- UD9 �9�B:@CFO4T9�6:P3MR;3U P3@ C9�2H99= >3BDM�>HM�U89;GIM�B [MC4�235K=S5K=3XV1C9�BD=39�FKU GIB8M�4 P39�6:9�BDM�X�9�=39MC03UZ;A@b6:@�U8M�03B8[9U��-/1> 9�[5 JA[@CF7F7^5-AUD9�C9BD@CF]B89[9�=L6:F7^;39�UD[B85K2H9; 904R6:9�=3UD57M�=3Ua@CFKF7M � 6:PS9 /�P7Ru6DM @bUDUD57X�=!BD9FK@b6:5 �9 � 95KXCP 6DU$6DM C@bBD5KMC03U ;A@b6c@?UD9�6:U8-;39�> 9�=3;35K=SX 03>HM�=?6:P39�5KB 0S6:57FK5 6:5K9�UN57= >H9B GIM�BD4�5K=3X @ X�5 �9= [FK@CUDU857JA[@b6:57M�=_6c@CUM1 �XW-M � 9��9�B9- @CFKFMCGV6DP39U89_4T9�6:P3MR;3U�>3B8M1;S03[9 U 6c@b6D5KM�=3@CB8^ [M�4 235K=A@ 6:5KMC=3U9Y%5 � 9 �Z-]6DP39_BD9�FE@b6D5 C9 � 95KXCP 6DU�MCG 6:PS9b@CBD57M�03U[1b9BD=S9FKU";3M =3MC6 b@CB ^?@C4�M�=3X 5K=S>30S6 904S@C4�>3F79U �\ =_6:P357U � M�B21]- � 9�;39U8[BD572 9.-35K4�>3F794�9=L6W@b=3; b@CFK57;A@b6:9-@�4�9�6:PSM1; GIMCBN[MC4�235K=S5K=3X�4 03F76D5^/

>3F79"1b9BD=S9FKU 5K=�@�=3M�=3U 6c@b6D5KM�=3@CB8^?G @CU8P35KM�=@-�� PS9BD9a6:P39"1C9B8=39FOGI03=3[�6D5KM�= [M�4 235K=A@ 6:5KMC= b@CB85K9�U;39�> 9�=3;35K=SX�M�= 6DP39 57=3>30S6 � N P39Z@b>3>3BDM�@C[cP_03UD9�UV@aFK@CBDXC90/ 4T@CB8X�5K= FK@b6:9�= 6_/ b@CB85E@C23F79VX�9=S9B:@ 6:5 C9>3B8M�2A@C2357FK57U86:57[�4TMR;39�F � 5 6:P357=<6DP39�4T@L415K4�0S4 9=L6:B8M�>L^ ;S5KUD[�BD574T57=A@b6:57M�=)O`Rba Y!SVGIB:@C4�9�� M�BM1 �\ =�6:PS5KU 4�9�6DP3MR;U- >A@bB:@C4�9�6D9BZ9�U86:574 @ 6:5KMC= 57UZBD9�=3;39B89;�6:BD@C[�6:@C23F79 2L^ b@CB85E@b6D5KM�=3@CFp2 M�0S=3;35K=SX@C=3; @b= 576D9B:@ 6:5 C9 M�>16:5K4�5dc@b6:57M�= >3BDMR[9�;303B89 �)W-9�BD95- � 9_>3B8M�> MCUD9_@C=eRfa�YgW"5KF72 9�B86aUD>A@C[�9

Page 4: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

` @C03UDU85E@C= 4T5 416D03BD9a4TMR;39�F`-H5K= � P357[cP�9@C[cP�[�M�4�> M�=S9=L6�5KU-5K4�>3FK57[5 6:F7^T4T@C>3>H9; R5E@T@'R 9B /[9�B"1b9B8=39F�GI03=3[�6:5KMC=U-]@b=3; � 9TU8P3M � 6:PA@ 6$6DP39�UD03>3>HM�B 6 C9[�6DM�B 4T@C[cP357=39 5KU$@?UD>H9[5K@CF�[@CU89MCG 6:P357Ua4�M1;S9F � N P39�4T5 4R6:03B89�4�MR;39F�@CF7FKM � U 03U 6:M [�M�4�2357=39�@<XC5 �9�= U89�6aMCG 1b9BD=S9FKUa5K= @=3M�=SFK5K=S9@CBO@C=3; =3MC=3U86:@b6:57M�=A@CB ^a4T@C=3=S9B9- � P35KF79W@ �M�57;35K=SXZM �9B J36D6D5K=3X 2 ^ BD9�X�03FE@bBD5dc@b6:57M�= � � 9@CF7UDM ;39�BD5 �9 @C= 9���[579=L6 UD9�QR0S9=L6:5K@CF�4�5K=3574 @CF M�>S6:574T5Zc@b6D5KM�=<@CF7X�M�B8576:PS4�GIM�B ;S5KUD[�BD574T57=A@b6:5 �9>A@CBD@C4�9�6:9�BV9U 6:5K4T@b6D5KM�= �

� 9N94�>35KB85K[@bFKF7^ 5K= �9�U86D5KXL@b6D9 6DP39W>H9B8GIMCBD4T@C=3[9 MCGA6:PS9 /�P!R @b=3;�576DU�b@CB85E@C=L6:UOM�=�= 034�9B /M�03UN4�03F76D5^/ 1C9B8=39FHFK9@CBD=S5K=3X$6c@CUM1RU8-3B:@b=3X�5K=SXaGIBDMC4�57FKF703U86DB:@b6D5 �9"U8^R=L6:PS9�6:57[Z;A@b6:@�UD9�6:U9-16:M�[�M�4V/4�M�=3F7^�03UD9�; 2 9�=3[cP34T@CB21�;3@b6c@<UD9�6DU9-]6DM<6DP39 B89@CF / � M�BDF7; [M�4�>30S6:@b6:57M�=A@CF�2S5KM�F7M�XC^�>SBDM�23F794MCG]>3BDMC6D957=<GI03=S[�6:57M�= @C=3=3MC6:@b6:57M�= � \ = 6DP39a4T@��8M�B8576 ^ MCG�[@CUD9�U9-s@b=3; � 5 6:P3MC0S6-@C=L^ >3@CB86D5K[0SFE@CB6:0S=35K=3X MCG 6:PS9a@bFKX�M�B8576DP34b- M�0SB"=S9��)6D9[cP3=S5KQ 039$M�0S6:>H9B GIM�BD4�UV904157U86:57=3X 4T9�6:P3MR;3U��

Page 5: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� �����������

� �� ������������������� �� � � R MC6D5 b@b6:57M�= � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �� � } � M�=L6:B85K230S6D5KM�= � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �� �! \%BD5KMCB � MCB21 � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � "� �$# %ZBDXL@C=S5dc@ 6:5KMC= MCG N P39U85KU � � � � � � � � � � � � � � � � � � � � � � � � � � � }

& '(�*)+�����, -).��/10324�5 �27698:��;=<>�? -)+�����, �A@} � � \ =L6:BDMR;303[�6:57M�= � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � #} � } e F7X�M�BD5 6:P34�U � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � ��B

} � } � � /R03>3>HM�B86 C9[�6DM�B"4 @C[cPS5K=39�U � � � � � � � � � � � � � � � � � � � � � � "} � } � } C 9�BD=39�Fd4T9�6:P3MR;3U � � � � � � � � � � � � � � � � � � � � � � � � � � }C~} � } �D � MC4�235K=S5K=3X�1b9BD=S9FKU � � � � � � � � � � � � � � � � � � � � � � � � }E�

} �! R 9�6DP3MR;3U � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � }�}} �! � � `�9=S9F%Z=L6:MCFKM�XC^ [FK@CUDU89U � � � � � � � � � � � � � � � � � � � � � � }�}} �! � } C 9�BD=39�FKU � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � } } �! �D a 41>H9BD574T9�=L6c@CF GIBD@C4�9�� M�B21 � � � � � � � � � � � � � � � � � � � � � } #

} �$# �"9�UD03F 6:U � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � }HG} �$# � � a 41>H9BD574T9�=L6 ��IJ� M�4T>3@CBD57UDM�=_MCGC1C9�BD=39�FO[�M�4�2357=A@b6D5KM�= 4�9�6DP3MR;3U � � }HG} �$# � } a 41>H9BD574T9�=L6 }7I P @CB8^R5K=SX�B89FK@b6:5 �9 1b9BD=S9F �N9�5KX�PL6 � � � � � � � � � � }�B} �$# �D a 41>H9BD574T9�=L6K I R 03F76D5K>3F79Z=3M�57U8^D1C9B8=39F7U � � � � � � � � � � � � � � ~} �$# �!# a 41>H9BD574T9�=L6L# IMC 9�BD=39�FKU � 576DP?4T57UDUD57=3X 904S@C4�>3F79U � � � � � � � � � }

5

Page 6: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

} � G YZ5KU8[03U8UD5KMC= � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �#} � � /103>3>SFK94�9=L6:@CB8^ � 9U803F76DU � � � � � � � � � � � � � � � � � � � � � � � � � � �

� �3�� �� ��)+������ �)+��/10 27�5 -27698:�,;=<�� -)+������ @�� � � R @L415K4 034 a%=L6:B8M�>L^<YZ5KUD[�BD574T57=A@b6:57M�= � � � � � � � � � � � � � � � � � � � � # � � } YZ5KU8[BD574T57=A@b6D5 �9 ` @C03UDU85E@C= �"@b6:57M � FE@CU8UD5 JA9B8U � � � � � � � � � � � � � � � � # G �! �p@b6:9�= 6 R @ 4S574�034 a�=L6DBDM�>L^<YZ5KU8[B85K4�5K=A@b6D5KM�= � � � � � � � � � � � � � � � � #�� �$# YZ5KU8[BD574T57=A@b6D5 �9 C 9B8=39F75dc9�; `$@C0SUDUD5K@C=fR 5^4R6:0SBD9U � � � � � � � � � � � � � � GE� � G /19Q 039�=L6:5E@bF R 5K=3574 @bF�%Z>S6:574T5Zc@b6D5KM�= � � � � � � � � � � � � � � � � � � � � GHG

� G � � \ =L6D9B_/ [FK@CUDU � � � � � � � � � � � � � � � � � � � � � � � � � � � � � G�B � G � } \ =L6DB:@L/ [FE@bUDU � � � � � � � � � � � � � � � � � � � � � � � � � � � � � G " � G �D 6"9��V6DM�=�/ 6:9> � � � � � � � � � � � � � � � � � � � � � � � � � � � �+� � G �!# \ 4�>3F794�9=L6c@b6D5KM�= � � � � � � � � � � � � � � � � � � � � � � � � � � �+�

� � 6-M�=SU86c@ 6:5KMC=A@CB8^ C 9BD=S9F � M�4�2S5K=A@b6D5KM�= � � � � � � � � � � � � � � � � � � � � #

@ �3�� �� ��)+������ �)+��/10 27�5 -27698:�,;=<�� -)+������ �� ;�>���5� �H) 6� 2��*��6 � � ���

# � � /R^R=L6:P39�6:5K[ ;A@ 6c@ UD9�6:U � � � � � � � � � � � � � � � � � � � � � � � � � � � � �HB# � � � � a%57X�PL6M/ ` @C03U8UD5K@C=3UV;A@b6:@ UD9�6 � � � � � � � � � � � � � � � � � � � � � � "# � � � } �d57=39@CB / Q 0A@C;SB:@b6D5K[Z;A@ 6c@ UD9�6 � � � � � � � � � � � � � � � � � � � � � � "

# � } � 9=S[cP34 @bB21 ;A@ 6c@ UD9�6:U � � � � � � � � � � � � � � � � � � � � � � � � � � � � �# � } � � � 57UD[�M�=3UD57=?23BD9@CU86"[@b=3[9�B � � � � � � � � � � � � � � � � � � � � � � ## � } � } /RM�=A@CB � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � ## � } �D W"9@CB 6 � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �

# �! � 9@CU 6">3BDMC6D957=?GI0S=3[�6D5KM�=A@bFs[FK@CUDU857JA[@b6:57M�= � � � � � � � � � � � � � � � � � � � �# �$# /3R % N 574T57=3X � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � BL}

� 8:�, ��A6?���*���� ���

G � � /1034�4 @bB8^TMCG][�M�=L6:B85K230S6D5KM�= � � � � � � � � � � � � � � � � � � � � � � � � � B

575

Page 7: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

G � } � 0S6:03B89 YZ5KB89[�6D5KM�=SU � � � � � � � � � � � � � � � � � � � � � � � � � � � � � BAG

� ��<>6?�?��� ��) ���,/ ���

� ��� 2E ���� �H2�� ��

� )��� �� ��24��� ���?��2 ��

e � � ` 9�6D6D5K=3X�/R6:@CB86D9; � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � "H"e � } a 43@b4T>3F79 � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � "H"e �! �4 @bF76:9�; � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � ~ #e �$#uUD034�4T@CBD5Zc9 � 9U803F76DU � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � ~HGe � G UD57X�=39; �-@C=�1 � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � ~C�

� )��� 2�� 24��27 ��H2 ��� �� � � ` BD@C4 � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � ~�B

� � � � � `�B:@b4 O [�M�=3U 6:BD0S[�6:MCB S � � � � � � � � � � � � � � � � � � � � � � � � � ~ "� � � � } XC9�6 � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �H�~� � � �D ;S5E@CX � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �H�~� � � �!# =SM�BD4T@CFK5Zc9 � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �H�~� � � � G [�M�4�2357=39 � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �H���

� � } C 9BD=S9F � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �H� }� � } � � C 9�BD=39�F � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �H� }� � } � } \ M�F7^R=3MC4T5K@CF C 9B8=39F � � � � � � � � � � � � � � � � � � � � � � � � � �H� }

� � } � } � � \ M�F7^R=3MC4T5K@CF C 9B8=39F O [�M�=3U 6:BD0S[�6:MCB S � � � � � � � � � � � � �H� }� � } � } � } [�M�4�>30S6:9 � � � � � � � � � � � � � � � � � � � � � � � � � �H�

� � } �D �"@C;35K@CF C 9�BD=39�F � � � � � � � � � � � � � � � � � � � � � � � � � � � �H� � � } �! � � �"@C;35K@CF C 9�BD=39�F O [�M�=3U 6:BD0S[�6:MCB S � � � � � � � � � � � � � � �H� � � } �! � } [�M�4�>30S6:9 � � � � � � � � � � � � � � � � � � � � � � � � � �H� #

575K5

Page 8: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� �! �p@C2 9�FKU � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �H� #� �! � � �p@C2H9F7U O [�M�=3U86DBD03[�6:M�B S � � � � � � � � � � � � � � � � � � � � � � � �H� #

� �D � � � � XC9�6 � � � � � � � � � � � � � � � � � � � � � � � � � � � � �H��G� �$# �d9@CB8=39; � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �H��

� �$# � � �d9@CBD=39�; � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �H��� �$# � } R<9;34�5^4 �d9@CB8=39; � � � � � � � � � � � � � � � � � � � � � � � � � � �H��

� �!# � } � � R<9;34�5^4 �d9@CB8=39; O [�M�=3U 6:BD0S[�6:MCB S � � � � � � � � � � � � � �H��� �!# � } � } XC9�6 � � � � � � � � � � � � � � � � � � � � � � � � � � � � �H��� �!# � } �! [�FE@CU8UD5 G ^ � � � � � � � � � � � � � � � � � � � � � � � � � �H� �

� �$# �D R<FK4�5^4 �d9@CB8=39; � � � � � � � � � � � � � � � � � � � � � � � � � � � �H� �� �!# �! � � R<FK4�5^4 �d9@CB8=39;)OI[M�=3U 6:B803[�6DM�B S � � � � � � � � � � � � � � �H�*B� �!# �! � } XC9�6 � � � � � � � � � � � � � � � � � � � � � � � � � � � � �H�*B� �!# �! �! [�FE@CU8UD5 G ^ � � � � � � � � � � � � � � � � � � � � � � � � � �H�*B

� �$# �!# /R;3> �d9@CB8=39; � � � � � � � � � � � � � � � � � � � � � � � � � � � � �H� "� �!# �$# � � /R;3> �d9@CB8=39; O [�M�=3U86DBD03[�6:M�B S � � � � � � � � � � � � � � � �H� "� �!# �$# � } XC9�6 � � � � � � � � � � � � � � � � � � � � � � � � � � � � �H� "� �!# �$# �! [�FE@CU8UD5 G ^ � � � � � � � � � � � � � � � � � � � � � � � � � � }b~

� � G �d9@CB8=39B � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � }b~� � G � � �d9@CBD=39�B � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � }b~� � G � } R<9;34�5^4 �d9@CB8=39B � � � � � � � � � � � � � � � � � � � � � � � � � � � }b~

� � G � } � � R<9;34�5^4 �d9@CB8=39B"OI[M�=3U 6:B803[�6DM�B S � � � � � � � � � � � � � � }7�� � G � } � } XC9�6 � � � � � � � � � � � � � � � � � � � � � � � � � � � � � }C}� � G � } �! 6DB:@C57= � � � � � � � � � � � � � � � � � � � � � � � � � � � � }C}

� � G �D R<FK4�5^4 �d9@CB8=39B � � � � � � � � � � � � � � � � � � � � � � � � � � � � } � � G �! � � R<FK4�5^4 �d9@CB8=39B!OI[M�=SU86:B803[�6DM�B S � � � � � � � � � � � � � � � } � � G �! � } XC9�6 � � � � � � � � � � � � � � � � � � � � � � � � � � � � � } #� � G �! �! 6DB:@C57= � � � � � � � � � � � � � � � � � � � � � � � � � � � � }�G

5

Page 9: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� � G �!# /R;3> �d9@CB8=39B � � � � � � � � � � � � � � � � � � � � � � � � � � � � � }�G� � G �$# � � /R;3> �d9@CB8=39B"OI[M�=3U 6:B803[�6DM�B S � � � � � � � � � � � � � � � � }b�� � G �$# � } XC9�6 � � � � � � � � � � � � � � � � � � � � � � � � � � � � � }b�� � G �$# �! 6DB:@C57= � � � � � � � � � � � � � � � � � � � � � � � � � � � � } �

� � � �"9�UD03F 6 � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � } B� � � � � � 9U803F76 � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � } B

� � � � � � � � 9U803F76"OI[M�=SU86:B803[�6DM�B S � � � � � � � � � � � � � � � � � � � } B� � � � � � } XC9�6 � � � � � � � � � � � � � � � � � � � � � � � � � � � � � } B

� � � � } � � 9U803F76 � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � } "� � � � } � � � � 9U803F76*O [�M�=3U 6:BD0S[�6:MCB S � � � � � � � � � � � � � � � � � � } "� � � � } � } XC9�6 � � � � � � � � � � � � � � � � � � � � � � � � � � � � � ~

� � � UD4�M � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � ~

Page 10: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� � 3� ��� � ����� �

� � � ���) ;�>6�2 ��� � ) ��� �*�?). �-)+��) � � � � ) �� �� ���27 ��-27���+).�5�?)+<>6�2�� N P35KUJAX�03B89aU8P3M � UZ@C=<5KF7FK03U 6:BD@b6:5 �9�904S@C4�>3F79 6DPA@b6"94�>3PA@bUD5dc�9U 6:P39$=39�9; GIM�B ;357U_/[B85K4�5K=A@b6D5 C9W>A@CBD@C4T9�6:9�B 9�U86:574 @ 6:5KMC=�GIM�B [�FE@CU8UD5 JA[@b6D5KM�= � 5 6:P�4T5 416D03BD9�U � N PS9;A@b6:@ [�M�=L6c@C57=3U @C=��803=357=L6:9=S;39;�� b@CBD5K@C23F79 � � � � � � � � � � � � � � � � � �

� � } ���) ;�>6�2 ��� ) � � ) ��� �*�?). ; �� ������2�� � � ��) �� ��? ,��27 ���27��.).�5��).<�6?2�� N P357UZJAX�03B89�[MC= 6D5K= 039�U 6DP39�57FKFK0SU86:BD@b6:5 �9$904S@C4�>3FK9a6:PA@b6Z94�>3PA@L/UD5Zc9U�6DP39V=39�9; GIM�B�;357UD[B85K4�5K=A@ 6:5 C9N>A@bB:@C4�9�6D9B�9�U86:574 @ 6:5KMC=aGIM�B%[�FE@CU8UD57J3[@b6D5KM�=� 576DP�4T5 416D03BD9�U � � 9 U899 6 �NM?6 � M./ [�M�4T>HM�=39�=L6a`$@C0SUDUD5K@C=�4�5^4R6:03B89�4�M1;39�FKU6:BD@C5K=39�; 5K=S;39>H9=3;S9=L6:F ^ � 576DP 4T@L415K4�034 F75d1C9�FK57P3M1MR; � � FE@CU8UD5 JA[@b6D5KM�= � 576:P6:P39�UD9$4TMR;39�FKU � 57FKF 2H9 > MRM�B�� � � � � � � � � � � � � � � � � � � � � � � � � #

� �! ���) ;�>6�2 � � ) ��� � ).��� ���?) ; �� ������2�� ��� � ) �� ��? ,��27 ���27��.).�5��).<�6?2�� N P357UZJAX�03B89�[MC= 6D5K= 039�U 6DP39�57FKFK0SU86:BD@b6:5 �9$904S@C4�>3FK9a6:PA@b6Z94�>3PA@L/UD5Zc9U�6DP39V=39�9; GIM�B�;357UD[B85K4�5K=A@ 6:5 C9N>A@bB:@C4�9�6D9B�9�U86:574 @ 6:5KMC=aGIM�B%[�FE@CU8UD57J3[@b6D5KM�=� 576DP�4T5 416D03BD9�U � � 9 U899 6 �NM?6 � M./ [�M�4T>HM�=39�=L6a`$@C0SUDUD5K@C=�4�5^4R6:03B89�4�M1;39�FKU6:BD@C5K=39�; ;357UD[B85K4�5K=A@ 6:5 C9F ^ � 576DP Rfa�Y � � FE@CU8UD5 JA[@b6D5KM�= � 576DP 6:P39�UD9_4�M1;39�FKU� 5KF7F 2H9$[�M�BDB89[�6 � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � G

R5

Page 11: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

} � � 8:�,;=<�� ��? ��� 24� -276 ��� �A��; ��6?)+������2 �H��; ��)+� � ���� ).�H�5� � � ��� �����24�5; � � N P39 JAX�03B89T>SFKMC6DU 6DP39 = 034�2H9B$MCGV` %�6D9BD4�U OI^+/ @ 4S57U S GIM�B � P357[cP@_X�5 C9= /�P!Ru[FK@CUDU857JA9�B @C[cP3579��9�U @_U8> 9�[57J39;!4T9@C= � % � U8[M�B89fO 4Q/ @L415KU S �a�@C[cPTU89B85K9U�[�M�BDB89UD>HM�=3;SU�6DM$@C= /QP!R 6:PA@b6�0SUD9U�U89Q 039=S[9Z@bFKM�=39.-LU86DBD03[�6:03B89@CFKMC=395-LM�B%[�M�4�2357=A@b6D5KM�=3U%MbG@1b9BD=S9FKU 03U85K=3Xa@C=�03= �N9�5KX�PL6:9�; @ �9�B:@CXC9-M�B�03U85K=3X/SY�\�� � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � } �

} � } � ).��/-� � �5276�)+��� ��2�� 24�5 �276 �F27� � �,� � N P39�JAX�03B89$>SFKMC6DUV4T9@C= � % � U8[M�B89@CU�@ GI03=S[�6:57M�=�MCG%6DP39 FKM�X�� O��� ��� S0- � PS9BD9���Z@C=3;��� @bBD9 6DP39 � 95KXCP 6DU @CU_/UD57X�=39;_6DM 6DP39 UD9�QR0S9=3[�9�@C=3;?U 6:BD0S[�6:0SBD9!1C9�BD=39�FKU9- B89UD>H9[�6:5 �9F ^ � a�@C[cP U89B85K9U[M�B8BD9�UD>HM�=3;3U"6:M M�=S9aMCG]6:P39�`:% 6D9BD4�U 57= N @C23F79 } � � �L%Z=�9@C[cP�UD9�BD579U9-H6:P39FE@CB8X�9 XCBD99�=?[5KB8[F79Z5K=3;S5K[@ 6:9U 6:P39�F7M�X�B:@ 6:5KM MCGO6DP39 � 95KXCP 6DUVUD9�FK9[�6:9�; 2L^?/1Y�\�� } "

} �! �J24).�5 �� �1� � ��2 ���52���27 ��H2 ��� ���� � /�� 24� -276 � � N P39�JAX�0SBD9�>3F7MC6:U8- GIM�B9@C[cP ` % 6D9BD4 -�6:PS9 � % � UD[�M�BD9"@C[cP3579�C9;�2 ^ 6:P39-/SY�\ /�P!R�@CU @ZGI03=3[�6D5KM�=MCGH6:P39� % � UD[MCBD9-@C[cP35K9 �9�;T2L^ 6:PS9V03= �N9�5KX�PL6:9�; U8034 MCG�1C9B8=39F7U ��YZ5�� 9�BD9=L6> MC5K=L6%6 ^R> 9�U [�M�BDB89UD>HM�=3; 6:M 6:BD@C5K=S5K=3X�03U85K=3X!c�9BDM�-RMC=39 M�B%6 �NM$=3M�57UD9 1C9�BD=39�FKU9-@CUV;39�UD[B85K2H9; 5K=_6:P39�6D904R6 � � � � � � � � � � � � � � � � � � � � � � � � � � �

} �$# 8:�,;=<�� ��? ��� 27�5 -276 � � ��� � ;� � �*� � ��)+�*) � a�@C[cP JAX�03B89_>3FKMb6:U9-%GIM�B�@UD57=3X�FK9a` % 6:9�BD4 -H6DP39 4�9@C= � % � UD[MCBD9�@bUZ@�GI0S=3[�6D5KM�=�MbG�6:P39a> 9�BD[�9=L6c@CXC9MCGO4T57UDUD57=3X�;A@ 6c@ 5K=_6:PS9$U 6:B803[�6D03BD9 1C9�BD=39�F � N P39�JABDU 6"UD5^4 UD9�BD5K9�U [M�B8BD9U8> MC=3;6:M!6:P39<e P a @C=3; /SY�\ 4�9�6DP3MR;3U9- � 5 6:P 4T57UDUD57=3X!;A@b6c@ @ ��=3576 ^ [�M1;S9; @CU�26-MC=395- � �:/19�F7G � M�B �8e F7F � � N P39 JA=3@CF U89B85K9UN5KU�GIBDM�4�@C=?/QP!Rg6:BD@C5K=S9;TGIB8M�46:P39 U 6:BD0S[�6:0SBD9 1C9B8=39F @CF7M�=39 � � � � � � � � � � � � � � � � � � � � � � � � � H

1575

Page 12: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� � ' � �H���-2 �������?;���A)+������ � N P35KU J3X�03BD9_U8P3M � U 6:P39_>3B8M�X�B89UDU85KM�= GIB8M�46:P39�57=3576D5E@CFH[MCBDBD9�[�6 ����� 574T>3F794�9=L6c@ 6:5KMC= MCG 6:P39a/3R %|@CFKXCM�BD5 6:P34 -L6:M 6:P39M�>S6D5K4�5dc9�; �9�BDU85KM�= �[O @L/ 9 S][MC4T>A@bBD9V9FK@C>3U89; 6:5K4�9NGIM�B%/3R %)@C=S;DR<e N �pe ��������� ���� � O G SW[MC4T>A@bBD9U 9�FE@C>3U89;<6:5K4�9ZGIM�B-/3R % @C=3;�R %$/�a C [�M�4�4T9�B_/[5K@CFsM�>S6D5K4�5dc@b6:57M�= U8MCG 6 �W@bBD9 � � � � � � � � � � � � � � � � � � � � � � � � � �

# � � �J)E��27 ,� ��� � ) ��� �*��) ;� ���-�52�� N P35KU�JAX�0SBD9 UDP3M � U 6:P39�@C2S5KFK5 6 ^ MbGFE@b6D9=L6CRfa�Y 6DM"F79@CB8= @ FE@bBDX�9%4T@CBDXC5K=�[FK@CUDU857JA9�B9- 9�C9= 57= @b=a9 416DBD9�4T9 [@CU89 MbG4TMR;39�Fs4T57UD4T@b6:[cP � N PS9a[�FE@CU8UD57J39B 5KUW6DP39aBD@b6:57M MCG]6 � M_` @C03U8UD5K@C=?4T5 416D03BD9�U9-9@C[cP � 5 6:P 6 � M?[M�4�>HM�=39=L6DU � R @L41574�034�FK5Z1C9F75KP3MRMR; O @+S"[�FE@CU8UD57J39UZ>HM1MCBDF7^5-@C[cP3579�R5K=3X GC~�� @C[�[03BD@C[�^ 2H9[@C03UD9"576�57X�=3M�B89U%;357UD[�BD5K4�5K=3@b6:5 �9N>H9B GIM�BD4T@C=3[�9 ��p@b6:9�= 6 Rfa�Y O 2]SV@C[cPS5K9�C9U"> 9�B8GI9�[�6"[FK@CUDU857JA[@b6:57M�=?@C[[�03B:@b[�^ � � � � � � � � � ~

# � } 0324�5 �276J�H��; <��? �)+���?�� �, � /- ,� �-2A���?� ��)+�*) � N P39�JAX�03B89�5KF7FK03U 6:B:@ 6:9U 6:P39235K=3@CB8^a;39[�5KU85KM�= UD0SB8G @C[�9V2 9�6 �N9�9= 9 4S@C4T>SFK9U�6:@51C9�=�GIB8M�4 @ZGI03=S[�6:57M�=�6:P3@b6�5KUFK57=39@CB�@C=3; Q 0A@C;3BD@b6:57[ �%\O@C=39F O @+S]UDPSM � U�6:PS9 R � 4T5 4R6:03B89V;39[�5KUD57M�= 2HM�03=3;�/@CB8^ Y�>A@C=S9F7OI2]SaU8P3M � U�6:P39?/1Y�\w;S9[57UD57M�= 2HM�03=3;A@bB8^ �T6-95 6:P39�B 6:9�[cP3=357QR0S9[M�B8BD9�[�6:F ^ [�FE@CU8UD57J39UV6:P39 ;A@ 6c@ � � � � � � � � � � � � � � � � � � � � � � � � � }

# �! �3�� �� ��)+������ �)+��/ � 24� -276 �H��; <��? �)+���?�� 1�� � /- �� ��2A���?� ��)+�*) � N P39$JAX./03BD9 5KF7FK03U 6:B:@ 6:9Ud6DP39N2357=A@CB ^ ;39[�5KUD57M�=�U803B8G @C[�9N2H9�6 � 99�=�9 4S@C4T>SFK9U 6c@51b9= GIB8M�4@ GI0S=3[�6D5KM�=_6:P3@b6"5KU >35K9�[9 � 5KUD9$FK57=39@bBV@C=3;<Q 0A@C;3BD@b6:57[ � \]@C=39�F O @+SWUDPSM � U"6:P396Z/ CK� ;S9[57UD57M�= 2 M�0S=3;A@CB ^�YC6Z/ C � [M�B8BD9[�6:F ^�UD9�>A@CBD@b6:9�U$6DP39 ;A@b6:@ ��\O@C=39FO 2]S%UDPSM � U 6:P39 6Z/ CK� 1C9B8=39F �N9�5KX�PL6 M �9B 6:P39"5K=3>S0S6NU8>A@C[�95Y3;A@bB21C9�BNU8PA@C;39�U[M�B8BD9�UD>HM�=3;�6:MT6:P39aQR03@C;3B:@ 6:5K["1C9�BD=39�F �!6-Mb6:9a6DP39�U84TMRMC6:PS=39U8UZMCG�6DP39�UDMCFK0�/6:57M�= � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � ��

R5K575

Page 13: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

# �$# �3�� �� ��)+������ �)+��/ ��24�5 -2E69�H��;=<>�? �)E���?�� � � � /,24) � � ����� ��27� � �� ������?�� ) � �� ��)+���?�� � N P39 JAX�03B89!U8P3M � U9-ZGIM�B_9@C[cP GI0S=3[�6D5KM�=A@bFZ[FK@CUDU<@C=3; 9@C[cP[FK@CUDU857JA[@b6:57M�= 4�9�6DP3M1; 6:P39 4�9@C= e�� � GIBDM�4�J �9�6D5K4�9U"6:P3B8990/ GIM�FK; [BDMCUDU_/b@CFK57;A@b6:57M�= � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � B

# � G �� � �� � ���?; 2 �H��; ��).�5� � �, ���3' � ) �� ����� ��� �� � � N P39<J3X�03BD9>3FKMb6:U�B803=3=357=3X�6:5K4�9_@CU�@�GI03=3[�6:57M�= MCG-6DP39?= 034�2H9B MCG-904S@C4�>3FK9�U GIM�B�M�03B/3R %�574T>3F794�9=L6c@ 6:5KMC= @C=3; R e N �de ��� U ��������� � � M�= 6DP39T6DM ^ ;3@b6c@?UD9�6;39U8[B85K2H9;<5K= /19[�6:57M�= # � � � } � � � � � � � � � � � � � � � � � � � � � � � � � BL}

e � � �-2 2 � 27�5�?; 27 ,� �*�H�5� ��� GIM�B-@C=�904S@C4�>3F79a6:PSBD99 / 6D5K4�9U"BD9>SFK5K[@b6:9�;U- J �9 /GIM�FK;@-d[BDMCUDU_/ b@CFK57;A@b6:57M�=�9041>H9B85K4�9=L6$M C9B���� � -��� � ~ - @C=3;�� �~�~ �N P39WU8[BD57>S6�U89�6DU�03> >A@CBD@C4�9�6:9�BDU]@C=3;�57= CM$1C9�U�6:P39 R @ � N 9 41> 9�BD5K4�9=L6];3BD5 �9B>3BDMCX�B:@C4 O�� �� ����� SW6:M ;3M 6:P39 BD9@CF � M�B21�� � � � � � � � � � � � � � � � � � � ~E�

5^4

Page 14: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� � 3� ��� � ��� ���

} � � � ��27��� �����? � � � ��24�5; � � ����; ��2�� �-27 ��H2�� ��� ����; � �*� �������-��2 � a�@C[cPBDM � 5K=!6:P39�6c@C2SFK9 F75KU 6:Ua@�` %n6:9B84�@b=3; ;39�UD[B85K>S6D5KM�=@-O6:PS9 M�=L6:MCFKM�XC^�GIB8M�4� P35K[cP 5 6�[MC4T9�U O`R � � 4TM�F79[�03FE@CBpGI03=3[�6:57M�=U- � � � [�9FKF703FE@bB][MC4T>A@bB86:4�9=L6@C=3; � \ � 235KMCFKM�X�57[@CFS>3BDMR[9�UDU S -36:P39 =R0S4�2 9�BNMCG >HM�UD5 6:5 �9 9 4S@C4T>SFK9UN@CUDU8M1[�5^/@b6:9�; � 576DP�6:P39W6D9BD4 -C6DP39V4T9@C= @C=3; U 6c@C=S;A@CBD; 9�BDBDMCB � % � U8[M�B89U%GIM�B> L4 G [�/�P!R�6DB:@C57=35K=3XT03UD57=3X)O � S"6:P39 U 6:B803[�6D03BD9�1b9BD=S9F`- O } S"6:PS9�UD9�QR0S9=3[�9 1b9BD=S9F`-O +SV6:P39 03= �N9�5KX�PL6:9�; UD034 MCG�2HMC6:P�1b9BD=S9FKU8-d@C=3; O�#QS 6DP39 � 957X�PL6:9;�U8034hMbG6:P39 1b9B8=39F � \ =+6:P39_6:@C23FK9.-�6:9�BD4�U @CBD9 U8M�B86D9;j2L^ 6:PS9_;35 � 9B89=3[�9<57= � % �2 9�6 �N9�9= �:/R6:B803[�6D03BD9 � @b=3; �:/19Q 039�=3[9 � � � B8M�4�6DP39 9=L6:57BD9 UD9�6"MCG GC� 6:9B84TU6:PA@ 6 �N9$[M�=SUD5K;S9BD9�;U-36:PS9 6:@C23F79�FK5KU 6:UVM�=SF7^ 6DP39�6:M�> � ~ @C=S;<6DP39 2 MC686:M�4 G � }C�

} � } � ��27��� �����? � ��� ��24�5; � � ����; � 2��(��27 ��H2 ��� � ���,; � ���5�������-�52�� � 9UD0SF76:UGIM�BW6:PS9 # � B894T@C5K=S5K=3X ` %w6D9B84TUV=3Mb6-U8P3M � = 57= N @C23F79 } � � � � � � � � � � � B

} �! '�� �� �27� ��) � �H��; ��)+� � ���� �� � � � �� � 24�5� ;�2E �� � � N P39$6c@C2SFK9$FK5KU 6:U 03=�/[M�B8BD9�[�6:9�;�/ C@bFK039�U�GIB8M�4 @ � 57FK[�M 41M�=�UD57X�=39�;�/ BD@C=31�6:9�U86 [M�4�>A@CB85KU8M�=TMbGs6:P39BD9�UD03F 6:UpMCG�a 41>H9B85K4�9=L6 � � ejU85KX�=S57JA[@C=L6��/ b@CF7039�5K=�6DP39%6c@C23F79�5K=S;35K[@b6:9�Us6:PA@b64T9�6:P3MR; @CFKM�=SX?6DP39 BDM � >H9B GIM�BD4�U UD5KXC=357JA[@C=L6:F ^�2 9�6D6D9B�6:PA@b= 6:PS9T4�9�6DP3M1;@CFKMC=3X�6:P39 [�M�FK034�= � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � H"

4

Page 15: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

} �$# '�� �� �27� ��) � �H��; ��)+� � ���� �� � � � �� � 24�5� ;�2E �� � � N P39$6c@C2SFK9$FK5KU 6:U 03=�/[M�B8BD9�[�6:9�;�/ C@bFK039�U�GIB8M�4 @ � 57FK[�M 41M�=�UD57X�=39�;�/ BD@C=31�6:9�U86 [M�4�>A@CB85KU8M�=TMbGs6:P39BD9�UD03F 6:U GIBDMC4 a 41> 9�BD574T9�= 6 � e.U85KX�=S57JA[@C=L6 �/ b@CF7039�57= 6:P39�6:@C23F79�5K=3;S5^/[@b6D9U%6:P3@b6 4T9�6:P3MR;�@CFKM�=SXZ6:P39"BDM � >H9B GIM�BD4�U%UD57X�=35 JA[@C=L6DF7^�2H9�686:9�B�6DPA@C= 6:P394T9�6:P3MR;<@CFKMC=3X�6:P39 [�M�FK034�= � � � � � � � � � � � � � � � � � � � � � � � � � H"

} � G '�� �� �27� ��) � �H��; ��)+� � ���� �� � � � �� � 24�5�?; 27 ,�F@ � a @b[cP 6c@C23F79-F75KU 6:U9- GIM�B@ X�5 �9= > 9�BD[9�=L6V4T57UDU85K=3X3- 03=S[M�B8BD9[�6:9�; �/ b@CFK0S9U GIB8M�4 @ � 57FK[M 41M�= U85KX�=S9;�/B:@C=�1 6:9�U86$[M�4�>A@CB85KU8M�= MCG 6DP39 UD5 4 [FK@CUDU857JA[@b6:57M�=�4T9�6:P3MR;3U 5K=)a 41> 9�BD574T9�= 6# � e UD57X�=35 JA[@C=L6 �/ b@CFK039 5K=�6:P39 6:@C23FK9 57=3;357[@b6D9UZ6:P3@b6 4T9�6:P3MR;!@CFKMC=3X 6:P39BDM � >H9B GIM�BD4�UVUD57X�=35 JA[@C=L6DF7^T2 9�6D6:9�BV6:PA@C=?6:PS9$4�9�6DP3MR; @bFKM�=3X�6DP39 [M�F7034�= � # ~

# � � 8:�,;��).�5� ���� �� � � ���H�, ��*�? <��524) � � �H) ��H24� �-)+��) � N P39 6c@C23F79�FK57U86DU9-GIM�B 6DP39 � � \ � 5KU8[M�=3U85K= 23B89@CU 6<[@C=3[�9B_;A@ 6c@ UD9�6<@C=3; UD5 4 [�FE@CU8UD57J3[@b6D5KM�=4T9�6:P3MR;3U8-S6:P39 4�9@C=?@b=3; U 6c@C=S;A@CBD;?;39 R5E@b6D5KM�=_MCG 6:9�U86"UD9�6-@C[[�03B:@C[�^?@C[�BDM�U8UJ3G 6:9�9=�[�BDM�U8U_/ C@bFK5K;3@b6:57M�=3U OI6DP3BD9�90/ GIM�FK; � P B89>H9@b6D9; J C9a6D5K4�9U S � N P39aJ3BDU866:P3B899�4T9�6:P3MR;3U$@CB89 /QP!R U 6:BD@C5K=39�; � 5 6:P!UD57=3X�FK9�1b9B8=39F7U9-pGIM�FKF7M � 9;!2L^�6:P39/SY�\ @C>3>3B8ML@C[cP�MCG�� �p@C=3[ 1 BD579�6 9�6 @CF �Z- }C~C~L}�� -s@ 4T@L415K4�0S4 FK5d1b9F75KP3MRM1;?4�5^4Q/6:03B89�MCG�`$@C0SUDUD5K@C=3U?[FK@CUDU857JA9�B9- @C=3; 6:P39)6 / C � 4�9�6DP3MR; � N P39 4T@L415K4T@CF4T9@C= b@CFK039�57UV5K=3;S5K[@ 6:9;?57=_2 M�F7;SG @C[�9 � � � � � � � � � � � � � � � � � � � � G

# � } 8:�,;��).�5� ���� �� � �, -).� �-)+��) � N P39�6c@C23F79�FK57U86DU9- GIM�B 6:PS9 � � \ U8M�=A@CB;A@b6:@�UD9�6-@C=S;<U85^4 [FE@bUDUD5 JA[@ 6:5KMC= 4T9�6:P3MR;3U8-S6:P39 4�9@C=?@b=3;?U86c@b=3;A@CB8; ;39 R5E@L/6:57M�= MCGd6D9U86 U89�6 @b[[0SB:@C[�^_@C[�BDM�U8UWJ3G 6:9�9=?[B8M�UDU / b@CFK57;A@b6D5KM�=3U OI6DP3BD9�90/ GIM�FK; � PBD9�> 9@b6:9�; J �9 6:574T9�U S � N P39�J3BDU86�6DP3BD9�9 4T9�6:P3MR;3U @CB89 /�P7R U�6:B:@b5K=39�; � 576:PUD57=3X�FK9 1C9�BD=39�FKU9-�GIMCFKFKM � 9;�2L^a6:P39"/SY�\!@C>3>SBDML@C[cP MbG�� �p@C=3[ 1 BD579�6�9�6�@CF �^- }C~�~L}�� -@T4T@L415K4�0S4 FK5Z1C9F75KP3MRMR;<4�5^4R6D03BD9 MCG ` @C03U8UD5K@C=3U [�FE@CU8UD5 JA9B8- @C=S; 6:PS9<6Z/ C �4T9�6:P3MR; � N P39 4T@L415K4T@CFH4T9@C= b@CF7039�5KUV57=3;357[@b6D9;_5K=?2HM�FK;1G @C[9 � � � � � � � �

415

Page 16: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

# �! 8:�,;��).�5� ���� �, �-27)+��� ��)+�*) � N P39!6:@C23F79�FK5KU 6:U8--GIM�B 6DP39� � \ P39@CB86;A@b6:@�UD9�6-@C=S;<U85^4 [FE@bUDUD5 JA[@ 6:5KMC= 4T9�6:P3MR;3U8-S6:P39 4�9@C=?@b=3;?U86c@b=3;A@CB8; ;39 R5E@L/6:57M�= MCGd6D9U86 U89�6 @b[[0SB:@C[�^_@C[�BDM�U8UWJ3G 6:9�9=?[B8M�UDU / b@CFK57;A@b6D5KM�=3U OI6DP3BD9�90/ GIM�FK; � PBD9�> 9@b6:9�; J �9 6:574T9�U S � N P39�J3BDU86�6DP3BD9�9 4T9�6:P3MR;3U @CB89 /�P7R U�6:B:@b5K=39�; � 576:PUD57=3X�FK9 1C9�BD=39�FKU9-�GIMCFKFKM � 9;�2L^a6:P39"/SY�\!@C>3>SBDML@C[cP MbG�� �p@C=3[ 1 BD579�6�9�6�@CF �^- }C~�~L}�� -@T4T@L415K4�0S4 FK5Z1C9F75KP3MRMR;<4�5^4R6D03BD9 MCG ` @C03U8UD5K@C=3U [�FE@CU8UD5 JA9B8- @C=S; 6:PS9<6Z/ C �4T9�6:P3MR; � N P39 4T@L415K4T@CFH4T9@C= b@CF7039�5KUV57=3;357[@b6D9;_5K=?2HM�FK;1G @C[9 � � � � � � � �

# �$# 8:�,;��).�5� ���� � �3/,24) � � ����� ��27�? � �� ��������� ). � -� ��)+������ �; 2A� �-����� �N P39 6:@C23FK9!FK57U86DU9-ZGIM�B 9@C[cP GI03=S[�6:57M�=A@CF [�FE@CU8UeO B8M �:S @C=3;)9@C[cP [�FE@CU8UD57J3[@L/6:57M�= 4�9�6DP3M1;)OI[M�F7034�=]S%6DP39Z4�9@C=_e�� � GIBDM�4 J �9Z6D5K4�9U 6:P3B8990/ GIM�FK; [BDMCUDU_/b@CFK57;A@b6:57M�= � N PS9<JAB8U86�6:P3B899<[M�F7034�=3U [M�B8BD9�UD>HM�=3; 6DM /QP!R U�6:B:@b5K=39�;jMC=UD57=3X�FK9"1C9�BD=39�FKU O X�9�=39 9041>3B89UDU85KM�=@- >SBDMC6D95K=�;SM�4 @b5K=�[�M�=L6:9=L6 @C=3;�U89Q 039=S[9UD574T57FE@CB8576 ^$- B89UD>H9[�6:5 �9F ^�S � N P39 JA=A@CFs6 � MT[�M�FK0S4T=3UV[�M�=L6c@C57=?BD9U803F76DUVGIM�BW6:P39/SY�\ @C=S; =3M�=SU86c@ 6:5KMC=A@CB8^<1C9B8=39FH[MC4�235K=3@b6:57M�= 4T9�6:P3MR;3U�� � M�B @CFKF34�9�6DP3MR;3U9-U86:@C=3;A@CB8; 9�BDB8M�BDU OI=3MC6 UDPSM � =IS"@CB89 X�9=39�B:@CF7F7^TM�=_6:P39 M�B8;39B MCG ~ � ~L} -39 41[9>16GIM�BV[FK@CUDU89U } O ~ � ~ #QSN@b=3; " O ~ � ~HG S � � � � � � � � � � � � � � � � � � � � � ��"

# � G '(�*) ��-).�5� 27����� � � � � /�24) � � ; 24) � � 8 �*�H� ��2�� � N PS9a6c@b23FK9 FK57U86DU9-3GIM�B9@C[cP GI03=3[�6D5KM�=3@CFV[FK@CUDUTO BDM �:S @C=3; 9@C[cP [�FE@CU8UD5 JA[@b6D5KM�=j4�9�6:PSM1; O [�M�FK034�=]S6:P39-U86:@C=3;A@CB8; 9B8BDM�B8UW@CU8UDMR[5K@b6:9�; � 576DPT6:PS9Z[M�B8BD9�UD>HM�=3;357=3X 4�9@C=SU GIBDMC4 N @L/23FK9 # �!# � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � B�~

# � � 8:�,;��).�5� ���� ��� /�24) � � ����� �*2E�? � �� ��������� ) � -� �*)+�����, �; 2A� �-�����K������ � ��2�� ��27 ��H2 ) �� � ���5�������-�52�� N P39 6:@C23FK9<FK57U86DU9-WGIM�B�9@C[cP ` %h6:9�BD4O B8M �:S @C=S; 9@C[cP [�FE@CU8UD57J3[@b6D5KM�=+4�9�6DP3M1; O [�M�FK0S4T=]Sa6DP39?4T9@C=je�� � GIB8M�46:P3B899�6:574T9�UVJ �9 / GIM�F7;<[�BDM�U8U_/ C@bFK5K;3@b6:57M�= � N P39 JABDU 6"[M�F7034T=?[�M�BDB89UD>HM�=3;SU-6:M@b1b9BD=S9FW@ C9B:@bX�95-]6DP39 U89[�M�=3; 6:M�/SY�\C- @C=S; 6:P39�6:P357BD;!6:M =SM�=3U86:@b6:57M�=A@CB ^1C9�BD=39�F [�M�4�2357=A@b6D5KM�= � � � � � � � � � � � � � � � � � � � � � � � � � � � � B+�

4S575

Page 17: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� � � � � � ��� � � � � � � � �

\ � M�03F7; FK5Z1C9�6:M�6:PA@b=31_4 ^<@C; R57UDM�B � 5KF7FK5E@b4�/ 6c@�� M�BD;f6-M�2SFK95- � P3MTU86DM1MR; 2L^?4�9$6DP3BDM�0SX�PP357U]6:BD@C=3UD5 6:57M�= 6:MZ6DP39��-=S5 �9�BDU8576 ^�MbG � @CU8P35K=3Xb6:M�= @C=S;�4a^�@C; 157UDM�B N M�=L^C9�2A@CBD@�- � P3MZ6:MRM$14�9�5K=L6:M P357U"XCBDM�03><@CU"@ GI03FKF��A9;3XC9;<4T9�4�2 9�B9- @C=S;?6DMT2HMC6DP?GIMCB 6DP3957BV;35KB89[�6:5KMC=U-SU803>3>HM�B869-@C=3; XC035K;A@b=3[9V;30SBD5K=SXZ4 ^�;SM1[�6:M�BD@CFS9�;303[@ 6:5KMC= � N P39V[�M�4�>3FK9�4T9�= 6:@CB8^a9041>H9B85K9=S[9W6:M � PS5K[cP6:PS9�^_PA@ C9a9 4S>HM�U89; 4�9 PA@CU 2H99=<5K= b@CF70A@C23F79 �\ �NM�0SFK; @CF7UDM F75d1C9<6:M 6DPA@C=31 6:PS9�4T9�4�2H9BDU MCG 2 Mb6:P FE@b23U9-WGIB8M�4 � PSM�4 \ PA@ C9�X�MC6M/

6:9�= @C; 157[9.-OGIBD579=3;SUDP357>U- @C=3; @b= M�>H9=!9041[cPA@C=SX�9 MCGN5K;39@CU ;303BD57=3X<4 ^ BD9�FE@b6D5 �9�F7^ UDM�F7576c@bB8^BD9�UD9@CBD[cP �

� 5K=3@CFKF ^$- \ �NMC03FK;<FK5Z1C9Z6:M 6DPA@C=31_4 ^ G @C4T57F7^5-19�UD>H9[5K@CFKF ^ 4 ^ � 57GI95- � PSMTPA@ C9aU803>3>HM�B86D9;4�9W5K= 6DP39WBD@b6:P39�B�03= 03U80A@CFAFK5 GI9U 6 ^1F79NMCGH@ZU 6:03;S9=L6 @C=3; 9�=3[M�0SB:@CX�9�; 4T9N6DMZ[MC= 6D5K= 039W6DP3BDM�0SX�P6:PS9$4�M�U 6 ;35 ��[0SF76V6:574T9�U � \ FKMRM$1 GIM�B �N@CBD;?6:M U89957=3X 6:P39�4 @CXL@C57= �N P39a6D904R6 GIMCB � P3@C>S6:9�B } 5KU-@TB89>3B85K=L6"MCG�6:PS9a4T@b6:9�BD5K@CFd@CU"576�N@CU U803234�576D6D9;<6:M� ��`H�� ?��

� HL> B�5E���� K � �d9�� 57U9-�C9�2A@CB:@�-3@C=3;'6"M�23F795- }b~�~�� [ � � N PS9Z6:P39�UD5KUW@C0S6:PSM�BW5KU >3BD574 @bB8^T@C0S6DP3M�B GIMCB6:PS9 � M�BM1_@C=3;?6:P39 [�M./ @C016:P3M�B8U ;35KB89[�6D9; @C=3;?UD0S> 9�B R5KU89; 6DP39 BD9�UD9@bBD[cP GIMCBW6:P357U"[cP3@C>S6:9�B �N P39_6:9 416 GIM�B � P3@C>S6:9�B 57U @�BD9�>3BD57= 6 MbG-6DP39?4 @b6D9B85E@CF @CU 576 �N@CU UD0S234T5 6D6D9;+6:M�6:PS9

� H���> ?��5A H���� �!� F!� ?@=�" =#�5> ?�� ?!$&% = K =#�5>'� F � �d9 � 5KU9-(C92A@bB:@�-S@C=3; 6"M�23FK9.- }C~�~�� @ � � N PS9-6:PS9UD57U@C0S6DP3M�B%57U%>3BD574 @CB ^�@b0S6:P3MCB�GIMCB�6:P39 � M�B21 @b=3;�6DP39 [M./ @C0S6DP3M�BDU%;S5KBD9�[�6D9;T@C=3;�UD03>H9B�157UD9�;T6:PS9BD9�UD9@CBD[cP<GIM�BW6:P357UV[cPA@C>S6D9B��N P39 6D904R6 GIM�B � PA@C>S6D9B # 5KUTFE@CB8X�9F ^ @ B89>3B85K=L6 MCG 6:P39�4T@b6D9BD5K@CF @CUT576 �W@CU @C[[�9>S6D9;

6:M 6DP39*)0?IE =0> ?��5E��`HL?��5A,+ HL?-� =0> =0?.� = HL?/� �!� F!� ?@=0" =#�5> ?�� ?!$ � �d9�� 57U9-1C92A@CBD@�-Z@b=3; 6-M�2SFK95-}C~�~C� 2 � � N P39 6:P39�UD5KU @C0S6DP3M�B�5KU�>3B85K4T@CB8^ @C0S6:PSM�B%GIM�B%6:P39�NMCB21 @C=3;�6:P39"[ML/ @C0S6DP3M�B8U ;357BD9�[�6:9�;@C=3;<UD0S> 9�B R5KU89; 6DP39 BD9�UD9@bBD[cP GIMCBW6:P357UV[cPA@C>S6D9B �

415K575

Page 18: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

������������ ��������������� ��

415

Page 19: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� � ��� ��� �

� ��� ��� � � � � ���

� ( � k � #%�$�a#�����

e 4�M�=3XCU86$>3B:@b[�6:5 6:57M�=39B8U9-p6:P39�BD9�5KUa@ R5 6c@CF�=39�9; 6DM F79@CB8=!GIB8M�4 P39�6D9B8M�X�9=S9M�03Ua;A@b6:@ UD9�6:U��N P357U =399�; 5KUaGI039F79; 2L^ 6:P39?57=3[B89@CU85K=3X @C4�M�03=L6 MCG-;A@b6:@�2 9�5K=3X X�9�=39BD@b6:9�; 2L^+;S5 � 9BD9�=L6>3B8M1[�9UDU89U8- 6:PA@ 6_> Mb6:9=L6D5E@CF7F7^ 5K=1GIM�BD4 ;35 � 9B89=L6?@CU8> 9�[�6DU<MbG @ F79@CB8=35K=SX >3BDMC23FK9�4 � e-U?@C=904S@C4�>3F795- [M�=SUD5K;S9B�6:P39 [MC4T>3016c@b6D5KM�=A@bF3235KMCFKM�XC^ >3BDMC23FK9�4 MCGs>SBDMC6D95K= GI03=S[�6:57M�=T@C=3=3MC6:@b6:57M�= �6-0S4T9�BDM�03U �N9�6 FE@C2 9 41> 9�BD5K4�9=L6DU PA@ �9_>3B8M R57;39; @ � 57;39 b@CBD579�6 ^ MCG";A@b6:@ > 9�B86:@C5K=357=3X 6DM6:PS9 U:@b4T9 JA=35 6:9"UD9�6NMCGs>SBDMC6D95K=SU � a�@C[cP 6 ^R>H9 MCGd4�9@bUD03B894�9=L6 -R9 � X �^-3Y76-e U89Q 039=S[95-36DP3BD9�9;3574T9�=3UD57M�=A@CFWU 6:B803[�6D03BD9.-VUD032H[9�FKFK0SFE@CB F7M1[@b6:57M�=U-�>3BDMb6:957= ;SM�4 @b5K=3U8- 57= 6D9BD@C[�6D5KM�=j=39�6 � M�BM1RU8-9�6D[ �^- M�� 9�BDU @ ;35 � 9B89=L6�UD9�6NMCG ;357UD[B85K4�5K=A@ 6:5 C9 GI9@b6:03B89U%GIM�B%[�FE@CU8UD57J3[@b6D5KM�= � N P39 >3B:@b[�6:5 6:57M�=39BUDPSM�03FK; PA@ C9<6DP39_GIBD99�;3M�4�6DM!0SUD9<@CFKFNMCG-6DP39U89 ;3@b6c@�6:M 57=SGIM�BD4�@�[FE@bUDUD5 JA9B @b=3; U8P3M�03F7;9041>H9[�6-6DP39 FK9@bBD=357=3X @CFKXCM�BD5 6:P34 6:M 03U89$6DP39 ;A@b6:@ 57=<@ U89=3U85K23F79 �W@^ �

C 9BD=S9F"4T9�6:P3MR;3U � /1[cP��M�Fd1bM�>SG�9�6 @CF �Z- � "H"H" � -N2L^j>3BDM R5K;S5K=3X @!U8M�B86TMCG�[@C=3M�=S5K[@bFWGIM�BD4GIM�B ;A@ 6c@�UD9�6:U8-N>3B8M R57;39<@�FE@CB8X�9 U86D9> 6:M �N@CBD; 6:P39?X�M�@CFNMCG-FK9@CBD=S5K=3X GIB8M�4�PS9�6:9�BDM�XC9=39�M�03U;A@b6:@ � \ = 1C9�BD=39�F 4T9�6:P3MR;3U9-�6DP39 1C9�BD=39�F3GI03=3[�6D5KM�= 57U�6:P39 UDMCFK9W57= 6D9B G @C[9 2H9�6 � 99=�6:P39 F79@CB8=35K=3X@CF7X�M�BD5 6:P34 @C=S;�6DP39V;A@b6:@ � N P39 1C9�BD=39�F 5KUDMCFE@b6D9U]6DP39 FK9@bBD=357=3X�@CF7X�M�BD5 6:P34 GIB8M�4|6:PS9V;39�6:@C5KF7U�MCG

Page 20: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

}

6:PS9�;A@b6c@�B89>3B89U89=L6c@b6D5KM�=<@C=S;?GIB8M�4 6:P39�;357U86:@C=3[9�4�9�6DBD57[ � C 9B8=39F7UVPA@ �9$@CF7FKM �N9�; 4T@C[cP35K=S9FK9@CBD=S5K=3X @CF7X�M�B8576:PS4TU$6:M 2 9?4�M1;S03FE@CB85dc�9;U-%23016�6DP39�^ P3@ C9 Mb6:P39�B�574T>HM�B 6c@C=L6 @b; b@C=L6c@CX�9�UUD0S[cP_@CU�>3BDM R5K;S5K=3Xa@$[�M�4�>A@C[�69-L5K4�>3FK57[5 6�4T@C>3>357=3X�6:M$P35KX�P�/O@C=3;�9��9�= 5K=1JA=3576D90/ ;35K4�9=3U85KM�=3@CFGI9@ 6:03B89$U8>A@C[�9U-@C=3;<> 9�BD4�576D6D5K=3X FK5K=S9@CBW[�FE@CU8UD5 JA9B8UW6:M�M�> 9�B:@b6D9�5K=_6:PS9UD9$=3M�=�/ FK57=39@bBWUD>A@b[9U��\ = 6:PS5KU%6:P39�UD57U9- �N9-[M�=3U85K;39�B 6DP39 [�M�4�2357=A@b6D5KM�= MCGU1C9B8=39F GI03=3[�6:57M�=3U�GIM�B 6DP39 6c@CUM1 MCGd[FK@CU_/

UD5 JA[@ 6:5KMC= � \%B89�R5KM�0SUT@b>3>3FK57[@b6D5KM�=SU 5K= 6DP35KU @bBD9@ � \]@ RFK57;35KU 9�6T@CF �^- }C~�~+� - }C~�~L} - CML@C[cP3574TU9�6$@bF �^- }C~C~+� - � @b=3[ 1 BD5K9�6 9�6$@CF �Z- }C~�~ #L@�- 2 � P3@ C9 UDP3M � = 6:PA@b6Z[M�4�2S5K=357=3XD1b9BD=S9FKU [@C=�� @b=3;MCG 6D9=�;3MR9U�� 574T>3B8M �9$[FE@bUDUD5 JA9B">H9B8GIMCBD4T@C=3[9 � � 9a>3BDM�>HM�U89�@T=S9��!- 4�M�B89a>HM �N9�B8GI03Fp6:9�[cP�/=357QR0S9 GIM�BN[�M�4�2357=35K=SX"1b9BD=S9FKU @b=3;_9�b@CF70A@b6:9-576DUN>H9B8GIMCBD4T@C=3[9-5K=TUD9�C9BD@CFd94�>35KB85K[@CFAU86D03;35K9�U� �p9 � 5KU 9�6-@CF �Z- }C~�~�� 2U- @ � �e UW>S5K[�6DM�BD5K@CF 4TMb6:5 b@b6D5KM�=@- �N9Z>SBD9U89=L6V6:PS9Z2A@CU85K[ZU8[9=3@CBD57M�5K= 6DP39 GIM�F7FKM � 5K=SX$57FKF703U86DB:@b6D5KM�=

O � 5KX�03B89U � � � / � �D $S � � M�=3U85K;39�BO@V;A@ 6c@ UD9�6p6DPA@b6p[MC=3UD57U86:U MCG1P3957X�PL6 @C=3; �N9�5KX�PL6 4�9@CU803BD9�4T9�= [email protected]=!@b6�6 � M?FE@C2HM�BD@b6:M�B85K9�U � N P39 4�9@CU803BD9�4T9�=L6:U$@CBD9a6c@51b9= GIBDM�4g@ U:@C4�>3F79�MCG 4 @bFK9�@b=3;GI94T@CF79 U8032 �89[�6:U�@b6O2357B86:P @C=3;�4T@b6D03BD5 6 ^ � N P3M�03X�P�6DP35KU 5KU]@"G @C2SBD5K[@b6:9�;�904S@C4�>3F795- � 9W9 4S>H9[�6GIM�03BdB8M�03X�PSF7^Z`$@C0SUDUD5K@C=�[F703U86D9B8U [�M�BDB89U8> M�=S;35K=3XV6DMWGI94T@CFK9�2S5KB86DPU- 4T@CFK9�2S5KB86DPU-GI94T@CF79%@C;303F 6 -4T@CFK9-@C;303F 6 � \ = M�03BN9 4S@C4T>SFK95-RP3M � 9��9�B9-H@C= � 03=35K=L6D9=3;39�;�� b@CBD5K@C23F79"P3@CUW2H99=_57=L6:BDMR;303[�9; �%Z=39 MbG 6:PS9 FE@b2 M�BD@b6:MCBD5K9�U%PA@CUN@a4�5KUD[@CFK5723B:@ 6:9; U8[@CF79-6DPA@b6 �W@CU 03UD9�; GIM�B @CFKFA4�9@bUD03B894�9=L6:U��6-M �nFK9�6 03U @CU8UD034�9 6DPA@b6 � 9 � 5KU8P 6:M�F79@CB8= 6:M�[�FE@CU8UD5 G ^ 4T@CFK9T@C=3; GI9�4 @bFK9�904S@C4�>3FK9�U

X�5 �9= M�=3F7^ PS95KXCP 6N@C=3; �N9�5KX�PL6W4�9@bUD03B894�9=L6:U�� � 9Z[cPSM1M�U89-6DM [FK@CUDU857G ^ � 5 6:P_@$FKM�X$B:@b6D5KM$MCGFK5Z1C9�FK5KPSM1MR;3UNGIB8M�4�6 � M_` @C03UDU85E@C=<4�5^4R6:03B89�4TMR;39�FKU"O M�=S9 GIMCB"4T@CF795-3M�=S9$GIM�BVGI9�4 @CF79 S � �"UD57=3X>3B85KM�B 1 =3M � FK9�;3X�95- �N9-[cP3M1MCUD9 6 � M ` @C03UDU85E@C=SU >H9B 4TMR;39F -LGIM�B 2S5KB86DP @b=3;_@C;30SF76 � � 9-;3M =3Mb61 =3M �w@C2HM�0S6V6DP39 4T57UD[@bFK5K2SB:@b6D9; U8[@CF79 �

� 5KXC03BD9 � � � U8P3M � U 6:PS9 } / ;35K4�9=SUD5KMC=A@CFs;A@ 6c@ � � 5KX�03B89 � � } 5KF7FK03U 6:BD@b6:9�UW6:P39$BD9�UD03F 6 � 9 [@C=9041>H9[�6 5 G � 9 6:B:@b5K= 6:PS9 ` @C03U8UD5K@C=?4T5 416D03BD9 4TMR;39F7UV5K=3;S9>H9=3;39�=L6:F7^5-A03UD57=3X 4 @ 4S574�034�FK5Z1C90/FK57P3MRM1; >3@CB:@C4�9�6D9B 9U 6:574 @b6D5KM�= � N P39?FKM�X BD@b6:57M�[FE@bUDUD5 JA9B � M�03F7; 2H9?[M�=1GIM�03=3;39�; 2L^+6:PS95KB8BD9�FK9�b@C=L6 �N9�5KX�PL6-UD[@CFK9a4T57UD[@bFK5K2SB:@b6D5KM�=?@C=S; � M�03FK; ^1579F7; >HM1MCB-;357UD[�BD5K4�5K=3@b6:57M�= � N PS5KU MR[0/[0SBDU 2 9�[@C0SUD9 6:P39�4�9@CU803BD9�4T9�=L6-57UVUDM G @CBVM���@CUW6:M 4T@51C9�6:PS9 @C;303F 6M/ [cPS5KFK;_XCBDM�03>S5K=3X 4�M�BD9FK5Z1C9�F7^ 0S=3;39BV6DP39�` @C03U8UD5K@C=3U9-36DPA@C=?6:P39 X�9�=3;39�B-X�B8M�03>357=3X�U�� R @L415K4�0S4 FK5Z1C9F75KP3MRMR; 9U 6:5K4T@L/

Page 21: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

Male

Female

Hei

ght

Weight

Male/Female Height vs. Weight Measurements from Two Labs

� 57X�03BD9 � � �HI � �) ; ��6?2 � � � ) ��� �*��) ��)E��) � ��� � ) �� �� ���27 ��-27���+).�5�?)+<>6�2�� N P357U JAX./03B89-U8P3M � UN@C=T5KF7FK03U 6:B:@ 6:5 C9W904S@C4�>3F79W6:PA@b6 9�4T>3P3@CUD5Zc9U�6:PS9-=39�9;�GIM�B�;35KU8[BD574T57=A@b6D5 �9N>A@CB:@b4V/9�6D9BZ9�U86D5K4T@b6:57M�=<GIMCB-[�FE@CU8UD57J3[@b6D5KM�= � 576:P 4T5 416D03BD9�U � N P39�;A@b6:@ [MC= 6:@C5K=SUZ@C= � 03=35K=L6D9=3;39�;��b@CBD5K@C23F79 �

Page 22: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

#

Male

Female

Hei

ght

Weight

Male/Female Height vs. Weight Measurements from Two Labs

� 57X�03BD9 � � }EI � �) ; ��6?2=���L) � � ) ��� �*��) ;��(������2 � � � � ) �� ��? ,��27 ��-27� �+).�5� �).<�6?2�� N P357U J3X�03BD9<[MC= 6D5K= 039�U�6DP39 57FKF703U86DB:@b6D5 �9 904S@C4�>3FK9 6DPA@b6�94�>3PA@CU85dc�9U 6:P39?=39�9; GIMCB;357UD[B85K4�5K=A@ 6:5 C9 >A@bB:@C4�9�6D9B?9U 6:5K4T@b6D5KM�= GIMCB_[FE@bUDUD5 JA[@ 6:5KMC= � 576:P 4�5^4R6:03B89U�� � 9 UD9�9!6 � M6 � M./ [�M�4T>HM�=39�=L6 ` @C03UDU85E@C= 4T5 416D03BD9"4�M1;39�FKU�6:BD@C5K=39�; 5K=S;39>H9=3;S9=L6:F ^ � 5 6:P 4T@L415K4 034 FK5Z1C90/FK57P3MRM1; � � FE@CU8UD5 JA[@b6D5KM�= � 5 6:P_6:PS9UD9$4�M1;39�FKU � 57FKF 2H9 > MRM�B��

Page 23: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

G

Male

Female

Hei

ght

Weight

Male/Female Height vs. Weight Measurements from Two Labs

� 57X�03BD9 � �D I ���).; �>6�2 ���=) ��� � ) ��� �*�?). �;� ���-��2 � � � � ) �� �� ,�*2E ��-2E��.)+� ��).<�6?2�� N PS5KU�JAX�0SBD9 [�M�=L6:5K= 039�U�6:P39_57FKF703U86DB:@b6D5 �9 9 43@b4T>3F79 6:P3@b6 94�>3PA@bUD5dc�9U 6DP39_=39�9;GIM�B ;357UD[B85K4�5K=A@ 6:5 C9�>A@CBD@C4T9�6:9�B-9�U86:574 @ 6:5KMC=?GIMCB"[�FE@CU8UD5 JA[@b6D5KM�= � 576DP 4�5^4R6D03BD9�U � � 9aU899a6 � M6 � M./ [�M�4T>HM�=39�=L6a`$@C0SUDUD5K@C=�4�5^4R6:03B89 4�M1;S9FKU"6:BD@C5K=39�;�;35KU8[B85K4�5K=A@b6D5 C9F7^ � 5 6:P)Rfa�Y � � FK@CU_/UD5 JA[@ 6:5KMC= � 576:P?6:PS9UD9 4�M1;S9FKU � 57FKF 2 9 [MCBDBD9�[�6 �

Page 24: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

6:57M�= MCG 6DP39"4 @CF79 @C=3;�GI94T@CFK9V4�M1;S9FKU%57X�=3M�B89U%6:PS9"G @C[�6 6DPA@b6�6:PS9-[�FE@CU8UD9U @CB89-=3Mb6 U89>A@bB:@b6D9;>3B8M�> 9�BDF ^ � \ = [�M�=L6:B:@bU86 -L6DP39VFE@b6D9=L6 Rfa�Y `$@b03UDU85E@C= 4�5^4R6:0SBD9 � 9 >3BDMC> M�U89 �NMC03FK; 2H9W6:B:@b5K=39�;;357UD[B85K4�5K=A@ 6:5 C9F ^$-L03U85K=3X�4T@L415K4 034 9=L6DBDM�>L^ >3@CB:@C4�9�6D9B 9U86D5K4T@b6:57M�= � N P39Z[�FE@CU8UD57J39B � M�03F7;FK9@CBD=$6:M-5KX�=3MCBD9%6:P39 �N9�5KX�PL6�C@[email protected] 2H9[@C03U89WX�5 C9=$6:P39 4TMR;39F - 576O5KU =3MC6]@CUO;S5KUD[�BD574T57=A@b6:5 �9@CU�6:PS9TP39�5KX�PL6 � N P39�FK9@CBD=S9; `$@b03UDU85E@C=3U � M�03F7; @C>3>H9@bB @CUa57= � 5KX�0SBD9 � �! @b=3; [�FE@CU8UD5 JA[@L/6:57M�= �NMC03FK;?6:P 03U-2 9 UD0S[[9�UDU GI03F � \ =<G @C[�69-36:P357U 5KFKF703U86DB:@b6D5 C9Z904S@C4�>3FK9ZGIMCBD4�U 6DP39 2A@CU85KU GIM�B @U8^R=L6:PS9�6:57[a;3@b6c@ 9041>H9B85K4�9=L6"5K= � PA@C>S6D9B # �N P35KUV57UW@C=?@bB86:5 JA[5K@CFH904S@C4�>3FK9 � W-M � 9��9�B9- 576NP35KXCP3FK57X�PL6:U @�BD9@bF 5KU8UD039�57= 4T@C[cP35K=S9ZFK9@CBD=�/

5K=SX � \ 6-5KU-@CFK4�M�U86"@bF �N@ ^RU"6:P39$[@CU89a6DPA@b6 @�>3B8M�2A@C2S5KFK57U86D5K[�4�M1;39�Fd5KU-@�U85K4�>3FK5 JA[@ 6:5KMC=_MCG�6:PS96:B8039Z;357U86DBD5K2S0S6:57M�= 2H957=3X�4�M1;39�FK9�; � � P39�=_4TMR;39FH4�5KUD4T@b6D[cP_@CBD57UD9�U9-3@ 6WFK9@CU86W5K=_@ ;S5KUD[�BD574V/5K=3@b6:5 �9ZF79@CB8=35K=3XaUD[�9=A@CB85KM3-S576W57UW[F79@CB 6:PA@b6WM�>S6:574T5Zc57=3Xa6DP39Z>A@CBD@C4�9�6:9�BW9U 6:574 @b6D5KM�=TGIM�BN6:PS9;357UD[B85K4�5K=A@ 6:5 C9_M�2 �89�[�6:5 �9 B:@b6DP39B 6:PA@b= 6:PS9 X�9�=39BD@b6:5 �9 M�=39<5KUT@ R5E@b23FK9?M�>S6D5KM�= � \ = 6:PS9904R6DBD94�9 [@CU895-L6:PS9"U803>3>HM�B86 C9[�6DM�B�4 @b[cP35K=39 O /�P!RfS � P @C>3=S5d1]- � "H" B � @C23@C=3;3M�=SU�6DP39 X�ML@CF1MCG4�M1;39�FK57=3X-6DP39 5K=3>3016%;35KU 6:B85K230S6D5KM�=�@CF76DM�X�9�6DP39B8- @C=3; M�=3F ^ 4T@L415K4�5dc�9U]@ 4�9@bUD03B89"MbG ;S5KUD[�BD574V/5K=3@b6:5 �9 > 9�B8GIM�B84 @b=3[9 � N P357U"P3@CU->SBDM �9�=�@�U85K4�>3FK9 @b=3; U803[[�9UDU GI03F]U 6:BD@b6:9�XC^ �[W"M �N9 �9B8- � 92H9FK579�C9a6:P3@b6Z4�M1;S9FK57=3X�[@C=�2H9 �803;S5K[57M�03U8F7^?BD9�5K=L6:B8M1;S03[9�;�6:M 9 4S>SFKM�5 6 U 6:BD0S[�6:0SBD9 5K= @ ;A@b6:@UD9�6 � N M @C;3;3B89U8U 6DP35KU >3BDMC23FK9�4b- �N9�M�� 9�BWFE@b6D9=L6 Rba Y � � 9 GI03B 6:P39�BW>3B8M�> MCUD9Z03U85K=3X�1b9B8=39F /5dc�9;TFE@b6D9=L6XRfa�Y 6:Ma> 9�BD4�576 @a`$@C0SUDUD5K@C= 4�5^4R6D03BD9 4�M1;39�FA5K= � P35K[cPT9@C[cP_`$@C0SUDUD5K@C=�BD9U85K;39�U5K= @�;35 � 9B89=L6VGI9@b6D03BD9 UD>A@C[�9 � N P35KUNBD9U803F76DUV5K=_@�=SM�=3U86:@b6:57M�=A@CB ^D1b9B8=39Fd[�M�4�2357=A@b6:57M�=U- � 576DP=3M �9�Fp2 9�=39�J36DU @bU� 9 UDPA@bFKFs;39�UD[�BD5K2H9 �

� ( � ����� #%������ #%���T�

N P39W>SBD5K=S[5K>3@CF1[�M�=L6:B85K230S6D5KM�=aMCGA6:PS5KUO6DP39U85KU�57U]=3MC=3U86:@b6:57M�=A@CB ^"1b9B8=39F3[�M�4�2357=A@b6D5KM�=DO 6 / C � S �6Z/ C � X�5 C9U 6DP39�@C2357FK5 6 ^+6:M 9 4S>SFKM�5 6 >3B85KM�B 1 =3M � FK9;SX�9�6:P3B8M�03X�P 6DP39 ��� > �`HL> �V[cPSM�5K[�9�MCGUD9 �9�B:@CF 1b9B8=39F7U @C=3; @ U 6:BD0S[�6:0SBD9; X�9�=39BD@b6:5 �9�4�MR;39F � N P39 4�M1;S9FO@CFKF7M � U"03U 6DM [MC4�235K=S91C9�BD=39�FKU_57= @ 4�M�BD9 �A90415K2SFK9�4T@C=3=39�BT6DPA@C= UD574T>SFK9<FK5K=S9@CB�[M�4 235K=A@ 6:5KMC= � N P39 >3BDM�>HM�U89;?@HL?�K0E��5E��`HL?��5>�� [M�4 235K=A@ 6:5KMC= > 9�BD4�576:U%6DP39 1b9BD=S9F � 957X�PL6 6DM b@CB ^ M C9B 6:P39"5K=3>S0S6NU8>A@C[�95-3@bU

Page 25: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

@ >HM�U 6:9B85KM�B ;357U86DBD5K2S0S6:57M�= M C9B @!4�5^4R6:0SBD9?4TMR;39�F �a�@C[cP�1C9B8=39F"PA@CUTX�BD9@b6:9�U86T5K= �3039=3[�9M �9�B 6:PS9 [�FE@CU8UD57J39B � P39B89 576<57U<4�M�U 6 B89F79�b@C=L6 6DM 6DP39 57=3>30S6<;357U86DBD5K2S0S6:57M�= � N PS5KU<5KU<@X�9�=39BD@CFK5Zc@b6D5KM�= M C9B"90415KU 6:5K=SX 6D9[cP3=S5KQ 039U8-H@CU � 5KFKF 2 9 U8P3M � = �N MT@C[cP3579�C9"6 / C � - � 9 [M�4�2S5K=39�FK@CBDX�9 4 @CB8X�5K=_;S5KUD[�BD574T57=A@b6:57M�= � 5 6:P?X�9�=39BD@b6:5 �9 4TMR;�/

9F75K=3X 5K= @ >3B8M�2A@C2357FK57U86:57[$GIBD@C4�9�� M�B21 @C=3;!@C>3>3F ^ 6DP39 BD9�UD03F 6:57=3X_[FK@CUDU857JA9�BDUZ6:M_4 03F76D5^/ 1b9B8=39FFK9@CBD=S5K=3Xw>3B8M�23FK9�4TU�� � 9 03UD9 6:P39 GIM�B84 @CF75KU84 MCG 4 @ 4S574�034 9=L6:B8M�>L^ ;35KU8[BD574T57=A@b6D5KM�=� �@�@51Q1CM�FK@�- R 957FE@�-"@C=3; C9�2A@CBD@�- � "H"�"C2 � 6DM+X�9=S9B:@bFK5dc�9�03>HM�= UD0S>3> MCB86 �9�[�6DM�B?4 @C[cPS5K=39�U� � M�UD9�B 9�6-@CF �^- � "�" } - � MCB86:9�U @b=3; P @C>3=35Z1 - � "H" G -�P @b>3=35d1]- � "H" B � �N P39 [�03BDB89=L6 BD9�UD9@bBD[cPw5K4�>3BDM C9U 6DP39 U 6c@b6D90/ MbG / 6:PS90/ @bB86<5K= U89�C9B:@bF�5K4�> MCB86c@b= 6 �N@^1U��

N P3M�0SX�P 4�03F76D5^/ 1C9B8=39FOFK9@CBD=357=3X3-sFK@CBDXC9�4 @bBDX�57=�[FK@CUDU857JA[@b6:57M�=U-s@b=3; 5K=3;39�9; 4T@L415K4�034 9=�/6:B8M�>L^ ;35KU8[B85K4�5K=A@b6D5KM�= @CBD9"904157U86:57=3X�6:9�[cP3=35KQ 039�U9-R6:P3B8M�03X�P 6:P357U�BD9U89@CB8[cPU- � 9"PA@ �9 9 4R6:9=S;39;@C=3; @C>3>3F75K9�; 6DP394u57= @b= 57= 6D9B89U86D5K=3X!=39 � �W@^ � N P39 >3B85KM�B � M�BM1j57U ;35KU8[03U8UD9; 5K= /19[ /6:57M�= � �D a@C=3; M�0SB [�M�=L6:BD57230S6D5KM�=3U @CB89 ;39�6c@C57FK9;T5K=�6:P39"GIM�FKF7M � 57=3X [cPA@C>S6D9B8U � W-9�BD95- �N9 23BD579 �3^P357X�P3FK57X�PL6"UDM�4�9 MCG%6DP39*1b9�^ [M�=L6:B85K23016:5KMC=3U MCG]6:P39�B89U89@CB8[cP 6DM UD9�6Z6:PS9 U86:@CX�9 GIMCB"6DP39�FE@ 6:9BUD9�[�6D5KM�=3U��\ = �@C@51Q1CM�FK@�-CR 957FE@�-p@C=S; C9�2A@CB:@ � � "H"H"C2 � 6:P39 57;39@CU MCG 4T@L415K4�034g9=L6:B8M�>L^ ;35KU8[B85K4�5^/

=A@b6D5KM�=)O Rfa�Y!S � 9BD9 9 4S>SFK5K[@b6:9�;?5K= ;39�6c@C57F � N P3@b6 >A@C>H9BV>3B8M�>HM�UD9�UW6:P39�9 416D9=3U85KM�=<MCG Rfa�YGIM�BW0SUD9 � 576DP_FE@b6D9=L6 b@CB85E@C23F79 4�M1;S9FKU8-16DP3M�03X�P_U8> 9�[5 JA[U"@CB89ZM�4�576D6D9; � C92A@CBD@ � }b~�~ #L@ � GI03B_/6:PS9BV9041>3F7M�BD9�UWFE@ 6:9=L6 Rba Y @C=3;_>SBDM R5K;39�UV4TM�B89 ;39�6c@C57F � \ = 6DP35KU 6:P39�UD5KU8- � 9�>3BDM�>HM�U89 @�=39��FE@ 6:9=L6 Rba Y b@CB85E@b6D5KM�=A@bF%2 M�0S=3;35K=SX�6:9[cPS=35KQ 039 6DPA@b6 >3B8M 157;39U @<6:BD0S9_2 M�0S=3;39;+U8M�FK016:5KMC=@C=3; @T[FK9@CBD9�BZ03=3;S9BDU 6c@C=S;35K=3X_MbG%6:P39�FK@b6:9�=L6 Rfa�Y >A@CB:@b4T9�6:9B-9U 6:5K4T@b6D5KM�= @CU�@ 4�5K=3574 @ 4>3B8M�23FK9�4 � %Z03B @b>3>3BDM�@C[cP�5KUZ>SBD5K=S[5K>SFK9;�@C=3; M�03BZ;S9BD5 b@b6:57M�=3UZ@bBD9�>3B89U89=L6:9�; 5K= GI03FKF � N P39=39 ��2 M�0S=3;35K=SX 6:9�[cP3=357QR0S9�>3BDM R5K;S9U @ X�0A@CBD@C=L6:99 MCG�[�M�= �9B8X�9=S[9�6:M @ F7M1[@CFKF ^ M�>S6D5K4T@CFUDMCFK0S6D5KM�= �C92A@bB:@ � }C~C~ #L@ � @CFKU8M�M�� 9�BDU%6:PS9VUD03X�XC9U86D5KM�=�MCG @�4TMCBD9V9���[�5K9=L6 M�>S6D5K4�5dc@b6:57M�=a6D9[cP3=357Q 039

GIM�B @ FE@b6D9=L6!Rfa�Y 4�5^4R6:03B89 MCGN` @C03U8UD5E@b=3U � N P39 57=L6:9=L6 �N@CUZ6DM >3BDM R5K;S9 @ U86:@CB86D5K=3X >HM�57= 6GIM�B�GI03B 6:P39�B � M�B21]-�� PS5K[cP �N@CU 57=3;39�9; B89Q 0357BD9; � � 9T[M�4�>3FK9�6:9�F7^�B890/ ;S9BD5 �9�; 6:PS9 03>H;A@b6D99Q 0A@ 6:5KMC=3UOGIM�BO@-U89Q 039�= 6D5E@CF14T57=35K4T@CFbM�>S6:574T5Zc@b6D5KM�= O /3R %!S � \%FE@b686 - � "H"�" � @CFKX�MCBD576DP34 GIMCBO6:PS9

Page 26: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

B

FE@ 6:9=L67Rfa�Y 4T5 416D03BD9$MCG ` @C03U8UD5E@b=3U 03U85K=3X @ 4TMCBD9 9�FK9�XL@C=L6-GIMCBD4�03FK@b6:57M�=<MCG�6:PS9�>3BDMC23FK9�4 �� 9V@CFKU8MZ;357UD[M C9B%@C=S; 9041>3FK57[@b6D9NU89��9�B:@CFS[@CU89U�6:P3@b6 � 9BD9VMC4T5 6D6:9�;aGIB8M�4 C92A@CBD@ � }b~�~ #L@ � -CU8M� 9-[�M C9B�6:P39 9�= 6D5KB89 GI9@CUD5723FK9VU8>A@C[�9 � � 9";S5KUD[�M �9B89;�6:PA@b6 @�U86:@C=3;A@bBD; /3R %)@CF7X�M�B8576:PS4 [@C=G @C57F36:M$BD9@b[cP_@C= MC>S6:574 @�5K=�BD9@CUDMC=A@C23F79"6D5K4�95- ;3039 6:Ma=3M�=�/ UD4�M1MC6DP3=39�UDU MCGs6:PS9-FK@b6:9�= 6 Rfa�YM�2 �89�[�6D5 �9.- @C=3; � 9�>3BDM R5K;39 @ U8M�FK0S6D5KM�=TGIM�BN6:P3@b6V>3B8M�23FK9�4 �]e U"@�BD9�UD03F 6 MCGp6:P39�UD9$@C; b@C=3[�9U8-� 9_@CBD9T@C23F79�6DM >3B8M 157;39T6DP39TJ3BDU86 5K4�>3FK9�4T9�=L6c@b6D5KM�=�MCG /3R %�GIM�B$FE@b6D9=L6�Rba Y >SBDM�23F794�U �N P39 U8MCG 6 �N@CBD9 57U � B857686:9= 5K= ����� @C=3; 57Ua57= �M$1b9;+GIBDM�4 MC03B�R e N �de � UDMCG 6 �N@CBD9 03UD57=3X6:PS9*Rba�� 57= 6D9B G @C[9 �

� 9$5K=L6DBDMR;303[9�;<6DP39 6:9[cPS=35KQ 039$MCG�=SM�=3U86:@b6:57M�=A@CB ^ 1C9�BD=39�Fp[M�4�2S5K=A@b6D5KM�=@-303UD57=3XT@ FK@b6:9�=L6Rfa�Y 4�5^4R6D03BD9�MCG3`$@b03UDU85E@C=3U�� C 9B8=39FL[�M�4�2357=A@b6D5KM�=�6:9�[cP3=357QR0S9U]P3@ C95- 6:P 03UpG @CB9- 2 9�9=aFK5K=S9@CB[MC4�235K=3@b6:57M�=3UdMCGI1b9B8=39F7U � \]@ RFK5K;S5KUp9�6�@CF �^- }C~�~+� - }C~�~L} - �p@C=S[ 1RB85K9�6]9�6�@CF �Z- }b~�~L} - N UD0S;A@ 9�6]@CF �Z-}C~�~HG -4%Z=3X 9�6 @CF �Z- }b~�~AG�� MCB�6:P39�5KB%957X�9= C9[�6DM�BDU � � B85KU 6:5E@b=35K=3519�6 @CF �Z- }b~�~L} -4%Z=3X 9�6N@bF �^- }C~�~AG � �N P39 [M�4�2S5K=A@b6D5KM�= � 957X�PL6:U]P3@ C9N2H99�=�5K=3;S9>H9=3;39�=L6�MCG36DP39 5K=3>3016O6DM 2H9 [�FE@CU8UD57J39;U-C@C=3;a6DP 03U@CB89 K0E��5E��`HL?��5>�� � � 9T5K=L6:B8M1;30S[9 ;39�> 9�=3;39�=3[9?MCGV6DP39 [MC4�235K=3@b6:57M�= � 957X�PL6:U�MC= 6:P39T5K=3>3016UD>3@C[9.-W[B89@b6D5K=3X!@ ?@HL?�K0E �5E �`HL?��5>��_[M�4�2S5K=A@b6D5KM�=+MbG 1b9BD=S9FKU � �p9 � 5KU8- C923@CB:@�-N@C=3; 6-M�2SFK95-}C~�~C� 2 � � N P357U =39�� 6D9[cP3=S5KQ 039 57U 5K=L6:9�BD9U 6:57=3X?2 9�[@C03U89 5 6 5KU [@C>3@C23FK9 MCGNUDM�F R5K=3X?>3B8M�23FK9�4TU6:P3@b6 904157U86:57=3X 6D9[cP3=357Q 039U [@C=3=3MC6�UDM�F �95- @CU 5KFKF703U86DB:@b6D9; 5K= U ^1=L6DP39�6D5K[_;A@b6:@ 9041>H9B85K4�9=L6:U��N P 03U�G @CB8-�94�>35KB85K[@CF%BD9�UD03F 6:U � 5 6:Pe6 / C � M�= [�M�4T4�M�= 2 9�=3[cP34T@CB21 U @C=3; BD9@bFN>3B8M�23FK9�4TUPA@ �9?03U80A@CF7F7^ 2 9�9= 2 9�6D6D9B 6:PA@b=+90415KU 6:5K=SX�6:9[cPS=35KQ 039�U9- � 5 6:P3MC0S6 6:P39_=S99; GIM�B�>3@CB86D5K[0SFE@CB6:0S=35K=3X MCG 6:PS9a@bFKX�M�B8576DP34 �

� 9�[MC=3;303[�6:9;+U89�C9B:@bF 9�4T>357BD57[@CF�U 6:03;S5K9U$03U85K=3X 1C9�BD=39�FN[MC4�235K=3@b6:57M�=U-d5K=S[FK0S;35K=3X?M�=S9UD9�6�MCG 9 41> 9�BD5K4�9=L6DU � �d9�� 57U9- C92A@CBD@�- @C=3; 6-M�23F795- }b~�~�� [ � 6:PA@ 6 5KFKF703U86DB:@b6D9U$6:PA@b6�F79@CB8=35K=3X1C9�BD=39�Fp[M�4�2S5K=A@b6D5KM�= �N9�5KX�PL6:U R5K@ MC>S6:574T5Zc@b6D5KM�=�5KUV=3Mb6 @CF �N@^RU"U803>H9BD57M�BW6:M 0SUD5K=SXT@�U85K4�>3FK903= � 95KXCP 6D9;![M�4 235K=A@ 6:5KMC= � N P35KUZU 6:03;1^�5KUZ>3@CB86D5K[0SFE@CB8F7^<BD9�FK9�b@C=L6Z6DM_>3B:@b[�6:5 6:57M�=39B8UZ;3039�6DM6:PS9 6:574T9<BD9�QR0S5KBD9�; 6:M 6:M [�M�4T>S0S6:9 6DP39 [�M�4�2357=A@b6D5KM�= �N9�5KX�PL6DU GIM�BTFK@CBDXC9 ;A@ 6c@ U89�6:U?@b=3;;3039 6DM<6DP39 [03B8BD9=L6aFE@C[ 1 MCGNGIB899�F7^�@ b@C57FE@C23F79 U8MCG 6 �W@bBD9 6:M?> 9�B8GIM�B84h6:PS9�MC>S6:574T5Zc@b6D5KM�= � \ =M�03B 9041> 9�BD574T9�= 6DU9- 6:P39�0S= � 957X�PL6:9�; [�M�4�2357=A@b6:57M�= �N@CU_MCG 6D9= @CU XCM1MR; @CU?@C= MC>S6:574T5Zc9;[MC4�235K=3@b6:57M�= � � 9 ;357UD[0SUDU?UDM�4�9�[@bUD9U?57= � PS5K[cP �N9!M�23U89B��9;)@C= @C; b@C=L6c@bX�9�GIM�B 6:PS9

Page 27: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

"

M�>S6D5K4�5dc@b6:57M�= � N PS5KU B89UD9@CBD[cP @CF7UDM+904S@C4�5K=S9; 6DP39�9 � 9[�6?MCG$4T57UDUD57=3X ;A@ 6c@ � 5 6:P,1C9�BD=39�F[MC4�235K=3@b6:57M�= � � 9TGIM�03=3;+6:P3@b6 6:P39_U85K4�>3FK9T03= �N9�5KX�PL6D9;j[M�4�2S5K=A@b6D5KM�= �W@bU�Q 035 6:9 B8M�2303U 66:M 4T57UDU85K=3X!;A@b6:@ � N P35KU�U86D03;S^ 4 @^ 9�=3[M�0SB:@CX�9 9041>H9BD574T9�=L6c@CF75KU86DU 6:M 6DB8^jUD574T>SFK9 1C9�BD=39�F[MC4�235K=3@b6:57M�= 6:9�[cP3=357QR0S9U � PS9= MC>S6:574T5Zc@b6D5KM�=T5KUV95 6:P39�BV5K=39 ��[5K9�=L6-MCBV03=A@ b@C5KFK@C23FK9 �

� 9<PA@ �9<[B89@b6D9; @ [�M�4�>3FK9�6:9bR e N �de ������� � UDMCG 6 �N@CBD9<5K4�>3F794�9=L6c@b6D5KM�= 6:PA@b6 � 9� 5KF7F 4T@51C9 >30S23FK57[F7^ @ b@C5KFK@C23FK9"GIM�B @C[@C;394�5K[�0SUD9 �

� (�� '|�������� �����

� 9W230357FK;�03>HM�= @ZXCBD9@ 6 � 9@CF 6:P MCG B89[9�=L6 �NM�BM1 57= 6:P39W@CBD9@CU�MCG]1b9BD=S9FA4�9�6:PSM1;3U � /R[cP �M�Fd1bM�>SG9�6a@CF �Z- � "H"H"�-p/R[cP �M�Fd1bM�>SGW@C=3;+/R4TM�FK@�- }b~�~L}�� -pFE@CB8X�9 4 @bBDX�57=�[FE@bUDUD5 JA[@ 6:5KMC= � P @C>3=S5d1]- � "H" B�� ->3B8M�2A@C2357FK57U86:57[ 4TMR;39F75K=3X @C=3;_57=SGI9B89=3[�9 � \ 9@CB8F`- � "H" B - CM�BD;3@C=_9�6"@CF �Z- � "H"�" � -S@C=3;_M�>16:5K4�5dc@L/6:57M�= � � M ^R;?@C=3; P @C=3;39�= 2 9�BDX�P39.- }C~C~ �- \%FE@b686 - � "H"�" � � N P39B89 PA@CU 2 9�9= 9 41>3FKM�U85 C9 >3B8M�X�BD9�UDU8-MCGVFK@b6:9.-O57= @CF7F%MCGW6DP39 @C2HM �9 @CBD9@CU � N P357U 4T@51C9�U 4T@C[cP35K=S9�F79@CB8=35K=SX @C=S; 576DU @C>S>3FK57[@b6D5KM�=@C= 9041[�576:57=3X JA9�FK;U-�23016�@CFKU8M�4 @51b9U 5 6 ;35 ��[�03F76a6:M U86:@ ^ @CP39@C; MCG 6:P39 �N@ �9<MCG 6:P39�M�BD9�6:5^/[@bF @b=3; 9�4T>357BD57[@CF�B89U803F76DU�@C=3;!6:P39 �AMRM1;!MCGV;3@b6c@ � N P39TJA9�FK;!PA@CUaBD9U8> MC=3;39; 5K=!UD9�C9BD@CF�N@ ^RU��F%Z=39 5KU 6:M_;39 �9F7M�>�G @CU 6:9B @C=3;�4�M�BD9a@C[�[9U8UD5723FK9�U8MCG 6 �N@CBD9�6DM_@C;3;3B89U8UZ6:P39a=399�;3U�MCG>3BD@C[�6D576:57M�=39�BDU�6:M$9�b@CF70A@b6D9V9��9�B_/ X�BDM � 5K=SXa;A@ 6c@ BD9>HM�U8576:MCBD5K9�U � \%FK@b6D69- � "H"H"�- CML@C[cP3574TU8- � "H" B�� �e =SMC6:P39�BZ5KU"6:M_57=3[B89@CU89 6:P39 [M�4�>3FK9 41576 ^<MCG�M�03B"6:9�[cP3=35KQ 039�U�6:M F79@CB8=�4TMCBD9aGIB8M�4 90415KU 6:5K=SX;A@b6:@ � �@�@.1�1bM�FE@ @C=S; W-@C03U8UDFK9�B9- � "�" B - �@�@.1�1bM�FE@�9�6 @CF �^- � "H"�"�@�- [5- N @CUM1b@bB 9�6 @CF �^- }C~C~ �-Ce-F76D03=9�6$@bF �^- }C~�~ �- N UDMR[cPA@C=L6:@CBD57;35KU�9�6 @bF �^- }C~�~ #3- C923@CB:@�- }C~�~ #L@ � ��/1M�4�9 @C>3>3B8ML@C[cP39�U$G @C[�5KF7576c@ 6:92HMC6:P MCG 6:PS9UD9?X�M�@CFKU8-�6:M 4 @.1C9 6:BD@C[�6:@C23F79_@C>3>3B8M 4S574 @ 6:9_@CF7X�M�B8576:PS4TU 6:PA@ 6 UDM�F �9_[MC4T>3F7904>3B8M�23FK9�4TU � YZ94�>3U 6:9BV9�6-@CF �^- � " � ��-�CM�B8;A@C=?9�6-@CF �Z- � "H"H"�-�C92A@CBD@�- }C~�~ #L@ � �R 03[cP MCGV6DP39 [0SBDBD9�=L6 9=L6:P 03U85E@CU84�U 6:94�U GIB8M�4�@ X�BD9@b6�B89[9�=L6 6:BD57034�>3P 57= 4T@C[cP35K=S9

FK9@CBD=S5K=3X3-36DP39$UD03>3>HM�B 6 C9[�6DM�B 4T@C[cP357=39 O /�P7RTS � � MCUD9B-9�6 @CF �^- � "H" } - � M�B86D9U-@C=3; P @C>3=35Z1 -� "H" G -�P @C>S=35d1]- � "�" B - � B85KU 6:5E@b=35K=35]@C=3; /1PA@ � 90/ N @^RFKM�B8- }C~�~�~�� � N M?03=3;S9BDU 6c@C=S; 6:PS9 UD5KXC=357G /5K[@C=3[�9<MbG 6:PS9 /QP!R - � 9 U8P3M�03F7;j6:@51C9 @!2SBD5K9�G F7M1M51 @b6 6:PS9?J39FK;j>3B85KM�B�6DM 5 6:U ;357UD[M C9B8^ �e B 6:5 JA[5K@CFp5K=L6:9�FKFK57X�9=S[9DO e \ S - MbG � P35K[cP�4T@C[cP357=39 F79@CB8=35K=3XT5KU @C=�M�� UD>3B85K=3X�- PA@C; UD0 � 9B89;!@

Page 28: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� ~

b@CBD579;?>A@CU 6 -A;30S9 6DM [�^R[F79U"MCG]57BDBD@b6:57M�=A@CFH9041032H9BD@C=3[9$GIM�FKF7M �N9�;_2 ^?M C9BD[�M�BDB89[�6:5KMC= �N P39 J39FK;aMCGAe \ PA@C;a>3BDM�4�5KU89;$X�BD9@b6OBD9U803F76DU9- � P35K[cP�=S9��9�B�UD9�94�9; 6DM-4T@b6D9BD5K@CFK5Zc9 � N P39

FE@ 6:9 � " GC~ � U U:@ � 6:P39�@b; �9�= 6WMCGs6:PS9Z> 9�BD[�9>S6DBDM�=_@bFKX�M�B8576DP34 � �"M�U89= 23FK@b6D69- � " G " � - � P357[cP �N@CU@ UD574T>3F757JA9�; 4�M1;39�F MCG 6:PS9�=3903B8M�= � N P39 >H9BD[�9>S6DBDM�= �N@CU UD99�=�@CUVP3@ R57=3X X�BD9@b6 > Mb6:9=L6D5E@CF03=L6:57F R<5K=3UM1 ^ @C=3; \]@C>H9B 6 � � " � ��- � " � " � U8P3M �N9�; 576:U 6:PS9M�B89�6:57[@CF"FK574T5 6c@b6D5KM�=SU � YZ9�[@C;39�UFE@ 6:9B8-]6:PS9_BD9U89@CB8[cP [M�4�4�03=35 6 ^!BD9U8> MC=3;39; � 576DP O @bB86:5 JA[5K@CF S�=39�03B:@CF =39�6 � M�BM1RUbOIe 6 6"U S -9U8UD9�= 6D5E@CF7F7^ > 9�BD[�9>S6DBDM�=3U [@CUD[@C;39;j5K=L6DM�4�03F76D5KFK@ ^C9B$=39�6 � M�BM1RU�� \%BDM�X�B89U8U �W@CU U8FKM ��03=L6:5KFGI99�;�/ GIMCB �N@CBD; =S9�6 � M�B21 U_@C=S; 6:P39 2A@C[ 1 >3B8M�>A@CXL@ 6:5KMC= 6:BD@C5K=S5K=3X!@CF7X�M�BD5 6:P34 � � 9B82 M�U8- � " � # �� 9BD9 ;357UD[�M C9B89; � N P39�UD9 6:9[cPS=35KQ 039�U � 9B89T>HM�>303FK@CBD5Zc9�;�5K=�6:PS9�9@CBDF ^ � " B�~ � U � � 034�9F7PA@CB869�6Z@CF �^- � " B���� �"e 6:6-UZU 6:5KF7FpUD0 � 9B89;�UD9 �9�B:@CF�>SBDM�23F794�U9-H9�C9= � 576DP�2A@C[ 1 >3B8M�>A@CX�@b6:57M�= � N P39>3B85K4T@CB8^?>3B8M�23F794�U � 9BD9 ;A@ 6c@ B89>3B89UD9�=L6c@b6D5KM�=U- [cP3M�5K[�9�MCG =39�6 �NM�BM1 6DM�> MCFKM�XC^5- =SM�=�/ [�M�= �9 4O =SM�=�/ XCFKM�2A@bF SVM�>S6:574T5Zc@b6D5KM�=@- @C=S;!M C9B8JS6D6:57=3X � N PSM�03X�P =39�03B:@CF%=S9�6 � M�B21 Ua@CBD9 U 6:5KF7F]57=�03UD9.-6:PS9$U8M�FK016:5KMC=3UW6:M 6:PS95KBV>SBDM�23F794�UV[@C4�9�FE@bBDX�9�F7^�6:P3B8M�03X�P<@C=3Mb6:P39�B"[�FE@CU8U MCG�@bFKX�M�B8576DP34TU��N P39VUD0S>3> MCB86 C9[�6DM�B%4T@C[cP35K=S97O /QP!RTS � P @C>3=35Z1]- � "�" B � PA@CU�PA@b; 9=3M�B84TMC03U�UD0S[[9�UDU � 576DP

[FK@CUDU857JA[@b6:57M�= >SBDM�23F794�U];3BD@ � = GIB8M�4 4 @C=L^$JA9F7;3U9-CUD03[cP�@CU�2S5KM�F7M�XC^ � UD99 6"M�23F795- }b~�~ # � -b6D904R64�5K=357=3X � YZ034 @b5KU9- � "H" B � -S5K4T@CX�9 B89[�M�X�=35 6:5KMC= �!%ZUD0S=A@ 9�6-@CF �^- � "H" � � -3@C=S;<Mb6:P39�BDU � N P357UVUD03[ /[9�UDU [@C= 2H9 @b6D6DBD57230S6:9�; 6:MZ6:PS9"9�4T>S5KBD57[@CFR>H9B8GIMCBD4T@C=3[9NMCG 6DP39 @CF7X�M�BD5 6:P34 - 6:P39"@C[�[9U8UD57235KF7576 ^MCGOQ 0A@CFK5 6 ^ U8MCG 6 �W@bBD9 � \O@ RF75K;357UV9�6-@CF �^- }C~C~ #3-�CML@b[cP35K4�U9- � "H" B � -S6:PS9 �390415K2357FK5 6 ^ 5K4�>A@CB 6:9�;_2 ^1C9�BD=39�F 4�9�6DP3MR;3U � /R[cP �M�Fd1bM�>SGV9�6a@CF �^- � "H"�" � -p@b=3;!6DP39 UDM�0S=3; 6DP39M�B89�6D5K[@bF%03=3;39�BD>357=3=35K=SX�U�MCG6:PS9 6:9�[cP3=35KQ 039 � P @C>3=S5d1]- � "H" B � ��R 03[cP MCGV6DP39_@C>S> 9@CFNMCGV6DP39?/�P7R [M�4�9UaGIBDM�4 576DU B89F^/@b6D5 �9�F7^ UD574T>3F79�[MC= C904!M�>16:5K4�5dc@b6:57M�= � � M ^R; @C=3;�P @C=3;39�= 2 9�BDX�P39.- }C~�~ � - � PS5K[cP!2A@CFE@b=3[9�U6:PS9$9�4T>S5KBD57[@CF FKM�U8UVMCG 6:P39 [FK@CUDU857JA9�B � 576DP 5 6:UV9041>H9[�6:9; X�9=S9B:@bFK5dc@b6:57M�= �

�-@bFKFK579;Z2L^Z6DP39�> MC>303FE@bBD576 ^-MCGR6:P39 /�P7R - BD9�UD9@CBD[cP39�BDUOPA@ �9 UDM�03XCP 6p6DM"9 4R6:9=S; 576DUd;3M�4T@C5K=6:M 57=3[F703;39�@ X�B89@b6D9B b@CBD579�6 ^ MCG]>SBDM�23F794�U � N PS9UD9$904R6D9=3U85KM�=3U"5K=S[FK0S;39 6:PS9a@b235KF7576 ^ 6:M >H9B /GIM�B84�B89X�B89U8UD5KMC= � YZB803[ 1C9�BW9�6W@CF �^- � "H" ��-S/R[cP �M�Fd1bM�>SGp9�6V@CF �Z- � "�"H" � -14�0SF76:5 / [�FE@CU8U%[FE@bUDUD5 JA[@ 6:5KMC=� � 9�U86:MC=_@C=3; � @b621 5K=3U8- � "H" B � -LGI9@b6D03BD9"UD9�FK9[�6:57M�= � � 9U86DM�= 9�6W@CF �Z- }b~�~+� � -R@C=3;T6DB:@C=SUD;303[�6:57M�=� `$@C4�4�9BD4T@C=�9�6�@CF �Z- � "H" B - CML@b[cP35K4�U9- � "�"H"�- � M�F7FKM�2H9B 6 9�6a@CF �^- }C~�~HG�� - � 576DP35K=�6DP39 /QP!RM�>S6D5K4�5dc@b6:57M�= �>%Z6DP39B8UVPA@ �9 904R6D9=3;39�;�/�P7R UV6:M U 6:BD0S[�6:0SBD9;<;A@b6:@ ;35KB89[�6DF7^ � N @CUM1b@bBV9�6"@CF �Z-

Page 29: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�H�

}C~�~ �-]e-F76:0S=+9�6�@CF �Z- }C~�~ �- N UDMR[cPA@C=L6c@bBD5K;S5KU 9�6�@bF �^- }C~�~ # � @C=S; 6DP3BDMC03X�Pe1C9�BD=39�FVGI03=3[�6D5KM�=SU� �@�@51Q1CM�FK@ @C=3; W @C0SUDUDF79B8- � "H" B - �d9UDF75K9 9�6T@CF �^- }C~C~L} - }b~�~ � � /R6D5KFKF MC6DP39B8U�9 4R6:9=S; /�P7R U6:M�4�03[cP<FE@bBDX�9�BV>3BDM�2SFK94�UV2L^?4 @.1R57=3X UD[@CFE@b23FK9 @CF7X�M�B8576:PS4TUN@C=3;<5K4�>3FK9�4T9�= 6:@b6:57M�=3U � \%FE@b686 -� "H"�"�- CML@C[cP3574TU8- � "H" B � -]2HMC6:P 5K=!6:9B84TUaMCGW6D5K4�9T@b=3; U86DM�B:@bX�9 � N P39_@ b@C5KFK@C2357FK576 ^ MCGWG @bU86 -GIBD9�9 /�P7Ry5K4�>3F794�9=L6c@b6D5KM�=SUWPA@CU @C[[�9FK9�B:@b6D9;�5 6:U-@C[[�9>S6:@C=3[�9 � N P39 /�P7RyPA@CU"2 9�[M�4�9 U8M4T@C5K=3U 6:B89@C4 6:P3@b6W[�FE@CU8UD57J3[@b6D5KM�=TUD9B�R5K[9�U"@CBD9-M�� 9�BD9�; GIM�BNGIBD9�9ZM�= 6DP39 � 92 � \]@ RFK5K;S5KUN9�6 @CF �Z-}C~�~ # � �e =3Mb6:P39�B�@C[�6D5 �9 @bBD9@ZMbG 4T@C[cP357=39NF79@CB8=35K=SXZBD9�UD9@bBD[cP�PA@CU%2H99= X�9�=39BD@b6:5 �9V>3B8M�2A@C2S5KFK57U86D5K[

4�M1;39�FK57=3X�@C=3; X�B:@b>3P35K[@CFW4�M1;S9FKU � \O9@CBDF - � "H" B - CM�BD;3@C= @b=3; � 5KUDPSM�> � � �p@b6D9=L6 C@bBD5E@b23FK94�M1;39�FKUN@CBD9 6 ^R>357[@CF7F7^�PA@C=S;3FK9�;_2 ^ 9041>H9[�6:@b6:57M�=_4T@L415K4�5dc@ 6:5KMC= � YZ94�>3U 6:9BN9�6 @CF �Z- � " � � � MCBb@CBD5K@b6:57M�=A@CFH4�9�6:PSM1;3U � CM�B8;A@C=<9�6-@CF �^- � "H"H" � OIMCG � P35K[cPba R 5KU @b=<9 4S@C4T>SFK9 S �

�"9�[9�= 6DF7^5- 6DP39B89<P3@ C9?2 9�9= C@bBD5KMC03U @b686:94�>S6DU�6:M 4T9�BDX�9 ;35KU8[BD574T57=A@b6D5 �9 @C=3; X�9�=39B /@b6D5 �9 6D9[cP3=357Q 039U � �@�@.1�1bM�FE@<@C=3; W @C0SUDUDF79B8- � "H" B - �@C@51Q1CM�FK@<9�6�@CF �Z- � "H"H"�@�- }C~�~�~ - C92A@CBD@@C=3; \O9=L6DFE@C=3;@- � "H" B - C92A@CBD@�- }C~�~ #L@�- N @CUM1b@bB 9�6 @CF �^- }C~�~ �- e-F76D03= 9�6_@CF �Z- }C~�~ � � N P357U6:B89=3;?B89 �A9�[�6:U 6:PS9�;39U85KBD9Z6DM 9041>3F7M�576V>SBD5KMCBX1 =3M � FK9�;3X�9 MCGp6:P39�57=3>30S6 ;S5KU86DBD57230S6:57M�=U-1@C=3;_6:PS96:9�=3;39�=3[�^?6:M �N@CBD; @ 03=35 JA9;<X�9=S9B:@ 6:5 C90/ ;35KU8[BD574T57=A@b6D5 �9-FK9@CBD=357=3X >A@CBD@C;357X�4 �

YZ039 6DM 6:P39 >3BDM�F757GI9�B:@b6D5KM�=jMCG = 034�9BDMC03U_;A@b6:@ UD9�6:U_>H9B86:@C5K=S5K=3X!6:M 6DP39�U:@b4T9�U89�6DU MCG9=L6D576:579U8- 9 � X �^- >3B8MC6:9�5K=3U8- 1b9BD=S9F [M�4 235K=A@ 6:5KMC= 6:9�[cP3=35KQ 039�U � \]@ RFK57;35KU_9�6<@CF �^- }b~�~+� - }b~�~L} -� BD57U86D5E@C=357=35]9�6a@CF �^- }C~�~�} -��p@C=3[ 1 BD579�6a9�6a@CF �Z- }b~�~L} --%Z=3X<9�6a@CF �Z- }C~�~AG - N UD03;A@<9�6a@CF �Z- }b~�~AG -/1M�=S=39= 2303B8X 9�6N@bF �^- }C~�~�� @ � @CB89"2H9[�M�4�5K=3X >HM�>303FK@CB �]YZ039V6:M 6:P39�5KB�@C23U 6:BD@C[�6D5KM�= GIBDMC4 FK9@CBD=�/5K=SX @CF7X�M�B8576:PS4TUV@b=3; 6:PS95KB 4T@b6:PS94T@b6:57[@CFs>SBDM�>H9B 6:5K9�U9- [MC4�235K=S5K=3X 1C9�BD=39�FKU 57U"@TBD9@CUDMC=A@C23F79@C>3>SBDML@C[cPj6:M FK9@CBD=S5K=3X�GIBDMC4�P39�6D9B8M�X�9=S9M�03UT;A@b6:@ � � 9?UDP3MC03FK;j4 @.1C9 @!;357U86D5K=3[�6:5KMC=+2 9 /6 � 99= [�M�4�2357=35K=3X 1C9�BD=39�FKU�@b=3;�>3B8M�23FK9�4�MCG �8F79@CB8=35K=3X ��6DP39<1C9�BD=39�F � � PA@b6Z4T@C=L^<BD9�GI9B-6DM@CU FK9@bBD=357=3X$6DP39 1b9B8=39F 5KUW@b[�6:03@CFKF ^ FK9@CBD=357=3X$UDM�4�9 [�M�4�2357=A@b6:57M�= MCG 1C9�BD=39�FKU X�5 C9= � � > �`HL> � �% G 6:9�=U-S9 �9= 6DP39 1b9BD=S9Fs[�M�4�2357=A@b6:57M�= 6:9[cPS=35KQ 039�U �NMCB21 � 576:PD1C9B8=39F 4 @b6DBD57[9U O `�B:@b4 4 @L/6:B85K[�9U S -]U8M 6:PS9�^ [MC4�235K=S9 1b9BD=S9F 9�b@CFK03@b6:57M�=3U9-pBD@b6:P39�B$6DPA@C= 1C9B8=39F�GI03=3[�6:57M�=3U �'W"M �N9 �9B8-UDMC4T9�[�M�4�2357=A@b6D5KM�=<GI03=3[�6D5KM�= 5KUZ03U80A@CF7F7^<FK9@CBD=39�;U-sU8M 6:P39 [�M�4�2357=39;�1b9BD=S9F�[@C= 2 9�9 b@CFK0�/@b6D9; GIM�B�6:9U 6$904S@C4�>3FK9�U 6:@51C9�= GIBDMC4g6:PS9TUD@C4T9 57=3;35 R57;30A@CFC1C9B8=39F�GI03=3[�6:57M�=3U9-pX�5 �9�=!6DP3957B

Page 30: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� }

b@CFK0S9U � N P39T/SY�\ @C>3>3B8ML@C[cP � � @b=3[ 1 BD5K9�6 9�6$@CF �Z- }C~�~L} � 57U 6:BD@C=3UD;S03[�6D5 �9.-pUDM?576 [@C= 2H9=39�J36GIBDMC4 1 =3M � 5K=3X 6:PS9 6D9U 6-9 4S@C4T>SFK9U ;30SBD5K=SX 6DB:@C57=35K=SX �

� (�� f �%� �������"�a#����� � �wz���������

N P39VB894T@C5K=3;S9B MCGA6:P39 6:P39�UD5KU]5KU�M�B8XL@C=35Zc9�;�5K=L6:M"6:P3B899V[cPA@b>S6:9�BDU%;3BD@ � =�GIB8M�4 M�03B]>S0323FK57UDP39�;@C=3; UD032S4T5 6D6:9�; � M�B21 M�= [M�4 235K=357=3X'1C9�BD=39�FKU @C=S; @<GIMC03B86DP [cPA@b>S6:9�B 6:PA@ 6a[�M�=3[�FK03;39�U 6:PS96:PS9UD57U"@C=3;<;35KU8[03U8UD9U GI0S6D03BD9 � M�B21��

� PA@C>S6D9B } 5KU-@C=�9�4T>357BD57[@CFdU 6:03;S^ MCG%F79@CB8=35K=SX � 5 6:P PS9�6:9�BDM�XC9=39�M�03U�;A@b6:@ � N P39�>A@b> 9�B;39@CFKU � 576:PT[M�=S5K["[M�4�2S5K=A@b6D5KM�=SU MCGU1C9B8=39F7UW[MC= 6:@C5K=S5K=3X$;A@b6:@aGIBDM�4 ^C9@CU 6V>3B8MC6:9�5K= U89Q 039�=3[9@C=3;!U86DBD03[�6:03B89 � � 9�[@CFKFO6:P357U�U86c@ 6:5KMC=A@CB8^f1C9�BD=39�F [�M�4�2357=A@b6D5KM�=�2H9[@C03U89�6DP39 [M�4�2S5K=A@b6D5KM�=� 95KXCP 6DU ;3M =SMC6 b@CB8^ @b[BDMCUDU 6:P39?5K=S>30S6 UD>3@C[9 ��a 415KU 6:5K=SX�6:9[cPS=35KQ 039�U @ b@C5KFK@C23FK9�6:M 2357M�F^/M�XC^ BD9�UD9@bBD[cP39�BDU-G @bFKF 57=L6:M 6:P357UW[@ 6:9XCM�B8^ � N PS5KU U86D03;S^_57UV5K4�> M�B 6c@C=L6N2 9�[@C03U89a>SB:@C[�6:576D5KM�=S9BDU4T@ ^ =3MC6$PA@ �9T@C[�[9U8U$6DM_6:P39�4TMCBD9�[�M�4T>SFK5K[@b6:9�;!/SY�\)U8MCG 6 �W@bBD9T@C=3; �NMC03FK;!=3MC6$2H9 5K=!@>HM�UD5 6:5KMC=!6DM >H9B8GIMCBD4 @ [�M�4T>3@CB:@b6D5 C9T9 C@bFK0A@b6D5KM�= MCGN6:P39�6:9[cPS=35KQ 039�U � N P39TFE@C[ 1 MCGNGIBD99�F7^@ b@C5KFK@C23FK9VU8MCG 6 �N@CBD9�@b=3; 6:PS9-6:574T9 [�M�4T>SFK90415 6 ^ MCGdM�>S6D5K4�5dc@b6:57M�= 4 @^�2H9 UDF7M � 5K=3X 6:P39Z@C;3M�>�/6:57M�=+MCG 4�03F76D5^/ 1C9B8=39F FK9@CBD=357=3X�6:9�[cP3=357QR0S9U9-N230S6�M�03B B89UD0SF76:U 57=3;35K[@b6:9 6DPA@b6 =39�9;j=3MC6�2H96:PS9 [@bUD9 � \ = 6DP35KU"UD9�6ZMCG%9 41> 9�BD5K4�9=L6DU9- 57=�@CF7Fd230S6-6:P39a4TM�U 6 >H9B��9�BDUD9 [@CUD9�U9-H6:P39aUD5K4�>3F79U866:9�[cP3=357QR0S9�>H9B GIM�BD4�U C9B ^ �N9�FKF � N PS5KUZB89UD0SF76 UDPSM�03FK;�U8>A@CBM1 UDMC4T9�57=L6:9B89U 6 5K= 6DP39 @C>3>3F75K9�;[MC4T4�0S=3576 ^ � � 9 @bFKUDM UDP3M � UDM�4�9 [�M�=3;35 6:5KMC=3U 03=S;39B � P357[cP�6:P39 4�M�B89 [MC4T>3F75K[@b6:9�;�/SY�\6:9�[cP3=357QR0S9 UDPSM � U"576DU U86:B89=3Xb6:P � \ =�@C;3;S576:57M�=U- �N9$>3BD9�UD9�= 6Z@�B89U803F76 6:P3@b6"UDP3M�0SFK;<9=3[�M�03B:@bX�9>3BD@C[�6D576:57M�=39�BDUZ6:M<03U89 @C;S;3576D5KM�=A@bF]>A@CB 6:5K@CF�5K=1GIM�BD4T@b6:57M�= � P39�= 576 57U MCGNXCM1MR; QR03@CFK5 6 ^ � /103[cP5KUV6DP39a[@CUD9$BD9�XL@CB8;35K=3X�>3B8MC6:9�5K=<U86:B803[�6D03BD9a;A@b6:@�- � P35K[cP 5KU 5K=<BD9�FE@b6D5 C9F7^ UDP3MCB86-UD03>3>SF7^ � N P39/�P7R �W@bUW@C23F79"6DMa4T@51b9 03U89 MCGp@b= @C;3;S576:57M�=A@CF�1C9B8=39F 4 @ 6:BD5 4 � 5 6:P @bUN4�03[cP @CUNP3@CF7G MCGs6:PS9;A@b6:@ 4T57UDUD57=3X �

� PA@C>S6D9B �;39�UD[�BD5K2H9U 4T@L415K4 034 9=L6:B8M�>L^+;35KU8[B85K4�5K=A@b6D5KM�=!5K= ;39�6:@C5KF @C=3; ;39�BD5 C9U M�0SB=3M�=SU86c@ 6:5KMC=A@CB8^'1b9B8=39F [M�4 235K=A@ 6:5KMC= � � 9�@CF7UDM�>3BD9�UD9�= 6 ;39B85 b@b6D5KM�=3UVGIM�B-@TU89Q 039�= 6D5E@CF 4�5K=�/5K4T@CFsMC>S6:574T5Zc@b6D5KM�= >SBDMR[9;S03BD9$GIM�B M�03B FE@b6D9=L6 Rfa�Y `$@b03UDU85E@C=<4T5 4R6:03B895- @C=3; UDPA@bBD9$9041> 9 /

Page 31: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

BD579=3[�9U BD9�XL@CB8;35K=3X 6DP39 5K4�>3FK9�4T9�= 6:@b6:57M�= �� PA@C>S6D9B # >3BD9�UD9=L6DU_M�03B =SM C9F-=3M�=3U 6c@b6D5KM�=A@bB8^ 1C9�BD=39�FZ[M�4 235K=A@ 6:5KMC=j6D9[cP3=357Q 039�5K= @

[MC4T>A@bB:@b6D5 �9aU86D03;S^ � 5 6:P�U 6c@b6D90/ MbG / 6:PS90/ @bB86"6:9[cPS=35KQ 039�U � N PS9 94�>35KB85K[@bF B89U803F76DU�@CBD9a6c@51b9=M �9�B 5KF7FK03U 6:BD@b6:5 �9�U8^R=L6:PS9�6:57[ ;A@ 6c@TU89�6DU9- [�M�4�4TM�=?2H9=3[cPS4 @CBM1?;A@b6c@�UD9�6:U9- @C=3; @TBD9@CF^/ �NMCBDFK;2357M�5K=SGIMCBD4T@b6:57[UZ;A@ 6c@?UD9�6 � N P35KU$BD9�UD9@CBD[cP 57U$6DP39 JABDU 6 >30S23FK57UDP39�; � M�B21 M�=!=3M�=3U 6c@b6D5KM�=3@CB8^1C9�BD=39�Fd[M�4 235K=A@ 6:5KMC=_@C=3;_M�>H9=SU 6DP39 �N@ ^TGIM�BNGI03B 6:P39�BVBD9�UD9@bBD[cP<5K= 6:PS9�;35KB89[�6D5KM�=_MbG �8@C;A@C>�/6:5 �9 �!MCB�5K=3>S0S6M/ ;39>H9=3;S9=L6 1C9B8=39F [�M�4�2357=A@b6:57M�=3U���"=3;39B B8M�03X�PSF7^!6:P3B899_GIM�03B 6:P3U MCG"6:PS99041>H9B85K4�9=L6c@CFd[�M�=3;35 6:57M�=3U9-16:P39 =3M�=SU86c@ 6:5KMC=A@CB8^ [M�4�2S5K=A@b6D5KM�=_MC0S6:>H9B GIM�BD4�9;?904157U86:57=3X 6:9�[cP�/=357QR0S9U � N PS9�[cPA@C>S6D9B�[�M�=L6c@C57=3U-6DP39�BD9�UD03F 6:U�@b[[9�>S6:9�;�GIM�B >30S23FK57[@b6D5KM�= @C=3; @C=�@C;3;35 6:5KMC=A@CF@CUV^�9�6"03=3>3032SFK5KU8P39;<BD9�UD03F 6 �

� PA@C>S6D9B G [�M�=3[�FK03;39�U�6:P39T6:P39�UD5KU 2 ^ UD0S4T4T@CBD5Zc57=3X MC03B�[MC= 6DBD57230S6:57M�=+@C=S; BD9 1579�� 57=3XM�03BVB89U803F76DU � � 9$@CF7UDM >3B89UD9�=L6 U8M�4T9 >HM�UDU85K23F79ZGI0S6:0SBD9�;357BD9[�6:57M�=3UWGIM�BW6DP39 �NM�BM1��

Page 32: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� #

� � ��� ��� �

� � ��� � � � � �� � � � � � � ��� � � � � � � ���

\ =�6:P357U�[cPA@C>S6D9B8- � 9 >3BD9�UD9�= 6a@_[MC4T>A@bBD5KU8M�=�MCG UDMC4T9�9 415KU86D5K=3X_6D9[cP3=357Q 039U�GIM�B�[�M�4�2357=35K=3X1C9�BD=39�FKU�� N P39U89�6D9[cP3=S5KQ 039U 03U89�@ [M�=357[ [M�4 235K=A@ 6:5KMC= MCG 1C9�BD=39�F%4 @b6DBD57[9U�� N PS9�^�;3M?=3Mb694�>3F7M ^ =3M�=3U 6c@b6D5KM�=3@CBD5 6 ^$- 5 � 9 �^- 6DP39�[M�4 235K=A@ 6:5KMC= �N9�5KX�PL6:U ;3M"=3MC6 b@CB8^ZM C9Bp6:P39�57=3>30S6 UD>3@C[9 �6-MC=39�6DP39F79UDU8-%6:P39 /SY�\w6D9[cP3=S5KQ 039 � � @b=3[ 1 BD5K9�6�9�6 @CF �^- }C~�~L} � 57Ua6:PS9 [0SBDBD9�=L6 U86c@ 6:90/ MCG / 6DP390/@CB 6 � N P39�>SBD5K4T@CB ^ ;3B:@ � 2A@C[ 1 U MCGp03U85K=3X�/1Y�\j@bBD9 6DP39 6:574T9"BD9�Q 035KB89; GIM�B 6:P39ZMC>S6:574T5Zc@b6D5KM�=@C=3; 6DP39 FK@C[ 1�MCG @aGIBD9�9F ^ @ b@C57FE@C23F79 5K4�>3FK9�4T9�= 6:@b6:57M�= � � M�B >SB:@C[�6:576D5KM�=S9BDU 5K= [�M�4�>30S6c@ 6:5KMC=A@CF2357M�FKM�Xb^$- 5K= � P35K[cP�FK@CBDXC9a;A@ 6c@TU89�6DU�@C=3;�4 03F76D5K>3F79 1b9B8=39F7U�@CBD9$[MC4T4�M�=U- 6:P39�UD9�;SB:@ � 2A@C[ 1 UMCG�/SY�\ [@C=3=3MC6 2H9 5KX�=SM�BD9�; �N P39NGIM�F7FKM � 5K=SX"9�4T>S5KBD57[@CFLU 6:03;1^ �N@CU]U803234�576D6D9; 6DM-6DP39 �8M�03B8=A@CF( ��`H�� ?-� HL> B�5E ��� K � �p9 � 5KU8-

C923@CB:@�-1@C=3; 6-M�23F795- }C~�~C� [ � � � 9 2H9FK579�C9-6:P3@b6 6DP35KU >3BD@CX�4T@b6:57["[�M�4�>A@CBD57UDM�=TMCG /SY�\ 6DM 6:PS9904R6DBD94�9F ^ U85K4�>3FK9"03= � 95KXCP 6D9;?[MC4�235K=3@b6:57M�= � 57FKF 2H9ZMCG�b@CFK0S9-6:Ma6:P39�@b>3>3FK579;T[M�4�4�03=35 6 ^ �

� ( � mp� #��������� V#%���T�

\ 6Z57U 2L^ =3M �|@ 6:B8035KU84�6DM >HM�5K=L6-M�0S6 6DPA@b6 235KM�F7M�X�57[@CFs;3@b6c@ 57U 2H957=3X >3B8M1;S03[9�; @b6�@ BD@C>357;B:@ 6:9 � �d9U8U�M�2 R5KM�0SU9-�23016�9Q 0A@bFKF7^ ;3@C03=L6:57=3X3-]57U$6DP39 FK@CBDXC9 b@CB85K9�6 ^ MbGW6 ^R> 9�U�MCGV2357M�FKMCX�5K[@CF;A@b6:@a2H957=3X >3B8M1;S03[9�; � N BD@C;35 6:5KMC=A@CFAU86:@b6:57U86D5K[@bFA4T9�6:P3MR;3U 6DPA@b6N@CUDU8034�9�` @C03UDU85E@C=T;35KU 6:B85K230�/6:57M�=3U8-dM�B 9=3X�57=399�BD57=3X_4T9�6:P3MR;3U�6:P3@b6$@CUDU8034�9 C9[�6:M�B$M�B�4T@b6:B85^4 5K=3>3016 ;3M =SMC6 M�2 R5KM�03U8F7^

Page 33: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

��G

X�9�=39BD@CFK5Zc9 6:M�;A@b6c@�UD9�6:UZ[�M�4T>SBD5KU89; MCG b@CBD5K@C23F790/ F79=3Xb6:P_U86DBD57=3X�U9-��9�[�6DM�BDUZMbG%BD9@CFp=R0S4�2 9�BDU8-6:B899�UN@C=S; =39�6 �NM�BM1 U � � M�=3U89Q 039=L6DF7^$-S4�03[cP B89[�9=L6 � M�B21 P3@CU GIMR[0SUD9;TM�= 6:P39";39�C9F7M�>34�9=L6MCGdU 6c@b6D5KU 6:5K[@CF @C=3;T[M�4�>30S6:@b6:57M�=A@CFS4T9�6:P3MR;3U�6:PA@b6N@CB89-[@C>A@C23F79-MbGs;3BD@ � 57=3X 57=SGI9B89=3[�9U GIBDM�4FE@bBDX�9.-3P39�6D9B8M�X�9=S9M�03U"2357M�FKM�XC5K[@bFH;3@b6c@ UD9�6:U �

C 9BD=S9F�4T9�6:P3MR;3U � /1[cP �M�FZ1CM�>SGN9�6 @CF �^- � "�"H" � >3B8M 157;39�@<>SBD5K=S[5K>SFK9;�4�9@b=3U�6:M<BD9>SBD9U89=L6@C=3; P39=S[9 ;3BD@ � 5K=SGI9�BD9�=3[9�UaGIBDMC4 ;35 C9BDU89T6 ^R>H9U�MCGW;A@b6c@ � e 1b9B8=39F 4T9�6:P3MR; B89>3B89U89=L6:U@_[M�F7FK9�[�6:57M�=�MCGN@CBD2S576:BD@CBD57F7^<[MC4T>3F7904 ;3@b6c@_M�2 �89�[�6DUa2L^ 03U85K=3X<@?UDM./ [@CF7FK9;�1b9B8=39F%GI03=3[�6:57M�=6:P3@b6 ;39�J3=39U 6:P39�U85K4�5KFK@CBD5 6 ^ 2 9�6 �N9�9=�@b= ^ X�5 C9=<>A@C57BWMCG M�2 �89�[�6:U�� \ =?>3BD@C[�6D5K[�95-S6DP35KUV4�9@C=SU6:P3@b6�@ [�M�FKF79[�6:5KMC= MCG���M�2 �89�[�6:U [@C=�2H9�U80 ��[5K9�=L6:F7^<B89>3B89UD9�=L6:9; R5E@T@C=��'/ 2L^Q/���4T@b6:B85^4MCG]>A@C5KB�� 5KU89 1b9B8=39F b@CFK039�U � N P35KU 1C9�BD=39�FO4T@b6DBD5^4�-3PS9=3[�95-H>3BDM R5K;39�U @ UDMCB86-MCG�=3MCBD4T@CF GIM�B84 I@CUVF7M�=3X @CUW@ b@CF75K; 1C9B8=39FsGI0S=3[�6D5KM�=_[@C=?2 9�;39�JA=39�;<MC= @�XC5 �9�=?;A@b6c@ 6 ^R>H95-S6DP39=<@C=L^ UD03[cP;A@b6:@TU89�6-[@C= 2 9aBD9>SBD9U89=L6:9�; @CU-@ 1C9�BD=39�FO4T@b6DBD5^4 � C 9�BD=39�FO4�9�6DP3MR;3U @bBD9a@CFKX�MCBD576DP34�UN6:PA@ 6M�>H9BD@b6:9 M�='1C9�BD=39�Fp4 @b6DBD57[9U8-3B:@ 6:P39�B 6DPA@C=?M�=?6:P39 BD@ �);A@b6:@ MC2 �89[�6:U 6:P39�4TU89F C9U��

� ^!G @CB$6DP39 2H9U 6M/ 1R=SM � = 1b9BD=S9FN4�9�6DP3MR; 5KU 6:P39 UD03>3>HM�B 6 �9�[�6DM�B�4T@C[cP35K=S9TO /�P!RTSa@CF^/X�M�B8576DP34 � � M�UD9�B 9�6�@CF �Z- � "�" } -IP @C>3=35Z1]- � "H" B - � BD57U86D5E@C=357=35d@C=S; /1PA@ � 90/ N @^RFKM�B8- }C~C~�~ � � N P39/�P7R�5KU-@ UD03>H9B�R5KUD9�; [FE@bUDUD5 JA[@ 6:5KMC= @CF7X�M�B8576:PS4�6:PA@ 6ZFK9@CBD=SU 2L^ 9 4S@C4T>SFK9 6:M ;357UD[�BD5K4�5K=3@b6:9@C4�M�=3X 6 � M M�BW4�M�BD9 X�5 C9=_[FK@CUDU89UVMCG ;A@ 6c@ � � 5 6:P357= [M�4�>30S6:@b6:57M�=A@CFH2357M�FKM�Xb^$-1/�P!R<U"P3@ C92H99= @C>3>3F75K9�; 6DM @b= 57=3[B89@CU85K=3X b@CBD579�6 ^�MbGW>3B8M�23FK9�4TU8-p5K=3[�FK03;357=3X_BD9�4TMb6:9 >3BDMb6:957= P3M�4�M�F^/M�XC^ ;S9�6:9�[�6D5KM�=U- b@CBD57M�03U�6 ^R> 9�U MCGVXC9=39�9041>3B89UDU85KM�= @C=A@CF ^1U89U8-�UD>3F75K[�9�U8576D9 @C=S; @CF 6:9B8=A@b6D5 �9UD>SFK5K[�5K=3X ;S9�6:9�[�6D5KM�=U-36:@C=3;39�4 4T@CUDUVU8> 9�[�6:B8M�4�9�6:B ^<@C=A@CF ^RUD5KU8-39�6D[ ��� 6-M�23F795- }b~�~ # � �\ =TMCBD;39�B�6:M$@C>3>3F ^ @C=T/�P7R 6DM$@ PS9�6:9�BDM�XC9=39�M�03U ;A@b6c@�U89�6 -Q1b9BD=S9FKU�4�0SU86�2H9";S9�JA=39�;�GIMCB

9@b[cP ;A@b6c@"6 ^1>H95- @b=3; 6:PS9 1C9�BD=39�FS4T@b6:B85K[9�U]4�0SU86�2H9N[�M�4�2357=39;�@CFKX�9�23B:@b5K[@bFKF7^ � � M�BO9 4S@C4T>SFK95-\]@ RFK57;35KUD=0E �5A��T03U89;!6:P357U @C>3>3B8ML@C[cP 6:M<[M�4�2S5K=39 4�5K[�BDML@CB8B:@^�XC9=39 9041>3B89U8UD5KMC= ;A@b6:@ @b=3;>3PL^RFKM�XC9=39�6:5K[ >3B8MCJAF79U 5K=!@C= 03= � 95KXCP 6D9; G @bUDP357M�=U-p@C>3>SF7^R5K=3X?4T@b6:PS94T@b6:57[@CFOM�> 9�B:@b6DM�BDUZ6DMGIMR[03U�6:P39 /�P7R M�= � 576DP35K=�/ ;A@b6:@L/ U89�6�[MCBDBD9�FE@b6D5KM�=SU�@C4TMC=3X�GI9@b6D03BD9�U � P357FK9 5KXC=3M�BD57=3X�[MCBDBD9�FE@L/6:57M�=3U 2 9�6 �N9�9= ;A@b6:@-U89�6:U � \O@ RF75K;357UO9�6%@CF �Z- }C~�~E� - }C~�~L}�� � e =�03= � 957X�PL6:9; U8034wMCG]1C9�BD=39�FKU�PA@bU@CF7UDM�2H99�=<0SUD9;?U803[[�9UDU GI03FKF ^ 57= 6:P39 >3BD9�;35K[�6:5KMC= MCG >3BDMb6:957=�/ >SBDMC6D95K=T5K=L6:9�B:@C[�6:57M�=3U � � 9�=�/ W"03B@C=3;b6-MC23FK9.- }C~�~AG � �

Page 34: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� �

�"9�[9�= 6DF7^5- U89�C9B:@bF B89U89@CB8[cP X�B8M�03>3U�PA@ C9T>3B8M�>HM�UD9�; B ��A E�� � Ad=*;+=0>0?@=0ACAd=#�5> ?�� ?!$ O R C � S4�9�6:PSM1;3UO6:PA@b6�[M�4�2S5K=39 1b9B8=39F7U � 5 6:P357= 6:PS9"/�P!R @CF7X�M�BD5 6:P34 5 6:U89F7G � �p@C=3[ 1 BD579�6�9�6�@CF �^- }b~�~L} -� @C[cP 9�6�@bF �^- }C~�~ #3-�%Z=3XT9�6Z@CF �^- }C~�~AG - /RM�=3=39�=R2S03BDX 9�6�@CF �Z- }b~�~�� @�-�C9�2A@CB:@�- }b~�~ #�2 � � N P39�UD94�9�6:PSM1;3U?GIM�B84�03FE@ 6:9!@ U85K=3X�F79 M�>S6:574T5Zc@b6D5KM�= >SBDMR[9;S03BD9!6:PA@b6 UD574�03F 6c@C=39�M�03U8F7^ JA=S;3U 6:PS9/�P7R [FK@CUDU857JA[@b6:57M�=+UDMCFK0S6D5KM�=j@CU � 9FKF @bU � 957X�PL6:U M�= 6:P39<5K=3;S5 R5K;303@CFN;A@ 6c@�6 ^1>H9U�5K= 6:PS9P39�6:9B8M�X�9�=39M�0SU UD9�6 � � @b=3[ 1 BD5K9�6 9�6a@CF � � }C~�~L} � GIM�BD4 03FE@b6D9�6:P39 >3B8M�23F794.03U85K=3X<UD9�4T57;39�J3=3576D9>3B8M�X�B:@b4T4�5K=3X�- � P39B89@CU �$%Z=3X 9�6 @CF �Z- }C~C~AG�� GIM�B84�03FE@ 6:9 6:P39T>3BDMC23FK9�4 03UD57=3X U894�5^/ 57=SJA=35 6:9FK57=39@bB]>3B8M�X�B:@b4T4�5K=3X � N PS9UD9-@C>3>SBDML@C[cPS9U�PA@ �9"2 9�9=�UD03[�[9�UDU8GI0SF 57= C@bBD5KMC03U�2357M�5K=SGIMCBD4T@b6:57[U6c@bU21 U9-15K=3[�FK03;357=3X�^�9@CU86N>3BDMC6D957=�GI03=S[�6:57M�=A@CF [�FE@CU8UD57J3[@b6D5KM�= � � @b=3[ 1 BD5K9�6W9�6W@CF �Z- }b~�~ #�2U- @ � - >3BDM./6:9�5K=�U 6:BD0S[�6:0SBD9 [FK@CUDU857JA[@b6:57M�= � � M�BDX �W@CB8;S6�9�6$@CF �^- }C~C~AG�� - >3B8MC6:9�5K=�UD0S2 [�9FKF703FE@bB FKMR[@bFK5dc@b6:57M�=��� 5K9=<@C=S; %Z=3X�- }C~�~�� � @C=3; @CF76D9B8=A@b6:5 �9ZU8>3FK57[57=3X BD9�[M�X�=S576:57M�= � /1M�=3=39�= 2303BDX�9�6-@CF �Z- }C~�~�� 2 � �\ =_X�9=S9B:@bF`-IR C ��4�9�6DP3M1;SUN6:PA@ 6V@CU8UD5KXC= �N9�5KX�PL6DUN6:M�57=3;35 157;30A@CF ;A@ 6c@a6 ^R>H9UVPA@ �9�U8M�4�9

>3BD@C[�6D5K[@bFR;S5KU:@b; b@C=L6c@CX�9�U � N P39V/SY�\ @C>S>3BDML@b[cP�MCG��p@C=3[ 1 B85K9�6 =0E �5A��]BD9�Q 035KB89U�FK@CBDX�9 @C4�M�03=L6DUMCGS4T9�4TM�B ^ � N P357UO>3B8M�23F794 �N@CU 9UDU89=L6:5K@CFKF ^�UDMCF �9�; 2L^ � @C[cPa9�6O@CF � � }b~�~ # � -b2S0S6p6:P39 BD9�UD03F 6:5K=SX@CF7X�M�BD5 6:P34�5KU U 6:5KF7FdQ 03576D9$U8FKM � � % 6:PS9B R C � 4T9�6:P3MR;3U-@CBD9$@CF7UDM�UDF7M � � � 0SB86:PS9BD4�M�B895- @CF7FsMCG6:PS9UD9a@CF7X�M�BD5 6:P34�UW@bBD9�4�M�BD9�[�M�4T>SFK5K[@b6:9�; 6:M >3B8M�X�B:@b4�6:PA@b= @ U85K4�>3FK9 /QP!R �N P39 [03B8BD9�= 6 � M�B21 @C5K4�UT6DMj@C=3U � 9B_6DP39�Q 039U 6:5KMC= I @CB89�R C � 4�9�6DP3M1;SU �NMCB86:P 6:PS9

@C;3;S576:57M�=A@CF 9 � M�B869- B89FK@b6:5 �9 6:M 03U85K=3X @C= 03= � 95KXCP 6D9; U8034�MCG:1C9�BD=39�FKU�� � 03B 6:P39�BD4�M�BD9.- 5 GR C ��4�9�6:PSM1;3U @CB89-03U89�GI03F -R6DP39= �N9 �NM�0SFK; F75d1b9"6DMa2H9Z@C2SFK9V6:Ma[cPA@CB:@b[�6:9�BD5Zc9-6DP39"UD576D0A@b6D5KM�=3U5K= � P357[cP<6DP39�^ UDP3M�0SFK;<2 9 03U89; �N M�@C=3U � 9Ba6:P357UaQ 039�U86:57M�=U- �N9 GIMR[0SUaM�= @ >A@CB 6:57[03FK@CBZ6c@CUM1 I >3BD9�;35K[�6:5K=SX�`�9=39 %Z= 6DM�F^/

M�XC^ O ` %!SV6D9B84TUZ0SUD5K=SX_@ [M�4 235K=A@ 6:5KMC= MCG @b4T57=3M @C[�5K;�U89Q 039�=3[9�@C=3;�>SBDMC6D95K= U86:B803[�6D03B:@bF5K=1GIM�BD4T@b6:57M�= � N P35KU$6c@CUM1 PA@CU$5K=L6:B85K=3U85K[ 5K=L6:9�BD9�U86 I [M�=3U85K;39�BD57=3X 6DP39 @C4�M�03=L6$MCGV9 � MCB86a[03B /BD9�=L6:F7^ 2H957=3X!9041> 9�=3;39�; M�= 57=SGI9B8BD5K=SX!>SBDMC6D95K=jU86DBD03[�6:03B89U8-"5 6 5KU�5K=L6:9�BD9�U86:57=3X 6:M Q 0A@b= 6D57G ^6:PS9T9 416D9=L6 6DM � P357[cP >3B8MC6:9�5K=!U86DBD03[�6:03B89 5K4�>3B8M C9U$03>HM�= MC03B @b235KF7576 ^<6:M ;SB:@ � 5K=1GI9BD9�=3[9�U@C2HM�0S6 >3B8MC6:9�5K=3U8-dBD9�FE@b6D5 �9a6:M?5K=SGI9�BD9�=3[9�U$;SB:@ � =�GIBDM�4gUD9Q 039�=3[9 @CFKMC=39 � � 0SB86:PS9BD4�M�B895-s6:PS9>3B8M�23FK9�4 PA@CUN6 � M [cPA@CB:@b[�6:9�BD57U86:57[UN6DPA@b6W@CBD9Z0SUD9�GI0SFs5K=�6:P39�[�M�=L6:904R6VMbG 6DP35KU U86D03;S^ � � 57BDU 6 -R2 ^BD9�U86DBD5K[�6:57=3XTMC03BDU89F C9U"6:M 6 �NM 1C9B8=39F7U9-H576"5KU >HM�UDU85K23F79�6:M�9041>3FKMCBD9$U8^RU86D94T@b6:57[@CF7F7^ 6DP39$UD>A@C[�9

Page 35: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� �

MCG">HM�UDU85K23F79 FK57=39@bB [MC4�235K=3@b6:57M�=3U �!/R9[MC=3;U-�UD57=3[9 � 9 1 =3M ��6:P3@b6 U86DBD03[�6:03B89_5KU�XC9=39�B:@CF7F7^4�M�BD9 5K=1GIM�BD4T@b6:5 �9W6DPA@C= U89Q 039�=3[9.- �N9-[@C=T9041>H9[�6NBD9@CUDM�=3@C23F7^ [�M�=3U85KU86D9=L6 2 9�PA@ 157M�B MCGsM�0SB1C9�BD=39�Fp[M�4�2S5K=A@b6D5KM�=SUV@C[B8M�UDU-@ � 5K;39 b@CB85K9�6 ^_MCGO[FE@bUDUD5 JA[@ 6:5KMC= 6c@CUM1RU��

%Z03B 9 41> 9�BD5K4�9=L6DUNUDPSM �!-RJABDU 6 - 6:PA@ 6N>3B8MC6:9�5K=�U86DBD03[�6:03B89Z5KU�4�M�BD9 5K=1GIM�BD4T@b6:5 �9.-L5 � 9 �^-14�M�BD9>3B89;357[�6:5 �9TMCGWGI03=3[�6:57M�=U-]6DPA@C= >SBDMC6D95K= UD9Q 039�=3[9 � N P357U 5KU @C= 9 41> 9�[�6:9�;U-�230S6 [M�4 GIM�B86D5K=3XBD9�UD03F 6 � N PS9 U86DBD03[�6:03B89D1b9BD=S9F�6:PA@b6 � 9T9�4T>3F7M ^�03UD9�UVR e RTR % N W �$%ZB86:5Zc 9�6 @CF �^- }C~�~L} � -� P357[cP�5KU-@TU 6:BD0S[�6:0SB:@CFO@CFK57X�=34�9=L6-@CFKXCM�BD5 6:P34�6:PA@b6-[MC=3UD57;39B8UZM�=3F ^_6:P39a>3BDMC6D957= 2A@C[ 1 2HM�=39.-5KXC=3M�BD57=3X 6DP39_UD57;39?[cPA@C5K=SU�6:PA@b6 ;S5 � 9B @C4�M�=3X�@b4T57=3M @C[57;3U � W-9=S[95-�6:PS5KU�1C9�BD=39�F`- 2L^+576DU;39�UD5KXC=U-s5KU-G @C5KB8F7^?5K=S;39>H9=3;S9=L6$MCG�6:P39�U89Q 039�=3[9 1C9�BD=39�F �<6"M�=39�6:P39�FK9U8U9-d9 �9= � 576DP3M�0S6ZUD5K;S9[cPA@C57= 5K=1GIM�BD4T@b6:57M�=U-�6DP39ZU86DBD03[�6:03B8971C9�BD=39�Fs>3BDM R5K;S9UW2H9�686:9BNBD9[�M�X�=35 6:57M�= >H9B GIM�BD4T@C=3[�9-6:P3@C=6:PS9ZUD9�QR0S9=3[�9"1b9BD=S9FsM�=?@bFKF GC� ` % 6D9B84TU 6:PA@b6 �N9�[�M�=3UD57;39B�� N P39U89Z6:9�BD4�UW[M�4�9 GIB8M�4�@CFKF6:PSBD99<` % P35K9�B:@CB8[cP35K9�U � 4�M�F79[0SFE@CB GI03=3[�6:5KMC=U-%235KMCFKM�X�57[@CF%>SBDMR[9U8U�@C=3;+[9�FKF703FE@CB$[MC4T>A@bB86M/4�9=L6 �\O9�BDPA@C>SUZ4TMCBD9 UD03B8>3BD57UD57=3X�F7^5- �N9$JA=3; 6DPA@b69- GIMCB 6DP35KU 6 � M./ 1b9BD=S9FO6:@CU21]- 6:P39$03= � 95KXCP 6D9;

@ �9�B:@CX�9 MCG 1b9B8=39F7U >H9B8GIMCBD4�U�U8FK57X�PL6:F7^��0=0E E =0>�6:PA@b= @ 4TM�B89?UDM�>3PS5KU86D5K[@b6:9�; 4�9�6:PSM1; 6:PA@ 6@CU8UD5KXC=3U �N9�5KX�PL6:U 6:M 6DP39!1C9B8=39F7U � \ =3;39�9;U-H2L^_U8^RU86D94T@b6:57[@CF7F7^ [M�=3U85K;39�BD57=3X C@bBD5KMC03UVBD9�FE@b6D5 �9� 95KXCP 6DU9- � 9 @CB89"@C23FK9 6:M$;394�M�=3U 6:B:@ 6:9W6:P3@b6 -LGIM�B�6DP35KU%>A@bB86:57[03FK@CB]6:@CU21]- =3M!1C9�BD=39�F^/ � 957X�PL6:57=3XUD[cPS94�9a[@C= >H9B GIM�BD4n4�03[cP<2 9�6D6D9BV6:PA@b=<6DP39 UD5K4�>3F79Z03= �N9�5KX�PL6D9; U8034 MCGC1C9�BD=39�FKU �

%Z= 6:P39 MC6:PS9B]P3@C=3;U-b5K=�@ GIM�FKF7M � / 03>$9041>H9BD574T9�=L6 - � 9W;39�4TMC=3U86DB:@b6D9 6:P3@b6 R C �_57UO57=3;399�;P39�FK>SGI03F 5K= U8M�4�9Z[57BD[0S4TU 6c@C=3[�9U�� /1> 9�[5 JA[@CF7F7^5- � 9�[M�=SUD5K;S9BN6DP39�[@CU89Z5K= � P35K[cP<@C;3;S576:57M�=A@CF -=3M�57U8^ 1C9�BD=39�FKU @CB89Z@C;3;S9;_6:M 6DP39�UD9�Q 039=3[�9$@C=3;_U86DBD03[�6:03B8971C9�BD=39�FKU ��e-U �N9 @b;3;_4TMCBD9 =SM�5KU896:MT6:P39aU8^RU86D94 - 6:P39a> 9�B8GIM�B84 @b=3[9aMCG�6:PS9�03= �N9�5KX�PL6D9; @ �9�B:@CX�9 ;39�6D9BD57M�B:@ 6:9U�� \ =�[�M�=L6:BD@CU869-6:PS9 �N9�5KX�PL6:9�; 1C9B8=39F$@C>S>3BDML@b[cP F79@CB8=3U 6DM+;3M � =�/ � 957X�PL6_6:P39�=3MC5KUD9�1b9B8=39F7U9-Z@b=3; P39=3[�9[MC= 6D5K= 039�U"6DM � M�BM1 �N9�FKF �

� 5K=3@CFKF ^$- 5K=�@ U89>A@bB:@b6D9�9041>H9BD574T9�=L6 - � 9 5K= �9�U86D5KXL@b6D9 6:PS9�> 9�B8GIM�B84 @b=3[9aMCG 2 MC6DPT1C9�BD=39�F[MC4�235K=3@b6:57M�=_4T9�6:P3MR;3UV57=?6DP39 >3BD9�UD9�=3[9aMCG]4�5KU8UD57=3X ;A@b6:@ � \ = >3BD@C[�6D5K[�95- � 9aP3@ C9aU89Q 039�=3[95K=1GIM�BD4T@b6:57M�= GIM�BV4T@C=L^_4�M�BD9�>SBDMC6D95K=SU 6DPA@C= �N9$PA@ �9$U86DBD03[�6:03B89 57=SGIM�BD4T@b6D5KM�= ��/103[cP 4T57UDU_/5K=SX�;A@b6:@ 5KU [M�4�4TMC= 5K= X�9=3MC4T9 / � 5K;S9 ;A@b6:@ UD9�6:U8-A@C=3; 6DP39Z>3B8M�2A@C2357FK5 6 ^ 6:PA@b6W@C=L^ MC=39ZX�9�=39

Page 36: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

��B

M�BV>3B8MC6:9�5K= � 5KF7FsPA@ �9$4�5KUDU85K=3X ;A@b6c@ 5K=S[BD9@CUD9�U"@CU �N9$5K=3[�FK03;S9�4TM�B89�;A@b6:@ 6 ^R>H9U"5K=<@ UD57=3X�FK9[FK@CUDU857JA[@b6:57M�= 9 41> 9�BD5K4�9=L6 �7W-9�=3[9.-d576Z57U 57= 6D9B89U86D5K=3XT6:M_@CUM1 PSM � � 9F7F�@C= /QP!R�> 9�B8GIM�B84TU� P39�=!MC=39�MCG%6DP39<1C9�BD=39�FKUZ57= 6:PS9�[M�4 235K=A@ 6:5KMC= [�M�=L6c@C57=3UZ4�5KUDU85K=3XT;A@b6:@ � \ =�X�9�=39BD@CF`- P3M � /9�C9B8-S/QP!R U%;3M =3MC6%>3B8M 157;39V@ 4�9[cP3@C=35KU84 GIMCB�PA@C=3;SFK5K=SX 4�5KUDU85K=3X-;A@b6:@ � � 9W[MC=3UD57;39B]6DP3BD9�9UD574T>SFK9�6:9�[cP3=35KQ 039�U GIM�B BD9�>3BD9�UD9�= 6D5K=3X 4T57UDUD57=3X�904S@C4�>3FK9�U-57= @ 1C9B8=39FO4 @ 6:BD5 4 � %Z03B"9041> 9�BD5 /4�9=L6:U";3M =SMC6";39�JA=S576:9�F7^_U8P3M � 6:PA@ 6-MC=39aMbG]6:PS9UD9$6:P3B899 6:9�[cP3=35KQ 039�UZ5KU 2H9U 6 YHP3M �N9 �9B8- � 9;3M ;S94�M�=3U86DB:@b6D9$6DPA@b69- 03U85K=3X @C=L^ MbG�6:P39$6:P3B899�>SBDM�>HM�UD9�;�4�9�6:PSM1;3U GIM�B"PA@C=3;SFK5K=SX 4�5KUDU85K=3X;A@b6:@ @C=S; 03U85K=3X 9576DP39Ba@ �N9�5KX�PL6:9�; M�B$03= �N9�5KX�PL6D9;e1C9�BD=39�F [�M�4�2357=A@b6D5KM�=U-d6DP39_/�P7R >H9B /GIM�B84 @C=S[9";39X�BD@C;39�UNG @C5KB8F7^ X�BD@C;30A@bFKF7^ @CU 6DP39 >H9B8[9=L6:@CX�9�MCGd4�5KU8UD57=3Xa;3@b6c@ 57=T6DP39ZU86DBD03[�6:03B891C9�BD=39�Fp5K=3[�BD9@bUD9U��N P35KUN94�>35KB85K[@bFAU86:0S;S^_@C574TU�6:M >3BDM R5K;39 X�035K;3@C=3[9"6:M�0SUD9B8UVMCGO/�P7Rh[FE@bUDUD5 JA9B8U9-S@CU � 9FKF

@CU%6:M U803X�X�9�U86 @ �9= 039�U GIM�B�GI0SB86:PS9B�BD9�UD9@bBD[cP ��\ 9BDP3@C>3U M�03B�4TMCU86�5K4�>HM�B86:@C=L6�>3BD@C[�6D5K[@bF3[M�=�/[F703UD57M�=?5KUW6DPA@b6 6:P39 U85K4�>3FK9.-303= �N9�5KX�PL6D9; U8034 MCGC1C9�BD=39�FKU"[@C= >3BDM R5K;39 B894T@CB21 @C23F ^ B8M�2303U 6[FK@CUDU857JA[@b6:57M�=!> 9�B8GIM�B84 @C=S[9 � %Z=3F7^ � PS9= � 9 03U89; @ B89FK@b6:5 �9F ^ FE@CB8X�9�[M�F7FK9[�6:57M�= MCGV;A@b6:@6 ^R> 9�U9- � 576DP UDM�4�9 ;A@ 6c@ 6:P3@b6 � 9BD9_F79U8U BD9F79�b@C=L6�6DM 6:P39 6:@CU21 @b6 P3@C=3;U-�;357;+@ �N9�5KX�PL6D9;1C9�BD=39�F [M�4�2S5K=A@b6D5KM�=+4�9�6DP3MR; @b;3; b@CF7039 � N PS9 >3B85K4T@CB8^ 2H9=39�J36 MbG-6DP39?M�>S6:574T5Zc57=3X 6:PS9� 95KXCP 6DU �N@CU-6DM 9�FK5K4�5K=3@b6:9�@ 1C9�BD=39�FO[�M�4T>SFK9�6D9F ^ � N P357U-U803X�X�9�U86DU 6:PA@ 6 U8M�4T9$9041>H9B85K4�9=L6c@L/6:57M�= � 5 6:P 5K=3;35 R5K;30A@bF 1C9B8=39F7U�4T@ ^ B89;30S[9 B89FK5K@C=3[�9TM�= M�>S6:574T5Zc@b6D5KM�=�U8MCG 6 �N@CBD9 �=%Z=3[9 @UD9�6 MCG�BD9�FK9 C@b= 6 1C9B8=39F7U�5KU-UD9F79[�6:9;@-d03= �N9�5KX�PL6:9�; [�M�4�2357=A@b6D5KM�= 4 @^<2 9 UD0 ��[579=L6 � `�5 �9�=6:PS9 FKM � [MC4T>3016c@b6D5KM�=A@bF [�M�U86�MCGV6:P357U @C>3>SBDML@C[cP@-%576aUD99�4TU �N@CB8B:@C=L6:9�; � %Z03B�B89UD0SF76:U�@CFKU8MUD0SX�X�9U 6$[@C0S6D5KM�=�57= 5K=L6:9�BD>3B89�6:57=3X 6:PS9 UD>H9[5 JA[ �N9�5KX�PL6DUa@bUDUD57X�=39�; 6DM?9@C[cP!;A@b6:@ 6 ^1>H9 2L^ @� 95KXCP 6D9;'1C9�BD=39�Fd@C>3>SBDML@C[cP@-3UD57=3[9 6DP39 /�P7R.> 9�B8GIM�B84 @C=S[9 ;SM19�UV=3MC6 b@CB ^ ;SB:@C4T@b6:57[@CF7F7^ @bU6:PS9 1b9B8=39F�� 95KXCP 6DU-[cP3@C=3X�9 �

� ( � o �� ������# ��� �

� 9 >3B8M R57;39 P39�BD9�@a23BD579�G - =3M�=�/ 6:9�[cP3=35K[@CF M C9B R579�� MCGs6DP39 /�P7R -RGIMCFKFKM � 9;T2 ^T;39�UD[B85K>S6D5KM�=SUMCGA6DP39N6 � M�4T9�6:P3MR;3U]GIM�BOPA@C=3;SFK5K=SX P39�6:9B8M�X�9�=39M�0SU%;A@b6c@ � R M�B89W;39�6c@C57F1M�= /�P!R U�@b=3;<1C9�BD=39�F

Page 37: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� "

4�9�6:PSM1;3U-[@C=�2H9aGIMC03=3;�57=U- 9 � X �Z- � B85KU 6:5E@b=35K=35p@b=3;!/1PA@ � 90/ N @^RFKM�B � }C~C~�~ � -s/1[cP��M�Fd1bM�>SG 9�6Z@CF �� � "H"H" � �

��������� ������ ������������� �������� "!#��$

e >S>3F7^R5K=SX�@C= /�P!R 6DM @�[FE@bUDUD5 JA[@ 6:5KMC= >3BDMC23FK9�4y[�M�=3UD57U86DU MCG 6 �NM >3PA@bUD9U I 6:BD@C5K=357=3X�@b=3;>3B89;357[�6:57M�= �OYZ03BD57=3X 6DB:@C57=35K=3X�- 6DP39 /�P7R 6:@51C9�U�@CU�57=3>30S6�@-;A@b6c@ZU89�6%57= � P357[cP�9@C[cP 904S@C4�>3F795KU-@�J�4S9�;�/ F79=3Xb6:P C9[�6:M�B�� � 03B 6:P39�BD4�M�BD9.-H9@C[cP�9 43@b4T>3F79a4 03U86-PA@ �9 @b=�@CU8UDMR[5E@ 6:9; 235K=3@CB8^FE@b2 9�F � � 9 03U89�� � � �!6:M ;39=3Mb6:9 6DP39 >HM�U8576:5 �9<[FK@CUDUT@C=3; � / � � 6:M ;39=3Mb6:9 6DP39 =S9XL@b6D5 C9[FK@CUDU�� \ G$9@C[cP C9[�6:M�B_[�M�=L6c@C57=3U&% C@bFK039�U9- 6:P39�= � 9�U:@^ 6:PA@b6_6DP39�;A@ 6c@ BD9�UD57;39U_57= @C=%D/ ;S5K4�9=3U85KM�=A@bF UD>3@C[9$[@CF7FK9�; 6:P39 � ? ����E K � �!� = �N P39 /�P!R.6:BD@C5K=357=3X @CF7X�M�B8576:PS4�U89@CB8[cP39U"GIM�B @ >3FE@b=39 O M�B8- � P39�='%)( @ PL^R>H9BD>SFE@C=39 S

5K=?6:PS9a57=3>30S6"UD>3@C[9$6:PA@b6-UD9�>A@CBD@b6:9�U-6:PS9a>HM�UD5 6:5 �9�GIBDM�4 6DP39$=39XL@ 6:5 C9a9 4S@C4T>SFK9U�� �d9@CB8=35K=SX6:PS9M�B ^ U803X�X�9�U86:UO6:PA@b69- � P39�= 4 @b= ^$U803[cP PL^1>H9B8>3FE@b=39U�9 415KU869-L@C=�MC>S6:574 @CFL>SBDMR[9;S03BD9WU89F79[�6DU6:PS9NPL^R> 9�BD>3FK@C=39 6DPA@b6O5KUpG @CB86DP39U 6]GIB8M�4w@C=L^ 6:B:@b5K=357=3X-9 4S@C4T>SFK9 � N P357U]>A@CB 6:57[03FK@CBdPL^1>H9B8>3FE@b=395KU 1 =3M � = @CU-6DP39DB�+* � B ��B B�5>�$ � ?�F � �I=0> � A �5?@= � N P39�>SBDM�23F794 MCG�UD9F79[�6:5K=SX3-HGIMCB @ XC5 �9�=;A@b6:@_UD9�69-s6:P39 4T@L415K4�0S4 4T@CB8X�5K=�PL^R>H9BD>SFE@C=39 [@C= 2 9�GIM�B84�03FK@b6:9�; @C=3; UDM�F �9�; 9 �T[�5K9�= 6DF7^03U85K=3X-QR03@C;3B:@ 6:5K[ >3B8M�X�B:@b4T4�5K=3X � N P35KU M�>S6D5K4�5dc@ 6:5KMC=�[M�=3U 6:5 6:0S6D9UO6DP39V/QP!R�6DB:@C57=35K=3X >3P3@CUD9 �W @ R5K=3X�57;39=L6D57JA9�; 6:P357U�UD9�>A@CBD@b6:57=3XZPL^R> 9�BD>3FK@C=395-�6DP39W>3B89;357[�6D5KM�=�>SPA@CUD9 6c@51b9U�@CU�57=3>30S6�@

UD9�[M�=S; ;A@b6c@"UD9�6%MCGAF79=3XC6DP�/�% �9[�6:M�B8U � N P39 X�ML@CF MCGA6DP35KU >3PA@bUD9W57U 6DM >3B89;357[�6]6DP39W@bUDUDMR[5K@b6:9�;� � � / � FK@C2 9�F�GIM�B 9@C[cP�MbG36:P39�6:9�U86]904S@C4�>3FK9�U ��\%B89;357[�6:57M�=$5KUO@C[[�M�4T>SFK5KU8P39;$2L^$UD5K4�>3F ^ @CU21 57=3XM�= � P357[cP UD57;39�MCG 6:P39 U89>A@CBD@b6:57=3X PL^1>H9B8>3FE@b=39a9@C[cP?6:9U 6"904S@C4�>3FK9ZG @CF7FKU��N P35KU ;S9UD[�BD57>S6:57M�= MCG-6DP39</�P7R @CF7X�M�B8576:PS4 FK9@ C9U M�0S6 4T@C=L^ ;39�6c@C57FKU8- 2S0S6 UDP3MC03FK; 2H9

UD0 �T[�5K9�= 6�GIM�B%MC03B%UD032SUD9Q 039�=L6W;357UD[0SUDUD57M�= � R<M�U86 =3MC6:@C23F ^$- � 9"P3@ C9-=SMC6�;39U8[B85K2H9;�P3M � 6:PS9/�P7R �NM�BM1 U � P39=�=3M_U89>A@bB:@b6D5K=3XTP ^R>H9B8>3FE@C=S9�90415KU 6:U�� � BD579 �3^5- 6:PS5KU U8576D0A@b6:57M�= 57U PA@b=3;3FK9�;5K=_6 � M �N@^1U�� N P39�JAB8U86-UDM�F70S6:57M�=_5K= CM�F C9U"5K=L6:B8M1;30S[5K=SX @�U8M./ [@CFKF79; �8U8MCG 6"4 @CB8X�5K=@- � � PS5K[cP@CF7FKM � U�@�UD0S23UD9�6 MbGH6DP39W6:BD@C5K=S5K=3X-;A@b6c@ 6DMZG @CFKFRM�= 6:PS9 ��� BDM�=SX ��UD57;39WMCG 6:PS9VP ^R>H9B8>3FE@C=S95YR9 � X �Z-@ GI9�� 9 43@b4T>3F79UZFK@C2H9FK9�; � � � � 4�5KXCP 6-FK579 M�=�6DP39 � / � � U85K;39�MbG 6DP39�PL^R> 9�BD>3FK@C=39.-p@C=3; R5K[�9�9�BDUD@ � N PS9$U89[�M�=3;<UDM�F70S6:57M�=_5K= �MCF �9�U 5K=L6:B8M1;30S[5K=SX @V1b9B8=39FdGI03=3[�6:57M�=U- � PS5K[cP �N9 ;39�UD[B85K2H9

Page 38: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

}C~

=39 416 �

��������� � �� !#��� ��� ���#���$

`�9=39�BD5K[@CFKF ^$- @*1b9B8=39FHGI03=3[�6D5KM�=T5KU UD5K4�>3F ^ @$GI03=S[�6:57M�= 6DPA@b6 ;39�JA=S9UW6:PS9 UD574T57FE@CB8576 ^a2 9�6 �N9�9=@ X�5 �9�=+>A@C5KB$MCG M�2 �89[�6DU � YZ9�=3MC6:9�;�� O�����S0-]@ FE@bBDX�9 C@bFK039�5K=3;S5K[@ 6:9U$6:PA@ 6 � @C=3;�� @CB89UD574T57FE@CB8-R@C=3;<@ UD4T@CFKF C@bFK039Z57=3;357[@b6D9UW6:P3@b6V6:P39�^?@CB89�;35KU8UD5K4�5KFK@CB � \ =?6:P39�[�M�=L6:9 416-MCG 1C9�BD=39�F4�9�6:PSM1;3U 57= 4 @C[cPS5K=39_F79@CB8=35K=3X�-�6:P39'1C9�BD=39�FVGI03=3[�6D5KM�= 4�0SU86 PA@ �9<[9�B86:@C5K= 4T@b6:P39�4 @ 6:5K[@CF>3B8M�> 9�B86D5K9U8YV=A@C4�9F ^$-%GIM�B @CF7FN>HM�UDU85K23F79_;A@b6c@ UD9�6:U8- 6:PS9<4T@b6DBD5^4 MCG @CFKF / RU_/ @CFKF 1C9�BD=39�F C@bFK039�U4�03U 6 P3@ C9 =3MC=�/ =39�XL@b6D5 �9.-NB89@CF 957X�9= b@CF7039U8- � P35K[cP 9=3U803BD9�U 6:P3@b6 6:P39b1C9B8=39F"5KU�@ C@bFK5K;4�9�6:B85K[ �N P39_GI03=3;A@b4T9�= 6:@CFV5K;S9@�MCG @�1C9B8=39F 4�9�6DP3M1;+57U UD574T>3F79 230S6 U8M�4�9�� PA@b6�U8032S6:F79 � /1@ ^

6:P3@b6 ^CM�0 PA@ �9 @ [�M�FKF79[�6D5KM�=<MCG�� C9[�6:M�B8U9-d9@b[cP!MbG�FK9=SXC6:P % � N PS5KU ;3@b6c@ [@C=�2H9 � BD5 6D6:9�=@CU"@C= %D/ 2L^+/�� 4T@b6:B85^4 ��`�5 C9= @V1b9B8=39FdGI03=3[�6:57M�=�� O����� S0- �N9$[@C=<[MC4T>3016:9Z6:PS9$U85K4�5KFK@CBD5 6 ^2H9�6 � 99=�@CF7F1>3@C5KB8U]MCG C9[�6:M�B8U%5K= 6DP39W;A@b6:@ UD9�6 � N PS9UD9[1b9B8=39F b@CF7039UO[@C=�6DP39= 2H9 � B8576D6D9= @bU@C=�� / 2L^Q/���4 @ 6:BD5 4�-S[@bFKFK9�; 6:P3971b9B8=39Fp4T@b6:B85^4 � � M�B @C=<@CF7X�M�B8576:PS4 6:M 2 9 @�1b9BD=S9Fd4�9�6:PSM1;U-576 4�0SU86 2 9"> MCUDUD5723FK9V6DMaU8P3M � 6:PA@b6 6:PS9:1b9BD=S9F 4T@b6DBD5^4�5KU @aU80 ��[579=L6WB89>3B89UD9�=L6c@b6D5KM�=TMCGs6:PS9;A@b6:@ � \ =�MC6:P39�B � M�BD;SU9-s5 G%@C=�@bFKX�M�B8576DP34 5KU @ 1b9BD=S9F�4�9�6DP3M1;@-H6DP39=�5 6 U8P3M�03F7; 2H9�> MCUDUD5723FK96:M ;357UD[@CBD;_6:PS9$MCBD5KXC5K=A@CF ;A@ 6c@ 4 @ 6:BD5 4_@b=3;?U86:57FKF BD03=_6:PS9a@bFKX�M�B8576DP34b- 03U85K=3X M�=SF7^ 6DP3971C9�BD=39�F4T@b6:B85^4 �N P39<[@C=3MC=35K[@CF 1C9�BD=39�FVGI03=3[�6D5KM�=j5KU�6DP39?UD[@CFE@CB >SBDMR;303[�6fO @ � 1�� @ �+6:P39?;3Mb6 >3BDMR;303[�6TMCB

�9�[�6DM�BZ>3B8M1;30S[�6 S�� O�����S ������� � � � � N P 03U9-p@ 1C9B8=39FO4T9�6:P3MR;�57UZ@C=�@bFKX�M�B8576DP34�6:P3@b6Z[@C=2H9 � BD5 6D6D9=�;3M � =�57=�UD03[cP @ �W@^<6:PA@b6Z@CFKFp;A@ 6c@ C9[�6DM�BDUZ@C>3>H9@CB � 576:PS5K=�@TUD[@bFE@CB->3BDMR;303[�6M�>H9BD@b6:57M�= � N M �M1b9BD=S9FK5Zc9 �?6DP39 @CF7X�M�BD5 6:P34 -��N9 6:PS9=!UD5K4�>3F ^ B89>3FK@C[9�6DP39 UD[@CFE@bB�>3BDMR;303[�6M�>H9BD@b6:57M�= � 576DP?6DP39!1C9�BD=39�F GI03=S[�6:57M�=�� �

/10323U 6:5 6:0S6D5K=3X 6:P39 1C9�BD=39�FHGI0S=3[�6D5KM�= GIM�B%6:P39"UD[@CFE@bB >SBDMR;303[�6 M�>H9BD@b6:57M�= 5KU�03UD9�GI03FH2 9�[@C03U89576 57U 4 @b6DP394T@b6D5K[@bFKF7^�9�QR0S5 b@CFK9�=L6"6DMT>SBDM �89�[�6:57=3X 6:P39$;A@b6:@ U89�6-5K=L6:MT@ ;35 � 9B89=L6 U8>A@C[�9 �V/1@ ^6:P3@b6 6:P39 5K=S>30S6 UD>3@C[9�PA@CU %�;S5K4�9=3U85KM�=3U8-d230S6 � 9T03U89�@<Q 0A@C;SB:@b6D5K[�1C9�BD=39�F GI0S=3[�6D5KM�= ;39 /JA=39�; @CU � O��!�3S � O"����� � � � S � � \ = 6:P357U$[@CUD9.-�� 9 @bBD9�5K4�>3FK57[576DF7^ � M�B21 57=3X 57= @?UD>3@C[9�MCG

Page 39: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

}E�

% � ;35K4�9=SUD5KMC=3U � N PS5KUWP357X�P39�B_/ ;S5K4�9=3U85KM�=A@bFHU8>A@C[�9�5KUW[@CFKF79; 6DP39 � =#�5E ��> = K � �!� =0-S@C=3;_5K=T6:P357U904S@C4�>3F795-s5 6�[M�=L6:@C5K=3U�MC=39 ;35K4�9=SUD5KMC= GIM�B�9�C9B ^�>A@C57BZMCG ;35K4�9=SUD5KMC=3UZ5K=�6DP39 5K=S>30S6 UD>3@C[9 �N P357U*1C9�BD=39�FN[@C= 6:P 03Ua[@C>16:03B89 >A@C57B � 5KU89T[�M�BDB89FK@b6:57M�=3U 2 9�6 �N9�9=+57=3>30S6 C@bBD5E@b23FK9�U �_e 1C9B /=39�FK5dc�9; C9B8UD5KMC=�MCG%6:P39�/�P!R�@bFKX�M�B8576DP34 JA=3;3U-6:P39�4T@L415K4 034 4 @bBDX�57= PL^R> 9�BD>3FK@C=39�57= 6:PS9GI9@ 6:03B89 UD>A@C[�95- UD574T>3F ^<2 ^�UDM�F 157=3X 6:PS9�MCBD5KXC5K=A@CF M�>S6D5K4�5dc@b6:57M�= >SBDM�23F794g03UD57=3X<@?;S5 � 9BD9�=L61C9�BD=39�FdGI03=3[�6D5KM�= �

��������� � ����� "! "!������ !#� � $

% G 6:9�=U-Q1C9B8=39F7UW@CB89 03UD9�GI03F 2 9�[@C03U89-6DP39�^�@CF7FKM �j6:P39 /�P!R 6:M JA=3;T@$U89>A@bB:@b6D5K=3X$PL^1>H9B8>3FE@b=395K= @_;A@ 6c@_UD9�6�6:PA@b6 �N@CU >3B89�R5KM�0SUDF7^ 5K=3U89>A@bB:@C23F79 � C 9�BD=39�FKU�4T@^�@CF7UDM?@CF7FKM � 03UZ6:M?9=S[MR;39>3B85KM�B[1 =3M � FK9�;3X�9 @C2 MC0S6 6:P39 ;A@b6:@�- UD03[cP�@CUV6:P39 1 =3M � FK9;SX�9$6DP39$>A@C5KB�� 5KU89$[�M�BDB89FK@b6:57M�=3U @CB895K4�>HM�B86:@C=L6 � \ =_6DP39�[03B8BD9�= 6 � M�BM1 -APSM � 9�C9B8-�� 9$@CBD9 >A@CB86D5K[�03FE@CB8F7^ 57= 6D9B89U86D9;<5K= 6DP3971C9�BD=39�FGI03=3[�6:57M�= @CU @ �N@^ 6DM�9=3[�M1;S9 UD574T57FE@CB8576D5K9U @C4�M�=3X =SM�=�/ C9[�6:M�B @C=3; P39�6:9�BDM�X�9�=39MC03U�;A@b6:@UD9�6:U��

� 5KB8U869- � 9Z=3MC6D9 6:PA@ 6 @CF76DP3M�03XCPT6:PS9Z;35KU8[03U8UD57M�= 6:P 03UWG @CB PA@CUNGIMR[0SUD9;?M�= C9[�6:M�BW;3@b6c@�-S@1C9�BD=39�F GI03=3[�6:57M�= [@b=_2 9-;39�JA=S9;_GIM�BW@b= ^ @CB823576DB:@CB85KF7^�[M�4�>3FK9 4T;A@b6c@aM�2 �89[�6 � N P 03U8-I1C9B8=39F7UPA@ �9�2H99�= ;39�JA=S9; GIM�B Y76"e.@C=S; >3BDMC6D957= UD9�QR0S9=3[�9U9- >3BDMC6D957=�/ >3B8MC6:9�5K= @b=3; 4�9�6c@b2 M�F75K[=39�6 �NM�BM1 U9- >3PL^RFKM�X�9�=39�6D5K[�6:B899�U9-A9�6D[ ��� 6-M�23F795- }C~�~ # � e UVFKMC=3X @CUVM�03BV[�M�FKF79[�6:5KMC= MCGO;A@b6c@ [@C=2H9aB89>3B89UD9�=L6:9;!@CU-@TU8Q 0A@CBD9"1C9�BD=39�F]4T@b6:B85^4�-36:P39�=�@C=L^'1C9�BD=39�F]4�9�6DP3M1; [@C= 2 9a@C>3>SFK5K9�;<6DM6:PS9 ;A@b6:@ � N P39 1b9BD=S9FN4T@b6DBD5^4�5KU 6:P 03U @<UDM�B 6�MCGV=SM�BD4T@CF%GIM�BD4.GIMCBaB89>3B89UD9�=L6:5K=SX�;35 C9BDU896 ^R> 9�U-MbG];A@ 6c@ �

/19[�M�=3;U-%6DP39 4T@b6:PS94T@b6:57[U$MCG 1C9�BD=39�FKU @CF7FKM � U$03U 6:M ;39B85 �9 =39�� 1C9�BD=39�FKU�2L^ [M�4 235K=�/5K=SX<6 � M�M�B$4TM�B89V1C9B8=39F GI03=3[�6D5KM�=SU �bR @C=L^!4 @ 6:P39�4 @b6D5K[@CF�M�>H9BD@b6:57M�=3Ua@CBD9�[F7M�UD9�; 03=3;39�B6:PS9 1b9B8=39F >3BDMC> 9�B86 ^ � N P39�4�M�U86 574T>HM�B86:@C=L6�UD0S[cP M�>H9BD@b6:57M�= 5KU @C;3;S576:57M�= I 5 G ��@b=3; � �@CB89T2HMC6:P)1C9�BD=39�F GI0S=3[�6D5KM�=3U8- 6DP39= �N9�[@C= >3BDM C9T6:P3@b6 � O�����S � ��9O ����S � � � O��!�3S 57U@�1C9�BD=39�F � N P357U M�>H9B:@ 6:5KMC= 5KU 4T@b6:PS94T@b6:57[@CF7F7^�9�QR0S5 b@CFK9�=L6 6:M�[MC=3[@b6D9=A@ 6:5K=SX 6DP39 �9�[�6DM�BBD9�>3BD9�UD9�= 6:@b6:57M�=3U"MCG 6:P39�6 � MT;A@ 6c@ > MC5K=L6:U 5K= 6DP39�GI9@b6D03BD9 U8>A@C[9�U-;S9�JA=39�; 2L^���W@C=3; � � �N P35KU 4T@b6:PS94T@b6:57[@CF GIM�BD4T@CF75KUD4 >3B8M 157;39U 03U � 5 6:P @ U 6:BD@C5KX�PL68GIM�B �N@CBD; �N@^ 6:M [MC4�235K=S9

Page 40: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

}�}

P39�6:9B8M�X�9�=39M�0SU ;A@ 6c@ ��`�5 C9= @ U89�6<MCGa>3BDMb6:957=3U_BD9�>3BD9�UD9�= 6D9;w@CU_U89Q 039�=3[9�U�@C=3; U86DBD03[ /6:0SBD9U8- �N9_[�M�4�>30S6:9 @T1C9�BD=39�FW4 @ 6:BD5 4 � �$GIBDM�4 6:P39TUD9�QR0S9=3[�9UT@C=3; @f1b9BD=S9FW4T@b6:B85^4 ���GIBDMC4h6:P39�U86DBD03[�6:03B89U�� N P39 U8034 MCGN6DP39U89T6 � Mf1b9BD=S9F 4 @b6DBD57[9U 57Ua@?=39 � 1C9�BD=39�F 6:P3@b6$UD5^/4�03F 6c@C=S9M�03U8F7^ BD9�>3BD9�UD9=L6DU 6DP39 >3B8MC6:9�5K=�UD9�Q 039=3[�9U @C=3;�U86DBD03[�6:03B89U���e U�4�9=L6:57M�=39�;�5K=�6:PS95K=L6DBDMR;303[�6D5KM�=@-16:PS5KUVUD574T>SFK9ZU8034V/ MCG / 1b9B8=39F7UV@C>3>3B8ML@C[cP<PA@CU 2H99=<03U89;<UD03[�[9U8U8GI03F7F7^5-H9 � X �Z-S6DM>3B89;357[�6 >3B8MC6:9�5K=�/ >3BDMC6D957=�5K=L6:9�B:@C[�6:5KMC=3U�03UD57=3X<@<[�M�4�2357=A@b6D5KM�=�MbGN>3B8MC6:9�5K= UD9�Q 039=3[�9U8-]GI03=3[ /6:57M�=A@CFR@C=S=3MC6c@ 6:5KMC=U-C@b=3;�1 =3M � = >3BDMC6D957=�/ >3B8MC6:9�5K=a5K=L6:9�B:@C[�6:5KMC=3U � � 9�=�/ W"03B%@C=3;<6-M�23F795- }C~�~AG � �\ =_6:P39�[�03BDB89=L6�NM�BM1]- �N9�[�M�=L6:B:@bU86 6:P39�U85K4�>3FK9-UD034�/ MbG / 1C9�BD=39�FKUV@b>3>3BDM�@C[cP � 576:P?@ 4�M�BD9

UDMC>3P35KU 6:57[@b6D9; 4�9�6DP3MR;!6DPA@b6a5K=L6:B8M1;30S[9U � 95KXCP 6DU M�= 9@C[cP 1C9�BD=39�F � �-U85K=3X<M�=39�MCG b@CB85KM�03UM�>S6D5K4�5dc@b6:57M�=_4T9�6:P3MR;3U8- � 9�[@C= UD5K4 03F76:@C=39MC03UDF ^ JA=3; @�UD9>3@CB:@b6D5K=3X P ^R>H9B8>3FE@C=S9�@C=3; JA=3;� 95KXCP 6DUTMC= 9@C[cP 5K=S;35 R5K;S0A@CFX1b9B8=39F � N P39 �N9�5KX�PL6:UT@CB89 [cP3MCUD9= UDM @CU�6DM 4 @L41574T5Zc9 6:PS94T@CBDX�57=�2H9�6 � 99=T6:P39W6 � Ma[�FE@CU8UD9�U � N P357U�@C>3>3B8ML@C[cP�[M�B8BD9U8> MC=3;3U%6:M FK9@CBD=S5K=3X3-C9 � X �Z-L6DPA@b6%6:PS9UD9�Q 039=3[�9"1b9B8=39Fd57UW=3MC6 @bUV5K=SGIM�B84 @ 6:5 C9 @bUW6:P39ZU 6:B803[�6D03BD9!1C9�BD=39�FsGIM�BV@�X�5 �9�=_[FE@bUDUD5 JA[@ 6:5KMC=6c@bU21�� ` 9�M�4�9�6:B85K[@CFKF ^$-�6:PS9b1b9BD=S9F � 957X�PL6 B890/ UD[@bFK9U�9@b[cP ;3574T9�=3UD57M�= MbG�@ X�5 C9=�1b9B8=39F �N P 03U9-d57= 6:PS9 GI9@b6D03BD9 UD>A@C[�9�[MCBDBD9�UD>HM�=3;357=3X 6:M � ��� � } � � - 9@b[cP!MbG%6:P39�;S5K4�9=3U85KM�=3UGIBDMC4 � � 5KUVU8[@CF79;<2L^<@ G @b[�6:MCBVMCG } �

� (�� k � # �������

����� ��� � � !#��� ! ��� � � ��� �� ��$�$ ��$

N P39 ` 9�=39 %�=L6DM�FKM�Xb^ � `�9=S9 %Z=L6:M�F7M�XC^ � MC=3UDM�B 6:57034b- }b~�~�~ � 57U$@ ;35 �9B8UD9�[@b6:@CFKMCX<MbGWX�9�=39O >SBDMC6D95K=IS]@C=3=3Mb6c@b6D5KM�=U- � P35K[cP 5K=S[FK0S;39U%57=SGIM�BD4T@b6D5KM�= @C2 MC0S6%>3B8MC6:9�5K=�GI03=3[�6:57M�=�@C=3; FKMR[@bFK5dc@L/6:57M�= � � 9";39�J3=39�@a`:% 6D9B84�>SBD9;S5K[�6D5KM�=�2H9=3[cP34T@CBM1 2 ^�U 6c@CB 6:5K=SX � 5 6:P @ UD9�6WMCG B � $\�Y �U86DBD03[�6:03B89U8-1>3B803=39�;TU8M 6DPA@b6�=3M�6 � MaU89Q 039�=3[9�UNUDP3@CBD9 X�B89@b6D9B�6:P3@C= GC~ � U89Q 039�=3[9-5K;39�= 6D576 ^� �p5 9�6V@CF �Z- }C~�~E� � �Oe 4�M�=3X$6:P39�UD9 >SBDMC6D95K=SU9- G }HG PA@ �9 ` %)@C=3=SMC6c@b6D5KM�=SU9-R;3M � =3FKML@b;39;�GIBDM�4������� ����� �� �� � ��� � �� � � � M�BO9@C[cP `:% 6:9�BD4� "- �N9 >A@CB 6:5 6:5KMC=39;$6:P39VF75KU86]MCGH>3BDMb6:957=3U%5K=L6DM6:PSBD99 UD9�6DU � � 57BDU 6 -%@CF7F�>3BDMC6D957=3Ua6DPA@b6 @bBD9_@C=S=3MC6c@ 6:9; � 576:P� �@bBD9 FK@C2H9FK9�; @CU �8> MCUD576D5 C9 � �6-9 4R6 - � 9 6DB:@ �9�BDUD9ZGIB8M�4� @CFKMC=3X @bFKF >A@b6DP3UN6:M$6:P39-BDMRMC6 MCGd6:P39Z` 9�=39 %Z=L6:MCFKM�XC^ XCB:@C>3P �%eW6

Page 41: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

}

9@b[cP ` % 6:9B84|@bFKM�=3X-6:P357U�>A@b6DPU- � 9VFKMRM$1�GIM�B�>3B8MC6:9�5K=3U]6DPA@b6�@bBD9V@CU8UD57X�=39; 6DM 6:PA@ 6�6:9�BD4 @b=3;=3MC6 6:M @b= ^TMCGd6DPA@b6N6D9B84 � UN[cP357FK;3B89= � � 9 [�M�=3U85K;39�BN6:PA@ 6WUD0S[cP<>SBDMC6D95K=SUN4�5KX�PL6 2 9->3BDM�>H9B8F7^@CU8UD5KXC=39; 6DM "-�@C=3;+UDM � 9 FE@b2 9�F 6:PSM�UD9 >SBDMC6D95K=SU @CU �80S=3[9�B86c@b5K= � � � 5K=A@CF7F7^5-]@CF7F >SBDMC6D95K=SU6:P3@b6"@CBD9 =3Mb6 M�=<6DP39 >A@b6DP?GIB8M�4 6:M 6:P39 B8M1MC6"@bBD9�FE@b2 9�FK9;<@CU �8=S9XL@b6D5 C9 � �e-G 6D9B 6DP35KU�FK@C2H9FK57=3X<>3BDMR[9�;303BD9.- �N9_9�FK574T57=A@b6:9�; @bFKFN`:%�6:9�BD4�U � 576DP GI9�� 9B�6DPA@C= � ~C~

�8>HM�UD5 6:5 �9 � >3BDMb6:957=3U � \ =+M�BD;39�Ba6DM�@ �M�57; BD9�;303=3;A@b=3[�^5- � 9 6:PS9=+UD9�FK9�[�6:9�;+M�=3F ^!6DP39 4�M�U86UD>H9[�57JA[TMCGN6DP39 B894T@C5K=S5K=3X ` %�6:9�BD4�U9-]5 � 9 �Z- 6:P39�FK9@bGW=SM1;39�U MCGN6:P39�BD9�4 @C57=35K=SX<PS5K9BD@CBD[cPL^ �N P357U�>SBDMR[9;S03BD9_^R5K9�FK;39�; @�6DMC6c@CFNMCG ���� `:% 6:9�BD4�U I } � 4�M�FK9�[03FK@CB GI03=3[�6:57M�=+6:9B84TU8- }�}2357M�FKM�XC5K[@bFs>3BDMR[9�UDUZ6D9BD4�U9- @C=3; ��[9F7FK03FK@CB [M�4�>HM�=39=L6Z6D9B84TU�� e F7F Gb� 6:9�BD4�UZ@CB89 FK57U86D9;�57=6:PS9$U803>3>3F794�9=L6c@bB8^_B89UD0SF76:U"O /19[�6:5KMC= } � � S �

� M�B 9@C[cP `:% 6:9B84b-d6DP39T= 034 2 9�BaMCG =39�XL@b6:5 �9�904S@C4�>3FK9�U�G @CB 9041[9�9;3U$6:P39�= 034�2H9B MCG>HM�UD5 6:5 C9%904S@C4�>3FK9�U � � M�Bd9���[579=3[�^$- �N9�B:@b=3;3M�4�F7^ UD9F79[�6]@VU80323UD9�6]MbG16DP39�=39XL@ 6:5 C9�904S@C4�>3FK9�UUDM 6:P3@b6V6:P39 BD@b6:57M MCG]>HM�U8576:5 �9�U 6DM =39XL@ 6:5 C9U 5KUVMC=390/ 6:M./ M�=39 �

����� ��� � �� !#��� $

N M BD9�>3BD9�UD9�= 6 >3BDMb6:957= U89Q 039�=3[9�U9- � 9!03UD9!6:P39 4�5KUD4T@b6D[cP 1b9BD=S9F � �d9U8FK579!9�6 @CF �^- }C~�~ � �N P357U 1b9B8=39FpX�9�=39BD@CFK5Zc9UV0S> M�=?6:PS9$U85K4�>3FK9�B9-1UD>H9[�6DBD034 1b9B8=39F � �p9�UDF75K9�9�6-@CF �Z- }C~�~L}�� - � PS5K[cPBD9�>3BD9�UD9�= 6DU @ U 6:BD57=3X�@bU @ �9[�6:M�B MCGV[MC03=L6:U MbG @CFKF%>HM�U8UD5K2SFK9�UD0323U 6:B85K=3X�UaMCG @?J�419; F79=3XC6DP� � N P39 4�5KUD4T@b6D[cP)1b9B8=39F�X�9�=39BD@CFK5Zc9U 03>HM�=�6:PS9�U8> 9�[�6DBD034 1b9BD=S9F 2 ^�5K=3[�BD94�9=L6D5K=3X3-sGIMCB9@b[cP M�2SUD9B��9�; � / FK9�=3XC6:P_U 6:B85K=3X O � / 4�9B S0-16DP39 [M�B8BD9�UD>HM�=3;357=3X [M�0S= 6-@CU � 9F7Fd@CUW6DP39�[M�0S= 6DUMCG�@bFKF � / 4�9B8U"6DPA@b6-;35 � 9B GIBDMC4�6DP39 MC23UD9�B �9�; � / 4�9B 2L^�@ 6 4�M�U86�% 4�5KUD4T@b6D[cP39U�� \ = 6:P357U� M�B21]- �N9"03UD9-@ 4T57UD4T@b6:[cP U8> 9�[�6:B8034&1C9�BD=39�F�� 5 6:P � � # @b=3; % � � � N P39"J3=A@CFA4�5KUD4T@b6D[cPUD>H9[�6:B8034 �9�[�6DM�B PA@CU }C~�� � � �C~ ~�~�~ 235K=3U�� N P39 4T57UD4T@b6:[cP_U8> 9�[�6DBD034 [@C>S6D03BD9�U"U89Q 039�=3[9UD574T57FE@CB8576 ^5-N@C=S; PA@CU 2H99�= UDP3M � = 6:M+>3B8M 157;39 XCM1MR; >H9B8GIMCBD4T@C=3[9 5K= [�FE@CU8UD5 G ^157=3X+/ � % \UD0S> 9�B8G @C4�5KF75K9U � �d9�UDFK579�9�6-@CF �Z- }b~�~ � �\ =3UDMbG @CB @CU @�1C9�BD=39�FWGI03=3[�6D5KM�=+;S9�JA=39�U�6DP39_UD574T57FE@CB8576 ^�2H9�6 � 99�= >A@b5KBDU MCG"M�2 �89[�6:U8- 6:PS9

4�M�U86"=A@b6D03B:@bF >SFE@C[�9 6DM 2H9X�57= ;S9�JA=357=3X @ >3B8MC6:9�5K=<U86:B803[�6D03BD9"1C9�BD=39�F]5KU � 5 6:P<90415KU 6:5K=SXT>A@b5KB_/� 5KU89 U 6:BD0S[�6:0SBD9�[MC4T>A@bBD5KU8M�= @CFKX�MCBD576DP34�U � R @C=L^ UD03[cP @CF7X�M�B8576:PS4TU 9 4S57U869-"57=3[F703;357=3X � a

Page 42: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

} #

� /1P35K=S;S^L@CF7M @b=3; � M�0SBD=39.- � "�" B � -VY"e � \ � W"M�FK4 @C=S; /S@C=3;S9B9- � "H"� � @C=3; R e RTR % N W�$%�B 6:5ZcV9�6N@CF �^- }C~�~�}�� � R M�U 6NMCG 6:P39�UD9-@CFKXCM�BD5 6:P34�U�@b686:9�4T>S6�6DMa[�BD9@ 6:9-@C= @bFK5KXC=34T9�=L6%2 9�6 �N9�9=6 � M_>3BDMC6D957=3UZ@C=S;�6:P39�=�[M�4�>30S6D9�@ U8[M�B89�6:PA@b6 BD9 �A9[�6:UZ6:PS9 @CFK57X�=34�9=L6 � U Q 0A@CFK5 6 ^ � \ = 6:P357U� M�B21]- �N9 03U89 R e RTR % N W �!%ZB86D5dc 9�6 @bF �^- }C~�~L} � - � P357[cP 57U�9���[579=L6a@C=3;!>3BDMR;303[�9U$P35KXCPQ 0A@CF7576 ^_@bFK5KXC=34T9�=L6:U �

�-=SGIMCB86:0S=A@b6:9�F7^5-]6:P39 @CFK57X�=34�9=L6 Q 0A@CF7576 ^ UD[�M�BD9 BD9�6D03BD=S9;+2L^ R e7RTR % N W [@C=3=3Mb6�2H903U89;?@CUN@*1C9�BD=39�F GI03=3[�6:5KMC= ;35KB89[�6:F7^5- 2 9�[@C03U89Z6:P39-UD[�M�BD9Z57UN=3Mb6W>HM�UD5 6:5 C9-U894�5^/ ;39�JA=S576:9*O 5 � 9 �Z-GIM�B @_X�5 �9=!UD9�6$MCGN>SBDMC6D95K= U 6:BD0S[�6:0SBD9U8-]@b= @CF7F^/ �9B8UD03U / @CF7FO4T@b6DBD5^4 MCG R e7RfR % N WnUD[�M�BD9�U� 5KF7F�PA@ �9�UDMC4T9 =39�XL@b6:5 �9 957X�9= b@CF7039U S � � 9 6:PS9BD9�GIM�BD9�94�>3F7M ^ 6:P39 U8M./ [@CFKF79; �894�>357BD5K[@CF1C9�BD=39�F�4 @C> � � N U803;A@�- � "�"H" � 6DM_[M�= �9�B86$6:P357U�UD[�M�BD9 6:M<@ 1C9�BD=39�F I GIM�B @ XC5 �9�= ;3@b6c@_UD9�6 MCGU86DBD03[�6:03B89U�� � � ������ ����-3@ U 6:B803[�6D03BD9 � � 57U B89>3B89U89=L6:9�; @CUW@C= � / ;35K4�9=SUD5KMC=A@CF �9�[�6:MCB9-357=� P357[cP�6DP39���6DPT9�= 6DB8^ 57U�6:P39:R e RTR % N W U8[M�B89-2H9�6 � 99�= � � @C=3; � � N PS9 /QP!R�6DP39=�03U89U6:PS5KU C9[�6DM�B BD9�>3BD9�UD9=L6:@b6:57M�= ;S5KBD9�[�6DF7^ � N P357U 4T9�6:P3MR;+PA@CU 2H99�= 03U89; UD0S[[9�UDU GI03FKF ^ 5K= 6:PS9/�P7R'/ >A@b5KB � 57UD9Z4�9�6DP3MR;_MCG BD94�MC6D9Z>3BDMb6:957=_P3M�4�M�FKMCXC^ ;39�6D9[�6:5KMC= � �d5E@CM�@C=3; 6-M�2SFK95- }C~�~L} � -5K= � P35K[cP @ >3BDMb6:957= 57UNBD9�>3BD9�UD9�= 6D9;<@CUN@ �9�[�6:MCBNMCGpF7M�X*a / C@bFK039�U GIBDMC4n@$>A@C57B � 5KU89-U89Q 039�=3[9[MC4T>A@bBD5KU8M�=T@CFKX�MCBD576DP34 U803[cP?@CUV/R4T5 6:P�/ � @b6D9B84 @C= � /14�576:P @C=3; � @b6D9B84 @C=@- � " B+� � � \ = M�0SB9041>H9B85K4�9=L6:U8- �N9 0SUD9�6:PS9�FKM�XTMCG�6:P39<a / b@CFK039aBD9�6:03B8=39; 2L^�R e RTR % N W � N P39 BD9�UD03F 6:5K=SXR e RTR % N W 1b9BD=S9FH5K=3[�M�BD>HM�B:@ 6:9U�57=SGIM�BD4T@b6D5KM�= @b2 M�016%6:P39-@CFK57X�=A@C2S5KFK5 6 ^ MCGd@ X�5 �9=�>A@C57B%MCG>3B8MC6:9�5K=3U��

����� ��� � � ��� "��� ! ������� � � ��� �� �

e F7F /�P!R 9 4S>H9B85K4�9=L6:U �N9�BD9 >H9B GIM�BD4�9; 03UD57=3X M�0SB M � =+[MR;395-�� P35K[cP 57U @ [M�4�2S5K=A@b6D5KM�=MCG ����� @C=3;TR @b6DFE@C2 � N M [�M�4T>S0S6:9 �N9�5KX�PL6D9;�1C9�BD=39�F][�M�4�2357=A@b6:57M�=3U � 9 03U89 UD9�4T57;39�J3=3576D9>3B8M�X�B:@b4T4�5K=3X�-s@CU�;39�UD[�BD5K2H9;!5K= �p@C=3[ 1 B85K9�6$9�6$@CF ��� }C~C~L}�� � /�P!R<U � 9B89�6D9U86D9;!03UD57=3X_J �9 /GIM�F7; [B8M�UDU / b@CFK57;A@b6D5KM�=U-RBD9�> 9@b6:9�;_6:P3B899�6:574T9�U7O 4 G [��S � � 9�03UD9$@ J�419; b@CFK0S9ZMCGp6:P39$/QP!RBD9�X�03FK@CBD5Zc@b6D5KM�=�>3@CB:@C4�9�6D9B �� � ~ � � 9 4�9@CU803BD9�[FK@CUDU857JA[@b6:57M�=�>H9B8GIMCBD4T@C=3[9 03U85K=3X?6:PS9@CB89@ 03=S;39B 6DP39 B89[9�5 C9B�M�>H9BD@b6:57=3X [cP3@CB:@C[�6:9�BD5KU 6:57[�O � % � S [03B��9.- � PS5K[cP+>3F7MC6:U 6:P39 B:@b6D9MCG�6:B8039 >HM�UD5 6:5 C9U @CUZ@_GI0S=3[�6D5KM�=�MCG�6DP39 B:@b6D9 MCG�G @CFKU89�>HM�UD5 6:5 C9U GIMCB b@CB8^R5K=SX_[FE@bUDUD5 JA[@ 6:5KMC=

Page 43: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

}HG

6:PSBD9U8P3M�F7;3U � � 9TBD9>HM�B 6�4�9@C=3U @C=3; U 6c@C=S;A@CBD; ;39�R5E@ 6:5KMC=3U MCGN6:P39 � % � � 5 6:P BD9U8> 9�[�6�6DM6:PS9 JSG 6:99�= 4 G [�?UD>SFK576DU �

� (�� vg�Z� ����#%�

� 9�>3BD9�UD9�= 6 MC03B B89UD0SF76:UZ@CU�@ U89BD579UZMbG%GIM�03B 9 41> 9�BD5K4�9=L6DU � N P39�J3BDU86Z9041> 9�BD574T9�= 6 5KU @ ;35^/BD9�[�6-[M�4�>A@CB85KU8M�= MbG]6:PS9a03= � 957X�PL6:9;�@C=3; � 957X�PL6:9�;f1C9�BD=39�FO[�M�4�2357=A@b6D5KM�=?4�9�6:PSM1;3U"@C[�BDM�U8U@CF7F Gb� ` % 6:9B84TU-5K= M�03B 2H9=S[cP34 @bB21�� N P39 BD9U803F76DU U8P3M � 6DPA@b6"6:P39 U86:B803[�6D03BD9*1C9B8=39FO[M�=�/UD57U86D9=L6:F ^ M�0S6_/ >H9B8GIMCBD4�U 6:P39!UD9�QR0S9=3[�9 1C9�BD=39�F`- @C=S; 6DPA@b6?6:P39 03= � 957X�PL6:9;)[M�4�2S5K=A@b6D5KM�=X�9�=39BD@CFKF ^T>H9B GIM�BD4�UW2H9�686:9B 6:PA@C=_6DP39 � 95KXCP 6D9;?[MC4�235K=3@b6:57M�= � \ =_6DP39ZUD9�[M�=S; 9 4S>H9B85K4�9=L6 -� 9 U8^RU 6:94T@b6D5K[@bFKF7^ C@bB8^ 6:P39�BD9�FE@b6D5 C9 1b9BD=S9F � 957X�PL6�M�= @ U80323UD9�6 MCG � ~ ` %n6:9�BD4�U9-�@b=3;� 9 UDPSM � 6DPA@b69- GIMCB�6DP35KU�6c@bU21]-R6DP39"03= �N9�5KX�PL6:9�;_UD034 MbG 1C9�BD=39�FKUN>H9B GIM�BD4�U�=39@bBDF7^�M�>S6:574 @bFKF7^ �N P39W6DP35KB8;�9041>H9BD574T9�=L6%5K=L6:B8M1;S03[9�U�@CB86D57JA[�5E@CF =3M�57UD9W57=L6:M 6DP39V;A@b6:@ UD9�6 � \ = 6:PS5KU]U8[9�=A@CBD57M3-�6:PS9� 95KXCP 6D9;"1C9B8=39F1@C>3>SBDML@C[cPa5KUp03U89�GI03F -C@C=S;a>H9B GIM�BD4�Up2 9�6D6:9�B 6DPA@C= 6:P39 03= � 95KXCP 6D9; @b>3>3BDM�@C[cP@CU%6:PS9-@b4TM�0S= 6�MbGs=3M�57UD9V57=3[B89@CU89U � � 5K=A@CF7F7^5-C5K=T@ZGIM�03B 6:P�9041> 9�BD574T9�= 69- �N9";394�M�=3U 6:BD@b6:9V6:PS9BDMC2303U86D=39U8U MCGO2HMC6:P'1C9�BD=39�Fp[M�4�2S5K=A@b6D5KM�=_4�9�6DP3MR;3UV5K=_6:PS9$>SBD9U89=3[�9 MCGO4�5KUDU85K=3X ;3@b6c@ �

��������� � � ��� "��� ! � ��� � ��� #�� $���! � ����� !#� � � � � � �!#� �� "��!

��� ���#���$

\ = 6:P357U%9041> 9�BD574T9�= 69- �N9"> 9�B8GIM�B84T9�; [BDMCUDU_/ b@CFK57;A@b6:9�; 6:9U 6:57=3X MCG GIM�0SB�6 ^1>H9U MCGs/�P!R<U9-R03UD57=3XUD9�Q 039=3[�9V@CF7M�=395- U 6:BD0S[�6:0SBD9W@bFKM�=39.- @C=a0S= � 957X�PL6:9�;�[M�4 235K=A@ 6:5KMC=�MCG31b9BD=S9FKU8-�@C=S; @ �N9�5KX�PL6D9;[MC4�235K=3@b6:57M�=�MCG�1C9�BD=39�FKU � N @C23F79 } � � UDP3M � U @ U80323U89�6 MCG 6:P39�UD9"BD9U803F76DU � N PS9"[�M�4�>3FK9�6:9VUD9�6�MCGBD9�UD03F 6:U @CB89 @ C@b5KFE@b23FK9"5K= 6DP39�UD0S>3>3FK9�4T9�=L6c@CB ^_BD9�UD03F 6:U O /R9[�6D5KM�= } � � S � 6-MC6WUD03B8>3BD57UD5K=SX�F7^5-16:PS9R e RTR % N W 1C9B8=39FOGIBD9Q 039�=L6:F7^ >3BDM R5K;S9UZ2H9�686:9B�[�FE@CU8UD5 JA[@b6D5KM�= > 9�B8GIM�B84 @b=3[9 I 57= GHG M�016MCG Gb� [�FE@CU8UD9U8-16DP39 ;35�� 9�BD9�=3[9-2 9�6 �N9�9= 6:PS9 4�9@C=TU86:B803[�6D03BD9 � % � @C=3;�6:P39"4T9@C= U89Q 039�=3[9� % � 57UVX�BD9@b6:9�BV6:PA@C=_6DP39 UD034 MCG 6:PS9 6 � M�[M�B8BD9U8> MC=3;35K=SXTU 6c@C=3;3@CBD;<9B8BDM�B8U �e =a@CF76D9B8=A@b6:9%B89>3B89U89=L6c@b6D5KM�=aMCGR6:P39�UD9 BD9U803F76DU9- GIM�B @CFKF GC� 6:9�BD4�U9- 5KUdUDPSM � = 5K= � 5KXC03BD9 } � � �

�Z0A@CF7576c@ 6:5 C9F ^$- 6:P39!JAX�03B89 U8P3M � U 6:P3@b6 6DP39!UD9Q 039�=3[9e1b9B8=39F$> 9�B8GIM�B84TU?G @CB � M�BDU89 6:P3@C=

Page 44: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

}C�

N @C23FK9 } � �HI � ��2E���?����� � � ����24�5; � � ���,; ��2�� �-27 ��H2=� � � ���,; � �*� �������-��2 � a�@C[cP BDM �5K=_6DP39$6:@C23F79�FK5KU 6:U @T`:%w6:9B84 @C=3; ;39U8[B85K>S6D5KM�=U-16:P39$M�=L6:M�F7M�XC^TGIBDM�4 � PS5K[cP 5 6 [M�4�9U"O R �� 4TMCFK9[�03FE@bB GI03=S[�6:57M�=U- � � � [�9FKF703FE@bB [�M�4�>A@CB86D4T9�=L6V@C=3; � \ � 2357M�FKM�XC5K[@bF3>3BDMR[9�UDU S0-36:PS9= 034�2H9B"MCGO> M�U8576D5 �9 9 43@b4T>3F79U"@CU8UDMR[5E@ 6:9; � 576DP<6DP39�6:9�BD4 -36:P39$4T9@C=<@C=3;<U86:@C=3;A@CB8; 9�BDBDMCB� % � U8[M�B89U-GIMCBK L4 G [ /�P!R 6:B:@b5K=357=3X 03UD57=3X�O � SN6:P39aU86DBD03[�6:03B89*1C9�BD=39�F`- O } SN6DP39aU89Q 039�=3[91C9�BD=39�F`- O? +S 6DP39 0S= � 957X�PL6:9�; UD034 MCG�2HMC6:P 1C9�BD=39�FKU9-"@C=S;�O?#QS�6:PS9 � 95KXCP 6D9; U8034 MCG�6:PS91C9�BD=39�F � \ = 6:PS9 6:@C23F795-36:9�BD4�U"@CBD9$UDM�B 6:9�; 2L^?6:P39 ;35�� 9�BD9�=3[9$5K= � % � 2H9�6 � 99�= �:/R6DBD03[�6:03B89 �@C=3; �D/19Q 039�=3[9 � � � B8M�4 6:P39�9�=L6:5KB89�UD9�6 MCG GC� 6D9B84TU 6DPA@b6 �N9 [�M�=3UD57;39B89;U-s6DP39 6:@C23FK9aFK57U86:UM�=3F ^ 6DP39�6:M�> � ~ @C=3;_6:PS9$2HMC686:M�4 G ���������� ���� ����� ����� ��� ����� � ��������������� ��������������� �! "���#�$�� ����%���'& (�(�(�)�*�+�) ,�-��.�/�0 ��#��� �12���#� �3#������ �� �4/ 576 *�(�) (�8 9�:�*';<(�8 (�*�: (�8 =>(�9?;<(�8 ("@>( (�8 9�A"=?;B(�8 (�*�+ (�8 9�A�)?;<(�8 (�*�C���'& (�(�("C�C>(�+ � �����7� ���7D�� ��E�� ��$ 576 *�@>9 (�8 9�A�:?;<(�8 (�(�) (�8 =>:"=F;<(�8 (�*�C (�8 9"@�=?;B(�8 (�*�@ (�8 9"@�=F;<(�8 (�*�@���'& (�(�(�+"@>+�( ��G!�H�����0 � ��#>�� ��� IJ% *�(�9 (�8 )�)"CF;<(�8 (�*�: (�8 =>("=F;<(�8 ("@>( (�8 )"=>)K;B(�8 (�*�+ (�8 )"=>(?;<(�8 (�*�C���'& (�(�:�)�(�A"= ���>12#�������LD�� ��E�� ��$ 576 *�*�) (�8 9�*�+?;<(�8 (�*�C (�8 =>A�)?;<(�8 ("@�C (�8 9�*�*,;B(�8 (�*�+ (�8 9�(�9?;<(�8 (�*�+���'& (�(�:�+�:�)�A .��-��������-/���0 �3,�-��#�DM��0 � � IJ% *�@>) (�8 9�:�9?;<(�8 (�("= (�8 =>)"=F;<(�8 (�*�* (�8 9�A"=?;B(�8 (�(�) (�8 9�:�(?;<(�8 (�(�)���'& (�(�:�:"@�C�C ����0 0 ��0 #��N0 � ��� E?,���#�DO��0 � IJ% *�(�* (�8 )�9�*';<(�8 (�*�@ (�8 =>A"@F;<(�8 (�*�@ (�8 )"=>:K;B(�8 (�*�C (�8 )�+�:?;<(�8 (�*�A���'& (�(�*�+�)"C>A � ���,���#� ��'#����� �� �P/ 576 *�@>: (�8 )"C�CF;<(�8 (�*�: (�8 =>(�+?;<(�8 ("@>9 (�8 )�A"=?;B(�8 (�*�= (�8 )�*�(?;<(�8 (�*�9���'& (�(�:�:"@>+"@ ����0 0 ��0 #��N��#��DM��.�/�E��#>���

,�-��#�DM��0 � �IJ% @>(�9 (�8 9�*�@F;<(�8 (�("= (�8 =>+�:?;<(�8 (�*�) (�8 9�(�)K;B(�8 (�(�+ (�8 )�9"=F;<(�8 (�(�+

���'& (�(�(�9�*�*�= ������0 ���>�� E��L,���#�DO��0 � IJ% *�@>: (�8 )�9"@F;<(�8 (�*�C (�8 =>:�)?;<(�8 (�*�+ (�8 )�9�(K;B(�8 (�*�@ (�8 )�)�(?;<(�8 (�*�@���'& (�(�*�+�)"@>9 0 /"#� ��3#��-��� �� �P/ 576 @>(�* (�8 9�A"CF;<(�8 (�(�+ (�8 =>9�*';<(�8 (�*�A (�8 9�A�*,;B(�8 (�(�) (�8 9"@>+?;<(�8 (�("=���'& (�(�(�+"=>A"@ ��������Q-/�,��,����#�DM��0 � IJ% *�*�9 (�8 )"@>A?;<(�8 (�*�* (�8 =>)�*';<(�8 (�*�A (�8 )�:"C?;B(�8 (�*�* (�8 )"@>)?;<(�8 (�*�A���'& (�(�("=�@>:"@ � �"���#�����0 0 ��0 #��N �� $���#�0 � ��$

��#� ��#�E��IJ% *�:�( (�8 )�9�)?;<(�8 (�*�* (�8 )"C>9?;<(�8 (�*�: (�8 9�(�AK;B(�8 (�*�( (�8 9�(�(?;<(�8 (�*�*

���'& (�(�("C�C�@�C ��R!%SD�� ��E�� ��$ 576 *�(�: (�8 9"@>A?;<(�8 (�(�) (�8 )�)�:?;<(�8 (�*�C (�8 9�A�*,;B(�8 (�(�9 (�8 9�A�*';<(�8 (�(�9���'& (�(�(�:"@�C�@ ���� ����TU�P/��M�L����E����O������� E�#� �

#��-��� �� �P/576 *�:�( (�8 9�A"=F;<(�8 (�*�* (�8 9�("=F;<(�8 (�*�@ (�8 9�A"@?;B(�8 (�*�@ (�8 9�A�*';<(�8 (�*�@

���'& (�(�("C�*�9�) �������������#�0V,��0 ������0 ��#��-��� �� �P/ 576 *�=>9 (�8 )�(�9?;<(�8 (�*�( (�8 =>9"CF;<(�8 (�*�: (�8 )"@>)K;B(�8 (�*�( (�8 )"@>:?;<(�8 (�*�*

Page 45: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

} �

0

10

20

30

40

50

0.6 0.65 0.7 0.75 0.8 0.85 0.9 0.95 1

No.

of t

erm

s w

ith a

giv

en m

ean

RO

C

Mean ROC

SequenceStructureAverage

SDP

� 57X�03BD9 } � �HI 8:��;=<>�? �� � � 24� -276 ���K�A��; ��6�)+��� ��2 �H��; ��)+� � ���� ) �H��� � � ��� ��� ��24�5; � �N P39 JAX�0SBD9 >3FKMb6:UZ6:PS9�= 034 2 9�B$MbGV` % 6D9BD4�U OI^+/ @L415KU S-GIMCB � P35K[cP @_X�5 C9= /�P!Ru[FK@CUDU857JA9�B@C[cP3579�C9UO@"U8> 9�[57J39;$4T9@C= � % � UD[�M�BD9:O 4Q/ @L415KU S � a�@C[cPaUD9�BD5K9�Up[M�B8BD9U8> MC=3;3Up6:M"@C= /�P!R 6:PA@ 603U89U UD9�QR0S9=3[�9 @CF7M�=39.-SU86DBD03[�6:03B89 @CFKMC=395-1M�BW[MC4�235K=3@b6:57M�=3UNMbGC1b9B8=39F7UV03UD57=3X @C=_03= � 95KXCP 6D9;@ �9�B:@CX�9$M�BV03U85K=3XT/SY�\ �

Page 46: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

}�B

@C=L^�4�9�6DP3M1;�6DPA@b6$03UD9�U$6DP39 U86DBD03[�6:03B89 1b9B8=39F � � 03B 6:P39�BD4�M�BD9.- �N9�[M�4�>30S6D9;!@ � 5KFK[�M 4SMC=UD57X�=39�;�/ BD@C=31�6:9�U86 2 9�6 �N9�9=j@CFKF�GIMC03Ba>3@C5KB8UaMCGW4T9�6:P3MR;3U � N P39TBD9�UD03F 6:Ua^R579FK;!6:P39�GIM�FKF7M � 5K=3X2H9U86_/ 6DM./ � M�BDU 6WBD@C=31 5K=3XaMCGd4�9�6DP3M1;SU I 03= � 957X�PL6:9;?U8034 MCG 1C9�BD=39�FKU9-1U86DBD03[�6:03B89 1C9�BD=39�Fd@CFKMC=395-� 95KXCP 6D9;?UD0S4�MCG 1C9�BD=39�FKU8-A@C=3;?UD9�Q 039=3[�9!1C9B8=39Fp@bFKM�=39 � \ =_6:P357UNBD@C=31 5K=3X�-16:PS9�FE@CB8X�9U 6!O 5 � 9 �Z-FK9@CU86�U85KX�=S57JA[@C=L6 S]>�/ C@bFK039V57U ~ � ~�~ ��2H9�6 � 99�=T6DP39-U 6:B803[�6D03BD9 1C9�BD=39�F @bFKM�=39 @b=3;�6DP39 �N9�5KX�PL6D9;UD0S4 MbG31C9�BD=39�FKU�� N P 03U]5 6]@b>3> 9@CBDUp6:P3@b6][�M�4�2357=35K=SX"U89Q 039�=3[9 @C=S; U86DBD03[�6:03B89N[@C= 2H9 PS9FK>1GI03F`-230S6"M�=SF7^ � PS9= 0SUD5K=SX 6DP39 03= �N9�5KX�PL6D9; U8034 MCG 1C9�BD=39�FKU �

��������� � � ��� "��� ! � � ��� �� �� "!�� � � � � �� � ���� !#� � � � ��� �

N P39�>SBD9�R57M�03UZB89UD0SF76 � 6:PA@ 6 6:PS9 �N9�5KX�PL6D9;�UD0S4gMCG 1b9B8=39F7U�> 9�B8GIM�B84TU�NMCBDUD9�6DPA@C= 6DP39�03=�/� 95KXCP 6D9; U8034 � 5KU�U803BD>3B85KU85K=3X3-R=3MC6 FK9@CU86 2H9[@b03UD9-[M�=3U85K;39�B:@C2SFK9"9 � M�B86 PA@CU 2 9�9= 9 4S>H9=S;39;2L^ b@CBD57M�03UVBD9�UD9@CBD[cP�XCBDM�03>SU"6DM�;S9��9�FKM�><6:P39$M�>S6D5K4�5dc@b6:57M�= 6:9�[cP3=3M�F7M�XC^ 6DMTU8M�F C9�6:P357U 6 ^R>H9MCG R C �+>3B8M�23F794 � N PS9BD9�GIM�BD9.- � 9 UD9�FK9�[�6:9�; @ UD0S23UD9�6�MCG�6DP39a6D9BD4�U-GIB8M�4�M�03B"2 9�=3[cP34T@CB21@C=3;�UD0S2 �89[�6:9;T6:P39�4|6:M�GI03B 6:P39�B 57= �9U 6:57XL@b6:57M�= ��/1> 9�[5 JA[@CF7F7^5- �N9"UD9�FK9�[�6:9�;T6DP39 � ~ 6:9B84TU�GIMCB� P357[cP 6:P39$;35�� 9�BD9=S[9 57= � % � 2H9�6 � 99�=�6:P39aU86DBD03[�6:03B890/ MC=3F7^<@C=S; UD9�Q 039=3[�90/ M�=3F7^�/�P7R U 57UFE@bBDX�9�U86 � � MCBN9@b[cP<MbGd6:P39�UD9Z6:9�BD4�U9- � 9�U8^RU 6:94T@b6D5K[@bFKF7^ b@CB85K9�; 6:P39 BD9FK@b6:5 �9 1b9B8=39F � 957X�PL6:U8-@C=3;T> 9�B8GIM�B84T9�; [�BDM�U8U_/ b@CF75K;A@ 6:9; 6:9�U86D5K=3X$MCGs6DP39-B89U803F76D5K=3X /�P!R � N P39-BD9�UD03F 6:U @CBD9"UDP3M � =_57=� 57X�03BD9 } � } �N P39 4�M�U 6NU 6:BD5Z1 5K=3Xa@CUD>H9[�6WMCG � 5KX�0SBD9 } � } 5KU�6:PS9-Q 0A@CF7576:@b6:5 �9 UD574T57FE@CB8576 ^aMCGp@CF7F36:9=TUD9�BD5K9�U

5K= 6DP39"J3X�03BD9 � � M�B%9@b[cP_` % 6:9�BD4 -�6:P39"> 9�B8GIM�B84 @b=3[9VMCG 6:P39-/�P7R U 6c@^RU B8M�03X�P3F ^�6:PS9"UD@C4�9GIM�B @CF7F 1b9BD=S9F�[M�4 235K=A@ 6:5KMC=3U 6:P3@b6$@CUDU85KX�= FK@CBDX�9�B � 95KXCP 6 6DM?6DP39 U86DBD03[�6:03B89 1b9B8=39F � � PS9=4�M�BD9 � 95KXCP 6-5KU"@CU8UD57X�=39;<6:M 6:P39aUD9�QR0S9=3[�9<1C9�BD=39�F`- 6:P39$> 9�B8GIM�B84 @b=3[9 ;39�X�B:@C;S9U XCB:@C;303@CFKF ^$-� 576DP�@ BD@C>35K; ;39XCB:@C;A@ 6:5KMC=�M�=3F ^ � P39=�6:PS9 U86DBD03[�6:03B89�1C9�BD=39�F�BD9�[95 �9�U �9B ^�U84 @CF7F��N9�5KX�PL6 �N P357U BD9�UD03F 6 U8P3M � U�6:PA@ 6a6DP39_/�P7R 5KUaQ 03576D9TB8M�2303U 6�5K=!6:P39T>3BD9�UD9�=3[9_MCG C@bBD5E@ 6:5KMC= 57= 6:PS9BD9�FE@b6D5 C9�UD[@bFK9U MCG 6:PS9 6 � M�;A@b6c@ U89�6:U��e�UD9[�M�=3; MC23UD9�B b@b6:57M�= 5KU�6DP39 >SFE@C[�94�9=L6 MCG 6DP39?X�BD9�9= ;3MC6:U8-N57=3;35K[@b6:57=3X 6DP39 [cPSM�5K[�9

MCG71b9B8=39F � 957X�PL6:UT4 @C;S9 2L^j6:P39�/SY�\ M�>S6:574T5Zc@b6D5KM�= � \ = =39@CBDF ^j9��9�B8^ [@CU895-V6:PS9�/SY�\9B8BDM�=S9M�03U8F7^ X�5 C9U�4�M�BD9 �N9�5KX�PL6%6DM 6:P39VU89Q 039�=3[9 1C9�BD=39�F � N PS5KU%9041>3FK@C5K=SU�� PL^�6:PS9 �N9�5KX�PL6D9;

Page 47: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

} "

0.7

0.75

0.8

0.85

0.9

0.95

-Inf -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 Inf

Mea

n R

OC

Log2 ratio of kernel weights

� 57X�03BD9 } � }EI � )+��/�� � �5276�)+��� ��2 � 24�5 �276 � 27� � �,� � N P39 J3X�03BD9 >3FKMC6DU 4�9@C= � % � U8[M�B89@CU @�GI03=3[�6:57M�= MCG-6DP39_FKMCX � O�� ��� S0- � P39�BD9 �� @C=3; ���@CB89 6:P39 � 957X�PL6:U�@CU8UD5KXC=39; 6:M�6:PS9UD9�Q 039=3[�9?@C=3; U 6:B803[�6D03BD9 1C9B8=39F7U9-%B89UD>H9[�6:5 �9F ^ �ba�@C[cP UD9�BD579U [�M�BDB89U8> M�=S;3U 6:M M�=39TMCGW6:PS9` % 6:9B84TU-5K= N @C23F79 } � � � %Z=�9@C[cP�U89B85K9U8- 6DP39 FK@CBDX�9$X�B899=�[�5KB8[FK9$5K=S;35K[@b6:9�U"6DP39�FKMCXTBD@b6:57MMCG 6:P39 � 957X�PL6:U UD9�FK9[�6:9�; 2L^ /SY�\��

Page 48: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

~

1C9�BD=39�FO[�M�4�2357=A@b6D5KM�=_G @CB89U"> MRM�BDF ^ M�=<6:P357U 2 9�=3[cP34T@CB21��Ve >S>A@CBD9�=L6:F7^5-AGIM�BV6:P39�UD9a6:@CU21 U8- 6:PS9UD9�Q 039=3[�9'1C9B8=39F ^1579F7;3U�@C=+9�4�2H9;3;357=3X � 5 6:P+@ FK@CBDXC9B$4 @CB8X�5K= 6:P3@C=+;3MR9U 6DP39 U86DBD03[�6:03B891C9�BD=39�F`-A9 �9= 6:P3M�0SX�P_6:P39 FE@ 6D6:9�BV>3BDM R5K;S9U 2 9�6D6D9B X�9=S9B:@bFK5dc@b6:57M�= >H9B GIM�BD4T@C=3[�9 �

� 5K=3@CFKF ^$-W5 6 5KU 5K=L6:9�BD9U 6:57=3X 6:M+[�M�=3U85K;39�B � P39�6DP39B_6DP39�03= � 95KXCP 6D9; UD034 MCG!1C9�BD=39�FKU_57UM�>S6D5K4T@CF � � MCBd4 @C=L^�MbG16DP39 `:% 6:9�BD4�U 57= � 5KX�0SBD9 } � } - 6:PS9 PS5KX�P39�U86�� % � 57Ud=3MC6 @C[cPS5K9�C9; @b6 @FKMCXVB:@b6D5KMVMCG ~ � W-M �N9 �9�B9-L5K=�9 �9�B8^$[@CU895- 6:P39�;35�� 9�BD9=S[9�2 9�6 �N9�9= 6DP39�03= �N9�5KX�PL6D9; U8034 � % �@C=3;_6DP39�2 9�U86 >HM�UDU85K23F79 � % � 5KUWQ 035 6:9�U84 @CF7F`- M�=_6:PS9�M�BD;39�BVMCG ~ � ~+� � � 03B 6:P39�BD4�M�BD9.-1GIM�BV@b= ^J�419; FKM�X�BD@b6:57M3-�6:P39�BD9-@CBD9"UDMC4T9V6:9�BD4�U%6:PA@b6 >H9B GIM�BD4 � M�B8UD9-6DPA@C= 6:P39"03= � 95KXCP 6D9;_@ C9B:@bX�9@C=3; U8M�4T9a6:PA@b6 >H9B GIM�BD4g2 9�6D6D9B � N P 03U9- � 5KXC03BD9 } � } U803X�X�9�U86:U�6DPA@b6$@CF 6:P3M�0SX�P�@C= M�>S6D5K4T@CFFK9@CBD=S5K=3XT>3BDMR[9�;303BD9 4�5KXCP 6 2 9�@C23FK9a6:M JA=S;!2H9�686:9�B 1C9�BD=39�F �N9�5KX�PL6:UZ6DPA@C=�6DP39�03= � 95KXCP 6D9;@ �9�B:@CX�9.-36:P357UVPL^1>HMC6DP39�6D5K[@bFs4T9�6:P3MR;)O � S �NM�0SFK;_PA@ �9 6:M�6:@51C9 57= 6DM [M�=SUD5K;S9B:@ 6:5KMC=_=3MC6 �803U 66:PS9 1C9�BD=39�FV4 @b6DBD57[9Ua230S6�@CF7UDM 6DP39?` % 6D9B84yFK@C2 9�FKU8-%@C=3; O } S � M�03FK;+U 6:57FKF�> 9�B8GIM�B84yMC=3F7^UDF75KX�PL6DF7^T2 9�6D6:9�BV6:PA@C=?6:PS9$0S= � 957X�PL6:9�; UD0S4 MCGC1C9B8=39F7U �

��������� � � ��� "��� ! � � ��� � ���� " �"� !#� $ � ���� !#��� $

N P39 B89U803F76DUaGIBDMC4 MC03BaJAB8U86�6 � M�9 4S>H9B85K4�9=L6:U 2 9�X 6:P39TQ 039U 6:5KMC= I � P ^ 2 Mb6:P39�B � 576DP 6:PS9[MC4T>3016c@b6D5KM�=A@bFOM �9�BDP39@C; MbG � 957X�PL6:9�; 1b9BD=S9F%[MC4�235K=3@b6:57M�=3U � PS9= 6:P39 03= � 95KXCP 6D9;!UD034MCG 1b9BD=S9FKU > 9�B8GIM�B84TU-2 9�6D6:9�B � \ = 6:P39 6DP35KB8;�9041>H9B85K4�9=L6 - �N9 ;39�4TMC=3U86DB:@b6D9 R5E@ U85K4�0SFE@b6D5KM�=@ UD5 6:0A@b6D5KM�=_57= � P35K[cP?6:P39 � 957X�PL6:9; UD034�5KUV=39�[9U8U:@CB ^ �N M [@CBDB ^ M�0S6�6DP35KU%9 41> 9�BD5K4�9=L69- �N9 [B89@b6D9;T@�[M�F7FK9[�6:57M�=�MCG �8=3MC5KUD9 �71C9�BD=39�FKU � N PS9UD9-@CB89

UD574T>SF7^�[�M�>35K9�U]MCG16:P39 U86DBD03[�6:03B89 1C9�BD=39�F`- � 5 6:P >H9B84�0S6D9; B8M � U%@C=3;a[M�B8BD9U8> MC=3;35K=SXZ[M�F7034�=3U �N P39 BD9�UD03F 6:57=3X?4 @b6DBD57[9UZ@CBD9 U86D5KF7F 1C9�BD=39�FKU8- 2S0S6 6:P39 9=L6DBD5K9�U =3M?FKM�=3XC9BZ[�M�BDB89UD>HM�=3;!6:M_6:PS9FE@b2 9�FK5K=SX � � 9 6:P39�= 4T9@CUD03B89; P3M � 6DP39�>H9B8GIMCBD4T@C=3[9 MCG�M�0SBT6 � Me1C9B8=39F [M�4�2S5K=A@b6D5KM�=4�9�6:PSM1;3UV[cP3@C=3X�9�U @CUV6DP39 =R0S4�2 9�B MCG]=SM�5KU89 1b9B8=39F7U"57=3[B89@CU89U��N P39 B89UD0SF76:U�@CBD9TUDP3M � = 5K= � 5KX�0SBD9 } �D � \ = 6DP39 JAX�0SBD95-%XCBD99�= [B8M�UDU89U [�M�BDB89UD>HM�=3; 6DM

[FK@CUDU857JA9�BDU�6:BD@C5K=39�; � 5 6:PT=3Ma=SM�5KU89:1b9BD=S9FKU�� N P39U89Z>HM�5K=L6:U � 9B89-6:P 03U X�9=S9B:@ 6:9; 5K=�M�03B%JABDU 69041>H9B85K4�9=L6 -3;S9UD[�BD572 9�; @b2 M �9 � R M�U86 MbG 6DP39�>HM�5K=L6:U G @CFKFH2 9�FKM � 6:P39�F75K=39�� � � -S5K=3;357[@b6D5K=3X[F79@CB8F7^ 6:P3@b6 6:P39 03= �N9�5KX�PL6:9�; 1b9B8=39FV[�M�4�2357=A@b6:57M�= >H9B GIM�BD4�U�2H9�686:9B�6DPA@C= 6DP39 �N9�5KX�PL6D9;

Page 49: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

0.65

0.7

0.75

0.8

0.85

0.9

0.95

1

0.65 0.7 0.75 0.8 0.85 0.9 0.95 1

Mea

n R

OC

(S

DP

)

Mean ROC (Average)

No noise1 noise kernel

2 noise kernels

� 57X�03BD9 } �D I �M24).�5 ��? � � � �-2 ���52���27 ��H2 � � ���� � / ��24�5 -2E6 � � N PS9<JAXC03BD9?>3F7MC6:U8-�GIMCB9@b[cP `:%w6:9B84b-A6DP39 � % � U8[M�B89�@C[cPS5K9�C9;�2L^?6:P39 /SY�\ /�P7R�@CU-@�GI03=S[�6:57M�= MbG]6:PS9 � % �UD[�M�BD9 @C[cP3579��9�;_2L^T6DP39-0S= � 957X�PL6:9�;_UD034�MCG 1b9BD=S9FKU���YZ5 � 9B89=L6N>HM�57= 6 6 ^R> 9�UW[MCBDBD9�UD>HM�=3; 6DM6:BD@C5K=S5K=3X 03U85K=3XVc�9BDM�-AM�=39 M�BW6 � MT=3MC5KUD9!1b9BD=S9FKU8- @CU ;39U8[B85K2H9; 57= 6:P39�6D904R6 �

Page 50: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

}

UD0S4.MCG 1C9�BD=39�FKU �VW"M �N9 �9B8- 6DP35KU BD9U803F76 [cP3@C=3X�9�Ua@bU�UDMRM�=!@CU �N9 57= 6DBDMR;303[�9 @ UD5K=SX�FK9�=SM�5KU891C9�BD=39�F � \ =<6:P357U-[@CUD9.-H6DP39 � 957X�PL6:9; UD034�>H9B GIM�BD4�U-2H9�686:9�B"6DPA@C= 6DP39$03= �N9�5KX�PL6:9�;�UD034 GIMCBGHG M�0S6aMCGN6DP39 Gb� 6D9BD4�U � N P39 9 � 9�[�6�2H9[�M�4�9U$9��9�= 4�M�BD9�>3BDMC=3M�03=3[�9; 5K= 6DP39�>3BD9�UD9=S[9MCGV6 � M�=3M�57UD9 1C9B8=39F7U ��e � 5KF7[M 41M�= UD57X�=39�;�/ BD@C=31�6:9�U86�U803>3>HM�B86DU 6:PS9UD9 [M�=3[�FK03U85KM�=SU � 576DP904R6DBD94�9F ^_UD4T@CF7F��/ C@bFK039�U �

��������� � � ��� "��� ! � � � � �� !#� � $ � ��� �� $�$� "!�������� �� �"��$

� 57=A@CFKF ^$-��N9 [�M�=3UD57;39B$@ b@CB85E@C=L6�MCG M�03B�9 41> 9�BD5K4�9=L6:@CF�;39�UD5KXC=U-d5K= � P357[cP �N9 GIMR[03U M�=�6:PS9>3B8M�23FK9�4gMbG 4�5KU8UD57=3X ;A@ 6c@ � \ = >A@CB 6:5K[�03FE@bB9- � 9 @CB89�5K=L6:9�BD9�U86:9�; 5K=�6:PS9 904R6:9�= 6�6DM � P35K[cP � 9[@b= [MC4�235K=S9�5K=3[�M�4T>SFK9�6D9�U86DBD03[�6:03BD@CFp5K=SGIM�B84 @ 6:5KMC= � 576DP [�M�4T>SFK9�6D9 UD9Q 039�=3[9 5K=SGIM�B84 @ 6:5KMC= �N P 03U9- � 9�U85K4�0SFE@b6D9�B:@C=S;3M�4�F7^<;39F79�6D5K=3X b@CB ^157=3X?> 9�BD[�9=L6c@CXC9U MCG 6:P39 904S@C4�>3F79UZGIBDMC4g6:PS9U86DBD03[�6:03B89b1b9B8=39F 4T@b6:B85^4�-�@C=3;j4T9@CUD0SBD9 6:PS9<[�BDM�U8U_/ C@bFK5K;3@b6:9�; � % � UD[�M�BD9<MCG"6:P39_B89U803F76_/5K=SX�[FK@CUDU857JA9�B � e >3U8903;3MR[MR;39?;39�UD[B85K>S6D5KM�= MCG 6:P39_9 4S>H9B85K4�9=L6c@bFN;39�UD5KXC=+5KU�X�5 �9�=+5K= 6:PS9UD0S>3>3FK9�4T9�=L6c@CB ^_BD9�UD03F 6:U"O /19�[�6D5KM�= } � � S �

� 9[@C03U89 /QP!R U @CB89�=3MC6V;S9UD57X�=39�;?6DM PA@C=3;SFK9Z4�5KU8UD5K=SX ;A@b6:@�-S5 6V5KU =3MC6VMC2 R57M�03U,� � > �`HL> �P3M � 6:M BD9�>3BD9�UD9=L6-4T57UDU85K=3X�9 4S@C4T>SFK9UN5K= 6:PS9 1b9B8=39Fd4T@b6:B85^4 � � 9Z6:P39�BD9�GIM�BD9�[�M�=3UD57;39BW6DP3BD9�9@CF 6:9B8=A@b6D5 �9 4T9�6:P3MR;3UZGIM�B J3FKFK57=3X 57=�4T57UDUD57=3X 1b9BD=S9F�9=L6:B85K9�U � N P39 JAB8U86 U 6:B:@ 6:9Xb^$- �26-MC=395- �UD574T>SF7^ B89>3FK@C[9�U 6:PS9 BDM � @C=S; [M�F7034�=T[�M�BDB89UD>HM�=3;S5K=3X$6:M @$4T57UDUD57=3X$9=L6:B ^ � 5 6:P_@bFKFIc9�BDMR9U��N P357UOU 6:B:@ 6:9Xb^ @bFKFKM � Up6:P39 UD9�Q 039=3[�9[1C9�BD=39�F16:M-;39�6D9B84T57=39 6DP39 � 957X�PL6%@CU8UD57X�=39;a2L^a6DP39W/QP!R6:M�6:P357U 904S@C4�>3FK9.-H57X�=3M�B85K=3X 6DP39 U 6:BD0S[�6:0SBD9*1b9B8=39FO9=L6:57BD9F ^ � N PS9 UD9�[M�=S;�U86:BD@b6:9�XC^ O �D/19F G �QS4T@51C9�U 9@b[cP 4T57UDUD57=3X 9 4S@C4T>SFK9<UD5K4�5KFK@CB�M�=SF7^ 6:M 576:U89F G�2L^ >3FK@C[57=3X @ � M�= 6:P39 ;35E@CXCM�=A@CFMCG 6:P39fO =SM�BD4T@CFK5Zc9�;]S 1b9BD=S9F 4 @b6DBD5 4�@C=S; c�9BDMR9U 9�FKUD9 � P39B89 � � 5K=A@bFKF7^5- 6:PS9 � e FKF � U86DB:@b6D9XC^4T@51C9�UT9@C[cP 4�5KU8UD5K=SX�904S@C4�>3FK9_U85K4�5KFE@bBa6:M!9�C9B ^ Mb6:P39�B�4�5KU8UD57=3X�904S@C4�>3FK9.- 2S0S6 ;S5 � 9BD9�=L6GIBDMC4 @CF7F-=SM�=�/ 4�5KU8UD57=3X 904S@C4�>3F79U � N P357U 5KU_@b[[MC4T>3F75KU8P39; 2L^ >SFE@C[�5K=3X � U_5K= 6DP39T1C9�BD=39�F4T@b6:B85^4 2H9�6 � 99�= @CFKF�>A@C57BDU MCGV4�5KU8UD57=3X 9 4S@C4T>SFK9U8-�@C=S; ~ U$2 9�6 �N9�9= 4T57UDU85K=3X � =3M�=�/ 4T57UDUD57=3X>A@C57BDU�� N P39 9 � 9[�6�5KUa6DM >3FK@C[9 @CFKF�4�5KU8UD5K=SX 9 43@b4T>3F79Ua5K= @ UD5K=SX�FK9�M�B86DP3M�X�MC=A@CF�;35K4�9=SUD5KMC=5K= GI9@b6D03BD9TUD>A@C[�9 ��a � 9[�6D5 C9F7^5-�@CFKF 4�5KUDU85K=3X<904S@C4�>3F79U @CB89 [�M./ F7M1[@b6:9�; @b6�@ UD57=3X�FK9T> MC5K=L6 -5K=1JA=3576D9F ^ ;357U86:@C=L6"GIB8M�4n6DP39 MC6:PS9B ;A@b6:@ �

Page 51: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

H

0.7

0.8

0.9

0 10 20 30 40 50 60 70 80 90 100

Mea

n R

OC

Percent missing structures

GO:0008168

0.7

0.8

0.9

0 10 20 30 40 50 60 70 80 90 100

Mea

n R

OC

Percent missing structures

GO:0005506

0.7

0.8

0.9

0 10 20 30 40 50 60 70 80 90 100

Mea

n R

OC

Percent missing structures

GO:0006260

0.7

0.8

0.9

0 10 20 30 40 50 60 70 80 90 100

Mea

n R

OC

Percent missing structures

GO:0048037

0.7

0.8

0.9

0 10 20 30 40 50 60 70 80 90 100

Mea

n R

OC

Percent missing structures

GO:0046483

All SDPNone SDP

Self SDPAll Ave

None AveSelf Ave

Structure 0.7

0.8

0.9

0 10 20 30 40 50 60 70 80 90 100

Mea

n R

OC

Percent missing structures

GO:0044255

0.7

0.8

0.9

0 10 20 30 40 50 60 70 80 90 100

Mea

n R

OC

Percent missing structures

GO:0016853

0.7

0.8

0.9

0 10 20 30 40 50 60 70 80 90 100

Mea

n R

OC

Percent missing structures

GO:0044262

0.7

0.8

0.9

0 10 20 30 40 50 60 70 80 90 100

Mea

n R

OC

Percent missing structures

GO:0009117

0.7

0.8

0.9

0 10 20 30 40 50 60 70 80 90 100

Mea

n R

OC

Percent missing structures

GO:0016829

� 57X�03BD9 } �$# I 8F��;=<�� �� � ��24�5 -2E6 � � ��� � ;� � �*� �3��)+�*) � a�@C[cP JAXC03BD9">3FKMb6:U9-LGIM�B @ UD57=3X�FK9` % 6:9B84b- 6:PS9 4�9@C= � % � UD[MCBD9�@CU @aGI03=S[�6:57M�= MbGs6:P39-> 9�BD[�9=L6c@CXC9ZMCGd4�5KU8UD5K=SXa;A@ 6c@ 57=T6:PS9U86DBD03[�6:03B89"1b9B8=39F � N PS9 J3BDU86"U85^4?U89BD579U [MCBDBD9�UD>HM�=3;?6:M 6:P39�e P7a @b=3; /SY�\ 4�9�6:PSM1;3U8- � 576DP4�5KUDU85K=3X<;A@b6:@ @ �T=S576 ^![MR;39; @CU �M6-M�=39.- � �D/19F G �<M�B �8e F7F � � N P39TJA=3@CF�UD9B85K9�U 5KU GIBDMC4 @C=/�P7R 6DB:@C57=39;_GIBDMC4�6:P39 U 6:BD0S[�6:0SBD9!1C9�BD=39�F]@CF7M�=39 �

Page 52: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�#

� 5KXC03BD9 } �$#TU8P3M � U-6DP39aB89U803F76DU"MbG]6:PS5KU 9041>H9BD574T9�=L6 �V/ 6:BD5Z1 5K=3X�F ^$-3=SM�=39$MCG]6DP39aU89B85K9U";39 /6:9�BD57M�B:@b6D9U ;3B:@C4T@b6D5K[@bFKF7^�@CU � 9�5K=L6:B8M1;S03[9Z4�5KU8UD57=3Xa;3@b6c@ � \ =S;399�;U-34�M�U86V4�9�6DP3MR;3UN>H9B GIM�BD42H9�6D6D9BN6DPA@C= 6DP39 U89Q 039�=3[9!1C9�BD=39�Fd@CF7M�=39"9��9�= � P39=_6:PS9 U86DBD03[�6:03B8971C9�BD=39�Fs[M�=SUD5KU 6:U MCG GC~ �4�5KUDU85K=3X 9�=L6:BD579U��N B89=3;SU�@C4TMC=3X 6:PS9WUD5 4�4�9�6DP3M1;SUO6:P3@b6 � 9V[M�=3U85K;39�BD9�;�� 6 � M!1C9B8=39FS[M�4�2S5K=A@b6D5KM�=a4T9�6:P�/

MR;3U @C=3; 6:P3B899 4T9�6:P3MR;3U%GIM�B%B89>3FK@C[57=3X 4T57UDUD57=3X b@CFK0S9U � @CBD9V=SMC6 M�2 157M�03U%GIBDMC4 � 57X�03BD9 } �!# �e � 5KF7[M 41M�= UD57X�=39;�/ B:@b=31 [MC4T>A@bBD5KU8M�= MCG$6:P39 ;A@ 6c@ O UD9�9 UD03>3>SFK94�9=L6:@CB8^ B89UD0SF76:U O /19[ /6:57M�= } � � S2S ^R579FK;SU 6DP39�U:@b4T9 B:@b=31 5K=3X MCGO4T9�6:P3MR;3U @b6 �~ � M�B }C~�� 4�5KUDU85K=3X ;3@b6c@ I @bFKF 6DP3BD9�903= � 95KXCP 6D9;�U8034g4�9�6DP3MR;3U >H9B GIM�BD4�2H9�6D6D9B"6:PA@C=�@CFKFd6:PSBD99 �N9�5KX�PL6:9�;�UD034�4�9�6DP3M1;SU9-s@b=3;6:PS9 2H9U 6 U86DB:@b6D9XC^+GIMCB�P3@C=3;3F75K=3X!4T57UDU85K=3X ;A@b6:@!;S9>H9=3;3U 03> MC=j6DP39f1b9BD=S9F"[M�4�2S5K=A@b6D5KM�=4�9�6:PSM1; � �"UD5K=SX�@C= 03= �N9�5KX�PL6:9�;+[M�4 235K=A@ 6:5KMC=U- 6DP39 2H9U 6M/ 6:M./ �NM�B8U86aB:@C=�1R57=3X 57Uae-FKF / 6-MC=390//19�F7G � � M�= C9BDU89F ^$- 03UD57=3X @ � 95KXCP 6D9; [MC4�235K=3@b6:57M�=U-O6DP39 [�M�BDB89UD>HM�=3;S5K=3X�BD@C=31 5K=3X 5KU /R9F7G /6-MC=390/ e FKF �\ = U8P3M�B869-L6:P357U 9 41> 9�BD5K4�9=L6 ;3MR9U UDP3M � [�M�= R5K=3[�5K=3X�F ^�6:P3@b6 @C= /QP!R [@C=�4 @51b9"@C[[�03B:@b6D9

>3B89;357[�6:57M�=3U%57=�6DP39 >3BD9�UD9=S[9 MbG 4�5KU8UD5K=SX$;3@b6c@�Y P3M � 9�C9B9-R6:P39 B89UD0SF76:U @CB89"57=3[MC=3[F703UD5 �9 � 576DPBD9�UD>H9[�6"6DM 6:P39�2H9U 6-4�9�6DP3MR; GIM�BWBD9�>3BD9�UD9�= 6D5K=3X�4�5KUDU85K=3X 9 4S@C4T>SFK9UV57= 6:P3971b9B8=39Fp4T@b6:B85K[9�U �

� (�� & ��� ����������

N P39_>3B85K4T@CB8^ [�M�=3[�FK03U85KM�= GIB8M�4 6:P357U 94�>357BD5K[@CF�U86D03;S^ 57U 6:P3@b6�03U85K=3X @ �N9�5KX�PL6:9�; UD034 MCG1C9�BD=39�FKU�57= @C=!/�P!R�[�FE@CU8UD57J39BZ;3MR9U =3MC6 @CF �W@^RU�5K4�>3B8M C9�03>HM�=�6:PS9 UD5K4�>3F79B9-H03= � 95KXCP 6D9;UD0S4 @b>3>3BDM�@C[cP � \ = >3@CB86D5K[0SFE@CB8- � 9 PA@ C9�UDP3M � = 6DPA@b69-NGIM�B�@ [�M�4�2357=A@b6:57M�= MCGZU89Q 039�=3[9@C=3; U86:B803[�6D03BD9 1b9B8=39F7U�5K= 6DP39 >SBD9;S5K[�6D5KM�= MCG-`�9=39 %Z=L6:MCFKM�XC^�6D9B84TU8-]6:P39 �N9�5KX�PL6:9�;+UD0344�9�6:PSM1;_GIBD9�Q 039=L6:F ^?UD9�FK9[�6:U"@ UDM�F70S6:57M�= 6:PA@ 6 5KU � M�BDU89$6DPA@C=?6:P39 03= � 95KXCP 6D9; UD034 � %�=?6:PS9MC6DP39BZP3@C=3;U-s6DP39 �N9�5KX�PL6D9; UD034g;3MR9U @C>3>H9@bB 6:M_574T>3B8M �9 6DP39�/�P!R � U BDMC2303U86D=39U8U 5K=�6:PS9>3B89UD9�=3[9 MCGZ=3MC5KU8^ MCBT57BDBD9�FK9 C@b= 6V1b9B8=39F7U � � BDM�4u@ >3BD@C[�6D576:57M�=39�B � U�>HM�57= 6�MCG 1579��!-N6DP39U89BD9�UD03F 6:UaUD03X�XC9U86a6:P39 b@CFK039�MCGV9 b@CFK0A@ 6:5K=SX 57=3;35 R57;30A@CF 1b9B8=39F7U � 576DP BD9�UD>H9[�6�6:M @C=L^ XC5 �9�=[FK@CUDU857JA[@b6:57M�= 6:@CU21 >3B85KM�B 6:M�@C>3>3F ^157=3X�@ 1C9�BD=39�FW[M�4 235K=A@ 6:5KMC= 4�9�6DP3M1; � \ =+MC6DP39B �NMCBD;3U8-

Page 53: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

G

UD574T>SF7^![M�F7FK9�[�6:57=3X�@�FK@CBDXC9 b@CBD579�6 ^ MCG 1C9�BD=39�FKU @C=3; @b>3>3F7^R57=3X 6:PS9_BD9U803F76D5K=3X [M�4�2S5K=A@b6D5KM�=MCG:1C9�BD=39�FKU 6:M ;35 �9B8UD9?[FK@CUDU857JA[@b6:57M�= 6c@bU21 U 5KU =3MC6 F75d1b9F7^!6:M 2H9?@CU UD0S[[9�UDU GI03F @bUT@�4�M�BD9;357BD9[�6:9�; @b>3>3BDM�@C[cPU-A5K= � P357[cP?>3BD57M�B 1 =3M � FK9�;3X�9 MCG]@ >3@CB86D5K[0SFE@CB 1C9B8=39F � U B89FK9 b@C=3[9 X�0S5K;39�U576DUV5K=3[�FK03U85KM�=_57=_6:P39�6:BD@C5K=S5K=3X�U89�6 �

%Z03B�BD9U803F76DUN@bFKUDM U803X�X�9�U86 6:PA@b6�6DP39 1C9B8=39F�� 95KXCP 6DUN@bUDUD57X�=39�;T2L^�@C=DR C ��4T9�6:P3MR; 4 @^2H9�;35 ��[�03F76"6:M 57=L6:9B8>3BD9�6 ��� � > �`HL> � - 5 6Z57U [F79@CB"6:PA@ 6�@ F7M � � 957X�PL6�4T@ ^<2H9 @CU8UD5KXC=39;�;S03995 6:P39�B 6:M =3M�5KU89�5K= 6:P39�1b9BD=S9F�M�B-6:M B89;303=S;A@C=3[�^ � 576DP @C=3MC6DP39B 1b9B8=39F�57=�6:P39 [M�F7FK9[�6:57M�= �W-M � 9�C9B9- GIM�B�4T@C=L^�MCG 6:P39 [�FE@CU8UD5 JA[@b6D5KM�=�6:@CU21 U�6:P3@b6 �N9�[MC=3UD57;39B89;U- @_BD9�FE@b6D5 �9�F7^ 23BDM�@C;B:@b=3X�9 MbGdBD9�FE@b6D5 �9 1C9�BD=39�F � 95KXCP 6DUNMCG 6D9= ^R579FK;S9; Q 035 6:9"UD5K4�5KFK@CB%[FK@CUDU857JA[@b6:57M�=�> 9�B8GIM�B84 @C=S[9 �� 03B86DP39B84TMCBD95-O5K=!6:P357U >A@CB 6:57[03FK@CB [@CU895-�6:PS9 UD5Zc9TMCGW6:PS9 4 @bBDX�57=!;SM19�U�=3MC6a[M�B8BD9�FE@b6D9 � 9FKF� 576DP?M�>S6:574 @bF X�9�=39BD@CFK5Zc@b6D5KM�= >H9B GIM�BD4T@C=3[�9 �

� 576DP�BD9�UD>H9[�6�6DM >3B8MC6:9�5K=�[�FE@CU8UD57J3[@b6D5KM�=U-H576-5KU-> 9�BDPA@b>3UZ=3MC6ZUD03B8>3BD57UD5K=SXT6:P3@b6�U86DBD03[�6:03B895KU�4�M�BD9 57=SGIM�BD4T@b6D5 �9 6:PA@C=TUD9�QR0S9=3[�9 � W-M �N9 �9�B9-SMC03B B89U803F76DU � 5 6:P�BD9U8> 9�[�6 6:M$4T57UDU85K=3X ;A@b6:@UD0SX�X�9U 6-6DPA@b69-39�C9= � PS9= U8M�4�9$U 6:B803[�6D03BD9$;A@b6:@ 57UV=3MC6">3B89UD9�=L6 -H@C= /�P!R [M�4 235K=A@ 6:5KMC= MCGUD9�Q 039=3[�9�@C=S; U 6:BD0S[�6:0SBD9$4T57X�PL6V2 9 b@CF70A@C23F79 �N P39NF7M �N9�BO>H9B GIM�BD4T@C=3[�9 MCG16:P39 � 95KXCP 6D9;<1b9B8=39F1[M�4�2S5K=A@b6D5KM�= 4�5KX�PL6p2H9 ;S039 6DM-M �9�B8J36_/

6:57=3XZ@b=3; 5K=3U80 ��[579=L6�6:BD@C5K=S5K=3X";A@b6:@ � N P 03U8-RFK@CBDXC9B ;A@b6c@-UD9�6DU%4T57X�PL6]2H9=S9�J36�GIB8M�4 �N9�5KX�PL6D9;[MC4�235K=3@b6:57M�= � PS9=�6:PS9BD9N5KU]U80 ��[579=L6%;A@b6:@-6:M BD9F75E@C2SF7^�9�U86:574 @ 6:9 1C9B8=39F �N9�5KX�PL6:U���e F 6:9�BD=A@L/6:5 �9�F7^$- �N9�4�5KX�PL6VXCBDM�03>_4 03F76D5K>3F79-6c@bU21 U"@C=3;?;A@b6:@CUD9�6:UW6:M 4�M�BD9 BD9F75E@C2SF7^�9U 6:5K4T@b6D9Z@ UD57=3X�FK9UD9�6D6D5K=3X MCG 6:P39 � 957X�PL6:U"M�='1C9B8=39F7U � C923@CB:@�- }b~�~ #�2 � �e =L^ 9�4T>357BD57[@CF"U86D03;S^ =39�[9U8U:@CB85KF ^ FK9@ �9U?U8M�4T9�Q 039�U86D5KM�=3U?03=3@C=3U � 9B89; I M�=S9�[M�03F7;

5K4T@CX�57=39T@ b@CB85K9�6 ^ MCG"4�M1;35 JA[@ 6:5KMC=3U9-�9 4R6:9=SUD5KMC=3UTMCB @C;3;35 6:57M�=A@CF 9041>H9BD574T9�=L6:U 6:M @C;S; 6DM6:PS9 GIMC03B �N9";39U8[B85K2H9;T@C2 M C9 � N P39�UD9 57=3[F703;39.-�GIM�B%904S@C4�>3FK9.- 5K= �9�U86:57XL@b6D5K=3X�;35�� 9�BD9�= 6 6 ^R> 9�UM�B @�FK@CBDX�9�BW= 034�2H9B MCG 1C9�BD=39�FKU8-H4�MR;357G ^R5K=SXa6:PS9 /QP!R.BD9�X�03FE@bBD5dc@b6:57M�= >A@bB:@C4�9�6D9B9-1U8^RU86D94�/@b6D5K[@bFKF7^ @C;S;35K=3X?=3MC5KUD9 6DM M�=S9�MCB�4TM�B89�1C9�BD=39�FKU9-O9�6D[ � � P35KF79 UDM�4�9 MCG 6:P39�UD9�9041> 9�BD574T9�= 6DU� M�03FK;TFK5Z1C9F ^�2H9-4�M�B89"57=SGIM�B84 @b6D5 C9W6:PA@C=�MC6DP39B8U9- �N9-2 9�FK5K9 �9 6:PA@ 6 MC03B >SBD5K4T@CB ^�4�9UDUD@CX�9 �6:P3@b6"[M�4�2S5K=357=3X�1C9�BD=39�FKU 5K=<@ �N9�5KX�PL6:9�; G @CU8P35KMC=<57UV=3MC6"@CF �W@^RU"2 9�=39�JA[�5E@CF � � M�03F7;_BD94T@C57=03=3[cP3@C=3X�9�; � � 03B 6:P39�BV9041>H9BD574T9�=L6:U �NMC03FK;?4�M�BD9Z>SBD9[�5KU89F7^ ;39�J3=39$6DP39�UD5 6:0A@ 6:5KMC=3UW5K= � PS5K[cP

Page 54: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� 95KXCP 6D5K=3XV1b9BD=S9FKU"5KUV2H9=S9�JA[�5E@CF �� 9 ;35K;U-H5K=3@C; �9�B86D9=L6:F ^$-s>H9B GIM�BD4�M�=39�@C;3;35 6:5KMC=A@CFd9041>H9B85K4�9=L6 6DPA@b6 �N@CU�=3Mb6ZBD9�> MCB86:9�;

@C2HM �95- @C=3; � 9<2H9F75K9 �9 6:P3@b6 6:P39_B89U803F76 57U 5K=3U 6:BD0S[�6:5 �9 � \ = U89�686:5K=SX!0S> 6DP39?9041>H9BD574T9�=L6[MC4T>A@bBD5K=SX 1C9B8=39F [MC4�235K=3@b6:57M�=�4T9�6:P3MR;3U @C[�BDM�U8U Gb� ` %�6D9BD4�U9-�� 9�J3BDU86$M�2SUD9B��9�; 6:PA@ 66:PS9 /SY�\ 4�9�6DP3M1; @CFK4�M�U 6-0S=357GIM�B84TF ^ XL@ C9�@TFK@CBDXC9 � 957X�PL6 6DMT6:PS9 UD9�Q 039=3[�9�1C9�BD=39�F�@C=3; @UD4T@CF7F�� 95KXCP 6 6DM<6DP39 U86:B803[�6D03BD9 1C9�BD=39�F � \ = �9�U86:57XL@b6D5KM�= MCG 6:P39�UD9 BD9�UD03F 6:U UDP3M � 9; 6DPA@b6 6:PS9UD9�Q 039=3[�9'1C9B8=39FV4T@CB8X�5K= �W@bU [M�=3U85K;39�B:@C2SF7^!FE@CB8X�9BaUD574T>3F ^ 2 9�[@C0SUD9 � 9 PA@C;+=3MCBD4T@CFK5Zc9;6:PS9<1C9�BD=39�FKUVOI5 � 9 �^- >3B8M �89[�6:9;!@CF7FpMCG%6:P39 ;A@b6c@TM�=L6:M 6DP39�03=35 6ZU8>3P39B89 5K=<6:P39 GI9@b6:0SBD9�U8>A@C[9 S� 576DP3M�0S6 JABDU 6�[9�= 6D9B85K=3X_6:PS9�;A@b6:@_@CBDM�0S=3;�6:P39 M�BD57X�5K= � \ =!2HMC6DP�[@CU89U8-p6DP39�;A@ 6c@ � 9BD9�G @bBGIBDMC4 6:P39"M�BD57X�5K=@- @C=3; U8M >3B8M �89[�6:57M�= >3FK@C[9�; @CF7F3MCGs6DP39";A@b6c@$> MC5K=L6:U�M�=L6:M @ C9B8^TUD4T@CF7FA@CBD9@M�= 6DP39 0S=3576aUD>3PS9BD9 � � 9=L6D9BD57=3X�2H9�GIM�B89 =3MCBD4T@CFK5Zc@b6D5KM�=U-p@bU BD9�[M�4�4�9=3;39�; 2L^ �p@C=S[ 1RB85K9�69�6�@CF � � }b~�~L}�� -sFK9@C;3U"6:M_4�03[cP 2H9�686:9B [M�=3;S576:57M�=39�;�4 @ 6:BD57[9�U � N P35KU BD9U803F76Z5KFKF703U86DB:@b6D9U 6:PA@ 66:PS9 �N9�5KX�PL6:9�; 1b9B8=39FV4�9�6DP3M1; ;39�> 9�=3;3U 03>HM�= [cPA@CBD@C[�6D9BD57U86D5K[U MbG"6DP39 b@CBD57M�03U<1b9BD=S9FKU 57=6:PS9"[�M�4�2357=A@b6D5KM�= ��%Z=39"@ �9�=R0S9"GIM�BOGI0S6:03B89 �NM�BM1 � M�03FK; 57;39=L6:5 G ^ [cP3@CB:@C[�6:9�BD5KU 6:57[U�MCG �8X�MRM1;��1C9�BD=39�FKU8- @b=3;?>3BDM�>HM�U89$4�9�6DP3MR;3UVGIM�BV[B89@b6D5K=3X UD0S[cPf1C9�BD=39�FKU��e UD9�[M�=S; @bBD9@ GIMCB GI0S6D03BD9 � M�BM1 5KU 6:P39�;S9��9�FKM�>S4T9�= 6WMCG @CF76D9B8=A@b6:9 1C9B8=39F [M�4�2S5K=A@b6D5KM�=

4�9�6:PSM1;3U�� � M�B%904S@C4�>3F795-LX�5 �9= 6:PS9"B89FK@b6:5 �9F ^�B8M�2303U 6 >H9B GIM�BD4T@C=3[�9 MCGd/QP!R U � 576DPTB89UD>H9[�66:M X�BD@C;A@b6D5KM�=SU%5K= BD9�FE@b6D5 �9[1b9B8=39F��N9�5KX�PL69- � 9"2 9�FK5K9 �9V6:P3@b6 @$[�M�4�2357=A@b6DM�BD5K@CF14�9�6DP3MR; � PS5K[cPJA=3;SUV235K=A@bB8^ 1C9�BD=39�F �N9�5KX�PL6DUV4T57X�PL6N2H9 �9�B8^ UD03[�[9U8U8GI03F � �"=SGIM�B 6:03=A@ 6:9F ^$-R576N5KUN=SMC6VM�2 R5KM�0SUP3M �)6DM > 9�B8GIM�B84 9���[579=L6"M�>S6D5K4�5dc@ 6:5KMC= M�=<;35KU8[B89�6:9!1b9BD=S9F��N9�5KX�PL6DU �

� (�� x ����������� ��� #�� ��� vg��� ����#%�

Page 55: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� 6 ��� �5� � ��; � � BDMCUDU_/ b@CFK57;A@b6:57M�=ZGIB:@b4T9 �NM�BM1 GIM�Bd6:PS9 4�5KU8UD57=3X ;A@b6c@ 9041>H9B85K4�9=L6 � N P39 5K=3>3016b@CBD5K@C23F79U @CB89$;S9�JA=39�;�@CU GIM�F7FKM � U I�� � FK@C2H9Fs4T@b6:B85^4�-�� � U89Q 039�=3[9<1b9B8=39F 4 @ 6:BD5 4�-�� �U86DBD03[�6:03B89D1b9BD=S9FN4T@b6DBD5^4�-�� ��U89�6 MCGW[�FE@CU8UD9U8-�� ��= 034�2H9B$MCGV5 6:9BD@b6:57M�=3U8- ��= 034 2 9�BMCG�[�BDM�U8U_/ C@bFK5K;3@b6:57M�=+UD>3F7576DU9-�� �hU89�6 MCGZ>H9B8[9=L6:@CX�9U 4T57UDUD57=3X3-� �hU89�6 MCG�UD0S> 9�B R5KU89;FK9@CBD=S5K=3XT4T9�6:P3MR;3U � N P39�M�016:>30S6 MCG%6:PS9 @CFKXCM�BD5 6:P34 57U @T4 @b6DBD5 4 MCG%4�9@C= � % � U8[M�B89U8-5K=S;390419;<2L^?[FK@CUDU8-A> 9�BD[9�=L6c@CX�9 MCG]4T57UDU85K=3X�;3@b6c@�- @b=3;?FK9@bBD=357=3X 4T9�6:P3MR; ������������������������! #"$"$ &%�')(+*-,.*0/21�32/245 &67/2%5,98;:=<?>@<?A�<CB�<EDF<?G9<CHI<EJLKM-� NPORQ S2<$TUTUT$<ESWV X�Y[Z]\_^?\a`�bc\adUef`Wbab�gihfjlk?monqpEerks^En@dUe$pEnFtu2� vw�F��xyzB{�|� X~}�eU��\aZ�^E�2ef�~`W\aZ�eo�-�Fe$pE\a�@eUZ.^$t� � �=ORkCe$bcerm�^ojsba`qkEkr8;:=<ExUK�-� vw�]���9O���TUTUTEDI�|��2� vw�]�@�7O���TUTUT?G!���� � 8&�U��<C�U��<?>f��<?>���<EA��<EA��K�O�mo�2���]bc\c^r8#�W<?>@<?A�<��q<?G�K�X~���2ba\_^i\aZ.^En@^?p?`�\cZ�`WZ]�z^Eerk�^=kEeo^�kUt�2� vw�]�7��yzH��|��2� A��� O��~`W qe$¡�\¢kEkE\aZ2�F8_��<EA � K X£Y[Z]kCe$pC^i�@\¢kEkE\aZ2�@pEn�¤ik�`WZF��mUn�ba¥2�@Z]kUt�$S]� A��� OR�@`� �er¡�\ak?kE\cZ2�¦8§�|<EA � K���q� vw�]��¨Ly�J ����rM2� mob¢`�k?kE\_©]e$p=Oª^Ep�`W\aZ�8#¨{<�� � <?> � <?A��� K X@«�p�`W\aZ�^E�2e�mUba`qkEkE\_©FeUprt�$u]� �2p?e$�-\¢m�^?\cnqZ]k=Oª^?e$kC^r8;mUba`qkEkE\c©]eUpr¬2> � <EA��� K­X@¡®`� �e��2p?e$�-\¢m�^?\cnqZ]k�n�Z�^E�]e�^Ee$kC^=kEeo^$t� � � N�¯E° ±�° ²³O´N�¯E° ±�° ²µ¶mUn��@�2¥-^?e$g�n-mq8&� � ¬2�]pEer�-\amo^E\an�Z]k�K�·-8¸G�¹�D�K X~�-monqpEe^E�]e

�2p?e$�2\amo^E\an�Z]k$t�r�2� ��º|�!v¸�F��$�]� ��º��»v¸�F�� � � ��º��¼vw�]��$�]� ��º��»vw�]��$�]� ��º��¼vw�]�MWS]���.º��½���¾�������|�|���

Page 56: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

B

N�������� } � }EI � ��27���?�����? � � � ��24�5; � � ����; ��2�� �-27 ��H2 � � � �5��; � ���5����������2�� � ����� �������� ����� # � � ������ ��������� % ��� � ����� � ����� � � ��� �'N���� ��� } � � ���������� ���� ����� ����� ��� ����� � ��������������� ��������������� �! "���#�$�� ����%���'& (�(�*�+"=�=>9 ������0 ���>�� E�/�0 ����#��� �12���#� �

#��-��� �� �P/576 *�:"@ (�8 )�+�+?;<(�8 (�*�A (�8 =�@�=F;<(�8 ("@>( (�8 )�+�9K;B(�8 (�*�+ (�8 )�+"CF;<(�8 (�*�=

���'& (�(�*�+�(�:�A ����0 0V���$�#���� Q�#>�� ��� #���ED�� ��$������� �

IJ% *�(�+ (�8 )"=�*';<(�8 (�*�A (�8 =>A�A?;<(�8 (�*�) (�8 )"C>)K;B(�8 (�*�A (�8 )"@>9?;<(�8 (�*�:

���'& (�(�(�)"@�=>( Q�� ���L� ���7D�� ��E�� ��$ 576 @>A�: (�8 )�9"@F;<(�8 (�(�+ (�8 =�C>+?;<(�8 (�*�+ (�8 )�9�+K;B(�8 (�*�( (�8 )�)�9?;<(�8 (�*�*���'& (�(�(�+�(�+�+ #�0 ����.���0 ,�-��#�DM��0 � IJ% *�*�* (�8 9"@�*';<(�8 (�*�( (�8 =>)"CF;<(�8 ("@�C (�8 9�*�9K;B(�8 (�*�( (�8 9�*�@F;<(�8 (�*�(���'& (�(�(�A"=�@>A !!G!��D�� ��E�� ��$ 576 @�*�@ (�8 )�)�+?;<(�8 (�*�* (�8 =�C�@F;<(�8 (�*�: (�8 )�)�AK;B(�8 (�*�* (�8 )�+�)?;<(�8 (�*�(���'& (�(�(�:"C�*�) ������0 ��#� ��3#��-��� �� �P/ 576 *�@�C (�8 )�:�(?;<(�8 (�*�= (�8 =>(�)?;<(�8 (�*�+ (�8 )�A�*,;B(�8 (�*�+ (�8 )�*�+?;<(�8 (�*�:���'& (�(�(�+�)�*�* � ���?���#��� �M����� IJ% *�*�= (�8 =�=�*';<(�8 (�*�: (�8 +�:"@F;<(�8 ("@>( (�8 =�=>:K;B(�8 (�*�+ (�8 =>:�)?;<(�8 (�*�=���'& (�(�(�+"=�@�C #����,#>��� �3����,�M������E

,�-��#�DM��0 � �IJ% *�+�: (�8 )�9�(?;<(�8 (�(�) (�8 =>+�*';<(�8 (�*�: (�8 )�9�:K;B(�8 (�(�) (�8 )�)�A?;<(�8 (�(�9

���'& (�(�*�+�:�9�* � "�� E������E������#� �3#��-��� �� �P/ 576 C�*�+ (�8 9"C�@F;<(�8 (�("@ (�8 )"@>A?;<(�8 (�("= (�8 9"C�=?;B(�8 (�(�A (�8 9"C�CF;<(�8 (�(�A���'& (�(�(�9�:�("C ��#>��.���$������� � IJ% *�*�) (�8 9�:"@F;<(�8 (�(�) (�8 )�*�:?;<(�8 (�*�= (�8 9�:�*,;B(�8 (�(�) (�8 9�A�9?;<(�8 (�(�)���'& (�(�("C�C�@>: � R!%SD�� ��E�� ��$ 576 :�)"C (�8 )�)�)?;<(�8 (�(�+ (�8 =>+�:?;<(�8 (�(�) (�8 )�9�9K;B(�8 (�("C (�8 )�9"@F;<(�8 (�("C���'& (�(�A�("@>:�+ ��#��DM��.�/�E��#>����D�� ��E�� ��$ 576 *�("@ (�8 9"@>:?;<(�8 (�(�) (�8 )�(�*';<(�8 (�*�= (�8 9"@>9K;B(�8 (�("= (�8 9"@>+?;<(�8 (�(�)���'& (�(�(�+"C>(�) ����>�����0 /� � �#���E7�M������� E���0 /� � IJ% A�A�( (�8 9�:"CF;<(�8 (�(�A (�8 )"@>9?;<(�8 (�(�9 (�8 9�:�*,;B(�8 (�(�: (�8 9�:�(?;<(�8 (�(�:���'& (�(�(�)�+"C�@ #�,� ���,#���� E D�� �� �/��"��.��� � IJ% *�@�* (�8 9�*�+?;<(�8 (�*�A (�8 )�("@F;<(�8 (�*�= (�8 9"@>:K;B(�8 (�(�9 (�8 9�*�+?;<(�8 (�(�9���'& (�(�:"C�*�)�: �� ���#�D�0 � .�,���"���>1 ����>����� �

0 ����#�0 � Q�#>��� ���IJ% *�(�) (�8 )�:�:?;<(�8 (�*�= (�8 =>A"=F;<(�8 (�*�: (�8 )�:"@?;B(�8 (�*�C (�8 )�A"@F;<(�8 (�*�A

���'& (�("@>(�(�A"= .���,��D�� ��E�� ��$ 576 *�(�: (�8 9�)�A?;<(�8 (�(�+ (�8 )"=>)?;<(�8 (�*�C (�8 9�)�+K;B(�8 (�("C (�8 9�)�:?;<(�8 (�(�+���'& (�(�(�A"=>(�( ���#��� ����� ����� ���K12#��-������#����� �� �P/ 576 @�*�: (�8 9�A"@F;<(�8 (�("= (�8 )�A�+?;<(�8 (�(�) (�8 9�A"@?;B(�8 (�("= (�8 9"@>A?;<(�8 (�("=���'& (�(�*�+�("=>( !!G!��,�-��#�DM��0 � IJ% *�:�( (�8 )�)�+?;<(�8 (�(�9 (�8 =>9"CF;<(�8 (�*�) (�8 )�9�:K;B(�8 (�*�( (�8 )�9�:?;<(�8 (�*�(���'& (�(�("C�*�("@ ���������������D�� ��E�� ��$ 576 *�@>( (�8 9�(�9?;<(�8 (�*�( (�8 )�*�)?;<(�8 (�*�) (�8 9�A"@?;B(�8 (�(�) (�8 9�A�(?;<(�8 (�(�)���'& (�(�(�+�A"C�C ���$���0 #>�� ���7�>1 ���#��� ����� ����� ����#

��G!�!TPE����M����E������IJ% A�:�( (�8 9"@>)?;<(�8 (�(�+ (�8 )�A"=F;<(�8 (�*�( (�8 9�A�*,;B(�8 (�("= (�8 9"@>A?;<(�8 (�(�)

���'& (�(�*�+�)"=>: 0 � $�#� �3#��-��� �� �4/ 576 *�+�* (�8 )"=>A?;<(�8 (�*�* (�8 =>)�A?;<(�8 (�*�( (�8 )�9"@?;B(�8 (�(�9 (�8 )�9"@F;<(�8 (�(�9���'& (�(�(�+�:�+�) ����>���� �7#�,� ���,#���� E

��.��� ���.�����/�0 #>��� ���IJ% *�+�( (�8 )�9"@F;<(�8 (�*�( (�8 )�(�:?;<(�8 (�*�+ (�8 )�9�(K;B(�8 (�(�9 (�8 )"=>9?;<(�8 (�*�(

���'& (�(�*�+"=>9�) ."/�E�����0 #� ��#������ �� �4/�#M#��-��� ��$���7$�0 /����� �/�0 DO����E�

576 @�@�= (�8 9"=�*';<(�8 (�("C (�8 )�)"CF;<(�8 (�*�( (�8 9"=>AK;B(�8 (�("C (�8 9"=>:?;<(�8 (�("C

���'& (�(�(�+�*�*�) ��0 �����������7���#��� �M����� IJ% A�9"@ (�8 9�:�9?;<(�8 (�(�A (�8 )�+�:?;<(�8 (�(�+ (�8 9�+�(K;B(�8 (�(�A (�8 9�+�*';<(�8 (�(�A���'& (�(�(�:�+"=�@ ����>���� ��$�� ��#� ��#������ �� �4/ 576 *�+�: (�8 )�9�)?;<(�8 (�(�9 (�8 )�*�=F;<(�8 (�*�: (�8 )�9"@?;B(�8 (�(�9 (�8 )�)"CF;<(�8 (�*�(���'& (�(�(�:�)"=�@ ���������������#��-��� �� �4/ 576 *�A�) (�8 9�A"CF;<(�8 (�("= (�8 )"C�CF;<(�8 (�*�C (�8 9"@>+K;B(�8 (�(�+ (�8 9"@>(?;<(�8 (�(�+���'& (�(�*�C>("=�C � ���?���#��� �M���������#��-��� �� �P/ 576 *�*�( (�8 )�(�)?;<(�8 ("@>( (�8 =>A�(?;<(�8 (�*�9 (�8 )"@�@?;B(�8 (�*�) (�8 =>9�9?;<(�8 (�*�+���'& (�(�("C>:�)�9 ��0 �����������7���#��� �M��������

#��-��� �� �P/576 *�9�+ (�8 9�:�A?;<(�8 (�(�) (�8 )�+"=F;<(�8 (�(�9 (�8 9"C>)K;B(�8 (�("= (�8 9"C�=F;<(�8 (�("=

���'& (�(�("C�C�=>+ �%"�����#�����0 0 ��0 #��!����$�� ��� && A"C�@ (�8 )�)"=F;<(�8 (�("= (�8 )�*�CF;<(�8 (�(�9 (�8 )�9"=?;B(�8 (�(�+ (�8 )"=�@F;<(�8 (�("=���'& (�(�*�9�(�*�@ �� �� ��� && *�(�* (�8 )"C>)?;<(�8 (�*�C (�8 =>9�(?;<(�8 ("@�= (�8 )"C�@?;B(�8 (�*�+ (�8 )�A"=F;<(�8 (�*�=���'& (�(�A�("@>A�: ����Q�/�,�L���$���0 #>������#��-��� �� �P/ 576 *�A"@ (�8 )�*�CF;<(�8 (�*�( (�8 =>:"=F;<(�8 (�*�+ (�8 )"@>+K;B(�8 (�(�9 (�8 )�("CF;<(�8 (�*�*���'& (�(�*�+�("@�* � �"����$��#�0 ��?,��3D���#���� && *�A�+ (�8 =�=>:?;<(�8 (�(�9 (�8 =>("=F;<(�8 (�*�9 (�8 =>)�(K;B(�8 (�(�) (�8 =�@>9?;<(�8 (�*�)���'& (�(�(�+�:�*�@ ����>���� �7D�� �� 4/��"��.��� � IJ% *�=>( (�8 )�)�+?;<(�8 (�*�( (�8 )"@�CF;<(�8 (�(�9 (�8 )�9�)K;B(�8 (�(�9 (�8 )�9�9?;<(�8 (�(�9���'& (�(�("C>+�A�: ������0 ���� && A�:"= (�8 9�(�*';<(�8 (�(�+ (�8 )�:�A?;<(�8 (�("= (�8 9"@>(K;B(�8 (�("C (�8 9�*�=F;<(�8 (�("C���'& (�(�*�=�*�*�* ������0 ���� �� E��-TU���� ��.��� ��.�#>�#� �

#��-��� �� �P/576 *�C>: (�8 )�*�A?;<(�8 (�*�A (�8 =�C>+?;<(�8 (�*�= (�8 )"@>+K;B(�8 (�*�C (�8 )"@�*';<(�8 (�*�C

���'& (�(�("C�=>A"= �-/�������0 #� && :�9�( (�8 )�)�:?;<(�8 (�(�+ (�8 )"@>+?;<(�8 (�(�+ (�8 9�("@?;B(�8 (�("C (�8 )�9�*';<(�8 (�("C���'& (�("C�*�*�)�) ���>12#�������LD�� �� �/����.��� �� IJ% *�*�) (�8 )�(�9?;<(�8 (�*�= (�8 =�C�@F;<(�8 (�*�9 (�8 )�A�:K;B(�8 (�*�+ (�8 )�A�*';<(�8 (�*�=���'& (�(�:�A"@>A"@ � �"���#�����0 0 ��0 #��

������TP,��3D���#�����TPDM������E���$�#�����0 0 �

&& *�C>A (�8 )�*�:?;<(�8 (�(�9 (�8 =�C�=F;<(�8 (�*�A (�8 )�A"=?;B(�8 (�*�@ (�8 )�A�)?;<(�8 (�*�C

���'& (�(�:�A"@>A�: ����>���� �7����,��0 �%" && :�*�: (�8 )�*�+?;<(�8 (�(�9 (�8 =>+�*';<(�8 (�(�9 (�8 )�:�(K;B(�8 (�(�9 (�8 )"@>:?;<(�8 (�(�9���'& (�(�("C�C>(�9 ��#�0 ��� �� � ���7D�� ��E�� ��$ 576 *�=>A (�8 9�("=F;<(�8 (�*�* (�8 )"C>:?;<(�8 (�(�9 (�8 9�*�AK;B(�8 (�*�* (�8 9�*�A?;<(�8 (�*�(���'& (�("C>(�)"=>: ���$�#���� ,#�0 ��."/� � ��0 ��$�� ��#�0

��������� IJ% *�:�: (�8 )�)"=F;<(�8 (�*�( (�8 )�:"CF;<(�8 (�*�: (�8 9�(�AK;B(�8 (�*�( (�8 9�(�*';<(�8 (�*�(

Page 57: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

H"

N�������� } �! I ' � �� -27� ��) � �H��; ��).�5� ���� �� � � � �� � 24�5� ;�2E �� � � N ����� � ����� ��� ����� �� /� ����� � � ����� �/ ���� �� ����� � � � ��� � � 4 � � ������� ��� / � ��� 1 ��� ��� � � ��� � � ��� � � ��� ����� � � ���� ��� ���

a 4 � � � ��� �� � � ��� ������� �� � ��� � �/ ������ ��� ����� � ����� � � ���� � � ���� ��� � � ��� ��� � � � � � ��� ��� � ��� �� � ������� � � ���������� � ��� ����� � � ����� � ��� ��� ����� � � ��� � � ��� � ��� ��� � � � �� ��� �

��� �� � � � ��� � � ����� ���� � � � �� � �

��� ��� � � � � � �

��� � � � ��� ����� � B � / � �# � � �DGE� " � / #A" # ��� B � / � " ���� # ��� #H" � / � H � � �

� � � �� � � ��� # G � � / ����B � ����������� � �

N�������� ��� # I ' � �� -27� ��) � �H��; ��).�5� ���� �� � � � �� � 24�5� ;�2E �� � � N ����� � ����� ��� ����� �� /� ����� � � ����� �/ � ��� ��� ����� � � � � � � � 4 � � ������� ��� / � ��� 1 ��� ��� � � ��� � � ��� � � ��� ����� � ����� ��� ����� �

a 4 � � � ��� �� � � � ������� �� � ��� � �/!� ������ ��� ����� � ����� � � ���� � � ���� ��� � � ��� ��� � � � � � ��� ��� � ���#"

� � ������� � � ���������� � ��� ����� � � ����� � ��� ��� ����� � � ��� � � ��� � ��� ��� � � � �� ��� �

�! "���#�$�� ����% �! "���#�$��?*-T4G!��� � ����% *-T4G!��� � �! "���#�$��,@ T4G!��� � ����% @ T4G!��� ��! "����#�$�� $ =�8 C�*�9��-T4:�9 C�8 )�:"C>�-T�*�*�) =�8 A�*�9���T4C�C 9�8 @�@�*��-T�*�@>9 9�8 C>A�)���T4C>9���L% $ $ *�8 :�*�C>�-TP)�: (�8 (�(�("@>)"= *�8 +�*�)��-T�*�*�A *�8 *�*�C>��TP(�9

�! "���#�$��?*-T4G!��� � $ $ $ $ @�8 :�9�9��-T�=>( $����% *-T4G!��� � $ (�8 (�(�("@>)"= @�8 A"=�@>�-TP)�A $ @�8 )"C�=>�-T�*�*�: *�8 +�A�A���TP("C

�! "���#�$��,@ T4G!��� � $ $ $ $ $ $����% @ T4G!��� � $ *�8 *�*�C>�-T4(�9 *�8 =�@>+��-T4=>( *�8 +�A�A���TP("C =�8 C�=>A��-T�*�*�+ $

Page 58: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

# �

N�������� ���DGEI ' � �, -27� ��) � �H�,;��).�5� ���� �� � � � �� � 27�5�?; 27 ,� @ � a � � � ��������� ��� ����� - ����� ���� � �� � � � � �� � � ������� ��� - �� � ����� � � ����� �/ � ��� ��� ����� � � � ��� � � 4 � � ����������� / � ��� 1 ���� � � � � /� � � ��� � � ��� ��� � ��� 4 � ���������� � � ��� � � � � ��� � ��� ��� a 4 � � � ��� �� � # � � ����������� � � � � �/ � ��� �� � �

��� � ������� � ���� � � � ���� ��� � ��� � ��� � � ��� � ��� ����� ���#" � � � ����� � � ��� ������� � ��� ������ � ����� � ��� ��� ��� �

� � ��� � � ��� � ��� ��� � � � �� ��� �

*�( � �! "���#�$����U��0 0 � ���L%��2��0 0 � �! "����#�$����P����0 1�� ����%��P����0 1�� �! "���#�$����PG!������� ����%��PG!��������! "���#�$����U��0 0 � $ :�8 9"@�C>��T4=�C C�8 :�)�A���TPA�* @�8 9�9�:��-T4C�C 9�8 C>("@>�-TPA�( @�8 +�:�9��-T4+�*����%�2��0 0 � $ $ $ $ $ $

�! "���#�$����P����0 1� $ *�8 ("@>��T�*�+ $ +�8 (�)"=>�-T�*�= $ A�8 =>+"=>�-T�@�@����%��P����0 1� $ :�8 9"C�*���T�*�( $ $ $ *�8 C�*�A��-T-*�9

�! "���#�$����PG!������� $ A�8 9"@>��T�*�9 A�8 )�9�:���TP("C A�8 )�A"@>�-T4@>A $ )�8 +�A�)��-T�@>9����%��PG!������� $ (�8 (�(�*�9�*�: $ $ $ $

@>( � �! "���#�$����U��0 0 � ���L%��2��0 0 � �! "����#�$����P����0 1�� ����%��P����0 1�� �! "���#�$����PG!������� ����%��PG!��������! "���#�$����U��0 0 � $ )�8 *�:"C>��T4=�C A�8 :�A�)���T4C>) +�8 =�C�*��-TP+�* *�8 *�*�@>�-TP:"= *�8 9�:�+��-T�C�=����%�2��0 0 � $ $ $ $ $ $

�! "���#�$����P����0 1� $ :�8 :�:�:���T�*�( $ $ $ (�8 (�(�("=�=>A"=����%��P����0 1� $ A�8 )�9"C>��T�*�: $ $ $ *�8 )�+�:��-T4("=

�! "���#�$����PG!������� $ *�8 +�9"C>��T�*�+ :�8 9�+�A���T4@�@ )�8 C>(�+��-T�*�@ $ 9�8 ("C>+��-T-*�*����%��PG!������� $ *�8 C>+�9���T�*�@ $ $ $ $

A�( � �! "���#�$����U��0 0 � ����%�2��0 0 � �! "���#�$����P����0 1�� ����%��P����0 1�� �! "���#�$����PG!������� ���L%��PG!��������! "���#�$����U��0 0 � $ =�8 *�)"@>�-T4+�+ *�8 =>+���TP+�: *�8 =�*�)��-T4C>) )�8 :�+�*��-T4C>( @�8 A�+�:��-T�C>(����%��U��0 0 � $ $ $ $ $ $

�! "���#�$����U����0 1� $ *�8 )�(�*��-T4("C $ $ $ $����%��P����0 1�� $ *�8 *�C�=>�-T-*�A (�8 (�(�(�A�9�(�9 $ $ $

�! "����#�$����PG!������� $ :�8 *�*�+��-T-*�: C�8 *�@>9���TPA"= *�8 )�("C>�-TP("= $ (�8 (�(�(�)�)�:�)���L%��PG!������� $ )�8 ("C>)��-T�@�@ (�8 (�:�A"C�C $ $ $

Page 59: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

# �

� � ��� ��� �

� ��� ������� ��� ����� � ����� �� � ��� � ��� ����� ���

���! #"%$&�('*),+.-0/1)!/2-3"4-056+."87:9,/%)!/2 <;='>/2?@$37:56+4/4 <A,9,+. #7:5B+47=+4�!-C;='>$&�! #5!-ED<-F'*/45! #5!GH$37:;I;J9!5! K+L?:M���!-8NO7:/4P=)!/4-0"4-05Q+4-3RB�!-3/2-3 #5S�('>"�AT-3-35B'>$0$3-0),+.-0RVU( <5S'*A!/4 #R!G:-3RXWY7>/4;BUZ+47J+.�!-\[^](_a`cb^]Td>_fehgi]Td>jk gi]FlF`cb.`c]nm&`ogi]�pqdZm&rZes]n`\tu`4d>b^](es]Zvxwzy,{6{6|&}I~���-0N� <"0UV�>-0A('>/4',UT'>5!Rx��7:A!D#->U��>�:�:�*A,�hU�'*5!R�+.�,-WY9!D#D�+4-c�Z+H�('>"JAT-3-05�"49!A!;I #+2+.-0R�+.7x+.�,-��(gi��b^]Td>j�galHp�dZm&rZes]n`=tu`4d>b^](es]Zvx��`&��`4d>b.m&r~��u-cN� <"0U�>-3A!'>/.',U�'*5!RB�%7:A!D#->UT�>�>�:�:'*�V'>D<7:5,GJN� #+.�S+4�!-\-3;I)! </2 <$F'*Dn/4-0"49!DK+."�7>W����('>),+4-3/��!M

���!-H+.-3$&�,5! <�Q9!-H7>WO;@'��, #;J9!;�-356+./27:)6?qR! <"2$3/2 <;I <5('*+4 <7:5�N�'>"C #56+./47ZR!9!$0-3RqA6?��:':'>PQP*7:D�',U ¡-0 <D�'�U�'*5!R��>-3A!'>/.'S~£¢�¤:¤>¤>$0��'>5!R=N¥'>"O-c�Z+.-05!R!-0RB #5S�>-0A('>/.'X~¦�>�>�>�6'*�§M�¨%-0/4-*U�NO-1A!9! #D<R=7:5@+.�,-)!/2 <7:/©NO7:/2Pª+.7E)!/4-0"4-05Q+�'>5H <;I)!/27�«>-3RHD�'i+.-356+O �¬®­¯«>'*/4 �'i+. <7>5('>DQA�7>9!5!RVUZ'°D�'*+4-356+O �¬®­±;I K�Q²+.9,/4-J7>WO³\'>9!"2"4 <'>5!"%WY7>/1;J9!DK+. ´²LP>-0/45!-0DuD<-F'*/45! #5!G!U�'>5!R�'>5�-cµI$3 <-056+°7:),+4 <;I <¶F'i+. <7>5B),/47Z$3-3R,9!/4-*M·¸-@+.�!-05�)!/4-0"4-356+o+4�!-@+.-0$&�!5! #�Z9,-�'>"o'x5!7:5,"2+&'i+. <7>5('>/2?�P*-3/45,-3D¥$07:;JA! #5('*+. #7:5VU AQ?R!-3/2 #«Z <5,G+.�,-�$07:;JA! #5('*+4 <7:5JNO-3 #G:�6+."3M�·¸-�"4�!7�N¹+4�('*+®+.�,-%$07:;JA! #5('*+. #7:5ªNO-3 #G:�6+."®+&'>P*-�+4�!-�WY7:/4;7*Wn+.�,-)T7:"2+4-3/4 #7:/17�«>-3/8+.�,-J;= ´�Z+.9!/2-J;=7ZR!-0DhUT;@'>PQ #5!G@-3'>$&�qP>-3/25!-3D�;I7:"º+8 <5�»(9!-356+4 �'>D¼ <5x+4�!-J/4-0G: <7>57>W <5!),9,+�"4)('*$3-\WY7:/¥N��! <$&�B #+� #"�;=7>"2+�/4-0"4)T7:5!"2 <A!D#-8WY7:/¥+.�!-\ #5!)!9,+�R! #"2+4/4 <A,9,+. #7:5VM

½�¾�¿ À ÁE¡ÃFÄ Å�Ä ÆÈÇXÉ�Ê®ËIÌXÍ ÎÏÃFÐ�Ñ�Ê®ÃFÄ ÃFÇxÁCÉ�Ã3ËIÇ

���!-¹;='i�� <;ª9!; -356+4/47:)6?�R! <"2$3/4 #;= #5('*+4 <7:5ÓÒh ¡¬�­\ÔxWY7:/2;@'>D# <"2; N¥'*"¸Õ(/2"2+� #5Q+4/47ZR!9!$0-3R #5�:':'>PQP*7:D�',U� B-3 <D<',U®'>5!R��>-0A('>/4'Ö~£¢�¤:¤>¤>$0�¥'>5!R�N¥'*"o"4�!7�N�5�+.7�AT-�'�»(-c�� <A,D<-XG:-05!-3/4'>D< #¶F'*+4 <7:5

Page 60: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�Q�

7>W�"49!)!)T7:/º+E«>-3$c+.7:/C;@'>$&�, <5!-0"3M@ �¬®­�)!/47ZR!9!$0-3"C'B"27:D<9�+. <7>5q+4�('*+E <"\'�R! #"2+./2 <A!9�+. <7>5�7*W¥)('i²/.'*;=-c+.-3/C;=7ZR!-0D<"��@Ò��EÔ°/.'i+.�!-0/ª+.�('*5Õ(5!R! #5!G�'�"2 <5!G>D<-I)('>/.'*;=-c+.-3/C"4-c+4+. #5!G����FM¡·¸-X"º+&'>/º+A6?�'>"2"49!;I <5!GCN�-E'>/2-°G: #«>-35S+./4'> <5! #5!Gª-^�,'>;=),D<-3"����� ���N� K+.�S+.�!-0 </¥$07:/4/2-3"2)�7:5,R! <5!GoD<'>AT-3D<"� ������o¢��EWY7:/����������Q¢�� �!�!� �#"$�QM

·-1A�-0G: <5@N� K+.��'ªD# <5!-3'>/�R! <"2$3/4 #;= #5('>56+�WY9!5!$0+4 <7:5nU&%\Ò'�)(*�\Ô+�-,/.0�2143�M����! #"¥R! <"2$3/2 <;I K²5('>56+�WY9!5!$c+. #7:5� <"�"4)T-3$0 #Õ(-0R¡A6?5�-�6�7,8�93!�C$37:56+.'> <5! #5!GJ+.�,-E�6?Z)T-3/4),D�'>5!-\)('*/.'>;I-0+4-3/�'>"�NO-3D<D'>"C'B"2$F'>D<'>/\A! �'*"\«*'>D#9!-:3�M<;ÓD# <5!-3'>/°$3D<'>"4"2 #Õ(-0/EN� #D<D�;='>P*-@'�A! <5!'>/2?�),/4-3R, <$0+4 <7:5nU$=� UuWY7:/E'>5-c�,'>;I)!D#->U&��U(9,"4 <5,GH+4�!-\"4 #G:5�7>W©R, <"4$0/4 #;= #5('>56+FM

=� �¯"4 <G>5uÒ>%\Ò'�)(*�\Ô4Ô���!-?Id>b§v>es]H7>Wu+.�!-\$3D<'>"4"2 #Õ(-0/�WY7:/�-^�!'*;=)!D#-@�¼ <"�G: K«:-35�A6? � �%°ÒA�B(*�\Ô�'>5,RB #"�)�7>"4 #+4 #«>-8 DC+.�,-ªD�'*A�-0D � � #"�7>5�+.�!-E$37>/4/4-0$0+1"4 <R,-C7>W©+.�!-C�Q?Z)T-3/2)!D�'>5,->M�·-CR!-0Õ!5!-C+4�!-ªD#7:"4"0UFEHGJILK I�U'>"�'o5!7:5�²z <5!$0/4-3'>"4 #5!GI'>5!R�$37:56«>-c�BWY9!5!$c+. <7>5B7*W +4�!-\;@'>/2G: <5nMMzWuN�-8NO-3/2-°9!"4 #5!GH'ª/4-0G:9!D<'>/4 #¶F'*+4 <7:5H+.�!-07:/2?=WY/.'>;I-0NO7:/2Px~ ³\ #/47:"2 �-c+�'>D§M#UT¢�¤:¤ON��hUQN�-8NO7:9!D#R"4-0-3P '¸"4)T-3$3 KÕ($P���X"4-c+4+. #5!G�7>W�,�'>5,RH3�+4�('*+S;I <5! #;= #¶3-0"=D#7:"4"IN��! <D#-�-35,"49!/2 <5!G�+.�!'*+X+.�,-;='>G:5! K+.9!R!-�7>W�'1/2-3G:9!D<'>/4 #¶F'*+4 <7:5\WY9!5!$c+. #7:5RQHÒS�\Ô #"©P*-3),+®"2;@'>D#D6WY7:/©G:-05!-3/4'>D< #¶F'*+4 <7:5C)!9!/2)�7:"2-3"0U->M G!MKU � � �±'*/4G:;I <5T U QHÒ��\ÔV1XW ZY [ ExÒ � \%\ÒA�](*�\Ô2Ô7^��·¸-%$3'>5X <56+4/47ZR!9!$3-�R!-0"4 </2-3R=;= #5! <;J9,; ;='>/4G: #5H)('>/.'*;=-c+.-3/2"3U`_a�6�/_cb*� �!�!� �#_ . �\'>5!R=/4-0N�/2 #+4-+.�,-E7>),+. #;= #¶F'*+4 <7:5=7>Wd����'>"�WY7:D<D#7�N�" G

Ò�� � �#_ � Ôd�±;= #5Tfe g U QHÒS�\ÔV1 W ZY [ E�Ò'_JYÔ ^"49!AJh2-0$0+�+.7 � �%\Ò'�:i(*�\Ôkj�_`ml �&� no�p�q�r�

ML5¸+4�!-=$3'>"4-I7>W� �¬®­JUVN�-= <5!"º+.-F'*R¸"2-3-3P�'�R! <"º+./2 <A!9,+4 <7:5�7�«>-3/R�JMI���Q9!"3U $3D�'*"4"4 KÕ($F'i+. <7>5N� <D#DnAT-\)�-0/2WY7:/2;=-0R�N� K+.�

=� � "2 <G:5tsfu T �=ÒS�\Ôv%°ÒA�)(*�\Ôvw8��x��

Page 61: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

���

;1G:'> <5VU�N�-\ <56+4/47ZR!9!$3-\;='>/4G> <5X)('*/.'>;I-0+4-3/4"�'>5,R¡-^�,),/4-3"2"�+4�!-\$3D<'>"4"2 #Õ($3'*+. #7:5S$37:5,"2+./4'> <56+4"%'*"u T �=ÒS�\Ô�Ò � \%\ÒA�](*�\Ô2Ô&wJ� l _` no� ���<�

�%7�N\UVNO-H;J9!"2+°Õ!5!RP�@Ò��EÔ�+.�('*+\"4'*+. #"2Õ(-0"8+.�!-H$0D�'>"2"4 #Õ!$F'*+4 <7:5x$07:5!"º+./.'* <56+."8N� K+.�!7:9�+\'>"4"29!;o² <5,G¡'*5Q?Q+4�! <5!GB'>R,R! #+4 <7:5('*D�'>AT7:9,+��=ÒS�\ÔcMo���! #"\$F'>5�A�-I'>$0$37:;I)!D# <"4�,-3RqA6?�;@'��, #;= #¶3 #5!G@+.�,-� r,d>](]ngi]��O](_§b.g����iU�Ò>�@Ò��EÔ2Ôd�6j�� T �@Ò��\Ô,D<7:Gd�=ÒS�\Ôvw8�JUZ7>WV+4�!-8)('>/4'>;I-0+.-0/�R! #"2+4/4 <A,9,+. #7:5VUN��! #D<-ª"4'*+. #"2Ws?Z <5,G=+.�,-J$37:5,"2+./4'> <56+4"3M°���! #"8 <"1't?Id� :e'?o�8?�`c](_fb.g����SÒh ¡¬OÔ�-3"2+4 <;='*+. #7:5B)!/47:AZ²D<-0;¡M¼���!7:9,G:�ªNO-�/4-c+&'> #5C+4�!-�5('*;=-��2;@'��, #;J9!; -056+./47>)Q?CR! #"4$3/2 <;I <5('i+. <7>5VU���NO-�N� <D#DQ'>$0+49('>D#D#?9!"2-8+.�!-8;I7:/2-1G:-05!-3/4'>Dn;I <5! #;J9!;/2-3D<'*+. K«:-1-056+./47>)Q?�Òh ���¬�ÔcU,'>"¥ <5S�:':'>PQP>7:D<'ª-0+�'>DhM�~£¢�¤:¤:¤>$c�hM·¸-E9,"4-\+.�!-\/4-0D�'*+4 #«>-����('>5,5!7:5B-356+./27:)6?�G: #«>-35BAQ?

��Ò���� �������fÔd� u T �=ÒS�\Ô,D<5 �=ÒS�\Ô� ����� Ò��\Ô wJ� �N��! #$&��'>D<D#7�N�"E$&�,7: <$0-=7>W�' �Tb^ehgib8R! #"2+./2 <A!9�+. <7>5VU\� ����� Ò��\ÔcM��%7*+.-H+.�('*+C;I <5! #;= #¶3 <5,GX/4-0D�'*+4 #«:--356+4/47:)6?� <"�;I7:/2-°G:-35!-0/.'>D�"2 <5!$0-\$&�!7�7>"4 <5,G � ����� Ò��EÔ�9,5! #WY7:/2;�G: K«:-0"�;='i�� <;ª9!;Ó-056+./47>)Q?>M

!#"%$'&)(*$,+ -/. �,d6d*0106gijKd�`c_1d>j323465�7�7�7Zm98;:Vr(`C��gij£��_fehgi]�_LgB_Yr(`ªp¡�<�/�Tb.g>=3j<` ?�r,di�H_sr(`�lFgij@?j<g*A�es]ZvJvZ`c]n`cb2d>j>lFgib*?CB

�@Ò��R�#_VÔd� ¢DJÒFETÔ �������4Ò��R�#_VÔHG1IKJMLONQP JSR T�JMU ��V JFW T �YX g J3Z

A©r(`cb.`�DªÒFETÔoe<�J_Yr(`J]ngib*?Id>j£e3[�d>_§ehgi]�m&gi],�c_hd>](_\wM�,d>bc_fes_fehgi]=l^�Z]nmc_§ehgi]>}Sd>]�\]E�� �^EFb*�!�!� � �_E . �\Z`9`®]n`&�¡dq��`c_ogalS]ngi]a?L]n`hv6d>_fecb>`@tVd�v>b2d>]ZvZ`a?o�Zj£_§e��Tj£eh`cb.��4Igi]n`°lFgibx`4dZm&r¹mcjKdi�&�ce `¥m4d>_§ehgi]¯m&gi]a?�c_fb4d>es](_F2dE d>b.`X��`c_�=e�f`®]�\>es]Zv¸_sr(`��Z](ehg3��`5?Id� :e'?o�J? galS_sr(`°lFgijsj<g*A�es]ZvCiFgies](_fj@��m&gi]nm4d>b>`l^�Z]nmc_§ehgi]�B

j®ÒSE�Ô �6j�D<7:GkDJÒSE�Ô*�·-o5,7�N �('F«:-o+.�,-o;=-3'>5!"8+.7S"27:D#«>-I �¬®­ ),/47:A!D#-3;I"3U�'*"°D<7:5!GX'>"8N�-H$3'>5�'>5('>DK?Z+4 <$3'>D<DK?

-0«*'>D#9('*+4-�+4�!-B)('>/2+4 #+4 <7:5�WY9!5,$0+. #7:5VUlDJÒFETÔcMnm�-3$3'>9!"4-B+.�!-�7:A`h2-3$0+4 #«>->Uoj®ÒSE�ÔJ #"I$07:5!$3'�«>->U¥NO-$F'*5�Õ(5!R� K+."�;@'i�� #;J9!;�+4�!/47:9,G:�x"2+.'>5!R('*/4Rx$07:56«:-c��)!/47:G>/.'>;I;= #5!GJ+.-0$&�!5! #�Z9,-3"I~pm�7�?�Rq'*5!Rq�'>5!R,-35QA�-0/4G:�,->U��>�:�r�i�hM

Page 62: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�:�

; )!/4 #;@'>/º?�'*R,«*'>56+&'>G:-�7>W�+.�,-� ¡¬�­ WY/.'>;I-0NO7:/2P� <"J+4�('*+oNO-¡$3'>5Ö-3'>"4 #D#?;=7�«:-B'FN�'�?WY/47>;Ï+.�,-�+4/.'>R, #+. #7:5('>D®D# <5!-3'>/JR! #"4$3/2 <;I <5('*5Q+C+.7q <5,$3D<9,R!-X)!/27:A('>A! #D< #"2+. #$@;I7�R,-3D<"0M���7:G�/4'*+. #7R! #"4$3/2 <;I <5('*5Q+4"¥7>W¼+.�!-°WY7:/2;

%\Ò'�)(*�\Ôd� D#5 �@Ò'��� ,��VÔ�@Ò'��� , X Ô 1 3'>/2- /4-3'>R! #D#? �('>5,R!D<-0R A6?  �¬®­JMI���! <"ÖR! <"2$3/2 <;I <5('>56+�WY9!5!$c+. #7:5 <"�"4)T-3$0 #Õ(-0R A6? � ��7,����9, X � 3/�@$37:56+.'> <5! #5!GBG:-35!-0/.'*+4 #«>-=;I7�R,-3D�)('>/4'>;I-0+.-0/4"E'>"\N�-0D<D�'>"C'B"2$F'>D<'>/\A! �'*"\«*'>D#9!-:3�M�%7*+.-C+4�('*+%N��!-35��=ÒA��� ,��nÔ����ÒA��� ��� ��Ô�'>5,R��@Ò'��� , X Ôp����Ò'��� � X ��Ô¥N�-J�!'�«>-J-3�Q9('*D$37�«*'>/2 �'>5!$0-E³E'*9!"4"2 �'>5!"0U�'>5!RB"47I/4-c+&'> #5�'ID# <5!-3'>/¥R! #"4$3/2 <;I <5('*5Q+OWY9!5!$c+. <7>5VM��-0$F'>D#D�+4�('*+� #5B �¬®­ NO-°"47:DK«:-8WY7:/¥'JR! <"º+./4 #A!9,+4 <7:5=7�«>-3/�"47>D<9,+4 <7:5!" �@Ò��\Ô�"49,$&�B+4�('*+�+.�,-

` �(`&mc_L`O\�«*'>D<9,-�7*WV+.�!-�R! #"4$3/2 <;I <5('*5Q+®9,5!R!-3/�+.�! #"OR, <"2+4/4 #A!9,+. #7:5I'>G:/2-3-3"®N� #+4�=+4�!-%D<'>AT-3D< #5!G!M\ML5'>R!R, #+. #7:5@+47JÕ(5!R! #5!GH'R�@Ò��\Ô�+.�('i+�".'*+4 <"2Õ!-3"�$3D<'>"4"2 #Õ($3'*+. #7:5X$07:5!"2+4/.'> #56+."� <5X+4�!-°-c��)T-3$c+&'*+4 <7:5VU �¬®­ /2-3G:9!D<'>/4 #¶3-0"�+4�!-E"47:D#9,+. #7:5�R! <"º+./4 #A!9,+4 <7:55�=ÒS�\Ô¥AQ?�-0 #+4�!-3/�;@'��, #;= #¶3 #5!GJ #+4"�-356+./27:)6?¡7>/;I <5! #;= #¶3 <5,GC K+."¥/2-3D�'i+. #«>-°-356+./27:)6?X+.7�N�'>/4RB"47>;=-°)!/2 <7:/O+&'>/2G:-0+�R! #"2+4/4 <A,9,+. #7:5 � ����� ÒS�\ÔcM����Q9!"0U �¬®­�"27:D#«>-3"�+.�,-E$07:5!"º+./.'* <5!-0R¡7:)�+. <;I <¶3'*+. #7:5@),/47:A!D#-3;

;= #5� � T � ��Ò���� � ����� Ôn" ��+!��u T �@Ò��\Ô3~ � '%\Ò'�B(*�\Ôkj�_`s�Vl¯� no����� Òh�,M#¢�Ô

N��! #$&�x)!/47 h2-3$0+4"%+4�!-ª)!/2 <7:/ � ����� ÒS�\Ô�+.7I+.�!-C$3D#7:"4-0"2+%)�7: #56+1 #5B+4�!-J'>R,;= #"4"4 #A!D<-°"2-0+17:/%$07:56«:-^��Q9!D<DQR!-cÕ(5!-0RJA6?°+.�!-�'>A�7�«>- �d��¢��!�!� � � "�$37:5!"º+./4'> <56+."0M©���!-O"47:D#9,+. #7:5u~ �:':'>PQP>7>D�'�-0+©'>DhMKU:¢�¤>¤:¤>$0�WY7:/¥+4�!-\)�7:"º+.-0/4 <7>/��@Ò��EÔ� <"�+.�!-\"º+&'>5!R!'>/4RB;@'��, #;J9!; -356+./27:)6?�"4-c+4+. #5!G

�=ÒS�\Ôd� � ����� Ò��\ÔDJÒFETÔ G I J P JFR T�J3U ��V J � T �YX g J3Z

N��,-3/4- DJÒFETÔ � u T � ����� ÒS�\Ô G I J P JhR T�JMU ��V J � T �YX g J Z ����!-E)('>/º+. #+4 <7:5=WY9!5!$0+4 <7:5 DJÒSE�Ô¥5!7>/4;='>D< #¶3-3"��@Ò��EÔ^M� �¬®­ Õ!5!R!"�+.�!-\7:),+4 <;='>Dn"2-0+2+. <5,GI7*W©+.�,-�u'>G:/4'>5!G:-O;J9!D#+4 <)!D# <-0/4" Ec�WY7:/\� ��¢��!�!�!� � "ÖAQ?ª;@'��, #;= #¶3 #5!G�+.�!-�$07:5!$F'F«>-�7:AJh2-3$c+. K«:-¥WY9!5!$c+. #7:5j®ÒSE�Ô ��jxD<56DJÒSE�Ô^M�³° #«>-35CE�U>+.�!-�"47:D#9,+. #7:5JR! #"2+./2 <A!9�+. <7>5 �=ÒS�\Ô¼ #" WY9!D#D#?E"4)T-3$0 #Õ(-0RVM+Mz+� #" +.�,-35"2+4/.'> #G:�6+4WY7:/ºN¥'*/4RH+.7E9!"4-�+.�! #"®R! <"º+./4 #A!9,+4 <7:5JWY7:/®)!/2-3R! #$0+4 <5!G\+.�!-�D<'>A�-0D(7>W�'\5!-cN R('*+49!; � «Z <'=� �¯"4 <G>5uÒF� T �@Ò��EÔ]%\ÒA�4(*�\Ô#wJ�\ÔcM¼���!-8 <56+4-3G:/4'>D<"� <5� ¡¬�­È'*/4-87>Ws+4-35S'*5('>D#?Q+4 <$%'>5!RX/2-3"49,D#+� #5

Page 63: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�`N-0µI$0 <-356+J'>5!RR,-0+.-0/4;I <5! #"2+4 <$H-3�Q9('*+4 <7:5,"EWY7:/EAT7>+.��D<-3'>/45! #5!G¡'>5!R),/4-3R, <$0+4 <7:5nM�¬���)T7:5!-05Q+4 �'>DWf'>;I <DK?=;I7ZR!-3D#"�N�-0/4-E"4�!7�N�5B+.7IA�-\'>5!'>D#?Q+. #$° <5B�>-0A('>/.'¡~ �>�:�>�6'i�hM

½�¾�� Î ÃFÐ�Ñ�Ê�Ã3Ä ÃFÇxÁCÉ�Ã���� � ÁJÅ�Ð�Ð�Ã0ÁJÇ � ÁCÉ�Ã3Ë �3ÁJÐ�ЩÃ����°Ê®Ð

·¸-E5,7�N R!-3/2 #«:-C'oD<7:Gi²LD< #P>-0D< <�,7�7ZR=/4'*+. #7=³E'>9,"4"4 <'>5�$3D<'>"4"2 #Õ(-0/3M®·-°N�'>56+%+47IÕ(5,R�'HR! <"2$3/2 <;I K²5('>56+�WY9!5!$c+. #7:5B'>"�WY7:D<D#7�N�" G

%°ÒA�)(*�\Ô+� D<5 �ÒA��� ���\� ,Ô�ÒA��� � X � ,Ô 1 3

N��!7:"2-¥"4 #G:5J'*G:/4-0-3" N� K+.�ª+4�!-�D<'>AT-3D<-0RE+4/.'> #5! <5,G%"2-0+FM ���! <" R! <"2$3/2 <;I <5('>56+uWY9!5!$c+. #7:5ª #" "2)�-0$3 #Õ!-3RA6? � � � ����� � X �93!�=$37:56+&'* <5! #5!G�A�7>+4�¸³E'>9,"4"4 <'>5q;=-3'>5!" ����'>5!R � X '>"°N�-0D<D®'>"E'�"4$3'>D�'>/A! <'>"¥«*'>D<9!- 3�M®���Q9!"3U� �¬®­ "47:DK«:-3"�+4�!-\$37:5!"º+./4'> <5!-0R¡7>),+. #;= #¶F'*+4 <7:5=)!/47:A,D<-3; ÒS�,MK¢�Ô&MML56+.-3/2-3"º+. <5,G:D#?>U®'>)!)!DK?� #5!Gq �¬®­ +.7x'x/.'*+4 <7�7*W� <R!-05Q+4 #+L?¸$37�«*'>/4 <'>5!$0-S³\'>9!"4"2 �'>5,"¡` QdZmc_§j@�b.` �Tb.ge\>��m&`&�@"49!),)�7:/º+¡«>-3$c+.7:/B;@'*$&�! <5!-0"3U°'*"B #"S-0«Z <R,-356+¡WY/27:; +4�!-q7:AJh2-3$c+. K«:->U�j� ����8M ·¸-'>"2"49!;I-C+4�('*+�+.�!-C)!/4 #7:/%R, <"2+4/4 #A!9,+. #7:5SWf'>$0+47:/4 #¶3-0"1 <56+47@'I)!/4 #7:/%7�«>-3/%+4�!-C«>-3$c+.7:/8)!'>/.'>;I-0+4-3/2"'>5!R¡'H)!/4 #7:/�7�«:-3/�"4$3'>D�'*/�A! �'>"0Uc� ����� ÒS�\Ô �-� ����� Ò ���VÔ#� ����� Ò � X Ô#� ����� Ò�3cÔ^MO���!-\Õ(/2"2+�+LN�7=)!/4 #7:/4"'>/2-S <R!-05Q+4 #+L?6²L$07�«>'*/4 �'*5!$3-X¶0-3/27*²L;I-F'>5�³\'>9!"2"4 <'>5!"o7�«:-0/H+4�!-S;I-F'>5!"H'*"JWY7:D<D#7�N�" � ����� Ò ����Ô��Ò � � � �&��Ô�'>5!R<� ����� Ò � X Ô � ��Ò � X � �&��Ô©N��! <$&�X-05!$37>9!/.'>G>-3"¥;I-F'>5,"O7>WVD<7�N¹;='>G:5! K+.9!R,-�WY7>/7:9!/ ³\'>9!"2"4 �'*5!"3M ���!-OD<'>"2+¼)!/2 <7:/� #"¼'�5!7>5�²L #5,WY7:/4;='*+4 #«:-�ÒY hM ->Mu»�'*+&Ô�),/4 <7>/ � ����� Ò>3cÔ � ��Ò>3 � �&��� Ô <5,R! <$3'*+. #5!Go+.�('*+1'>56?�"4$3'>D�'*/%A! <'>"� <"�-3�Q9('>D#D#?S),/47:A('*A!D<-@d �Tbcehgib^esM¥���,-ª <56+4-3G:/4'>D<"�'>/2-C"27:D#«>-3R <5¡�>-0A('>/.'B~ �>�:�>�:'*�hM����,-C/2-3"49,D#+. #5!Go7:AJh2-0$0+4 #«:-\WY9!5!$c+. #7:5� <"

j� ����\ÒSE�Ôd� W ZY [ E '_`oj���� ¢� W e ��DY [ E SEc�� � � �� � . ���S�

�%7*+.-o+.�!-H�Q9('>R,/.'*+4 <$J+.-0/4;I"E'>)!)T-F'>/°R!7>9!A!D<-0R¸"2 <5!$0-oN�-I�('F«:-='X+.-3/2;�WY7:/°-3'>$&�7>W�+.�,-H+LNO7³\'>9!"4"2 �'>5ª;=7ZR!-3D#" #5ª+.�,-¥)('>/º+. #+4 <7:5\WY9!5!$c+. #7:5VMkMzW�NO-¥$&�!7Z7:"4-�_`F� ��+4�!-�'>AT7�«:-¥7>),+. #;= #¶F'*+4 <7:5 <"I <R,-356+. #$F'>D�+.7�+.�!-;�,q\  R!9!'>D%7>),+. #;= #¶F'*+4 <7:5�)!/27:A!D#-3; Òf K+= #"@"2 <;I)!D#?�+LN� #$3-B+.�!-��'q\ �� "7:AJh2-0$0+4 #«:-FÔcM��89!/°7:A`h2-3$0+4 #«>-= #"°'>D<"27S"49!A`h2-3$0+E+.7S+4�!-H"2+&'*5!R('>/2R�5,7:5�²L5,-3G6'*+4 #«Z #+L?�$37:5,"2+./4'> <56+4"7:5B+.�!-�Ec «>'*D<9!-0"%"2 <5!$0-C+.�,-C-^�,)T-3$c+&'*+4 <7:5¡$37:5,"2+./4'> <56+4"1 <5�+.�,-ª;='i�� <;J9!;�-356+./27:)6?¡),/47:A!D#-3;

Page 64: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�6�

9!"2-ov>b.`4d>_a`cb_?L_sr,d>]X <5,-3�Q9('>D# #+. #-3"0M���9,/2+.�,-3/4;I7:/2->U(+.�!-C5!7:5�²z <5,WY7>/4;='*+. K«:-°A! <'>"%),/4 <7>/�?Z #-3D<R,"%+.�,--3�Q9('*D< #+L?q$07:5!"º+./.'* <56+�� E � p���,MS���Q9!"CD<-F'*/45! #5!G¡ #56«:7:DK«:-3"E"4 #;=),D#?�"27:D#«Z <5,G�'��Q9('>R!/4'*+. #$)!/27:G:/.'*; Ò�����ÔcM���/2-3R! #$0+. #7:5SWY7:/�'o�Q9!-3/º?�R('*+.9,; � <"�G: K«:-35BA6?

u T �@Ò��\Ôv%\Ò'�)(*�\Ô#wJ� � W ZY![ � 9Ec'� . � 1 =3 �N��!-0/4-%+4�!-�-c��)�-0$0+4-3RXA! <'>" =3¥ <"�WY7:9!5,R=«Z �'°+.�!-\'>/49,"4��²�\9,�!5�²L�¼9!$&P*-3/\Ò� °��Ô�$37>5!R! #+4 <7:5,"O'*"9!"29('>DhM

� 7XNO7:/2PBN� K+.�x5!7>5�²L"2-3)('>/4'>A!D#-ª)!/27:A!D<-0;="0UTNO-o9!"2-o'@R! #"2+./2 <A!9�+. <7>5�7�«:-0/8;@'*/4G: #5!"% #5�+.�,-)!/2 <7:/C'>5!R�)T7:"º+.-3/2 <7:/E <5,"2+.-3'>R�7>W¥"4 <;I)!DK?q"4-0+2+. #5!Gx;='>/4G: #5!"\-3�Q9('>D�+.7�'�$37:5,"2+&'*5Q+H�ÒYN��, <$&� <"\D# <P>-o9,"4 <5,G�'�R!-3DK+&'i²hWY9!5!$c+. <7>5�),/4 <7>/ � ����� ÒA_`§Ô�����ÒA_` j �>Ô4ÔcMI���!-X �¬®­Ó"47>D<9,+4 <7:5qR! #"2+./2 K²A!9,+4 <7:5S+4�!-35¡ <56«:7:DK«:-0"1'>5B'>9,G:;=-056+.-3Rq� N��! #$&�� #5!$3D#9!R!-3"�'>D#Dn;='>/4G> <5X«*'>/4 <'>A!D#-3"�'>"�WY7:D#D<7�N�" G��� � � � � � X �93/� _cb*� �!�!� �#_ . �QM%���!-CWY7:/4;J9,D�'oWY7:/%+4�!-ª)('*/2+. K+. #7:5BWY9,5!$0+4 <7:5;DJÒFETÔ� #"1'>"1'>AT7�«>--c��$0-3),+HNO-S5!7�NÓ�!'�«>-a� ����� ÒS�\ÔR� � ����� Ò ����Ô#� ����� Ò � X Ôv� ����� Ò>3cÔ�� . ��fb � ����� Ò'_`fÔª'>5!R� #56+.-3G>/.'*+4-7�«:-0/w8��w�_cbo�!�!� wO_ . M����,-S;@'>/2G: <5�)!/2 <7:/2"o'>/4-=$&�!7:"2-35�+.7�Wf'F«:7>/JD�'>/2G:-@;='>/2G: <5!"\?:-c+I'>D<D#7�N5!-0G6'*+. K«:-\;='>/4G: #5!"�N� K+.��-c��)T7:5!-356+4 �'>D#D#?XR,-3$F'F?Z <5,G=)!/27:A('>A, <D< K+L?:M�;15¡'>)!)!/27:)!/4 <'*+.-°$&�,7: <$0-° <"

� ����� ÒA_`fÔ � ��� ���� G X�� ���OX g J � _`�� �8�� ����� Ò'_`fÔd� � 7>+.�,-3/2N� #"4-����7:DK«Z <5!G°G: K«:-0"®+4�!-�5!-cN 7:AJh2-0$0+. K«:-�WY9!5!$c+. #7:5�j®ÒFETÔd� j! #"�$SÒFETÔ�1 � D#5�Òa¢Vj�E &% � Ô^M©���!-�5!7:5Z²"4-0)('>/4'>A! <D# #+L?�$0/4-3'*+.-0"X'¸D#7:G6'>/2 #+4�!;= #$XA('>/2/4 #-3/oWY9!5!$c+. <7>5 )!/2-0«:-056+. <5,G��u'>G:/.'*5!G:-B;J9!D#+4 <)!D# <-0/4"WY/47>;�G>/47�N� <5!G=A�-c?:7:5,R � M1���, <"1 #"1D# <P>-C'@"27>Ws+8;='>/4G> <5 �'q\ �� "8-c��)!D# <$0 #+%$37:5!"º+./4'> <56+�E '� � M�(7:/¥"2 <;I)!D< #$3 #+L?>U6N�-°7:;I #+�+.�,-3"4-\D#7:G6'>/2 #+.�,;= #$�A!'>/4/2 <-3/�WY9!5!$c+. <7>5!"� <5S'*D<Dn5,7:5�²L"2-3)('*/.'>A!D#-\ �¬®­)!/27:A!D<-0;="0U('>5!R h29!"º+% #;=)T7:"2-1+.�!-\9!),)�-0/�AT7:9!5,R � $07:5!"º+./.'* <56+�7:5B�¼'*G:/.'>5,G:-°;J9!DK+. <),D< <-0/4"0M;15!7*+.�!-0/� #;=)T7:/º+&'>56+�-^��+4-35!"2 <7:5B+.7o+.�,-C'*A�7�«:-\ #"%'*D<D<7�N� #5!Gª+.�,-ª³\'>9!"2"4 <'>5�;=7ZR!-3D#"�+.7IAT-'>)!),D< <-0RS7�«:-3/�WY-F'i+.9!/2-\«>-3$c+.7:/2"% #5!"2+4-F'>RB7>W¼+.�!-\7:/2 <G: #5('>DTR('*+&'�MdML5B+4�! <"�"2 #+.9!'*+. #7:5VU�NO-E�('F«:-�G

%°ÒA�)(*�\Ôd�¯D<5 �Ò�( �©ÒA��Ô � ���\��Ô�Ò�( X ÒA��Ô � � X ��Ô 1 3 � D<5 -^��)¼Òvj b� �)( ��Ò'��Ôkj ��� � � Ô

-^��)¼Òvj b� �)( X Ò'��Ôkj � X � � Ô 1 3N��!-0/4-=+4�!-H«:-3$c+.7:/$� #"E;='>)!)T-3R� <56+47�'�WY-F'*+49!/4-H«:-0$0+.7>/*( � ÒA��Ô°AT-0WY7:/2-= #5Q+4-3/4'>$0+4 <5!GSN� #+4�+.�,-C)T7:"4 K+. K«:-ª³E'>9,"4"4 <'>5B;=7ZR!-3Du'*5!Rx'HWY-F'*+49!/4-\«:-0$0+.7>/�( X ÒA��Ô¥AT-0WY7:/2-C #5Q+4-3/4'>$0+4 <5!GHN� #+4�¡+.�,-

Page 65: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

���

5!-0G6'*+. K«:-ª³E'*9!"4"2 �'>5¡;=7ZR!-3D§M m�-0$F'>9!"2-ªNO-J'>/2-ªR!-3'>D< #5!GoN� #+.�¡)�7>"4"4 #A!D#?� #5,Õ(5! K+.-\R! #;=-05!"4 #7:5('>DWY-F'i+.9!/2-�"2)('>$0-3"3Ui+.�!-O³\'>9!"2"4 �'*5E;I-F'*5!"¼'>/4-��('*5!R!D<-0Rª'*"¼D# <5!-3'>/V$07:;JA! #5('*+. #7:5!"V7*W,R! #"2+.'>5!$3-0"uA�-^²+LNO-3-35¡-c�,'>;I)!D<-0"� <;I)!D< #$3 K+.D#?J)!/477h2-0$0+4-3R�+.7oWY-F'*+49!/4-°"2)('>$0-\«Z <'HP*-3/25!-3DVWY9!5,$0+. #7:5!"0MO¬��Q9('*+4 <7:5,"WY7:/©¨% <D#A�-0/2+¼"4)!'>$3-�³\'>9!"2"4 �'*5!" N� K+.�J #;=)!D# <$0 #+�;I-F'>5J'>/4-¥-3'>"4 #D#?\R!-0/4 K«:-3RoA6?ª"2+&'*/2+. #5!G%N� K+.�ª+4/.'i²R! K+. <7>5('>DZR! <"º+&'>5!$0-�'>5!RH9!"2 <5!G8+4�!-¥NO-3D<D´²LPQ5!7�N�5wTÒ�� � � Ôd���nÒ�� ����Ô�1��nÒ � � � Ô`jX���VÒ�� � � ÔcM �Z <5!$0-NO-x'>/2-BR,-F'>D# <5!G�N� #+4�ÖR, <"4$0/4 #;= #5('*+. #7:5VU�NO-�$3'>5 #G:5!7:/2-S5!7:/4;='>D# <¶F'i+. <7>5� <"2"49!-0"=N� #+4��+4�!-3"2-³\'>9!"4"2 �'>5q;I7�R,-3D<"0MH���!-H/4-3"29!D#+4 <5!G j�ÒFETÔ°7>AJh2-3$c+. #«>->U¼"49!A`h2-3$0+C+.7 �,q° �²LD# <P>-H$07:5!"2+4/.'> #56+."3Uu #""2+4 <D#DV' � �pG

� W ZY![ E Fj ¢� W e �� Y![ Ec9Ec�� � � ��LÒ� � Ò'�:]�#�:��<ÔV1� X ÒA�]� ����Ô4Ô

N��!-0/4-� ¡-0/4$0-3/xP*-3/45,-3DCWY9,5!$0+4 <7:5!"�� � Ò'�:i� ���sÔ)� ( � Ò'�fÔ . ( � ÒA����ÔB'>5,R�� X Ò'�:]�#�:���Ô4�( X ÒA�fÔB. ( X ÒA����Ô�+&'*P>-J+.�,-o)!D�'>$0-J7>W® #5!5!-3/1)!/47ZR!9!$c+."°7>W�7:9!/%WY-F'*+49!/4-ªWY9,5!$0+4 <7:5!"0MC���,-o)!/4-^²R! #$0+. #7:5S/49,D<-1WY7:/¥+4�!-8Õ(5('*D�$3D�'*"4"4 KÕ(-3/OWY7:/�'o�Z9,-3/2?XR('*+.9,; � <" =� � b� � � 9EcºÒ� ��Ò'�q� �§Ô 1� X Ò'�q� �§Ô2ÔV1 =3�M½�¾&½ �ÁCÉ �°ÇXÉ�À Á\¡ÃFÄ Å�Ä Æ ÇSÉ�Ê�Ë=ÌXÍ ÎÏÃFЩÑ%Ê®ÃFÄ ÃFÇxÁEÉ�Ã3ËIÇ

·¸-¡5!7�N ),/4-3"2-356+X+4�!-¡D<'*+.-056+X ¡¬�­ ;=7ZR!-3D¥WY7>/I-^��)�7:5,-356+. <'>D�Wf'>;= #D#?¸R! <"º+./2 <A!9,+4 <7:5,"3M����!-R! #"4$3/2 <;I <5('*5Q+OWY9!5!$c+. <7>5¡ #"¥N�/4 #+2+.-05¡'*"�WY7>D<D<7�N�" G

%\Ò'�B(*�\Ôd�±D<5 � $� �fb �@Ò���� ( �� Ò'�:YÔ � ,��� Ô���� �fb �@Ò��k� ( X� Ò'�:YÔ � , X� Ô 1 3/� Òh�,M �>Ô

ML5q¬��Q9('*+. #7:5�Òh�,M �>Ô^UTN�-o #5Q+4/47ZR!9!$0-ª;I7�R!-0Du)('>/.'*;=-c+.-3/2"�,���U , X� U�WY7:/%)�7:"2 #+4 #«:-C'>5!R�5,-3G6'*+4 #«>-

;I7�R!-0D<"0U6/4-3"2)�-0$0+4 #«:-0D#?o(�'>5!R 3OWY7:/�+.�,-�"2$F'>D<'>/�A! <'>"3M�; 5,7:5�²L #5,WY7:/2;@'*+4 #«>-�)!/2 <7:/� #"�$&�!7:"4-05=WY7:/ 3+.7CWY7:/4;='>D< #¶3-�7:9!/OD�'>$&PI7>WuPQ5!7�N�D<-0R!G:-\'>AT7:9,+O+.�!-8)!'>/.'>;I-0+4-3/�'>5!RX+.7o"2 <;I)!D< KWs?J+.�,-8/4-0"49!DK+. <5,G �¬®­ <56+.-0G:/.'*D<"3M ;1)!),/47:)!/2 �'*+4-@)!/2 <7:/2"ª"2�!7:9!D#R�A�-@"4-3D#-3$c+.-3R�WY7>/ ,��

�'*5!R), X� M¡·-@N� #"4�+47

/4-0$37�«:-0/1'*5x �¬®­ R! <"º+./4 #A!9,+4 <7:5VU�@Ò��EÔd� �@Ò>, �b � �!�!� � , �$ �9, Xb �!�!�!� �9, X

�� 30Ô*�

+.�!'*+© #"©'*" $0D<7:"2-O+.7�+.�!-0"4-O)!/4 #7:/4" '>"©)T7:"2"4 <A,D<-�?:-c+�'>D#"471"4'*+. #"2Õ(-0" +4�!-�$0D�'>"2"4 #Õ!$F'*+4 <7:5E$37:5,"2+./4'> <56+4"N��! #$&��"4�!7>9!D<R¸D�'>AT-3D�+4�!-@R('i+&'¡$07:/4/2-3$c+.D#?�9!5,R!-3/C-c��)�-0$0+.'*+. #7:5!"ª7�«>-3/ �=ÒS�\Ô^M��%7>+4-I+4�!-@9!"2-

Page 66: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

���

7>W�-^��)!D< #$3 #+�WY-3'*+.9!/2-ª;='>)!)! #5!G:"( �� U ( X� N��, <$&�x)T-3/2;= K+%-3'>$&�x;I7�R,-3D�+.7=/4-3"2 <R!-C <5�'=R! #"2+. #5!$0+WY-F'i+.9!/2-E"2)('>$0->MML5�+4�!-�D�'*+4-356+o«*'>/4 <'>A!D#-@$F'*"4-�+.�!-�$3D<'>"4"2 <$3'>D¥;='i�� <;J9!; -356+4/47:)6?�"27:D<9,+4 <7:5 Òh�,MK¢�Ôª <"o5!7*+WY/49, #+4WY9,D(A�-0$F'>9!"2->UQWY7:/®;= ´�Z+.9!/2-3"3UZ$37>;=)!9�+. <5,GC'*5!R@;I <5! #;= #¶3 #5!G%+4�!-%)!'>/2+4 #+. #7:5JWY9!5!$c+. #7:5�DªÒFETÔ <"O <56+./4'>$0+.'>A!D#-�N� K+.�X-^�,)T7:5!-056+. �'*D<D#?H;='>56?H+.-0/4;I"3M����! #"�;I </4/27:/4"®+.�,-1$3D<'>"4"2 <$3'>D�$3'>"4-17>Wu;@'��Z² <;ª9!;�D< #P>-3D# <�!7Z7ZRI)!'>/.'>;I-0+4-3/�-3"º+. <;='*+4 <7:5HWY7:/�;= ´��+49!/4-�;I7�R!-0D<"0UQWY7>/�N��! #$&�XN�-19!"4-%-c��)�-0$0+.'i²+. #7:5B;@'i�� #;= #¶F'*+4 <7:5qÒf¬� xÔª~�­8-3;I)!"2+4-3/%-0+1'>DhMKU�¢�¤ � ���hM��¼7@$07:;=)T-35,".'*+4->U�N�-C9!"4-E«>'*/4 �'i+. <7>5('>D;I-0+.�,7�R!"0M ���,-OG:-05!-3/4'>D6"4$&�,-3;I-� #"�+.7�9!"4-�+4/.'>$c+&'>A!D#-�WY9!5!$c+. <7>5!"�+.�('*+uD#7�N�-0/ '*5!RC9,)!)�-0/uA�7:9,5!R+.�,-° <56+./4'>$0+.'>A!D<-�+.-0/4;I"¥7>Wu+.�!-1)('>/2+4 #+4 <7:5IWY9!5!$0+4 <7:5nM�·-8+4�!-35S7:)�+. <;I <¶0-%+4�!-1+./4'>$0+.'>A!D#-1WY9!5!$^²+. #7:5!"8+47¡ #5!R! </2-3$c+.D#?¡7:),+4 <;I <¶0-ª+.�!-H #5Q+4/.'>$c+&'>A,D<-o7:5!-*Uu"49!AJh2-0$0+C+.7S+. #G:�6+.5!-0"4"E7>WO+4�!-HA�7>9!5!R!"0M·¸-ª #+4-3/4'*+.-°+.�,-ªAT7:9!5!R! #5!GI)!/477h2-0$0+4 <7:5�'>5!Rx/2-c²L-0"2+4 <;='*+. #7:5�7>W�+.�,-C)('*/.'>;I-0+4-3/4"0UT+4�Q9!"%+4 <G:�6+2²-35, <5!GI+.�!-CA�7:9,5!Rx'>5,R�;='i�� <;I <¶3 #5!GJ+.�,-ª7:AJh2-0$0+4 #«:-*Un9!56+4 <Du$37:56«>-3/4G>-35!$0->M1���,-ª)!/27�$0-3R!9!/2-ª #"G:9('*/.'>56+.-0-3R�+.7I$37:56«>-3/4G>-E+47='oD#7�$3'>DV;='i�� <;J9!;Ó'>"� <5¡�:':'*PZP*7:D�'o-c+�'>DhMu~£¢�¤:¤>¤>$0�§M

�>-35!"2-35 � "° <5,-3�Q9('>D# #+L?� <"�Õ(/4"º+°'>),)!D< #-3R¡+47@+.�,-ª$37>/4/4-0$0+1$3D�'*"4"8;I7�R,-3Du <5B+.�!-C$3D�'*"4"4 KÕ($F'i+. <7>5$37>5!"2+4/.'> #5Q+4"°+.7�"4 #;=)!D# #Ws?B+.�!-0;¡UVN��, <D<-J+4 <G:�6+4-35! #5!GS+.�!-0;�"47�+.�('i+ª'*5Q?�'>R!;I <"4"2 <A!D#-J)T7: <56+° #"'>R!;I <"2"4 #A!D<-H9!5!R,-3/ª+4�!-@7:/2 <G: #5('>D�$07:5!"2+4/.'> #56+."3MB���!-05VU��>-35!"2-35� <"C'>)!),D< <-0R¸+47�+.�!-=)('>/º+. #+4 <7:5WY9!5!$c+. #7:5�N��! <$&��"2+4 <D<DO$37:56+.'> <5!"oD#7:G*²z"49!;I"ªWY7:/J+4�!-� <5!$07:/4/2-3$0+I$0D�'>"2"o;=7ZR!-3D§M����! #"J?� #-3D#R!"H'+./4'>$0+.'>A!D#-�D�'*+4-356+� �¬®­±)!/277h2-3$c+. <7>5VM �Z+.'>/2+4 <5!G°N� #+4�@'*5= #5! #+4 �'>DZ"47:D#9,+. #7:5:� � b � ÒS�\ÔcU:NO-1 K+.-3/4'*+.-+.�,-O+./4'>$0+.'>A!D#-�)!/277h2-3$c+. <7>5ª"2+4-3)H'>5,RJ$37:56«>-c�H�Q9!D#DZ/2-3"º+./4 #$0+4 <7:5C"2+.-0)o9!56+. #D�$07:56«:-3/2G:-35,$3->UQ"2D<7�N�D#?9!)TR('*+4 <5!G+4�!-x$09!/4/2-356+� �¬®­ "27:D<9�+. <7>5 � ��� � ÒS�\ÔI'>5!R¯/4-0R!9!$3 #5!G�R! K«:-3/2G:-35,$3-x+.7�+4�!-x)!/2 <7:/� ����� ÒS�\ÔcU�N��! <D#-°;=7�«Z <5!GJN� K+.�! #5S+.�!-C �¬®­ '*R!;= #"4"2 <A!D#-1"4-c+FM

·-q5!7�N A�-0G: <5 +47�R!-3/2 #«:-�+4�!-�+./.'*$0+&'*A!D<-x)!'>/2+4 #+. #7:5VM ·-� #D<D#9!"2+4/.'*+4-¡+.�,-x«>'*/4 �'i+. <7>5('>DD<7�NO-3/®AT7:9!5!R=AQ?H$07:5!"2 <R!-0/4 <5,G\+4�!-�$3D�'*"4"4 KÕ($F'i+. <7>5o$37:5!"º+./4'> <56+®WY7:/�+.�!-������1-^�!'*;=)!D#->U:N��! #$&�=NO-'>"2"49!;I-°N� #+.�,7:9,+�D<7:"2"�7>W G:-35!-0/.'>D# #+L?@�('>"�'I)T7:"2 #+. K«:-°D<'>A�-0DhU � ��¢:M®���!-E$37:5!"º+./4'> <56+�WY7:/�+.�,-�����ªR('i+.9!;Ó <"

u �@Ò��\Ô s!D#5 � � �=Ò ��� ( �� Ò'�fÔ � , �� Ô���=Ò �k� ( X� Ò'�fÔ � , X� Ô 1 3 j�_`Ax�wJ� l¯�&�

���!7Z7:"4 #5!G8'%R! <"º+./4 #A!9,+4 <7:5� aU>NO-�'>),)!D#?ª�>-35,"4-35 �¦"� #5!-3�Q9('>D# #+L?°+47%+.�,-¥)�7>"4 #+4 #«>-O;I K�Z+.9,/4-�;I7ZR!-3D

Page 67: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�6¤

+.7H7:A�+&'> #5¡'@�c_fb^ehmc_a`cb¥$0D�'>"2"4 KÕ($F'*+4 <7:5S$07:5!"º+./.'* <56+!Gu �@Ò��\Ô s W

�� 2Ò �BÔ,D<5��=Ò ��� ( �

� ÒA�fÔ � , �� ÔV1 �Ò � fÔj�D<5 W

��=Ò ��� ( X� Ò'�fÔ � , X� ÔV1 3 j�_`Ax wJ�6l¯�

N��!-0/4-��Ò � fÔO #"�+.�,-8-356+./27:)6?X7>W � LM�·-°$&�,7�7:"2-°'JR! #"2+./2 <A!9�+. <7>5 � ¼"29!$&�S+.�('*+�+.�!-8$0D�'>"2"4 KÕ($F'i²+. #7:5@ #5!-3�Q9('*D< #+L?I #"O+. #G:�6+¥9!5,R!-3/p� � � X b � Ò��\ÔcM©·¸-8"4-0-8+.�('i+�+.�,-8-c��)!/2-3"4"2 <7:5SWY7:/�+.�!-1A�7:9,5!R! <5,G$37>5!"2+4/.'> #5Q+� <"�"2 <;I)!D<-0/3U>A,9,+�"2+4 <D#D� #5!$3D#9!R!-3"�'8D<7:G*²z"49!;ÈWY7:/ +.�!-¥5,-3G6'*+4 #«>-�;= ´��+49!/4-O;=7ZR!-0DhM¼���!-/4-0;@'* <5! #5!G°D<7:Gi²L"49,;�N� <D#D!AT-%-0D< <;I <5!'*+.-0RJA6?I'>)!)!DK?� #5!GC�>-35!"2-35 � "¥ #5!-3�Q9('>D# #+L?C+.7E9!)!)T-3/�A�7:9,5!R+.�,-E)!'>/2+4 #+. #7:5@WY9!5,$0+. #7:5VU�'>"¥NO-\N� <D<D�"4�!7�N\M

·-ª5!7�N�),/47Z$3-3-0Rx+.7S'*)!)!D#?��>-05!"4-05 �¦"\ #5!-3�Q9('>D# #+L?�7:5�-F'>$&�q$37>5!"2+4/.'> #5Q+ �¦"15Z9,;=-0/.'*+47:/�WY7>/)T7:"4 K+. #«>-%R!'*+&'�� ��� �x'>5,RX7:5X-3'>$&�S$37:5,"2+./4'> <56+ �¦"OR!-35!7>;= #5('*+.7>/�WY7:/�5!-0G6'*+. K«:-8R!'*+&' ����� X M���! #"1D<-3'>R!"�+.7S'@5,-0N\UV;I7:/4-C$37:5,"2+./4'> <5,-3Rx)!/27:A!D#-3; <5BN��! <$&�xNO-ªWY7:/2;@'>D#D#?SR,-0Õ(5!-J'@"4 #5!G:D<- �¬®­�),/477h2-0$0+. #7:5B'>"�WY7:D<D#7�N�" G

;I <5� � T � ��Ò>�@Ò��EÔ1� � ����� ÒS�\Ô4Ô

"29!AJh2-0$0+1+47 G� �

U W�

� 2Ò �BÔ,D#5��@Ò���� ( �� ÒA�fÔ � , �� ÔV1 �Ò � fÔkj�D#5 W�

�@Ò��k� ( X� Ò'�:§Ô � , X� ÔV1 3`^ l _` no� ��� �� �

U W�

� 2Ò �VÔ,D<5��=Ò �k� ( X� Ò'�fÔ � , X� ÔV1 �Ò � §Ôkj�D<5 W�

�=Ò ��� ( �� ÒA�§Ô � , �� Ôkj)3`^-l _`Dno� ��� X ����Q9!"3UO+.�!-��>-35!"2-35�²zA�7>9!5!R!-0R¹$37:/2/4-0$0+I;= ´�Z+.9!/2-BR,7:;= #5('*+4-3"J+.�,-B #5!$37>/4/4-0$0+I;I K�Z+.9!/2-S7:5Ö'>D<DR('*+.'o)�7: #56+."3M����,-C5!-cN )('*/2+. K+. #7:5XWY9!5!$c+. <7>5�WY7>/¥+.�! #"�)!/477h2-0$0+4 <7:5BG: #«>-35 �o <"

�DªÒFE � �>Ôd� u T � ����� Ò��\Ô,-c��)��RWZY [�� E ºÒSW � � 2Ò �BÔ,D<5��@Ò���� ( ��ÒA�§Ô � , �

�ÔV1 �Ò � §Ô

jxD<5 W�

�=Ò �k� ( X� Ò'�fÔ � , X� ÔV1 3 j�_`§Ô��-c��)�RWZY [� Ec2Ò�W � � 2Ò���Ô,D<5��=Ò ��� ( X� ÒA�§Ô � , X� ÔV1 �Ò � §Ô

jxD#5 W�

�@Ò���� ( ��ÒA�fÔ � , �

�Ôkjm3 j4_`fÔ��Vw8� �

Page 68: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

N>�Mz+x #"¡ #56+.-3/2-3"º+. <5,G +.7Ö5!7>+.-�+.�('i+�+.�, <"B)('>/2+4 #+4 <7:5¯WY9!5!$c+. <7>5 AT7:9!5!R!"¡+.�!-¸7:/4 #G: <5('*D°7:5!-¸«Z <'DJÒSE�ÔHl �DªÒSE � �:ÔOWY7>/�'>56? ��M��¼7H)!/477h2-0$0+3U�NO-\;@'��, #;= #¶3-�G

E � � '>/4G>;@'i�P

Ò]jxD<5 �DªÒFE � �>Ô4Ô"29!AJh2-0$0+1+47 G

� � E �� � � W ZY [ Ec � V�±�&����! #"1)!/27:A!D<-0; <"1D#7:G*²z$37:5!$3'F«:-J'*5!R�"4 #;=)!D#-3/�+.�!'>5x+.�!-C7:/4 #G: <5!'>DVWY9!D<D© �¬®­)!/27:A!D<-0;¡U�?:-c+° #+ <"�"2+. #D<DT <56+./4'>$0+.'>A!D#-8R!9!-8+47J+.�!-°/2-3;='> <5! #5!GªD#7:G*²z"49!;I"¥ <5=+.�!-°-^�,),/4-3"2"4 #7:5BWY/27:; +.�!-°7:),)�7:"2 #+4-$3D<'>"4"1;=7ZR!-3D#"3M°���!-0/4-cWY7:/4-*UVN�-J),D�'>$0-o'>5�9!)!)T-3/1A�7:9,5!Rq7:5�+.�,-o)('>/2+4 #+4 <7:5BWY9!5!$0+4 <7:5¡WY7:/1+.�,-$37>5!"2+4/.'> #5!-3RC)!/477h2-0$0+4 <7:5CAQ?ª'>)!),D#?Z <5!G1�>-35,"4-35 �¦"� #5!-3�Q9('*D< #+L?1+.7%+4�!-�D#7:G*²z"49!;I"� <5 �DJÒFE � �>ÔV9!"4 #5!G«*'>/4 <'*+. #7:5('>DiR! #"2+./2 <A!9�+. <7>5!"���aM ���! #"uG: #«>-3"¼'¥«>'*/4 �'i+. <7>5('>Di9!)!)T-3/uA�7>9!5!R��DJÒFEV��� � �>Ô l �DJÒFE � �>Ô G

�DªÒFEV��� � �:Ôd� u T � ����� Ò��\Ô,-c��) �WZY [ � E 2Ò W � � 2Ò �BÔ,D<5��=Ò ��� ( �� ÒA�§Ô � , �� ÔV1 �Ò � fÔj W�� 2Ò���Ô,D#5��@Ò��k� ( X� ÒA�fÔ � , X� Ôkj �Ò���fÔV1 3 j4_`fÔ �

-c��) �RWZY [� Ec2Ò W � � 2Ò���Ô,D<5��=Ò ��� ( X� ÒA�§Ô � , X� ÔV1 �Ò � §Ôj W���2Ò �BÔ,D<5��=Ò ��� ( �� ÒA�fÔ � , �� Ôkj �Ò���fÔkjm3 j4_`fÔ � wJ�R�

�¼7X+. <G>�Q+4-35�+.�, <"89!),)�-0/°A�7:9,5!RVUnNO-H;J9!"2+8;= #5! <;I <¶0-E+4�!-o)('>/º+. #+4 <7:5BWY9!5!$c+. <7>5��D 7�«>-3/��Ó7>/;='i�� <;I <¶3-�jxD<5��DÈ7�«:-0/�HM®���Q9!"3U(NO-C�('F«>-�G

ÒFE � ��� � Ô �±'*/4G:;='i�P e Òvj�D<5��DJÒSE ��� � �>Ô4Ô"29!AJh2-0$0+1+47 G

�*� Ec�� � � W ZY [ E � �±�

� ���:� � . ¢@� ¢���!-S'>AT7�«:-=;@'i�� #;= #¶F'*+4 <7:5�9!"2-3"o'�_§b2dZmc_hd�=3j<`E)('>/º+. #+4 <7:5�WY9!5,$0+. #7:5��DªÒFEV��� � �:Ô8N��! #$&�� <5�²

$3D#9!R!-0"O+.�,-%«*'>/4 <'*+. #7:5('>D,R! <"º+./4 #A!9,+4 <7:5!" � '>5!R �E/2-3�Q9! #/4-3R@AQ?H+4�!-1R!7>9!A!D<-1�>-35,"4-35SAT7:9!5,RVMdML5

Page 69: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

N�¢Wf'>$c+FU:NO-%$3'>5H"47:DK«:-�+.�!-�7:)�+. <;I <¶3'*+. #7:5I�ce'?o�Zj£_hd>]n`&gi�Q�cj@�¥7�«>-3/ E@'>5!R �È'>"�'°$37:56«>-c�I)!/27:G:/.'*;¡M���!-=��R, <"2+4/4 #A!9,+. #7:5� <"E9!)�R!'*+.-0R�'>"C+4�!-@;='i�� <;ª9!;�D< #P>-0D< <�,7�7ZR�)�7>"2+.-0/4 #7:/C7�«>-3/C+4�!-@D<'*+.-056+«*'>/4 <'>A!D#-3"3UuG: K«:-05 � '>5!R EuMX���,-@7�«:-0/.'>D#D�D<'*+.-056+J ¡¬�­Ó)!/47:A,D<-3;�)!/47Z$3-0-3R!"C #+.-0/.'*+4 #«>-3D#?xAQ?9!)TR('*+4 <5!G\+.�!- �8+.7E+. <G>�Q+4-35I+.�!-%-3�Q9('>D# #+L?o$07:5!"2+4/.'> #56+."¥'*/47:9!5,RX'C),/4-0«Z #7:9!" � � � X b � ÒS�\Ô®;I7ZR!-3D+.7¡G:-0+ª'¡;I7:/2-=$07:5!"2+4/.'> #5!-3R¸)!/47 h2-3$0+4 <7:5'>5!R+4�!-35¸"47:DK«:-0"ª+.�!-I$37>5!"2+4/.'> #5!-3R�),/477h2-0$0+. #7:5�'*"'x$37>5Q«>-c��)!/27:G:/4'>;¡U�/2-3$07�«>-3/2 <5!G ��'>5!R E�"4 <;ª9!D#+.'>5!-37>9!"4DK?:M����! <"J K+.-0/.'*+4 #«:-@)!/47Z$3-0R!9!/4- �AT7:9!5!R! #5!Gª+4�!-8$3D<'>"4"2 #Õ($3'*+. #7:5@$07:5!"º+./.'* <56+."�N� K+.���>-05!"4-05�9!"4 #5!Go'J)!/2-0«Z <7:9,"¥;=7ZR!-0DF� ���MX b � Ò��\Ô'>5!R�+4�!-35�"27:D#«Z <5,G�'x"4 #;=)!D#-3/J �¬®­�)!/27:A!D#-3; � �('>"CA�-0-35�"4�,7�N�5�+47�$37:56«:-0/4G:-S+47q'xD<7Z$F'>D;I <5! #;J9!; '>"� <5S+.�,-ED<'*+.-056+�'>5!7:;='>D#?=R!-c+.-3$c+. #7:5¡),/47:A!D#-3;Ó7>W��:'>'>PQP>7:D<'H-c+%'>DhMV~´¢�¤>¤:¤>$0�§M

���!-�R!-0/4 #«*'*+4 <7:5EN�-�)!/4-0"4-356+®�!-0/4-¥ #"�'>5o #;=),/47�«:-0;=-05Q+©9!)T7:5ª+.�,-¥)!/4-0"4-05Q+.'*+. #7:5o <5o�>-3A('>/4'~ �>�:�>�6'i�VAT-3$F'*9!"4-\7>Wu+.�,-\'>)!)!D# <$F'i+. <7>5@7>W©�>-35,"4-35 �¦"� <5!-0�Q9('>D< K+L?H+.7HA�7>9!5!RX+.�,-° <5!$07:/4/2-3$0+º²L$0D�'>"2";I7�R!-0DhM �89!/uR!7:9,A!D<-®�>-05!"4-05J'>),)!/476'*$&�E?Z <-0D<R!"u'�+4 <G:�6+u9!),)�-0/�A�7:9,5!RC/4'*+.�,-3/V+.�!'>5°+.�!-<A�es](]n`cb_hd*06`&�°d>jsj>'>)!)!/27F�, #;@'i+. <7>5VM �89!/®5!-cN R!-0/4 #«*'*+4 <7:5I'>D#"47\;='>P>-0"O K+�'*)!)('>/2-356+O+4�('*+�D�'i+.-356+� �¬®­)('>/4'>;I-0+.-0/¥-3"º+. #;@'*+4 <7:5@ <"�'J;I <5! #;@'��I7:),+. #;= #¶F'*+4 <7:5nM ���!-8+LNO7I7:)!)T7:"4 #5!GoA�7>9!5!R!"�;J9,"2+�AT-+. #G:�6+FU!"2�Q9!-3-0¶3 <5,G@ <5S7>5B+4�!-°+./49,-ED<'*+.-056+% �¬®­�7:AJh2-0$0+4 #«:-�G

'>/4G:;I <5

'>/4G:;='i��

�DªÒSE ��� � �>Ôd� DJÒSE�Ô*�½�¾�� Î ÃFÐ�Ñ�Ê�Ã3Ä ÃFÇxÁCÉ�Ã���� � �°Ê®Ç � FÃ�� �� � ÁJÅ�ЩÐ�Ã3ÁJÇ À ÃcÂ�É�Å�Ê �8Ð

·¸-C5!7�N )!/2-3"2-356+8+.�,-CD<'*+.-05Q+8 �¬®­ ;I7�R,-3D�WY7:/�+.�!-E/.'i+. <7I7>W®¨� <D#A�-0/2+�"4)!'>$3-J³E'>9,"4"4 <'>5�;I K�Q²+.9,/4-3"0M®���!-CR, <"4$0/4 #;= #5('>56+�WY9!5,$0+. #7:5� <"¥N�/2 #+4+4-35¡'>"�WY7:D<D#7�N�" G

%°ÒA�](*�\Ôd� D#5 � $� �fb� � �Ò�( �

�Ò'�§Ô � � �

���Ô

���� �fb � � �Ò�( X� ÒA�§Ô � � X� ��Ô 1 3 Òh�,M��:Ô

'>5!R�+.�,-ª ¡¬�­ $3D<'>"4"2 #Õ(-0/� <" G=� � "2 <G:5ts u T �=ÒS�\Ô]%\ÒA�i(9�EÔvwJ� x � Òh�,M¦�6Ô

ML5B¬��Z9!'*+. #7:5�ÒS�,M��6Ô&U,NO-E #56+./47ZR!9!$0-8;I7�R!-0Dn)('*/.'>;I-0+4-3/4" � ��U � X� UZWY7:/�³\'>9!"4"2 �'>5S;I-F'*5!" ( U �

WY7:/�;= ´�� <5!G\)!/27:)�7>/2+. #7:5!" (�'*5!R 3�WY7:/®+.�!-%"4$3'>D�'>/®A! <'>"3M ·¯�! #+4-8³\'>9!"2"4 �'*5@)!/2 <7:/®R! #"2+./2 <A!9�+. <7>5!"3U

Page 70: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

N:�� ����� Ò �uÔd� ��Òf�&��Ô.U�'>/4-I$&�!7:"2-35�+47x/4-0G:9!D�'*/4 <¶0-o+.�!-X³E'>9,"4"4 <'>5;I-F'*5!"C+47�N�'>/2R�¶3-0/47!M¡�%7:5Z² <5�WY7:/4;='*+. K«:-8),/4 <7>/4"�'>/4-E$&�!7:"2-35�WY7>/ U � U�'>5!Rq31+47=-^��)!/4-0"4"17>9!/%D<'>$&PX7>W©PQ5!7�N�D<-3R,G:-ª'*A�7:9�++.�,-3"4-o)!'>/.'>;I-0+4-3/2"8'>5!Rx+47X"4 #;=),D< #Ws?@+.�!-J/2-3"29!D#+4 <5!GX �¬®­ #56+.-3G>/.'>D#"3M ·¸-ªN� <"2�x+.7X/2-3$37�«>-3/'>5x �¬®­ R! <"º+./2 <A!9,+4 <7:5S+4�('*+% <"%'>"%$0D<7:"2-E+47I+4�!-3"2-J)!/2 <7:/2"%'*"%)T7:"4"2 <A!D#-E?>-0+8'>D<"27="4'*+. #"2Õ(-0"%+.�,-$3D<'>"4"2 #Õ($3'*+. #7:5�$37:5!"º+./4'> <56+."IN��! <$&� "4�!7:9,D<R D<'>AT-3D�+.�!-BR('*+.'$37>/4/4-0$0+4D#?�9!5!R,-3/@-^��)�-0$0+&'i+. <7>5!"7�«:-0/ �@Ò��\ÔcM¯�%7*+.-�+.�!-¡9!"4-x7*W°-c��)!D# <$3 K+HWY-F'*+49!/4-¡;@'>),)! <5!G>" ( �� U ( X� N��, <$&�¹)T-3/2;= K+=-3'>$&�³\'>9!"4"2 �'>5S+47I/2-3"2 <R!-\ <5B'oR! #"2+. #5!$0+�WY-3'*+.9,/4-\"4)('*$3->M��)T-3$3 KÕ($F'*D<D#?>U,NO-\N� #"4��+.7H/4-0$37�«:-0/

�@Ò��\Ôd� �=Ò b*�� � b � �!�!� � $:�� �$ � � b9�� Xb � �!�!� � � � �� X� �93cÔ*�·-E'>),)!D#?=+.�!-8«*'>/2 �'*+4 <7:5('*Dn'>),)!/476'*$&�¡R!-c«:-0D<7:)T-3RB <5 ��-0$0+4 <7:5 �,M��ªN� #+.�S+4�!-\$37:5!R, #+. #7:5!-0R

³\'>9!"4"2 �'>5S;I7ZR!-3D#"¥/4-0)!D�'>$0 <5!GJ+4�!-°G:-05!-3/2 <$ h27: #5Q+¥)!/47:A!'>A! <D# #+4 <-3"0M©���!-\;I7:/4-1"49!A!"º+&'>56+4 �'>Dn+.'>"4P <"J+47q"47:DK«:-S+.�!-X«*'>/2 <7:9,"o <56+.-0G:/.'>D#"ªWY7:/ �DJÒSE � � � �:ÔC #5�$3D<7>"4-3R�WY7:/2;¡M¸·-�/4-cWY-3/J+47q+4�!-SWY7:/º²;J9!D<'>"E <5��>-0A('>/4'�~¦�*�:�>�6',U $&�('>)VMkNi�§M¡���,-X-c��)!/2-3"4"2 <7:5�WY7>/C+.�,-@)('>/º+. K+. <7>5�WY9!5,$0+. #7:5R,/.'>"º+. K²$F'*D<D#?I"2 <;I)!D< KÕ(-3"� #W�NO-°'>"2"49!;I-\'ª5!7:5Z²L <5�WY7:/4;='*+. K«:-�)!/4 #7:/�7>5X+.�!-8A, �'>"�'>5!RS5!7:5Z²L <5�WY7:/4;='*+. K«:-­8 </2 <$&�!D#-0+�)!/2 <7:/2"¡7�«>-3/�+4�!-;J9,D#+. #5!7:;I �'>D%)('>/4'>;=-c+.-0/4"3M���D#+. #;@'i+.-3DK?:U�+.�!-¸5!-3G6'i+. #«>-D#7:G6'i²/4 K+.�!; 7>W�+.�!-H)('>/º+. K+. <7>5xWY9!5!$0+4 <7:5q #"°$37:;I)!9,+4-3R¸'>5!Rq <"°7:9,/#�'q\ �²zD< <P*-o7:AJh2-0$0+. K«:-oWY9!5!$c+. #7:5�j®ÒSE � � � �:Ôd� j�D<7:G �DJÒSE � � � �:Ô^M�j�ÒFEV��� � �>Ô � W ZY [ Ec2Òh�Ò���fÔkj �Ò � fÔ2ÔV1XW ZY![ E Z_`j ¢

� WZY [ � � Y [ � Ec9Ec � Ò W � � 2Ò �BÔ � � Ò��BÔ�� �� ÒA�*� ���KÔV1 W�� 2Ò���Ô � � Ò �VÔ�� X� Ò'�*� ���´Ô2Ô

j ¢� WZY [ � Y [ EcSE ��zÒSW � ��2Ò �BÔ ����zÒ �BÔ�� �� ÒA�*� ���£ÔV1XW

�� 2Ò���Ô � ��zÒ ��Ô � X� Ò'�*� ���KÔ4Ô

1 WZY![ � � Y![ E SEc��zÒ W � � 2Ò �BÔ � ��zÒ �BÔ � �� ÒA�*�#���´ÔV1 W���2Ò �VÔ � ��zÒ �VÔ�� X� ÒA�*� ���KÔ2Ô �

;1AT7�«:-*U1N�-q�('F«>-qN�/2 #+2+.-35 +4�!-�7:AJh2-0$0+. K«:-q <5¹+4-3/2;="S7>WCP>-0/45!-0D°-0«*'>D#9('*+. #7:5!"0U � �� Ò��D���£Ô@'*5!R

Page 71: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

N>�� X� Ò � ��� ÔcU!/4'*+.�,-3/¥+.�!'>5¡ #5!5!-0/�)!/47ZR!9!$c+."�7:5�7:9!/�-c��)!D# <$0 #+�WY-F'i+.9!/2-°;@'>),)! <5!G>"3M; "2-0+87*W�� 1�� D< #5!-F'>/�-0�Z9!'>D< K+L?�$37:5!"º+./4'> <56+."�-3;I-3/2G:-CWY/27:; A('>/2/4 #-3/�WY9!5!$c+. <7>5!"1R!9,/4 <5,G <56+4-3G:/4'*+. #7:5ª'*5!RH'>/4-O-35,WY7>/4$3-0Ro <5ª'>R!R! K+. <7>5E+471+.�!-�)�7:"2 #+4 #«Z #+L?\'*5!Ro9!)!)T-3/ A�7:9,5!Ro$37:5,"2+./4'> <56+4"7:5�E�M��%7>+4-C+4�('*+1+4�!-3"2-J$37>5!"2+4/.'> #5Q+4"1"29!A!"49,;=-ª+4�!-C+4/.'>R, #+. #7:5('>D�D# <5!-3'>/�-3�Q9('>D# #+L?�$07:5!"2+4/.'> #56+7>W¼+.�!- �,q° ¸M

WZY![ E ��2Ò �BÔ � WZY [ � E � 2Ò �BÔ�n � � �Q¢��!�!�!� ���6�WZY [ � Ec � 2Ò���Ô � WZY [� Ec � 2Ò �VÔ n �����Q¢��!� �!� ���P�

� � E � � no� ���Q¢��!�!� � � " �·-1 <;I)!D<-0;=-05Q+4-3RH+.�!-1;@'i�� #;= #¶F'*+4 <7:5o7>W �j®ÒFEV��� � �>ÔcUZ"49!A`h2-3$0+�+47C+4�!-°'>AT7�«:-1$07:5!"º+./.'* <56+."0U

'>"�'8�Q9('*R!/.'*+4 <$O)!/47:G>/.'>;BU>7:;I #+2+. #5!G�+4�!-�-356+4/47:)6?ª+4-3/2;=" �Ò���fÔ R!9!-¥+471+.�,-3 </©5!7:5�²z�Z9!'>R!/.'i+. <$5('*+49!/4-*M����! #"¡"2 <;I)!D< KÕ($F'i+. <7>5 <"S+47:D<-0/.'>A!D#-xWY7:/S+.�!-�;I7:;=-056+FU1AT-3$3'>9!"2- �Ò � fÔ@«*'>5! #"4�!-0"+.7�N�'>/4R�¶0-3/47�'>" ��A�-0$37:;I-3"ª$37:;I;= K+4+4-3R+47q'x"4 <5,G:D<-=;= ´��+49!/4-@$37:;I)�7>5!-356+FU�N��, <$&��7>Ws+.-05�('>),)�-05!"% #5S)!/.'*$0+. #$3-*M

���!-19,)�R('i+.-%WY7>/ �°-05!"49!/2-3"¥+4�('*+�A�7>9!5!R!"O7:5@$0D�'>"2"4 #Õ!$F'*+4 <7:5I$37:5,"2+./4'> <56+4"¥'>/2-�+4 <G:�6+�9!5!R!-0/+.�,-E),/4-0«Z #7:9!"� #+4-3/.'i+. <7>5 �¦"�� � � X b � ÒS�\Ô�"47:D#9,+. #7:5 G

� 2Ò��BÔ�� -c��) ���D<5 � ��1 ���D<5 �Ò�( �� ÒA�§Ô � � �� Ô*���r� ��� �� ºÒ���Ô�� -c��) �:��D<5 � � ��1 �:��D#5 ��Ò ( X� ÒA�fÔ � � X� Ô9��� ����� X �

���Q9!"3U�WY7:/E9!)TR('*+4 <5!G �B'>5!RWY7:/E;='>PQ <5!GB)!/4-0R! <$c+. #7:5!"\N� #+.��+.�!-HÕ(5('*DO;I7�R,-3DhU�NO-X5!-0-3R-c��)T-3$c+&'*+4 <7:5!"E9!5!R,-3/ �=ÒS�\Ô1WY7:/\«*'>/4 #7:9!"\$37:;I)T7:5!-356+4"C7>W�+.�!-IR! <"2$3/2 <;I <5('>56+°WY9!5,$0+. #7:5VM �(7:/

Page 72: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

N*� <5,"2+&'*5!$3-*U!+.�!-\-c��)T-3$c+.-3RB«*'>D<9!-°7*W�-F'*$&�¡D#7:G*²º³\'>9!"2"4 <'>5@WY7:/ � ��¢�� � � <"

���D<5 �Ò�( �� ÒA�§Ô � � �� Ô*� � j � � D<5�Ò§� �Ôkj ¢

� j ¢� � �� ÒA�]� �fÔ1 W

�Y![�� E �

��Ò��BÔ�� �� ÒA� �

� �§Ôkj W�Y![ E �

��Ò �BÔ � �� Ò'� �

� �fÔj ¢� W

�Y [ �

� Y [ � E �E

����

�Ò �BÔ �

��zÒ �BÔ � �� Ò'� �

� ���<Ô

j ¢� W

�Y [

� Y![ E �E

�� �

�Ò �BÔ �

�� Ò��BÔ�� �� Ò'� �

� ��� Ô

1 W�Y [ �

� Y![ E �E

����

�Ò �BÔ �

��zÒ �BÔ � �� Ò'� �

� ���<Ô �

·-�"4 <;I <D<'>/4DK?°$37>;=)!9�+.-O+4�!-�-c��)T-3$c+.-3RHD#7:G°³\'>9!"2"4 �'*5o)!/47:A!'>A! <D# #+L? ���D<5 �Ò�( X� ÒA�§Ô � � X� Ô*�WY7:/J5,-3G6'*+4 #«>-S;=7ZR!-3D#"3M �© <5('*D<D#?>U NO-�7:A,+&'* <5�+.�,-S-c��)�-0$0+4-3R A, �'>"o'*5!R�;= ´�, #5!Gx)!/27:)T7:/2+4 <7:5!" <5,R! </2-3$0+4D#?I«Z �'J+.�!-°WY7:D#D<7�N� <5,GJ"49!/2/47:G:'*+.-°«*'>/4 <'>A!D#-3" G

� � � ���D<5 � �p1 ¢� �:�73!� n � ���Q¢��!� �!� � �6�

3 � � ���D<5 � � � j ¢� �:�73!� n � ���Q¢��!�!�!� � �P�

���! #"� #"®R!7:5!-�A6?H9!"4 #5!G°+.�!- \�Ö$37:5,R! #+4 <7:5!"0U:N��! <$&�=-35!"29!/4-�+.�('i+�'i+®5!7:5�²zA�7:9,5!R@�u'>G>/.'>5!G>-;J9!DK+. #)!D< #-3/@"2-0+2+. <5,G:"3U°$0D�'>"2"4 #Õ!$F'*+4 <7:5 <5!-0�Q9('>D< K+. #-3"�'>/2-'>$&�, <-0«>-3R A�es_sr `Og3�,d>j£es_S�iM ML5 7*+.�!-0/NO7:/4R!"0U¼+4�!-H"2+4/4 <$c+.-0/ª ¡¬�­ $37:5,"2+./4'> <56+4"E #;=),D< <$0 #+� <5��DJÒSE � � � �:Ô1AT-3$07:;=-H-0�Z9!'>D< K+. <-0"3MJ���Q9!"0U

Page 73: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

N�NN��!-05 E k��Òf�&� � ÔON�-\;J9,"2+%'>$&�! #-0«:-\+.�,-\WY7>D<D<7�N� #5!GªN� #+4��-3�Q9('>D# #+L?oGW

�� 2Ò��BÔ3Ò

� � 1 �:��D#5 ��Ò ( �� ÒA�fÔ � � �� Ô*�*ÔV1 �Ò � fÔ �W�� 2Ò���Ô3Ò>3 � 1 ���D<5 �Ò�( X� ÒA�§Ô � � X� Ô9�*ÔV1 �Ò � YÔV1m_` � ��� �W�

� 2Ò �VÔ3Ò>3 � 1 �:��D#5 ��Ò ( X� ÒA�§Ô � � X� Ô9�*ÔV1 �Ò � fÔ �W�� 2Ò��BÔ3Ò

� � 1 �:��D#5 ��Ò ( �� ÒA�fÔ � � �

� Ô*��1\ÔH�Ò���fÔV1m_` ����� X �·¸-J"47:DK«:-JWY7:/

� � WY7:/ � �Ó¢�� � � '>5,R�3 � WY7:/ � ��¢�� � �Ï <5�+4�! <"HÒY7�«:-3/a²L$07:5!"2+4/.'> #5!-3R(Ô1D< <5,-F'>/"2?Z"º+.-3;BU�7:A,+.'> <5! #5!Gª+4�!-\-c��)�-0$0+4-3RxA! <'>"�'>5!R�;I K�� <5,Go)!/47:)T7:/º+. <7>5!"3M

� 7�;='>P*-x)!/4-0R! <$c+. #7:5!"=N� K+.�¹+4�!-xD�'i+.-356+S �¬®­��¦"SD#-F'>/25!-3RH�=ÒS�\ÔcU¥NO-�$F'*5!5!7>+S9,"4-x+.�,-"2+.'>5!R('*/4Ro/49,D<-�WY/27:; ¬®�Q9('i+. <7>5BÒS�,M �QÔ¼R,9!-�+.7° K+." <56+./4'>$0+.'>A!D<-OD<7:Gi²L"49,;="0M\ML5,"2+.-3'>RVU6NO-�-3;I)!D<7�?+.�,-1WY7:D<D#7�N� <5!GC'>)!)!/27F�, #;@'i+.-�)!/4-0R! <$c+. <7>5@9!"2 <5!GJ+4�!-1-^�,)T-3$c+&'*+4 <7:5XWY7>/4;J9!D<'>"®N�- h29,"2+�R!-0/4 K«:-3RFG

=� �±D<5 � � -c��)ªÒ �:��D#5 �Ò�( �� Ò'��Ô � ���� Ô*��1� � Ô�

�-^�,)CÒ �:��D<5 �Ò�( X� Ò'��Ô � � X� Ô9�p1 3 � Ô � Òh�,M N>Ô

½�¾�� � ���SÅ �°ÇXÉ�Ã3Á ¹À ÃFÇ�ÃFÄ Á����Ì�É�ÃFÄ Ã���ÁCÉ�Ã0Ë=Ç

��D�'*+2+ � "1"2-3�Q9!-356+4 �'>D ;= #5! <;='>DV7:)�+. <;I <¶3'*+. #7:5¸ÒF�!  �EÔª~ ��D�'i+4+FUu¢�¤>¤:¤*� <"%'>5q'>D<G>7:/4 K+.�!;�WY7>/%+.�,- #+4-3/4'*+. K«:-®"47:D#9,+. #7:5E7>W($37>5Q«>-c�ª�Q9('>R!/4'*+. #$O)!/27:G:/4'>;="�N� K+.�J'�"4 #5!G:D<-®D# <5!-3'>/�-3�Q9('>D# #+L?\$07:5!"2+4/.'> #56+'>5!R�A�7:9,5!Rx$37>5!"2+4/.'> #5Q+4"3Mo�!  � N¥'*"8"4)T-3$0 #Õ($3'>D<DK?�R!-3"2 <G:5!-0Rx+.7="47:DK«:-JD<'>/4G:-^²L"2$F'>D#-#�'q\  7:)�²+. #;= #¶F'*+4 <7:5�)!/27:A!D#-3;I"3M��!  � #"1)('>/º+. #$39!D<'>/4DK?�-0µI$3 #-356+8N��!-05q+4�!-J"27:D<9,+4 <7:5¡ <"%"4)('>/2"4-*Uu'>"1 #"+.�,-E$3'>"4-°N� K+.���,q\ ¸M�!  �+&'>P*-3"E'>R,«*'>56+.'>G:-ª7*W�'="4)T-3$3 <'>D©$3'>"4-o7*W�+.�!-J"º+./29!$0+49!/4-0R�$07:5!"º+./.'* <56+."8NO-JR!-0"4$3/2 <AT-

<5S+4�!-\5!-c�Z+�"4-0$0+. #7:5VMk�!  � $F'>5BA�-E'>),)!D< #-3RX+.7I' ��� )!/27:A!D<-0;

� � �±'>/4G:;I <5�

s � . �R1 ¢� � .� � x � "49!A`h2-3$0+�+.7� � �-3/� Òh�,M �:Ô

Page 74: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

N>����!-E"4 #5!G:D<-1D< <5,-F'>/¥-0�Q9('>D< K+L?X$07:5!"2+4/.'> #56+%�!'>"�+.�!-°WY7:/2; G

� �!�!���� �!�!�

��� �!� ��������������

MMM� �MMM� �MMM

��

� 3 � Òh�,M �>Ô

MzW©NO-E-c�,'>;I <5!-8+4�!-EWY7>/4; 7>W¼+.�,-CD# <5!-3'>/¥-3�Q9('*D< #+L?X$37:5!"º+./4'> <56+ªÒS�,M �:Ô&U!N�-E5!7>+4 <$0-\+4�('*+�NO-C$3'>5;='> <56+&'* <5¸+4�!-S$37>5!"2+4/.'> #5Q+JAQ?�9!)�R!'*+. #5!G�'>"JWY-cN '>"C+LN�7�'>/2A! #+4/.'>/º?R! #;=-05!"4 #7:5!"0U� '>5,R��TM���! #"� #"�'>$3$07:;I)!D< #"4�!-0RBA6?S;='> #5Q+.'> <5, <5!GE+.�!-\-3�Q9('*D< #+L?>U

��� =� � 1��� =� � �

��� � � 1��� � � Òh�,M��:Ô

N��!-0/4-L=� R!-05!7>+4-3"S+.�!-q5!-cN�«*'>D#9!-�7>W �uM ·-q$3'>5¯"47:DK«:-ÖÒS�,M �6Ô=WY7:/ � � '>5!R¯/2-0N�/4 K+.-�+.�,-�Q9('>R!/4'*+. #$�7:AJh2-0$0+. K«:-�WY9!5!$c+. #7:5¡ÒS�,M¦�6Ô© <5J+4-3/2;="®7>WT+.�!-¥+LNO7C'i��-3"� @'>5,R��C <5J+.�,-�7>5!-�«>'*/4 �'*A!D<-� � M¹���!-B/4-0"49!DK+. #5!G�WY9,5!$0+4 <7:5�$F'>5ÖA�-BR! Cn-0/4-356+4 �'*+4-3R�N� #+.��/4-0"4)T-3$c+@+.7 � � U¥'>5,RÖ+.�,-¡/27�7>+$F'*5�A�-@$37:;I)!9,+4-3R+47�Õ(5!R�+4�!-X;I <5! #;J9!;BM Mz+.-3/4'*+. #5!G�"29!$&��'�)!/27�$0-3R!9!/2-@WY7:/ª'>D<D®)('> #/4"E7>W'i��-3"¥N� #D<D�;I7:5!7>+47:5! <$3'>D<DK?o'>),)!/476'*$&�X+.�!-8G>D<7:A('*DT;I <5, <;J9!;�7*W°Òh�,M �:Ô®N��! #D<-�;@'> #56+&'> #5! <5!G\+.�,-$37>5!"2+4/.'> #5Q+3M ��-3-@~ �®D<'*+4+3UV¢�¤:¤>¤*�nWY7:/�R,-0+&'* <D<"0M�!  � /2-3D< #-3"®7:5I"4-c«:-3/4'>Dn�,-39!/2 <"2+4 <$0"®+47C$&�,7�7:"2-8'i�� #"º²L)!'> </2"�+.7E7:),+. #;= #¶3-*M©���!-0"4-1�,-39!/2 <"2+4 <$0"

'>/2-B$0/4 K+. <$3'>D�+47q+4�!-B-0µI$3 #-35!$c?�7>W��!  �oM����,-�'>D#G:7:/2 #+.�,; +.'>P>-0"@;='i�� <;J9!;Ï'>R,«*'>56+.'>G:-�7>W"4)!'>/4"2 #+L?�'>5,R '*+2+.-0;=),+4"J+.7q;='>P>-�;='i�� <;J9!; )!/27:G:/4-0"4"HN� #+4��-3'>$&��"2+.-0)VM m�9! <D#R! <5,Gx9!)T7:5��D�'*+2+ � "=NO7:/4P�U�7>+.�,-3/4"S�!'�«>-�)!/47>)�7:"2-3R #;=)!/27�«:-3R �!-39!/2 <"º+. <$0"@WY7:/@'i�� <"X"2-3D<-0$0+4 <7:5 ~ °-3-0/2+.�, -0+%'>D§M#U�¢�¤:¤:¤i�hM

·-I5!7�N$07:5!"2 <R!-0/\+4�!-I)!/47:A,D<-3; 7>W¥7>),+. #;= #¶3 <5,G=+.�,-ID<'*+.-056+J ¡¬�­ �Q9('>R!/4'*+. #$o)!/47:G>/.'>;"49,AJh2-3$c+J+.7�+4�!-@G> #«:-05�"2?Z"º+.-3; 7>W�D# <5!-3'>/E-3�Q9('>D# #+L?q$37>5!"2+4/.'> #5Q+4"3M¡�� <P>-=;@'*5Q?q7>),+. #;= #¶F'*+4 <7:5)!/27:A!D<-0;="uWY/47>; +.�!-�;@'*$&�! <5!-�D<-3'>/45, <5!G�$37:;I;J9!5, #+L?:U�+.�, <"¼)!/47:A,D<-3;È)T7:"2"4-3"2"4-0"�"2+./29!$0+49!/4-�+.�('i+$F'*5�A�-=-c��)!D#7: #+4-3R¸+47¡?Z <-0D<R'>5�-0µI$0 <-356+J'>D<G:7>/4 #+4�!;BMX���!-XG:-05!-3/4'>D®WY7:/4; 7>W¥+4�!-@7>AJh2-3$c+. #«>-WY9!5!$c+. #7:5BWY7>/�+4�!-J ¡¬�­�R! <"2$3/4 #;= #5('*+4 #«:-°),/477h2-0$0+. #7:5�"º+.-0)� <"�j®ÒSE�Ô � � . ER1 b� E . � EuU�N��!-3/2-E� #"8+.�!-o"27:D<9�+. <7>5�+.7X+4�!- ���±)!/27:)�7>"4-3Rq #5x+.�!-C��-0$0+4 <7:5 �,M �!ME���!-H$37:5!"º+./4'> <56+."\'*/4-J7>W�+.�,-

Page 75: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

N �WY7:/2; EL� �,M ML5¹G:-35,-3/.'*DhU�NO-x$F'*5!5!7>+="4 #;J9!D#+.'>5!-07:9!"4DK?�;@'* <56+&'> #5�+.�!- � 1 � D< <5,-F'>/-3�Q9('*D< #+L?�$37:5!"º+./4'> <56+."HA6?�7:),+4 <;I <¶3 #5!G�7�«>-3/@7>5!D#?�'i�� <"H)('> #/4"3U�'>"H <5 ��D�'*+2+ � " �!  � WY7:/o+.�,-�,q° ¸M�¨�7�NO-0«>-3/0UO"27:;=-@'>5('>DK?Z"4 <"C/4-c«:-F'*D<"ª+4�('*+JNO-X$F'*5�/4-3R,9!$3-X+4�!-X5Q9!;JAT-3/J7*W�'i��-3"ª+47�';='i�� <;J9!; 7>W ;@'���Ò � � ��Ô�'*5!R�'o;I <5! #;J9!; 7>W¼+LN�7,UTR,-3)T-35!R! #5!GH7:5�+.�!-\"4 K+.9('i+. <7>5VM

³\-05!-3/4'>D�D< <5,-F'>/I-3�Q9('>D# #+L?�$07:5!"2+4/.'> #5!-3R¹'>D<G:7>/4 #+4�!;I"o;J9!"2+@$37:5,"4 <R,-3/@+4�!-�5Q9!D#D�"2)('>$0-x7>W+.�,-SD< <5,-F'>/E"2?Z"2+4-3; 7>W�$07:5!"2+4/.'> #56+."3MPML5�+.�,-S$F'>"2-S7>W�$37:5!"º+./4'> <5!-0R��%-0N�+47:5�;=-c+.�!7ZR!"0U�+.�! #"G:-05!-3/4'>D<DK?¡/2-3�Q9! #/4-3"%+.�!-o #5Q«>-3/2"4 <7>5x7>WO'@;='*+./2 K�B+.�('i+8$37>/4/4-0"4)T7:5!R!"8+47X+.�!- °� "2?Z"º+.-3; 7>W+.�,-I),/47:A!D#-3;BMª·¸7:/4PQ <5,GB"2-0+E;I-0+.�,7�R!"0U¼'>5q-c�Z+./2-3;I-=$3'>"4-H7>W�N��! <$&�� <" ��D<'*+4+ �¦" �!  �oU�"4'F«:-$37>;=)!9�+&'*+4 <7:5SA6?S7:)�+. <;I <¶0 <5!GC7�«:-3/�'o"49,A!"4-c+%7*W +4�!-\'i��-3"� <5�'>5� K+.-3/4'*+. K«:-°'*D<G:7:/2 #+4�!;¡MQ�!  �9!"2-3"�'�NO7:/4PQ <5,G1"4-c+©7*W,+LNO7°'i��-3"0M©���!-O"4 <5,G:D<-®D< #5!-F'*/�-3�Q9('>D# #+L?°$07:5!"2+4/.'> #56+ 7*W!+.�!- �,q°  $F'*5ªAT--c��)!D# <$0 #+.DK?o".'i+. <"ºÕ(-3RSAT-0+LNO-3-05S+.�!-1+LNO7o'i��-0"3M®���!-3/2-8 <"O7:5!-%R!-3G:/2-3-87*W�WY/4-3-0R!7:;Ó'>D<7>5!GEN��, <$&�+.�,-=D# <5!-3'>/4DK?x$37>9!)!D<-0R¸«*'>/2 �'>A!D#-3"\'>/2-@'*5('>D#?Q+4 <$F'*D<D#?¡7:),+4 <;I <¶0-3RVMI���!-@),/4 <;='>/º?x-0µI$0 <-35,$0?�7>W�!  � <"¥+.�!'*+� #+�+.'>P>-0"1'>R�«>'*5Q+.'>G:-°7>W©"4)('*/4"4 K+L?S <5 E�M

�u'*+.-05Q+� �¬®­ #"@;I7:/4-¡G:-35,-3/.'*D%+.�!'>5¹+.�!- �,q\ ¸M�·-�/4-3),D< <$3'*+.-B«*'>/4 <'>A!D<-0"I+47�)T-3/4;I #+7:),+4 <;I <¶3'*+. #7:5=7�«>-3/�'oD�'*+4-356+�R! #"2+./2 <A!9�+. <7>5VM����! #"�/4-3),D< <$3'*+. #7:5X #;=)('*/2+."O/4-0G:9!D�'*/¥"2+4/49!$c+.9!/2-\+47+.�,-¥$37:5,"2+./4'> <56+4"3M����!-¥WY7>D<D<7�N� #5!G1-0�Z9!'*+. #7:5J"4�,7�N�"�+4�!-¥WY7:/4; 7>W�+4�!-¥$37>5!"2+4/.'> #5Q+�;@'*+4/4 ´� WY7>/'=D<'*+.-056+° �¬®­ ),/47:A!D#-3; N� K+.�¡WY7>9!/%D<'*+.-056+1"º+&'*+4-3"3U�+LNO7@WY7:/�-F'>$&�xA, <5('>/º?�$3D<'>"4"�WY/47:; N��, <$&�-c�,'>;I)!D#-3"�'>/4-°R,/.'FN�5 G

���������!� � � ��� � ��� �!�!� jC¢ � �!�!� �

� ��� �

� �!��!� � � ��� � ��� �!�!� � jE¢ �!�!� �� �

�� �

� �!��!� � ¢ � �!�!� j � ��� j � ��� �!�!� ¢ � � �!��!� � � ¢ �!�!� j � ��� j � ��� �!�!� � ¢ � �!�

��

��������������������������

MMME � �E � �MMME ���E ���MMME� �

E� �MMM

��

�������������

��

Òh�,M ¤:Ô

Page 76: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

N ����!-E <D#D<9!"º+./.'i+.-3R�$07:D<9!;I5!"�7>W $07:/4/2-3"4)T7:5!RB+.7='i��-3" b*� � U �Ob � � � U�'>5!R��@b9��� � '*"4"47Z$3 <'*+.-0RN� #+4��-c�,'>;I)!D<-0" uU ��U�'>5!R��� <5x+.�,-oD�'*+4-356+E �¬®­�)!/47>A!D<-0;¡M\���!-o-05Q+4/4 #-3"°7>W®+.�,-JWY7:/4; �

���'>/2-%G: K«:-05@A6?H+.�!-�)�7>"2+.-0/4 #7:/®)!/47:A!'>A! <D# #+L?ªR! <"º+./4 #A!9,+4 <7:5!" �

�7�«:-0/�+4�!- � '>5!R � D�'i+.-356+�"2+.'*+.-0"

7>W�+4�!-EG:-35!-0/.'*+4 #«>-ª;I7�R!-0D<"0M\Ò>ML5�+4�! <"�$3'>"4-*U � � � � ��M ÔS��7>+.-\+.�!-E/4-0)!D< #$F'*+4 <7:5�7>W©«>'*D<9!-0"N� #+4�! <5�+.�,-�$37>5!"2+4/.'> #5Q+@;@'i+./4 ´��M ;�$07:/4/2-3"4)T7:5!R, <5!G¸/4-3),D< <$3'*+. #7:5� <"I/4-0�Z9, </4-0R¹ <5�+.�!-¡R!9('>D«*'>/4 <'>A!D#-3"3U E�M����!-°-3;JAT-3R,R!-3R � � � '>5!R � ��� #R!-356+. K+L?@;='*+4/4 <$0-3"¥- Cn-0$0+4 #«:-0D#?@"4-3D#-3$c+�'D�'i+.-356+%$37:5�Õ(G:9!/4'*+. #7:5�7>W�+4�!-Bg����(g��ces_L`�$0D�'>"2"8'>5!R� #+."%'>"2"47Z$3 �'i+.-3R�R!9('>Du«*'>/4 <'>A!D<-*M��%7>+4-ª�!7�N+.�,-HWY7>/4;�7*W�+4�!-H$37:5,"2+./4'> <56+4"°R! DC�-3/2"°A('>"4-0R9!)T7:5�+.�,-o$3D�'*"4"\7>W®+.�!-H$&�!7>"4-35¸-c�,'>;I)!D<-*Mª·¸-N� <D#Dn5!7�N -c��)!D<7>/4-°+.�!-\- Cn-0$0+%7>W +4�! <"�"º+./29!$0+49!/4-E7:5S+.�!-\7:)�+. <;I <¶3'*+. #7:5@),/47:A!D#-3;BM����� � ������������������� �

��-0+�9!"�$37:5,"4 <R,-3/�+LN�7=-c�,'>;I)!D<-0"3U �'>5,R �@WY/27:; 7:),)�7:"2 #+4-E$0D�'>"2"4-0"3M�·¯ K+.�!7:9�+�D<7:"2"�7*W�G:-05!-3/a²'>D# #+L?:U>D<-0+� =A�-�)T7:"4 K+. #«>-�'>5!R �JAT-�5,-3G6'*+4 #«>->M����!-05=NO-%$3'>5I;@'> #56+&'> #5J+.�!-�$37>5!"2+4/.'> #5Q+4"®9!"4 #5!G+.�,-\WY7>D<D<7�N� #5!GJ-3�Q9('*D< #+4 <-0"¥ <5S«:-0$0+47:/�WY7>/4;5G

� � =E � . ¢ � j =E � � � � E . � ¢ � j E �=E � j � � =E � . ¢ � � E � j � � E . � ¢ � ����!-05VU(N�-\$F'*5BN�/2 #+.-

! E � �Ò ! E . � ¢�Ô � �! E � �Ò ! E . � ¢�Ô � � � Ò2Ò4Ò ! E . � ¢�Ô � � Ô . ¢�Ô � � ��Ò ! E . � ¢�Ô � �

���Q9!"3U�Ò ! E&. � ¢�Ô � Ò ! E . � ¢�ÔcUT'>5!R ! E � '>5!R ! E � '>/2-ª$37>9!)!D<-0R¡«Z �'H+.�!-0 </�5!7:/2;="�A6?�'I"4 #5!G:D<-"4$3'>D�'*/¥+.�('*+�NO-\N� <D<D�$F'>D#D !#" M

! E � � !#" � � ÒS�,MK¢��6Ô! E � � !#" � � � ÒS�,MK¢:¢�Ô

Page 77: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

N>¤ML5 7*+.�!-0/�NO7:/2R!"3U8NO-$3'>5±;='> #5Q+.'> <5¹+4�!-�D< <5,-F'>/X-0�Q9('>D< K+L? $37>5!"2+4/.'> #5Q+4"¡A6?¯9!)TR('*+4 <5!G�+.�,-"47>D<9,+4 <7:5XN� K+.�S+.�!-\"2$F'>D#-3RB)�7:"º+.-0/4 <7>/�R! <"º+./4 #A!9,+4 <7:5!" � � '*5!R � � M

���!-E$&�('>5!G:-\ #5�+4�!-\�Q9('>R!/4'*+. #$°7:AJh2-3$c+. K«:-\WY9!5!$0+4 <7:5SWY7:/¥+4�!-E'i��-3" x'>5,R �@ <"! j � � Ò ! ETÔ � � . � ! E � 1 � . � ! E �1 b� ! E . � � � � ! E � 1 ! E . � � � � ! E � 1 b� ! E . � � � � ! E �1 W ��� � e � Ò ! E . � � ! E � 1 ! E . � � ! E � Ô �

;1D#DT+4�('*+�/4-3;='> #5!"� #"O+.7ª-c��)!/4-0"4"¥+4�!-8$&�('>5,G:-° <5I+.�!-87>AJh2-3$c+. #«>->U ! j � � Ò ! ETÔ�'>"�'CWY9!5!$c+. <7>5X7>W!#" A6?J$&�!'>5!G: #5!G8«*'>/4 <'>A!D<-0"©9!"2 <5!G\¬��Q9('*+4 <7:5,"�ÒS�,MK¢��6Ô '>5!RBÒS��M#¢:¢�ÔcM©���, <"� <"©'8"2+4/.'> #G:�6+4WY7:/ºN¥'>/2R'>D#G:-3A!/4'> <$°;='>5! #)!9!D<'*+. #7:5VM����!-E/4-0"49!DK+. <5,G=7:5,-c²LR, <;I-35!"2 <7:5('*DV�Q9('>R!/4'*+. #$E7>AJh2-3$c+. #«>-EWY9,5!$0+4 <7:5VU! j � � Ò !#" ÔcUT$F'>5xAT-J'*5('>D#?Q+4 <$F'*D<D#?@7:),+4 <;I <¶3-0R¡A6?�Õ(5!R, <5!G@+4�!-ª/27�7*+17>W©+.�!-CR!-3/2 #«*'*+. K«:-E9!5!R!-0/+.�,-EAT7F��$37>5!"2+4/.'> #5Q+3M

������� ������� � ��������� �

�%7�N N�-�-^�!'*;= #5!-@+.�,-B$3'>"4-S #5�N��! <$&��'i��-0" Ö'>5!R � '*/4-S$&�!7:"2-35�WY/47:; +.�!-S"4'>;I-S$3D�'*"4"3M·¯ #+4�!7:9,+ªD<7:"2"ª7>W�G:-05!-3/4'>D< K+L?:U©NO-X$&�!7Z7:"2- Ö'*5!R ��;I-3;JAT-3/2"J7>W�+4�!-X)T7:"4 K+. #«>-@$0D�'>"2"o'>"J #5¬��Q9('*+. #7:5 ÒS�,M¦¤6ÔcM:;1"E <5q+.�,-= #5Q+4-3/a²L$3D<'>"4"\$3'>"4-*U¼NO-=N�/2 #+.-o+4�!-=$07:5!"º+./.'* <56+."\ <5q+.-0/4;I"\7>W¥7:9,/+LNO7I«*'>/2 �'>A!D#-3"0U x'>5,R �CU! <5S«>-3$0+47:/�WY7:/4;5G

� � =E � . ¢ � 1 �� =E

. ¢ � � � � �E . � ¢ � 1 ��HE .

�¢ �=E � 1 =E

�� E � 1nE

���!-0"4-°$37>5!"2+4/.'> #5Q+4"�'>/2-1"4 #;=),D<-3/®+.�!'>5X <5I+.�!-1)!/4-c«� #7:9!"¥$3'>"4-*M ML5X)('>/º+. <$09!D�'*/3U6N��!-35 � � � ��U

NO-C7:A�+&'> #5X+.�!-°WY9!/º+.�!-0/�"2 <;I)!D< KÕ($F'i+. <7>5 G =E � . ¢ � 1 =E

. ¢ � � E . � ¢ � 1 �E .�¢ � ÒS�,MK¢��>'6Ô=E � 1 =E

�� E � 1nE

�� ÒS�,MK¢��*A�Ô

Page 78: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�:�

�%7*+.-®+.�('*+�Òh�,M#¢��>'6ÔV <"u".'i+. <"ºÕ(-3RCN��!-35XÒS�,MK¢��*A�Ô� <"u"4'*+. #"2Õ(-0RVM©���!-0/4-cWY7:/4-*U*NO-�5!-0-3RJ7:5,D#?°-05,WY7:/4$0-+.�!'*+®+.�!-�"49,;�7>W�+4�!-�«:-0$0+.7>/4"� #"�$37:5,"2+&'*5Q+3MdMz+� <"� <;I)T7:/2+.'>56+�+.7E7:A!"2-3/2«>-�+4�('*+®+.�,-� #56+./.'�²L$3D<'>"4"$F'*"4-\ <"�$37>;=)!/2 <"2-3R�7>W¼+LN�7I"49!AZ²L$F'*"4-3"�R! #"2+. #5!G:9! #"4�!-0R�AQ?SN��,-0+.�,-3/ � � � �

�7:/�5,7>+FM

����� (������ ����� $�������� �%7�N\UONO-B$37:56+. #5Q9!-BN� K+.��+.�,-¡R!-0/4 K«>'i+. <7>5�7>W%+4�!-�es](_§b2d>?4mcjKdi�&��`Og3�,d>j$F'*"4->M ��-0WY-0/4/4 #5!G=+47�¬��Z9!'*+. #7:5�ÒS��M#¢��iA�ÔcUTN�-o"2-3-ª+4�('*+8+4�!-J$37>5!"2+4/.'> #5Q+4"8$F'*5�A�-C".'*+4 <"2Õ!-3RVU�'i+-F'*$&�S #+.-0/.'*+4 <7:5nU6AQ?=$&�!7Z7:"4 #5!GJ'E"4 #5!G:D<-�"49,A�²a'i�� #" �='*D<7:5!GEN��! <$&�=+.7ª7>),+. #;= #¶3->U6"27ªNO-8/4-0"2+./2 <$c+7:9!/2"4-0D#«:-0" +47 ��®'>5!R ���*M\ML5C+4�! <"u$3'>"4-*U*+.�,-OD<'*+.-05Q+© �¬®­�7:),+. #;= #¶F'*+4 <7:51R!-3$07:;=)T7:"2-3"©R, </4-0$0+4D#? <56+47 ��D<'*+4+ �¦"6�!  �oM!·¸7:/2PZ #5!GoWY/47:;�ÒS�,MK¢��*A(ÔcU,NO-C7>A,+&'> #5

=E ��� 1 =E� � � E ��� 1 E � � �

N��! #$&�¡D#-F'>R!"�9!"�+47=E � � � E � � 1 ÒSE

� � j =E� � Ô=E

� � � E � � 1 ÒSE � � j =E � � Ô*�·¸-C'*D<"47H7:A,"4-3/º«:-\+.�('i+

! E � � �6j ! E� � �

·¸-C'*G6'> <5S$3'>D<DT+.�! #"�"4$3'>D�'>/��Q9('*5Q+4 #+L? !#" M����!-ER!-3/2 #«*'*+4 <7:5X7*W©9!)TR('*+4-\/49!D#-3"�)!/27�$0-3-3R,"1'>5!'>DK²7:G:7>9!"4DK?@N� #+4� �®D<'*+4+ �¦"6�,  �JM����� (������ ������� � $�������� �© #5('>D#D#?:UQNO-C$07:5!"4 #R!-3/�+.�,-Ies](_fb2d>?4mcjKdi�&�E��]n`Og3�,d>jZ$F'>"2->M����, <"�"4 K+.9('i²+. #7:5S <"�"4D< #G:�6+.DK?=$07:;I)!D< #$F'*+4-3RSA6?@+4�!-°Wf'>$0+¥+4�('*+�+4�!-°)�7>"2+.-0/4 #7:/¥R! #"2+./2 <A!9�+. <7>5!" � � '>5,R �

�'>/2-

5!7>+�-0�Q9('>DhU,'>5!R�"47H5!7HD#7:5!G:-0/�Wf'>$0+47:/¥7:9�+�'>5!R�$F'>5,$3-3DV'>"� <5�Òh�,M#¢��>'6ÔcM����, <"�$&�('>5,G:-°/4-0�Z9, </4-0"9!"@+47�-c��)!D# <$0 #+.DK?�-35�WY7:/4$0-�'$37>5!"2+4/.'> #5Q+@7:5 +4�!-x5!7:/2; 7>W°+.�!-¡R!9('>D�«*'>/4 <'>A!D<-S«>-3$0+47:/4"0U =E �'>5!R =E

�MpML5x7:/2R!-3/�+.7=-35,WY7>/4$3-E+.�!-C'>R!R, #+. #7:5('>D�$07:5!"º+./.'* <56+FU(NO-ª;J9!"º+8$&�!7Z7:"2-J'>5�'>R!R! K+. <7>5('>D

"49,A�²a'i�� #"��¼7�«:-3/�N��! #$&�B+47I7>),+. #;= #¶3->M�%DK+. <;='*+4-3D#?>U>NO-%-^�,),/4-3"2"�+.�,-%/2-3D�'i+. <7>5!"4�! #)HA�-c+LN�-0-35@+4�!-�WY7>9!/®$&�('>5!G: #5!GC'i��-3"¥'*"�'\"4 #5!G:D<-

"4$3'>D�'*/ ! " '>5!R�R!-3/2 #«>-C9!)TR('*+4-°/49!D#-3"0U("4 <;I <D<'>/4DK?o+.7o+.�,-E7*+.�!-0/�$3'>"4-0"3M

Page 79: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�,¢

����� � � ��� ��������� ���

;%Ws+4-3/� #;=)!D#-3;I-356+. #5!G �!  ��'>"�R!-0"4$3/2 <AT-3R¡'>AT7�«>->U!NO-C�!'>RS+./47>9!A!D<-°G>-0+4+4 <5!Go$07:5!"2 <"2+4-356+�$37:5Z²«:-0/4G:-05!$3-CN� #+.�BD�'i+.-356+�«*'>/4 <'>A!D#-°)!/47:A,D<-3;I"3M �!  � R, <RB$37:56«:-0/4G:-CN�-0D<D� <5�+.�,-��,q°  $3'>"4-*MpMz+"4-0-3;I-3Rq+.�('i+°$37:56«>-3/4G>-35!$0-=N�'>"\�!-F'F«Z <DK?�R!-0)�-05!R!-05Q+C9!)T7:5�+.�!-o7>/4R!-0/° <5xN��! #$&�'i��-0"\NO-3/2-"4-0D<-0$0+.-0RVU¥N��! #$&� "4�,7:9!D<RÖ5!7>+IAT-B+4�!-�$3'>"4-�WY7:/='�$07:56«:-c� 7:),+4 <;I <¶3'*+. #7:5VMm;%Ws+4-3/o«:-0/4 #Ws?Z #5!G+.�,-= #;=)!D#-3;I-356+&'i+. <7>5VUnNO-INO-3/2-=WY7:/2$3-3R�+.7¡'>$3$0-3),+C+.�('i+C$07:56«:-0/4G:-05!$3-X$07:9!D#R¸)!/27�$0-3-0R¸N� #+4� <5�Õ(5! #+4-3"2 <;='>DO"º+.-0) "4 #¶3-�R!9!-S+47¸'*5 '>D#;=7>"2+J»�'i+H7:AJh2-3$c+. K«:-�N��!-35Ö$37:5!"2 <R!-0/4 #5!G�'q;I <5, <;='>DNO7:/4PQ <5,G¡"2-0+FMrMz+J'>),)�-3'>/4"\+.�('i+��OM%�EM m¥'>$&�¹~¦�*�:�>�>��/4'>5 #56+.7¡'B"2 <;I <D�'*/1)!/27:A!D<-0;¡MI�¼7x'>R�²R!/2-3"4"E+.�! #"C"2 #+49('*+. #7:5VU�NO-@'>),)!D#?�'�;=7>/4-IG:D<7:A!'>D�7:),+4 <;I <¶3'*+. #7:5x7�«:-0/J'¡D<'>/4G>-3/8NO7:/4PQ <5,G�"4-c+7>W�'i��-0"3M�;1"1D<7:5!GX'>"%+4�!-ªNO7:/4PQ <5,GS"4-0+8 <"8'="4;='>D<D¼)�-0/4$0-356+&'>G>-J7>W�+.�,-ªWY9!D<D¼"4-c+°7>W�'i��-0"3UV+.�,-$37>;=)!9�+&'*+4 <7:5('*Dn-0µI$0 <-35,$0?� <"�5,7>+��('>/2;=-0RVM

·-�9!"4-�'*5o-3�Q9('>D# #+L?E$37:5,"2+./4'> <5,-3RJ"2-3$37>5!R�²L7>/4R!-0/�G:/.'*R! <-05Q+©R!-3"2$3-05Q+®+L?Z)T-¥"2+4-3)BÒ§'1�%-0N�+47:5"2+4-3)�Ô®'>"�R!-3"2$3/2 <AT-3R@ #5]mO7�?ZR@'>5!R q�'>5!R!-05ZAT-3/2G:�!-J~¦�>�>�r�*�§M����! <"®7:)�+. <;I <¶3'*+. #7:5J/2-3�Q9! </2-3"®+.�('i+NO-J$37:5,"2+./29!$0+E'*5!R� <56«:-0/2+8+4�!- °� "2?Z"2+4-3;�+.7X"27:D#«>-ªWY7:/%+4�!-J;I <5! #;J9!; 7*W�+.�!-J7>AJh2-3$c+. #«>-N� #+4�! <5=+.�!-85Q9!D#D�"2)('>$0-°7>W�+.�!-1-3�Q9('>D# #+L?=$37:5!"º+./4'> <56+."0M�·-19!"4-\'ª"2 <5!G>9!D�'>/®«*'>D<9,-1R!-0$37:;I)�7>"4 K²+. #7:5�ÒF�,q8­\Ô�+47C)T-3/ºWY7:/4;+4�!-1;='*+./2 K�J)!"4-09!R!7*²z <56«:-0/4"4-*MO���, <"� <"�'C/2-F'>"27:5('>A!DK?H-0µI$3 #-356+¥$09!A! #$+. #;=-�'>D#G:7:/2 #+.�,;¡U:A,9,+¥AT-3$3'>9!"4-�+.�!-�N�7>/4PQ <5!GC"4-c+¥+.-05!R!"O+47ªAT-1"2;@'>D#DhU>+4�!-%+4 <;I-� <"�"2+. #D<D@Ò � � Ô7:5S+.�,-\WY9,D<DV)!/27:A!D#-3;BM����! <"� #"� <5�D< #5!-1N� #+4�B+4�!-E'F«:-3/4'>G:-\$37>;=)!D#-c�� #+L?@7>WQ�!  �JM

������� �� �� ���� � ��� � �������

;1"�N� #+4��'>56?B)! #-3$3-E7>W�5,7:5�²z+4/4 K«� <'>DV"27>Ws+LN¥'*/4->UTN�-C$&�!7:"2-C+.7=A�-0G: <5�N� #+4�x'I/4-3D<'*+. K«:-0D#?X"2 <;I)!D<-A!9,+¥$37:/2/4-3$c+� <;I)!D#-3;I-356+&'*+4 <7:5nMu·¸-°'>$c+.9('*D<D#?H),/47>+47>+L?Z)�-0R�+4�!-��!  �È7>),+. #;= #¶F'*+4 <7:5oWY9!5!$c+. #7:5 <5�  ;����V;om%MT·¸-CG:'�«>-ª7:9,/o�!  ��WY9!5!$0+4 <7:5�'>5� #56+.-3/ºWf'>$3-°+4�('*+�N¥'>"%$37:;I)('*+4 <A!D#-8N� #+4�¡+.�,- <56+4-3/2Wf'*$3-\WY7:/�+.�!-ª  ;����V;om 7>),+. #;= #¶F'*+4 <7:5@+47�7>D<AT7��X <;I)!D<-0;=-056+&'*+4 <7:5S7>W ��� Ò��������������! ,Ô^Mm�-0$F'>9!"2-I  ;����V;om #"1'>5� <56+.-0/.'>$c+. #«>-ªD<'>5!G:9('*G:-ª'*5!R�A!9! #D#+2²z <5�;='*+./2 K��7:)T-3/4'*+. #7:5!"0U� #;=)!D#-c²;I-356+. #5!G°'>5!RHR!-0A!9!G:G> <5!G1+4�!-�)!/27>+.7>+L?Z)T-¥N¥'*"®'>$3$0-3D<-0/.'*+4-3RVM�¬�«>-35I <5H 5;���� ;Km1U:+.�,-3/4-¥NO-3/2-5Q9!;I-3/47>9!"�$&�('*D<D<-05!G:-0"O+.7CG:-0+2+. #5!Gª'E$37:/2/4-0$0+6�!  � <;I)!D<-0;=-05Q+.'*+. #7:5VM\;¥+�Õ(/2"2+3U� #"4"49,-3"¥7>WV5Z9Z²;I-3/4 #$F'>D� #5!"2+.'>A! <D# #+L?CN�-0/4-°'ª),/47:A!D#-3;BMkMz+ON¥'>"�5!-3$0-3"4"4'>/2?=+.7J-^��)!D< #$3 #+4D#?o-05,WY7:/2$3-1+4�('*+O$3-3/º+&'> #5

Page 80: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�6�

�Q9('>56+. K+. #-3"¥$07:9!D<R@5!7>+�AT-3$07:;=-1-0«:-05¡"2D< #G:�6+.D#?H5,-3G6'*+4 #«>->U!"2 <5!$0-\'ª$&�('>5!G>-° <5X"2 <G:5S$07:9!D<RS�!'�«>-R! #".'>"º+./47>9!"°- C�-3$c+."3M��85!$0-J+.�!-oA!'>"4 #$o)!/47:A,D<-3;I"1NO-3/2-='*R!R!/4-0"4"2-3RVUuN�-HR! #"4$07�«>-3/2-3R¸+4�!-o5!-0-3RWY7:/%'>R!R! K+. #7:5('>D6�2"º+.-0)�+L?Z)�-0"O�S'>"%R!-3"2$3/2 <AT-3Rx #5¡+.�,-ª)!/2-3$3-0R! <5,GX"4-0$0+. #7:5!"0M8�>-0A('>/.'�~¦�*�:�>�6'*�¼ #5 #+4"�"29!G:G:-0"2+. #7:5S7>W �!  � R! #RX5!7>+�R! <"º+. <5,G:9! <"2�XAT-0+LNO-3-35�+.�,-3"4-°$3'>"4-0"3U�'>5,RXR! <RS5,7>+¥$07�«>-3/�+.�,--356+4 </4-�WY-F'*"4 <A,D<-�"4)('>$0->M®¬�«:-05�'*Ws+.-0/�NO-1R, <"4$07�«:-3/2-3RX+4�!-15!-0-3R@WY7>/�+4�!-% #56+./.'�²L$3D<'>"4"®"º+.-3)=+L?�)T-3"0UNO-ª�('>R�5!7@PQ5!7�N�D<-0R!G:-C7>W�+.�,-ª5!-0-3R�WY7:/�+.�,-ª��-0N�+.7>5x"2+4-3)!"0M Mz+%+.7Z7:PS�Q9! #+4-ª'IA! #+�7>W� #56«:-3"a²+. #G6'*+4 <7:5VU '>5!R� #5Wf'>$c+o'¡WY-cN�/2-c²LR,-3/4 K«*'*+. #7:5!"3U¼+.7x$07:56«Z <5!$0-S7:9!/4"2-3DK«:-3"J+4�('*+C+.�!-S'*D<G:7:/2 #+4�!;N�'>"¥$37>/4/4-0$0+3U,AT-3$F'*9!"4-8 K+�R, <R@5,7>+�'>DKN¥'F?Z"�$07:56«:-0/4G:-*M ��D#+. #;@'i+.-3DK?:U: K+�AT-3$3'>;I-8'>)!)!'>/4-05Q+O+.�('i++.�,-o <;I)!D<-0;=-05Q+.'*+. #7:5�N¥'>"°$07:/4/2-3$c+FU�A!9,+°+4�!-o'>),)!D< #$F'*+4 <7:5¡7>WO'XD<7Z$F'>D¼7:),+4 <;I <¶F'i+. <7>5¡"29!$&�'*"�!  ��N�'>"ª),/47:A!D#-3;='*+. #$>M=���!-@/2-F'>D# <¶F'i+. <7>5�$3'>;I-= #5!R!-3)T-35,R!-356+.DK?:U A!9,+ªN�'>"C"49!)!)T7:/º+.-3RAQ?+.�,-E$0D�'> #;="� <5 ��M)�\Mam¥'>$&�~ �>�:�>�>�§M

�85!$3-JNO-H�('>Rq'S$37:/2/4-0$0+C  ;����V;omÈ #;=)!D#-3;I-356+&'i+. <7>5VU(N�-o+./4'>5!"2D�'*+4-3R� #+%+.7B�p1 1Ó'*5!R9!"2-3R�+.�!-o  ;����V;om  �¬�� <56+4-3/2Wf'*$3-C+47S <56«:7>P>-ª+4�!-ªWY9!5!$c+. #7:5VM ;%G6'> <5nU�NO-J7:),+4-3RxWY7:/%$37:/a²/4-0$0+45!-3"2"ª'>"\7:),)�7:"2-3R�+.7�"2)�-0-3R #5x+.�!-JÕ!/4"2+E #;=)!D#-3;I-356+&'i+. <7>5VM°·-oN�/47*+.-H'B�p1 1 ;='*+./2 K�$3D<'>"4"X'>"�'�D< #G:�6+LN�-0 <G:�6+X/2-3)!D<'>$3-0;=-056+XWY7:/�  ;����V;Km �¦"S;='*+4/4 <$0-3"0M6;%D<D�5!-3$0-3"2".'>/º?¯7:)�-0/.'i²+. #7:5!"�NO-3/2-1 <;I)!D#-3;I-356+.-0Ro <5@�p1$1JU6N� #+4�H"49!)!)T7:/º+OWY/27:;�V; �o;�� ~ ;%5!R!-0/4"47>5X-0+O'>D§M#U!¢F¤:¤:¤*�'>5!Rnm¥�V; �±~ �u'FN�"47:5 -0+S'*DhMKU�¢�¤ �>¤*�CÒYD< #5!-F'>/H'*D<G:-0A!/.'�'>5!RÖ;@'*+4/4 ´��D< #A!/.'>/2 <-0"&ÔcM �© <5!'>D<DK?¸NO-NO-356+ªA!'>$&Pq'>5!R¸"4)T-356+ª"27:;I-J+. <;I-o7:),+4 <;I <¶0 <5!G@+4�!-H <;I)!D<-0;=-056+&'*+4 <7:5VMª� 7BG: #«>-H"47:;I-H <R!-3'7>W°+4�!-x <;I)T7:/2+.'>5!$3-B7>W\$07�R!-�7:),+. #;= #¶F'*+4 <7:5nU�NO-�"4�!7�N Õ!«>-�)!D<7>+4"�Òh�,M NZM¦�QÔo+.�('i+@NO-3/4-�$0/4-^²'*+4-3RÖ'>"oN�-B)!/47>G:/4-0"4"4-0RÖN� K+.��+.�!-�$37ZR!-�;I7�R! KÕ($F'i+. <7>5!"3M � '>5!-3DCÒsW&Ôª7>W%+.�! #"JÕ(G:9!/2-�"4�!7�N�"7:9!/ �!  �È$37:;I)('>/2-3R�'>G6'* <5!"º+�+.�,-°�! <G:�,D#?I7:),+4 <;I <¶3-0RVU�  ���,¬ ~ ;15!R,-3/4"2-35¡'>5!R ;%5!R!-3/2"4-05VU�>�:�>�*��$37>;=;I-3/2$3 �'*Dn7:),+4 <;I <¶3'*+. #7:5@"27>Ws+LN¥'*/4->MML5 7:)�+. <;I <¶0 <5!G¡+.�!-��!  ��"27>Ws+LN¥'*/4->U�"47:;I-�7>W1+4�!-S+&'>"2PZ"I+.�('i+=),/47�«:-0R¹;=7>"2+o«*'>D<9!'>A!D<-NO-3/4-%;=7�«Z <5,GE$07:"2+4D#?>UZ #56«>'*/4 �'*5Q+�$07�R!-�7:9�+�7>WnD<7Z7:)!"0U6/4-3),D�'>$0 <5!G°+.-0;=)T7:/4'>/2?o7>AJh2-3$c+�$07:5!"2+4/49!$^²+. #7:5��*R,-3"2+4/49!$c+. #7:5¡N� K+.�x"º+&'*+4 <$E7:AJh2-3$c+."0U�'>5!R�'��, #"1"2-3D<-0$0+4 <7:5¡�!-39!/2 <"º+. <$0"3M �8W©+.�!-0"4->U�+.�!-JD<'>"2+ <"E;I7:"2+E <56+4-3/4-0"2+4 <5!G!U¼AT-3$F'*9!"4-X K+E <"\"4)T-3$0 #Õ($I+.7��!  �JMQ�Z-3�Q9!-356+4 �'>D ?oes](e'?Id>j�7>),+. #;= #¶F'*+4 <7:5 <56«>7:D#«>-3"ª$&�,7�7:"2 <5!G�'¡;I <5! #;@'*D©"4-c+J7>W¥'i��-3"�Òs«*'>/4 <'>A!D<-0"&Ô%+47�9!)TR('*+4->M����!-@"2 <¶0-@7>WO+.�('*+C"4-c+7>W®'��,-0"1 #"%R!-c+.-0/4;I <5!-0RxA6?B+4�!-ª$07:5!"º+./.'* <56+."0Un'>"%R!-3"2$3/2 <AT-3R�'>AT7�«:-*M%���!-ª�Z9,-3"2+4 <7:5�/4-3;='> #5!"3U

Page 81: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�r�

Ò§':Ô ÒYA�Ô

ÒY$�Ô ÒYR�Ô

ÒY-�Ô ÒsW&Ô

�© #G:9!/4- �,MK¢�G������ r&��%$ &�� � + �� � � & �� °���! #"1Õ(G:9!/2-ª"2�!7�N�"8+.�!-J),/47:G:/2-3"2"4 <7>5�WY/47:; +.�,- <5, #+. <'>D($37>/4/4-0$0+��p1 1 <;I)!D#-3;I-356+&'*+4 <7:5H7>W�+4�!-��!  � '>D#G:7:/2 #+.�,;¡U:+47ª+.�!-17:),+. #;= #¶3-0RI«>-3/4"2 <7:5nMÒ§'�²L-�Ô�$07:;I)('>/4-°-0D�'>),"4-3RS+4 <;I-1WY7:/6�!  ��'>5!R¡  ;����V;om �������������! �M1ÒYW.Ô�$37:;I)('>/2-3"�-3D<'>)!"4-0R+. #;=-%WY7:/6�!  � '*5!Rx  � ��¬'�$37:;I;=-0/4$0 �'>D�7:),+. #;= #¶F'*+4 <7:5="47>Ws+LN�'>/2->M

Page 82: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�>�

N��! #$&�@'>/2-�+.�!-�;=7>"2+®"49, #+&'*A!D<-�'i��-0"�+47E$&�,7�7:"2->M�·¸-%$3'>D<D�+.�! #"�)!/47:A,D<-3; d� :e<����`cj<`&mc_§ehgi](M��®D<'*+4+~£¢�¤:¤:¤*�¼9!"2-3"8�,-39!/2 <"2+4 <$0"%+.�!'*+1NO7:/4P�NO-3D<D§U�7>5x'F«:-0/.'>G:-*UnWY7:/�+.�!-��,q\  7>),+. #;= #¶F'*+4 <7:5VM��>-3A('>/4'~ �>�:�>�6'�UZ$&�!'>)VM ���n"29!G:G:-0"2+."f�2D<-3'>/45! #5!Gr�C'i�� <"®+./4'>5!"4 K+. #7:5!"�AQ?=G:/2-3-3R, <D#?H/2-3$3'>D<D# <5!G\)('>"º+¥$&�!7> <$3-0"+.�!'*+J;='>R!-=D�'>/2G:-= #;=),/47�«:-0;=-05Q+4"J <5¸+.�!-=7:AJh2-3$c+. K«:-XWY9!5!$c+. #7:5VMx¨�-3/2->U�NO-X+&'>P*-X"47:;I-0+4�! <5,G7>W1'��Q?ZA!/2 <RÖ'>)!)!/276'>$&�VM�·¸-�-35Q9!;I-3/.'i+.-B'�/.'>5!R,7:; )T-3/4;ª9,+&'*+4 <7:5�7*W8'>D#D�5!7>5�²L/2-3R!9!5,R('>56+'i�� <"�)!'> </2"3M�·¸-E K+.-0/.'*+4-8/4-0)�-3'*+.-0R!D#?S7�«>-3/�+.�!-\)T-3/2;J9,+&'i+. <7>5VU,/2-3;I7�«Z #5!Go)('> #/4"¥+.�!'*+�)!/47ZR!9!$0-D< K+4+4D<-8 #;=)!/27�«:-3;I-356+3UT7>/�+4�('*+%'>/4-C'*+�AT7:9!5!R�Ò§�=7>/ � ÔcMO·¯�!-35�+4�!-ED< <"º+�A�-0$37:;I-3"�-3;I),+L?>UTNO-/4-0 <5! K+. <'>D< #¶3-� K+ N� K+.�J'%R! DC�-3/2-356+�/4'>5!R!7:;È)T-3/2;J9,+.'*+. #7:5VM¼���! <"©'>D<G:7>/4 #+4�!; ),/47�«Z <R!-0"�G:7Z7�RC/.'>5�²R!7:;I <¶0-3R�$07�«>-3/4'>G:-H7>W®+.�!-H'��, #"º²z)('> </2"3UVA,9,+°WY7�$09!"4-0"°- C�7:/2+\7>5q+4�!7:"2-J+.�('*+8�('F«:-H)�-0/2WY7:/2;=-0RNO-3D<D§M¹���!-¡7:),+. #;= #¶F'*+4 <7:5� #"H/4-3)T-F'i+.-3R 9!56+. <D�+4�!-¡$&�!'>5!G:-¡ <5�"47:D#9,+. #7:5 '*5!R 7:A`h2-3$0+4 #«>-x'>/2-AT7:9!5!R!-0RxA6?x'I"4;='>D<DV+4�!/4-0"4�!7>D<RVM%��7:56«:-0/4G:-05!$3-o #"%"º+./2 <$0+4D#?�;I7:5!7>+47:5! #$>M �89!/�$37:56+./2 <A!9�+. <7>5 <"¥+4�!-°Õ(/4"º+� <;I)!D<-0;=-05Q+.'*+. #7:5X7>WQ�!  � WY7:/�D�'*+4-356+% �¬®­JM

½�¾�� � ËIÇ�Ð É©ÁCÉ�Ã0Ë=ÇxÁªÊ�Í � �°Ê®Ç � � ËIÄ ��ÃFÇxÁCÉ�Ã3ËIÇ

���!-oP*-3/45,-3D< #¶3-0R�D�'*+4-356+E �¬®­�;= ´�Z+.9!/2-ª;I7�R!-0D©$3'>5�A�-C«� #-0NO-3R�'>"°'x]ngi],�c_hd>_fehgi]Td>b �EP>-0/45!-0D$37>;JA! <5!'*+. #7:5¸+4-3$&�!5! #�Q9!->M� B7:"2+I;I-0+.�,7�R!"CWY7:/JP>-0/45!-0D�$37:;ªA! <5('i+. <7>5�'>"4"29!;I-X+.�('*+J"4-0«>-3/4'>DA('>"2-¸P*-3/25!-3D#"¡'*/4-q)!/47�«Z <R,-3R±'>5!R±'�"2 <5!G:D#-�$37:56«>-c�±$37:;ªA! <5('i+. <7>5¹ <"�9!DK+. <;='*+4-3D#?�9,+4 <D# <¶3-0RVM�%"2 <5!G�+4�!-q'>AT7�«:-q;= ´�Z+.9!/2-x;=7ZR!-0D< <5,G¸WY/.'*;=-cN�7:/2P )!/27�«� #R!-3"S)T7:"º+.-3/2 <7:/2"S7�«:-3/X+4�!- � '*5!R ;I K�� <5,GX)!/47>)�7:/º+. #7:5!"3U�N��! <$&�¸'�C�-3$0+\�,7�N�;J9!$&�q+.7*+&'>D <5,»(9,-35!$0-I-3'>$&��P>-3/25!-3D��!'>"° <5�+.�,-R! #"4$3/2 <;I <5('*5Q+ /.'i+. <7,M©¨�7�NO-0«>-3/0U� #5H'>R!R! K+. <7>5VU*+4�!-¥ <5,)!9,+�+478+.�!-�R! #"4$0/4 <;I <5!'>56+ N� #D<DZR!-0+4-3/4;I <5,-'\/4-c²hN�-0 <G:�6+4 <5!G\WY7:/®-F'>$&�S³E'>9,"4"4 <'>5='>$3$07:/4R! #5!G\+.7\+.�!-%¬�9!$3D# <R!-3'>5=R, <"2+.'>5!$0-%7>Wn-F'>$&�=;@'*)!)�-0R <5,)!9,+�+.7I-F'>$&�x³E'*9!"4"2 �'>5B;=-3'>5B <5¡¨% <D#A�-0/2+�"2)('>$3-*M¥���! #"�- Cn-0$0+4 #«:-0D#?�/2-c²zNO-3 #G:�6+."�+.�!-EP>-0/45!-0D$37>;JA! <5!'*+. #7:5� #5�5!7:5�²z"2+&'i+. <7>5('>/2?�N�'F?�"E'>5,Rq'>D<D#7�N�"1R! DC�-3/2-356+°P>-0/45!-0D�5!7:5!D# <5!-3'>/4 K+. #-3"� <5x+.�,- <5,)!9,+�"4)!'>$3-*M

���!-3/2-0WY7:/2->U¥+4�! <"o)('*)�-0/=R!-0"4$0/4 <AT-3"='�+.-3$&�,5! <�Q9!-BWY7:/H$37:;JA, <5! #5!G�P>-0/45!-0D<"=+4�('*+I <"H;I7:/4-G:-05!-3/4'>D!+.�('*5@'°N�-0 <G:�6+4-3RID< <5,-F'>/�"29!;=;='*+4 <7:5BÒf'J�c_hd>_fehgi]Td>b ��$07:;JA! #5('*+4 <7:5�Ô^M ���,-�+4-3$&�!5! #�Q9!-9!"2-3"�'JG:-05!-3/4'*+. K«:-8WY/.'*;=-cN�7:/2PI+4�('*+�"2)�-0$3 KÕ($F'>D#D#?I7:),+4 <;I <¶0-3"�R! <"º+./4 #A!9,+4 <7:5!"�+.7H'>$&�, <-0«>-°;@'��Z²

Page 83: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�ON <;='>D�;@'*/4G: #5!"3U®- C�-3$c+. K«:-3DK?�-0;JA�-0R!R! #5!GqD�'*+4-356+o«*'>/4 <'>A!D<-0"J <56+47�"49!)!)T7:/º+I«>-3$c+.7:/H;='>$&�! <5,-3"3M���!-H'>),)!/476'*$&�q+4�Q9!"°)�-0/4;I #+4"%+.�,-J9!"4-H7>W®;I K�Z+49!/4-J;I7ZR!-3D# <5!GI <5�'XD<'>/4G>-c²L;='>/2G: <5BR! <"2$3/2 <;I K²5('*+4 #«>-E"2-0+2+. <5,G!M

·-1R!-3;I7:5!"º+./.'i+.-1+4�!-8)T7�NO-3/�7>W�+.�!-1)!/47:)T7:"2-3RX+.-0$&�!5! #�Z9,-°AQ?=;I K�� <5!GCP>-0/45!-0D<"¥ #5S'ª5!7:5Z²"2+.'*+. #7:5('>/º?SWf'>"4�, <7:5VU�'>D#D<7�N� <5!GIP>-0/45!-0D©NO-3 <G>�Q+4"1+.7=A�-J'IWY9!5!$c+. #7:5x7>W�+4�!-ªR('i+&',M ML5x7:/4R,-3/%+47 <D#D<9!"º+./4'*+.-�+.�!-\R! Cn-0/4-35,$3-3"%'>;I7:5!GJ+4�!-\"2+&'*5!R('>/2R;�,q°  WY7>/4;J9!D<'*+. #7:5VUZ-c�� <"º+. #5!GHP>-3/25!-3Du$07:;H²A! #5('*+. #7:5B;=-c+.�!7ZR!"3UT'>5,R�+.�!-\+.-0$&�!5! #�Z9,-J)!/47>)�7:"2-3Rx�,-3/4-*Un$07:5!"4 #R!-3/�+.�,-f�,q° ÏR! <"2$3/2 <;I <5('>56+WY9!5!$c+. #7:5 G

� Ò���Ô � W ZY [ � hE �VÒ��c]� ��Ô\1 3/�¨%-0/4-*UQ+4�!-�$3D�'*"4"�D�'*A�-0D('>"4"2 <G:5,-3RH+.7\-c�,'>;I)!D<- �@AQ?ª+.�!-�+./4'> <5,-3R �,q\  R!-3)T-35,R!"O7>5H+4�!-�+./.'* <5�² <5,G1-c�,'>;I)!D#-3" �caU*+.�,- �,q° ÓN�-0 <G:�6+."QEcaU>'%A! <'>"u+.-3/2;63�U:'>5!Ro'�"4 <5,G:D<-�P>-0/45!-0D�WY9!5!$c+. #7:5 �VÒ � ��� ÔcMML5�+.�,- �,­��Ó~ �u'>5!$&PQ/2 <-0+J-0+H'>D§M#U �>�>�6�i��'>5!R��6?Z)�-0/4P>-0/45!-0DC~ �85!Gx-c+H'>D§M#U©�>�:�ON��¥'>),)!/476'*$&�!-3"0U+.�, <"1WY7:/2;J9!D<'= <"1G:-35!-0/.'>D# <¶0-3R�+47S9!"4-o;J9,D#+. #)!D<-EP>-0/45!-0D<"0U�-F'>$&�q7>W�N��! #$&�q�('>"\'=Õ,��-0R�NO-3 #G:�6+

� � G� Ò���Ô � W ZY![ � hEc W

�� � � � Ò��c]����Ô 1 3

���!-O'>)!)!/276'>$&�E+.�('*+uNO-O),/47:)T7:"4-�G:-05!-3/4'>D< #¶3-3"�+4�! <"�WY7:/2;J9!D�'i+. <7>51WY9!/2+4�!-3/0U:'>D#D<7�N� <5,G¥+.�!-®P>-0/45!-0DNO-3 <G>�Q+ � � +.7HR!-0)�-05!R�9!)T7:5�+.�!-\)!/27:)T-3/2+4 <-0"�7>W +4�!-\-c�,'>;I)!D<-°AT-3 #5!GH$3D<'>"4"2 #Õ(-0R G

� Ò ��Ôd� W ZY![ � SE �W�

� � e 2Ò���Ô � � Ò��c]� ��ÔV1 3���! #"°R!-3)T-35!R,-35!$0-I7>5 �� #"89!"4-cWY9!DhUVWY7>/8-c�,'>;I)!D<-*UV #W�+4�!-J+./4'> <5, <5!G=R('*+&'X$07:56+&'> #5!"°"2+4/49!$c+.9!/2-"49,$&�¸+.�!'*+E"47:;I-J+L?Z)�-0"ª7>WO-c�,'>;I)!D<-0"E'>/4-oAT-3"º+ª$0D�'>"2"4 #Õ!-3Rq7:5q+.�!-HA('>"2 <"\7>WO7:5!-HP>-0/45!-0D�'*5!R7>+4�!-3/�+L?Z)�-0"%7*W©-^�!'*;=)!D#-3"�'>/2-\A�-0"2+�$3D<'>"4"2 #Õ(-0R¡7:5S+4�!-\A('>"4 #"�7>W�'oR! Cn-0/4-05Q+�P*-3/45,-3DhM

���!-°R!-0$3 <"2 <7:5@/49!D#-1 <5X¬®�Q9('i+. <7>5qÒS�,M N:Ô®$F'>5SAT-1«Z <-cN�-0R¡'*"¥'J5!7:5,"2+&'i+. <7>5('>/2?IP*-3/45,-3DV$07:;H²A! #5('*+. #7:5VM\���! #"8 <"8R,7:5!-oA6?�/4-cN�/4 K+. <5,G@+.�!-o-0�Q9('*+. #7:5!"89,"4 <5,G�+4�!-oR!-cÕ(5! #+4 <7:5�7>W®+.�!-o-^�,)T-3$^²+&'i+. <7>5!"°WY7:/E+4�!-@D#7:G*²a³E'>9,"4"4 <'>5!"0M �© </2"2+3U /2-3$F'*D<DO�>-35!"2-35 � "o <5,-3�Q9('>D# #+L?:UuN��! #$&��!7:D#R!"\WY7:/ª'*5Q?5!7:5Z²L5!-0G6'*+. K«:- � � '>5!R � � "2$F'>D<'>/4"�"29!$&�¡+4�('*+ � � � � ��¢�G

D#5 W�

� � � D<5 W�

� �� �

� �l W

�� � D#5

� �� �

Page 84: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�:�

MzW¼N�-E"4-c+ � � � ���I � � �'>5!R�"49,A!"2+4 #+.9�+.-\ <56+.7o+4�!-\/4 <G>�Q+¥�('>5!RB"4 #R!-\'>AT7�«>->U!+4�!-\ <5!-0�Z9!'>D< K+L?@ #"

'>$c+.9('>D#D#?@'>5B-3�Q9('>D# #+L?oGD<5 W�

� � l W�

� ���� �

D<5 � �� �I � ���l W

� ���� �

D<5 W�

� �

�±D<5 W�

� �

���!-o/2-3"49,D#+\ <"1'>)!)!D# <-0Rx+.7X+.�,-JR!-0Õ!5! #+4 <7:5xWY7:/�+.�!-JÕ!5('>D�R!-0$3 #"4 <7>5�/49!D#-�Ò§¬��Q9('*+4 <7:5�Òh�,M N>Ô2Ô�+47/4-cN�/4 K+.-\ #+�'*"�WY7>D<D<7�N�" G

=� �-W�

-c��)¼Ò �:��D<5 �Ò�( �� ÒA��Ô � � �� Ô9�p1� � Ô�

�-^�,)¼Ò �:��D#5 ��Ò ( �� ÒA��Ô � � �� Ô9�p1

� � Ô�:��D<5 �Ò�( �� ÒA��Ô � � �� ÔV1 � � �

j W�

-^�,)¼Ò �:��D#5 ��Ò ( X� Ò'��Ô � � X� Ô9�p1 3 � Ô��-^��)¼Ò �:��D#5 ��Ò ( X� ÒA��Ô � � X� Ô*��1 3 � Ô �:��D<5 � � �Ò�( X� ÒA��Ô � � X� ÔV1 3 � �

���!-¥/4'*+. #7:" '>A�7�«>-¥$F'>5oAT-ON�/2 #+2+.-35J'>"©+.�,-ONO-3 <G>�Q+4"� <5J'15!7:5�²z"2+.'*+. #7:5('>/º?\P>-3/25!-3D,$37:;JA, <5('*+4 <7:5'>"�WY7:D#D<7�N�" G

=� � W�

� �� Ò'��Ô����D<5 �Ò�( �� Ò'��Ô � � �� Ô*� 1� � jmW

�� X� ÒA�qÔ��:��D#5 �Ò�( X� ÒA��Ô � � X� Ô*� 1 3 �

��-3$F'*D<Dn+4�('*+�NO-C�('F«>-�G���D<5 �Ò�( �

�ÒA��Ô � � �

�Ô*� �W

�Y![ � E �

��Ò��BÔ�� �� Ò'� �

� ��Ô\j W�Y![ E �

��Ò��BÔ�� �� ÒA� �

� �qÔkj ¢� � �� ÒA�q�#��ÔV1 � � � " � �

�o�'>5!R�+.�!'*+

���D<5 �Ò�( X� ÒA�qÔ � � X� Ô*� �W�Y [ E �

��Ò ��Ô � X� ÒA� �

� ���j W�Y [�� E �

��Ò���Ô�� X� ÒA� �

�#��Ôkj ¢� � X� ÒA�q�#��ÔV1 � � � " � �

�o�

Page 85: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� �

��7:;JA, <5! #5!GH'>D<DT+.-0/4;I"�?Z #-3D<R," G=� � W

�Y [ � W � E �

��Ò �BÔ � �� Ò'��Ô�� �� ÒA� �

� ���j W�Y [ W � E �

��Ò �BÔ � �� ÒA��Ô � �� Ò'� �

� ��Ôj W

�Y [ W � E �

��Ò ��Ô � X� Ò'��Ô�� X� ÒA� �

� �qÔV1 W�Y [ � W � E �

��Ò �VÔ � X� Ò'��Ô�� X� ÒA� �

�#��Ô1 W�

� �� Ò'��Ô�� �� ÒA�t� ��ÔkjmW�

� X� ÒA��Ô � X� ÒA�t� ��ÔV1 � � � " � ��f�*�

WY/47>; N��, <$&�xNO-o$3D<-3'>/4DK?�"4-0-J+.�('*+%+.�!-ªP>-3/25!-3D�$07:;JA! #5('*+4 <7:5�N�-0 <G:�6+4"8R!-3)T-35,R�7>5�+.�!-ª <5!)!9�+��U®'>5,R�+4�!-XR! #"4$0/4 <;I <5!'>56+JR!-0)�-05!R!"H'>D#"47�7:5�+4�!-SD<-3'>/45!-0R�)('>/4'>;=-c+.-0/4"3U�N��, <$&��;@'��, #;= #¶3-+.�,-E;='>/2G: <5VM

�%7:5,"2+&'i+. <7>5('>/2?ªP>-0/45!-0D($37:;JA, <5('*+4 <7:5ª <"� #5Q+4-3/2-3"2+4 <5!G,U6 <5J+.�!'*+® #+�R, <"4),D�'F?Z"�;=7:/2-¥/4-0)!/4-0"4-05�²+&'i+. <7>5('>D©)T7�N�-0/°+.�('>5q+.�,-ID# <5!-3'>/8$07:;JA! #5('*+. #7:5!"% <5q)�7>)!9!D�'*/89!"4-�(©�!7�NO-0«>-3/3U©7:9!/°-3;I)! #/4 <$3'>D"2+49!R! #-3"° <5,R! <$3'*+.-E+.�('*+8 #+8R,7�-0"85!7>+°7�«>-3/2Õ,+FME���!-oD�'*+4-356+E �¬®­�)!/2 <7:/%R! <"º+./4 #A!9,+4 <7:5VUT <5¡+.�! #"$F'*"4- ��Òf�&��ÔuWY7>/�+.�!-�³\'>9!"2"4 �'*5I;I-F'*5!"3U6/2-3G:9!D<'>/4 #¶3-0"©+.�!-�"27:D<9,+4 <7:5nU:'>"®R!7Z-3"�+4�!-�-c��)!D# <$3 K+�"47*Ws+;='>/4G: #5SA�7>9!5!R�$37:5,"2+./4'> <56+3M

���!-�WY7:D<D#7�N� <5!G%$&�('>),+4-3/�)!/2-3"4-056+."O'1+.�!7:/27:9!G:�H"2-0+®7>WT-c��)T-3/2 <;I-356+."�+4�('*+®$37>;=)('*/4-��K� 8�+.7H"º+&'*+4-c²L7*W�²z+.�,-c²a'*/2+¥+4-3$&�!5! #�Q9!-3"%7:5B'H«*'>/2 <-0+L?@7>W )!/47:A,D<-3;I"3M

Page 86: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� �

� � ��� �¸� � �

� ��� ������� ��� ����� � ����� �� � ��� � ��� ����� ���

� � � �©�����±� � � ���� �����

ML5H+.�! #"�$&�!'>),+.-0/3UQN�-�)!/2-3"4-056+O+4�!-�-c��)�-0/4 #;=-05Q+.'>D(/4-0"49!DK+."®N�-�7:A,+.'> <5,-3RoN� #+4�I7>9!/®5!7:5!"º+&'*+4 <7:5�²'>/º?¡P*-3/25!-3D $37:;JA, <5('*+4 <7:5S+4-3$&�!5! #�Q9!->M����!-ª$&�!'>),+.-0/8AT-3G: #5!"�N� K+.�B+LN�7X"º?Z5Q+4�!-0+4 <$J),/47:A!D#-3;I"3UR!-0"4 <G>5!-3R�)!/2 <;='>/4 #D#?¡+.7x #D<D<9,"2+./4'*+.-o+4�!-X$F'*)('>A! #D< #+4 <-0"°7>W�+.�!-=+.-3$&�,5! <�Q9!-*Mx���!-S5!-^��+J"4-3$c+. #7:5«*'>D< #R('*+4-3"®�o� 8�Ö7:5I"47>;=-�)T7:)!9!D<'>/ �%5! K«:-0/4"4 K+L?H7>Wu�¥'*D< #WY7>/45! <'8'*+ ML/2«Z <5,-8 �'*$&�! <5!-%��-F'>/25! <5,G��-3)T7:"4 K+.7:/º?�~  ¡9!/4),�Q?o'>5!R:;1�(',U,¢�¤:¤ONi�,A�-05!$&�!;='>/4PªR('*+&'8"2-0+4"3UQN��! <$&�HN�-0/4-�$&�!7:"2-35=A�-0$F'>9!"2-+.�,-0?oNO-3/4-�9!"2-3R@ #5@�u'>5,$&PZ/2 <-c+O-c+O'>DhM�~ �>�:�:�i�hM��(7:D<D#7�N� #5!G1+4�!7:"4-�-c��)T-3/2 <;I-356+."0UQNO-�R! <"2$39!"2"O+.�,-'>)!),D< <$3'*+. #7:5X7>W©�o� 8� +47I"27:;I-°/4-F'*DV?:-F'*"2+%)!/47>+4-3 #5�WY9,5!$0+4 <7:5B'>5!5,7>+&'*+4 <7:5S),/47:A!D#-3;I"3M

�x¾�¿ �XÍBÇXÉ� �1É�ÃFÑ �xÁCÉ�Á Ð �1É�Ð

ML5X+.�, <"�"2-3$c+. <7>5VU�NO-8«*'>D< #R('*+.-�+.�,-°�o� 1� +4-3$&�!5, <�Q9!-°7:5@+LNO7o"2?Z56+.�,-0+. #$°R('*+.'J"4-0+4"3M®���!-8),/4 K²;='>/2?H)!9,/4)T7:"4-*U,�!-0/4->U� <"�+.7ª #D<D#9!"2+4/.'*+4-�+4�!-1)T7�N�-0/�7>W�+4�!-%+4-3$&�!5, <�Q9!-1+47ª"47>D#«:-%)!/47>A!D<-0;="®+.�('i+-c�� #"2+. #5!GB'>)!)!/276'>$&�!-0"EWf'* <D +47�"47:DK«:->MH���Q9!"0U©'>56?�)T7:"2 #+. K«:-o/2-3"49,D#+E <5!R, <$F'i+.-3"\'XWY9!5,R('>;I-356+&'>D <;I)!/27�«>-3;I-356+�7�«:-0/�+4�!-°"2+.'*+.-\7>W¼+.�,-\'>/2+3MdML5¡'*D<D�Õ!G:9!/4-0"3U(+.�,-°)!D<7>+2+.-0RBR,-3$3 #"4 #7:5SA�7>9!5!R('>/2 <-0"NO-3/4-C'>$c+.9('>D#D#?=D<-3'>/45!-0R¡A6?X+4�!-\$3D<'>"4"2 #Õ(-0/4"3M

Page 87: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�:¤

� � � � � � ����������� ��� � ����� � � � � � � � �

·¸-=9!"2-@'*5� �¬®­ /.'*+4 <7�7>W�+LNO7¡+LNO7*²z$37:;I)�7>5!-356+ª³E'*9!"4"2 �'>5�;= ´�Z+.9!/2-3"\7:5�-3 <G>�Q+C³\'>9!"2"4 <'>5$3D#9!"2+4-3/2"@+.7¸ <D<D#9!"2+4/.'*+4-��!7�N ;='>/2G: <5�7:),+4 <;I <¶F'i+. <7>5�$F'>5¹7�«>-3/4$07:;I-x;=7ZR!-0D�;I <"2;@'i+.$&�VM ML5+.�, <"¥$3'>"4-*U!+.�!-8;='>/2G: <5X7>),+. #;= #¶F'*+4 <7:5 � '>A!"2-356+®WY/47:; +./4'>R! #+4 <7:5!'>D�;@'i�� #;J9!; D< #P>-3D# <�!7Z7ZR@)('i²/.'*;=-c+.-3/�-3"º+. #;@'*+4 <7:5 � R!/2 #«:-0"¥+.�!-C$3D<'>"4"2 #Õ(-0/�+47�N�'>/2R¡+.�,-ª$37>/4/4-0$0+1"47:D#9,+. #7:5VM¥���!7>9!G:��D<'*+.-056+ �¬®­±7>),+. #;= #¶3-3"�'ER! #"4$0/4 <;I <5!'*+. K«:-�7>AJh2-3$c+. #«>-�WY9,5!$0+4 <7:5VU6 K+®R!7Z-3"3UQD#-F'>/25='°G:-05!-3/4'*+. K«:-�;I7�R!-0DhM¨%7�NO-0«>-3/3U�+4�!-¡;I7ZR!-3D�)('>/4'>;I-0+.-0/4"='>/4-�-0"2+. #;@'i+.-3R�+.7�)!/47ZR!9!$0-¡+4�!-¡;I7:"º+=R, <"4$0/4 #;= #5('*+. K«:-R! #"2+./2 <A!9�+. <7>5VM ���,-3/4-cWY7:/4-*U,G:-05!-3/4'*+. #5!GER('*+&'°N� #+4�=+4�!-%;I7ZR!-3D!N� #D<D!)!/27�R,9!$3-��2 <R!-3'>D �°"4'>;I)!D<-0"N� #+4�x/4-0G6'>/2Rx+.7SR! #"4$3/2 <;I <5('i+. <7>5VM�ML5q+4�! <"%/4-0"4)T-3$0+3UVN�-o$07:5!"2 <R!-0/8D�'*+4-356+E �¬®­ '>"°'IN¥'F?�+477�«:-0/4$37>;=-\;I7�R!-0DV;I <"4;='*+4$&�B7>/¥+.7H$3D#-F'>5S+.�,-ER!'*+&',M

�© <G>9!/4-x�,M#¢QÒf'6Ô="2�!7�N�"B+LNO7Ö #5!R!-0)�-05!R!-356+�+LNO7*²L$07:;=)T7:5!-056+¡³E'>9,"4"4 <'>5¯;= ´�Z+.9!/2-3"@Õ!+S+47+.�,-�R!'*+&'�9!"2 <5!G�;='i�� <;J9!; D< #P>-0D< <�,7�7ZRVM �© <G:9,/4-��!MK¢QÒfA(Ô@"4�!7�N�"BD�'*+4-356+¡ �¬®­ N� K+.� +LN�7i²$37>;=)T7:5!-05Q+\³E'>9,"4"4 <'>5�;I K�Z+.9!/2-3"0MC���! #"°)!/47>A!D<-0; -0;=)!�!'>"4 #¶3-3"\'X$3'>)('>A, <D< K+L?B'>A!"2-356+E <5x+.�,- ��q+.-3$&�,5! <�Q9!-*M ML5�/4-3'>DnR!'*+&'J+.�,-°- C�-3$0+�NO7:9!D#R�"2+. #D<DTA�-°AT-35,-0Õ($0 �'>D§U,A!9,+� #5S"4;='>D<D#-3/OR!-3G:/2-3-*M� � � ��� � � � ������� ��� �� � � ������ � ��� ��� �

ML5X7:/2R!-3/�+.7J #D<D#9!"2+4/.'*+4-�+4�!-1$&�!'>/.'>$c+.-0/4 <"º+. #$3"�7*Wu5!7:5!"º+&'*+4 <7:5('*/2?HP>-0/45!-0DV$37>;JA! <5!'*+. #7:5VU:NO-1Õ(/4"º+)!/2-3"4-056+8'H"2?Z56+.�!-c+. #$E+LNO7*²LR, <;I-35!"2 <7:5('*Dn)!/27:A!D<-0;¡M�·¸-\G:-35,-3/.'i+.-C'HA, <5('>/º?XD<'>A�-0D<-0RBR!'*+&'o"4-c+9!"2 <5!Gq'�WY9!5,$0+. #7:5�+.�!'*+o <"C�Q9('>R!/4'*+. #$X <5�)('*/2+o7>W�+4�!-X <5,)!9,+o"2)('>$3-�'*5!R�D< <5,-F'>/E-3D#"4-0N��,-3/4-*M���!-\WY9!5!$c+. <7>5B #"�G: #«>-35�A6?

� Ò ��Ôd� ��� �� � � #W � � ��� ¢��¢ 7>+.�!-0/2N� #"4-��

� 7> <56+."ª'>/4-H+./4'>5!"4D<'*+.-0R�9!)'>5!R�R!7�N�5�'*D<7:5!G�+.�,-=«:-0/2+4 <$F'*D�'i�� #"E+47x$3/2-F'*+4-=+LNO7x$3D<'>"4"2-3"CWY7>/+.�,-JA! <5!'>/2?B)!/27:A!D<-0;¡M�·-C+.�!-05q'*+4+4-3;I),+1+47XD<-3'>/45�'=R!-3$0 <"4 #7:5x"29!/2Wf'>$0-J9!"2 <5!GS'=;@'i�� #;J9!;D< #P>-0D< <�,7�7ZR�;= ´��+49!/4-E7>W�³\'>9!"2"4 <'>5!"oÒ��© <G>9!/4-E�!M �>'6Ô%'*5!R�'>5���­��¹P>-3/25!-3D©$37:;JA, <5('*+4 <7:5Ò � <G*²9!/2-C�!M �*A�Ô^MO·¯�! #D<-8+4�!-���­��¹/4-3"29!D#+�;='F?�"4-3-0; "49!/2)!/4 #"4 <5,G@'*+�Õ(/2"2+3UT$07:5!"2 <R!-0/�+4�!-C7>AJh2-3$c+. #«>-+.�,-#��­�� <"�7:)�+. <;I <¶0 <5!G,M ���!-\D# <5!-3'>/¥P>-0/45!-0D $07:;JA! #5('*+4 <7:5@NO-3 #G:�6+."�'>/2-E$&�,7:"4-05x'>D#7:5!GJN� #+4�

Page 88: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�>�

Ò§':Ô

ÒYA�Ô

�© #G:9!/4-B�!MK¢�G�� � � $ ��� ����� � ��� � � � � + ���� �%( $ ���! <"IÕ(G:9!/2-�"2�!7�N�"@+.�!-�'>A! #D< #+L?7>WD�'i+.-356+¡ �¬®­ +.7�D<-3'>/45 '�D<'>/4G:-�;='>/2G: <5¹$0D�'>"2"4 KÕ(-3/0U%-c«:-35± <5 '>5¯-c�Z+4/4-3;I-q$F'>"2-q7>Wª;I7ZR!-3D;I <"4;='*+4$&�VM8���!-o$0D�'>"2"4 #Õ!-3/8 #"%+.�,-o/.'*+4 <7@7*W�+LN�7¡³\'>9!"4"2 �'>5�;= ´��+49!/4-0"3UV-3'>$&��N� #+4��+LN�7�$07:;H²)T7:5!-356+4"3MH �'��, #;J9!;�D< #P>-3D# <�!7Z7ZR�Òf'6Ô%$3D<'>"4"2 #Õ(-0"°)�7Z7:/2D#?:Un'>$&�! #-0«Z <5!G5N*� '>$0$39!/4'>$0?xA�-0$F'>9!"2- #+� #G:5!7:/2-3"®R! <"2$3/2 <;I <5('*+4 #«>-¥)�-0/2WY7:/2;@'*5!$3-*M��u'*+.-05Q+¥ �¬®­�ÒYA�Ô�'*$&�! <-c«:-3"O)�-0/2WY-0$0+O$3D�'*"4"4 KÕ($F'i+. <7>5'>$0$39!/4'>$0?>M

Page 89: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

��¢

+.�,-S�u'>G:/.'*5!G:-I;J9!D#+4 <)!D# <-0/4"8+.7�;= #5! <;I <¶0-oD<7:"2"J'>5!R;@'i�� #;= #¶3-H;@'*/4G: #5VM����('*+J #"ª)!/2-3$0 <"4-0D#?N��('*+� #"�'>$3$07:;=),D< <"2�!-3RnM

�© <G>9!/4-��!M��(Ò§'6Ô�"4�,7�N�"�+4�!-�$0D�'>"2"4 KÕ(-3/¼N� #+.�C+.�!-O)!/47:)T7:"2-3RJ5!7>5!"2+.'*+. #7:5('>/º?CP*-3/25!-3D!$07:;JA! #5('i²+. #7:5VM �%7>+4-¥+.�('i+��o� 1��'>$&�, <-0«>-3"®)T-3/2WY-0$0+�"4-0)('>/4'*+. #7:5o7>W�+.�!-�R!'*+&'1N� K+.�H;@'��, #;J9!; ;='>/4G: #5VM���!-8R,-3$3 #"4 #7:5@"29!/2Wf'>$0-8 <"�-c�Z+4/4-3;I-3DK?I"4;I7�7>+4�@-^�,$0-3),+�'*+�+4�!-%+4/.'>5!"2 #+4 <7:5IA�-c+LN�-0-35�D< #5!-F'*/O'*5!R�Q9('>R!/4'*+. #$1/2-3G: #7:5!"3M �85!-1;@'F?='>/4G>9!-1+.�!'*+¥ #5@+.�! #"�-^�!'*;=)!D#->U,'>5 � m �P>-0/45!-0DV$37:9,D<RXD#-F'>/25S'"4 #;= #D�'>/�R!-3$0 <"4 #7:5�"29!/2Wf'*$3->M�¨�7�NO-0«>-3/0Un+.�!-#� m ��"27:D<9,+4 <7:5�NO7:9!D<R¡A�-0�('F«:-J)T7Z7:/4DK?S <5B/4-0G: <7:5,"7>W�D#7�N�R,-35!"2 #+L?:M©���!-<� m �� <"©'8�! <G:�,-3/©$3'>)('>$0 #+L?EWY9!5!$c+. <7>5o'>5!RJNO7:9!D#RJ5!7>+�D# <P*-3D#?\),/47ZR!9!$3-�'*""4;I7Z7>+.�¡'="27:D<9,+4 <7:5nMp;1D<"27!U� <5¡/4-F'*D '*)!)!D< #$F'*+4 <7:5,"3U!+.�,-ªP>-0/45!-0D 7*Ws+.-35�-35!$07�R!-0"8"47>;=-ER!7:;='> <5PQ5!7�N�D<-0R!G:->U(N��! #$&�¡ #"�)!/4-0"4-0/2«:-0RxA6?��o� 8�1M

�© <G>9!/4-��!M��(ÒfA�Ô�"2�!7�N�"¥�!7�N +.�!-%$37:;ªA! <5('i+. <7>5HNO-3 #G:�6+."�«>'*/2?H7�«:-0/�+.�!-� <5,)!9,+O"4)('>$0->M®���! #" <D#D<9!"º+./4'*+.-0"H+4�!-�5,7:5!"2+.'*+. #7:5('>/2 #+L?�+4�('*+IN�-x�!'�«>-xR!-0"4$3/2 <AT-3R '*5!R¹R!-0/4 #«>-3RVM±���! <"I-c�,'>;I)!D#--c���! #A! #+4"X+.�!-q5!7�«>-3D#+L?¹7>WC+4�!-��o� 1� +4-3$&�!5! #�Q9!-'*5!R± #5!R! #$F'*+4-3"X K+."S9!"2-0WY9!D#5!-3"2"3M ML5±'*5Q?"4 K+.9('i+. <7>5x <5�N��! #$&�q+4�!-o$37>;JA! <5!'*+. #7:5�NO-3 <G>�Q+4"\;@'>5�5,-3-3Rq+.7S«*'>/º?x7�«:-0/\+4�!-o <5,)!9,+\"4)!'>$3-*U�o� 8�¯N� #D<DV�!'�«>-ª'*5¡'*R,«*'>56+&'>G:-*M

�x¾�� ��8Ç�Ñ �Ä ÁJÊ�� �xÁCÉ©Á Ð �%É�Ð

�%-^�Z+FU�NO-C«*'>D# <R('i+.-8+.�,-ª5!7:5,"2+&'i+. <7>5('>/2?�P*-3/25!-3D¼$37:;ªA! <5('i+. <7>5B+4-3$&�!5! #�Q9!-ª7:5¡"4-c«:-3/4'>D©AT-35,$&��²;='>/4P¸R('*+&'�"2-0+."HWY/47>; +.�!- �1� Mª;='>$&�! <5,-BD#-F'>/25! <5,G�/4-3)T7:"2 #+.7>/2?:M�·¸-�9!"4-�+.�,-�·¯ #"4$07:5!"4 #5A!/2-F'>"º+@$3'>5!$3-0/3U¥"27:5('>/0U¥'>5,R "2+.'*+.D#7:Gq�!-F'*/2+IR('*+.',U¥'>D#D¥7>W%N��! <$&��N�-0/4-B)!/4-c«� #7:9!"2D#?�9!"2-3RÖ+47«*'>D< #R('*+4-8+.�!-#�,­��¹;I-0+.�,7�R~ �u'>5,$&PZ/2 <-c+1-c+8'>D§M#UT�*�:�6�i�§MO·¸-C9,"4-\+.�!/2-3-ªP*-3/25!-3D#" G�'H�Q9('>R!/4'*+. #$P>-0/45!-0D

�8b0Ò�� b ��� � Ôd� Òº¢ 1 � . b � � Ô � �'o/.'>R, �'>DVA!'>"4 #"¥WY9!5!$0+4 <7:5¸Òh� m ��Ô�P>-3/25!-3D

� � Ò � b ��� � Ô � -^�,) Ò]j1�&� N!Ò � b+j � � Ô . Ò�� bkj � � Ô %��uÔ �'>5!R¡'oD< #5!-F'>/�P>-3/25!-3D

���iÒ � b*��� � Ô � � . b � � �

Page 90: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�:�

Ò§':Ô

ÒYA�Ô

�© #G:9!/4-=�!M �8G�� $'( � $�� r&�+�� � � � & � & � ��� ��� "%$ � ��� � � ����,-@Õ(G:9!/2-S <D#D<9!"º+./.'i+.-3"\+.�,-A! #5('>/2?¸R!-0$3 <"2 <7:5"49!/ºWf'>$3-SAT-0+LNO-3-05Ö-^�!'*;=)!D#-3"J+.'>P>-05�WY/27:; '�WY9!5!$c+. <7>5�+.�('*+J <"ªD# <5!-3'>/J'*5!R�Q9('>R!/4'*+. #$>M �©'*5!-3D¥Ò§'6Ô�"4�!7�N�"1+4�!-o ¡��;I K�Z+49!/4-ER!-3$0 <"2 <7:5¡A�7:9,5!R('>/º?f(�)('>5!-0D¥ÒYA�Ô�"4�!7�N�"8+.�,-�,­�� R,-3$3 #"4 #7:5�A�7:9,5!R('>/º?:M®�%-0 #+4�!-3/�+.-0$&�!5! #�Z9,-C$07:/4/2-3$0+4D#?S$0D�'>"2"4 KÕ(-3"¥+4�!-\R('*+&'�M

Page 91: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�>�

Ò§':Ô

ÒYA�Ô

�© #G:9!/4-\�!M��&G�� & � � � � � & � �( ���)$'( � $�� r&�+�� � � � & � & � ��� ��� " $ � ��� � � °���!-CÕ(G:9!/2- <D#D<9!"º+./4'*+.-0"©+.�!-�A! #5('>/2?ªR!-3$0 <"2 <7:5I"49!/ºWf'>$3-�AT-0+LNO-3-05X-c�,'>;I)!D<-0"�+&'>P*-35=WY/27:;�'8WY9!5!$c+. #7:5I+4�('*+® #")! #-3$3-cN� <"2-%D# <5!-3'>/®'>5!RI�Q9('>R!/4'*+. #$>M � '>5!-3D Òf'6Ô�"4�!7�N�"O+4�!-%�o� 1�ÖR!-3$0 <"2 <7:5IA�7>9!5!R('>/º?o(,�K� 8�$37>/4/4-0$0+4D#?I"4-0)('>/.'i+.-3"�+.�!-%R('*+.',M �©'*5!-3D©ÒfA�Ô®"4�!7�N�"�+4�!-%�o� 1� P*-3/25!-3DTN�-0 <G:�6+O7�«>-3/�+4�!-� <5!)!9�+"4)!'>$3-�((R('>/4P*-3/�"2�('>R!-0"�$37:/2/4-3"2)�7>5!RS+.7J+.�,-°�Z9!'>R!/.'i+. <$1P>-3/25!-3D§M®�%7>+4-8+.�!-1"4;I7�7>+4�!5!-0"4"�7>Wu+.�,-"47>D<9,+4 <7:5VM

Page 92: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�*�

;1D#D�+.�,/4-3-�P*-3/45,-3D<"I'>/2-S5!7:/2;@'>D# <¶0-3R�"47�+4�('*+o+.�,-3 </JWY-3'*+.9,/4-3"HD# <-X7:5�+4�!-�"49!/ºWf'>$3-�7>W1'�9!5! #+�6?Z)�-0/4"4),�!-3/2->U =�VÒ�� ���:Ô � � � � e � �� � � � e � � � � � e � � M ;%"@ #5È~��¼'*5!$&PQ/4 <-c+X-c+S'>D§M#U��>�>�6�i�§U�N�-¡9!"4-x'¸�('>/2R;='>/4G: #5�ÒsN� #+4� � ��¢��&�.�:�:�I+47X'F«:7> <R�5Q9!;I-3/2 <$3'>D R, #µI$39!DK+. #-3"�N��!-35 � � � Ô^Un'>5,R¡+.�,-��6m �N� <R�+.�B)('>/.'*;=-c+.-3/ �� <"�"2-0+�+.7I�&� N�U��&�K¢ª'>5,R��&� N�U!/2-3"2)�-0$0+. K«:-0D#?:U�WY7:/¥+4�!-°+.�!/2-3-\+&'>"2PZ"0M¥�K� 8�'>5!R�;='i�� <;J9!; D< #P>-3D# <�!7Z7ZR�Òh ��¼Ô8;I K�Z+.9!/2-3"\9!"2-=7:5,-=;I K�Z+.9,/4-o$37>;=)T7:5!-05Q+E)T-3/EP>-0/45!-0D®WY7>/-F'*$&��$0D�'>"2"ª;I7�R,-3DhU hM ->MKU�� � � � �,M�·¸-X/4-0)�7>/2+o;I-F'>5¸+.-3"º+o"4-c+I'>$3$09!/.'*$0?'>$3/27:"4"JÕ!«>-/.'*5!R!7:; /2-3)!D# <$3'*+. #7:5!"�7*W©+.�,/4-3-^²zWY7:D#RS$3/27:"4"�«*'>D< #R('*+. #7:5VM

�©'*A!D<-0"��!M#¢>U8�!M ��U8'>5,R �,M�� "49,;=;='>/4 #¶3-�+.�!-�/4-0"49!DK+."�7>WH+4�!-3"2-�-^��)�-0/4 <;I-356+4"3M �K� 8�'>$&�! #-0«>-3"H+.�!-S+.7>)�;I-F'*5�+4-3"º+="2-0+='>$0$39!/4'>$0?�WY7>/J+LN�7�7>W�+.�!/2-3-�R('*+.'q"2-0+4"3M �(7:/ª+.�,-B�,-F'>/º+R('*+.'E"2-0+3U,�K� 8� #"�"2-3$07:5!RXAT-3"º+FM�·¸-%AT-3D# <-0«>-�+.�('*+®+4�! <"�G:7Z7�RHG:-05!-3/4'>D< #¶F'*+4 <7:5o)T-3/ºWY7:/4;='>5!$0- <"ªR!9!->U� <5�D<'>/4G>-@)('>/º+FU�+.7��K� 8� � "I'>A! <D# #+L?�+47¸'*$&�! <-c«:-B'x;=7>/4-X/2-3G:9!D<'>/4 #¶3-0R�$3D�'*"4"4 KÕ(-3/ªAQ?9!"2 <5!Go+.�,-ED#7�N�-0/�$3'>)('>$0 #+L?S)T7:DK?�5,7:;= <'>DT'>5!RBD< #5!-F'>/�P>-3/25!-3D#"�WY7>/�/4-3G> <7:5!"�7*W +4�!-\ <5!)!9�+�"4)('>$0- <5HN��! #$&�=+.�,-0?H)T-3/2WY7>/4;NO-3D<D§MQmO?H$07:56+./4'>"2+3UZ+4�!-o��­��¸+.-0$&�!5! <�Q9!-% <"�WY7:/2$3-3RI+.7ER!7�N�5�²zNO-3 #G:�6++.�,7:"4-I-356+. #/4-IP>-0/45!-0D<"J'*5!R9!"2-=+4�!-]�6m �¯P>-0/45!-0DON� #+4�¸�!'>/4R¸;@'>/2G: <5nMI·¯ K+.� �,­�� U�NO-@7:A�²"4-0/2«>-3Rq'>5B7�«:-3/ºÕ!+8$0D�'>"2"4 KÕ(-3/� <5B;='>56?�$F'>"2-3"3UT hM ->MKU(+./4'> <5B'>$0$39!/4'>$0?�N�'>"17>Ws+4-35¡)�-0/2WY-3$c+%N��, <D<-+.-0"2+%'>$0$39!/4'>$0?SN�'>"�5!7>+3M

� ����� � � ��� ��� � ��� ��� � � ����� � � � � ���

���!-=A!/4-3'>"2+o$3'>5!$0-3/ªR!'*+&'B"4-0+ª <"E5!7>+ª"4-3)!'>/.'>A,D<-I9!"4 #5!G�+.�,-@)T7:D#?Z5!7:;I �'*D�7:/ED< <5,-F'>/\P>-0/45!-0D<"0M�%7>5!-0+4�!-3D#-3"4"0UZ+4�!-3"2-%P*-3/25!-3D#"�'>/2-�9!"4-cWY9!D(+.7°+.�!-�$07:;JA! #5('*+. #7:5J+.-0$&�!5! #�Z9,-3"3M ML5!R,-3-3RnU�AT7>+.�H+.�,-�,­���'>5!Ro�K� 8��;I-0+.�,7�R!"©G6'> <5C"4 #G:5! #Õ!$F'>56+�'*R,«*'>56+&'>G:-�AQ?C$37>;JA! <5, <5!G%P>-3/25!-3D#"�Òf� '>A!D#-��!MK¢�ÔcM� ������� � ��� ���

���!-¥"27:5('>/©R('*+&'�"4-c+� <"¼+.�!-¥7>5!D#?\R('i+&'1"2-0+�+4�('*+� #"©"2-3)('>/4'>A!D#-�9!"2 <5!G8-3'>$&�o7>W(+4�!-�+.�,/4-3-�P>-3/25!-3D#" <5,R! #«Z <R,9('>D<DK?:M¼���!- �,­���+.-3$&�,5! <�Q9!-\;='*+.$&�!-0"¥+.�!-\'*$3$39,/.'>$c?S7>Wu+.�!-°AT-3"º+� <5!R, #«Z <R!9!'>D�P*-3/25!-3D§U+.�,- �6m ��M!�o� 1� '>$&�! #-0«:-0"1'o"2;@'>D#DV'>R,R! #+4 <7:5('*DnG6'> #5XWY/47:;�5!7:5!"º+&'*+4 <7:5('*/4 #+L?xÒf� '>A!D#-°�!M �:ÔcM

Page 93: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

��N

� '>A!D<-��,M#¢�G�� &�+ � �( � & � & ��� ��r& � � � � ( $ ��� � � � r$'( ��� � � ����!-®+&'>A,D<-�D< #"2+4"3UFWY7:/�+.�,-�8� M�·¯ #"4$37>5!"4 #5�A!/4-3'>"2+°$3'>5!$0-3/°R('*+.'@"4-c+\'>5!R�"2 K��$3D<'>"4"2 #Õ($3'*+. #7:5�;I-0+4�!7�R,"3Un+4�!-J;I-F'>5�'*5!R"2+.'>5!R('*/4RXR!-c«Z �'*+4 <7:5=7>WV+.-0"2+�"2-0+¥'>$3$09!/.'>$c?X'*$3/47>"4"�Õ!Ws+4-3-05S$3/47>"4"º²h«*'>D< #R('*+. #7:5!"%ÒY+4�!/4-0-c²hWY7:D<R@�kq/4-0)�-3'*+.-0RxÕ!«:-J+4 <;I-3".ÔcM8���!-CÕ(/4"º+8+.�!/2-3-J;I-0+4�!7ZR!"°'>/2-f�,q° ¡"8+./4'> <5!-0R�N� #+4�x"4 #5!G:D#-ªP>-0/45!-0D<"0UWY7:D#D<7�N�-0R¯AQ?¯+4�!- �,­�� '>)!)!/276'>$&� 7>W�~��u'>5!$&PQ/4 #-0+¡-0+¡'>D§M#U��>�>�6�i�§U8'�;@'i�� #;J9!; D# <P*-3D< #�!7Z7�R;I K�Z+.9!/2-\7>W®³\'>9!"2"4 �'*5!"%$0D�'>"2"4 KÕ(-3/0U�'*5!R¡+4�!-ª�K� 8� ;=-c+.�!7ZRVM¥���!-E;='i�� <;='>DV;I-F'>5�«*'>D<9!-\ #" <5,R! <$3'*+.-0RB #5�A�7:D#R,Wf'>$0->M

;%D<G:7>/4 #+4�!;  ¡-F'*5�� �\��Q9('*R!/.'*+4 <$ �,M N*���:�:��,M¦�:¤,¢�6m � �,M¦�6� ��N��,M¦�,¢�¤D# <5!-3'>/ �,M N*���r�:��,M¦� � ���­�� �,M �,¢ N�N��,M¦�,¢ N ¡� �,M N�N �^� ���M �r��K� 8� �� ���� - � �� � -��

Page 94: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�>�

� '>A!D<-��!M �8G � &�+ � �( �e& � & � �e& � �( ��� � � ����,-%+&'*A!D<-�D< #"2+."0UZWY7>/�+4�!- �1� M�"27:5('>/OR('*+.'C"4-c+'>5!R�"2 K�S$0D�'>"2"4 KÕ($F'*+4 <7:5S;I-0+4�!7ZR!"3U,+4�!-\;=-3'>5B'>5!R�"2+.'>5!R('*/4R�R!-0«Z <'*+. #7:5S7>W¼+.-3"º+�"4-0+%'>$0$39!/4'>$0?'>$0/47:"2"ªÕ!Ws+.-0-35�$3/27:"4"a²z«*'>D# <R('*+4 <7:5,"XÒs+.�!/2-3-c²hWY7:D<R��kq /4-0)�-3'*+.-0R�Õ!«:-X+4 <;I-3"&Ô^Mx���!-XÕ(/2"2+J+4�!/4-0-;I-0+.�,7�R!"X'>/4-��'q\ ¡"S+./4'> <5,-3R N� K+.� "4 #5!G:D#-�P>-0/45!-0D<"0U%WY7:D#D<7�N�-0R A6? +.�,- �,­��Ó'*)!)!/47:'>$&� 7>W~��¼'*5!$&PQ/4 <-c+o-0+J'>DhMKU©�>�:�6�i�§U�'¡;@'i�� #;J9!; D< #P>-0D< <�,7�7ZRq;= ´��+49!/4-=7>W%³\'>9!"4"2 �'>5,"ª$3D<'>"4"2 #Õ(-0/3U�'*5!R+.�,-C�K� 8�¯;=-c+.�!7ZRVM����!-E;='i�� <;='>D�;I-F'*5�«*'>D#9!-° <"� #5!R! #$F'*+4-3R� <5�AT7:D<R,Wf'*$3->M

;%D<G:7>/4 #+4�!;  ¡-F'*5�� �\��Q9('*R!/.'*+4 <$ �,M �,¢F�ON:���M �,¢�6m � �,M �ON>¤ON��,M¦�:�:¤D# <5!-3'>/ �,M �:�>¤ �:���M �,¢��­�� �,M �ON>¤ON��,M¦�:�:¤ ¡� �,M¦� �,¢ ���,M¦�6�:��K� 8� �� �� � � � �� ��� �

� ����� � � ����� �

�(7:/°+.�!-=�!-F'*/2+CR('*+&'B"4-c+FU©+4�!-@;='i�� <;J9,;�+.-0"2+J"2-0+ª'>$3$09!/.'*$0?¸ <"C'>$&�! <-c«:-0RN��!-35�9,"4 <5,G¡+.�,-)T7:D#?Z5!7:;I �'*D¥7>W\R!-0G:/4-0-¡+LNO7!U�N� #+.�ÖN��! <$&� +4�!-�R!'*+&'"2-0+@ <"@5,7>+X"2-3)('>/4'>A!D#->M ���!-xR('*+.'¸ #""4-0)('>/4'>A!D<-°9,"4 <5,GH+4�!-\P>-0/45!-0D¼$07:;JA! #5('*+4 <7:5@+4-3$&�!5, <�Q9!-3" (��,7�NO-0«>-3/0UT5,-3 #+4�!-3/ �,­���5!7:/��K� 8� <"O'>A!D#-�+47J;='>P>-�WY9!D<D(9!"2-87>WV+4�!-1)T7:DK?�5,7:;= <'>D(P>-0/45!-0DhM®�K� 8� #"¥'>)!)!'>/4-05Q+4D#?I'>A,D<-�+.7J9!"2-1+.�,-)T7:D#?Z5!7:;I �'*D�7�«:-0/1'i+�D<-F'*"2+�)('>/º+�7>W¼+.�!-E <5!),9,+�"4)('*$3-=Òf� '>A!D#-E�,M��6Ô^M

�x¾&½ � �8ÁJÐ É�Ì�Ê�ËoÉ �8ÃFÇ �6Å�Ç�Ñ�É�Ã0Ë=ÇxÁ ¹Ñ 3ÁJÐ�ЩÃ���Ñ�ÁEÉ�Ã3ËIÇ

ML5o'�D�'>/2G:-3/u-c��)T-3/2 <;I-356+FUiN�-�'*)!)!D#?\7>9!/ 5,7:5!"2+.'*+. #7:5('>/º?\P>-0/45!-0D,$37>;JA! <5!'*+. #7:5°+.7%+4�!-�),/47:A!D#-3;7>W,)!/47>+4-3 #5\WY9,5!$0+4 <7:5C'>5!5!7*+&'*+4 <7:5°WY/47>;È'�$07:D<D#-3$c+. <7>5°7>W,�,-0+.-0/47:G>-35!-07:9!"©P*-3/25!-3D#"3M©·¸-®$37:;I)('>/2-+.�,-JD�'*+4-356+\ ¡¬�­;I-0+4�!7ZR�'>G6'> #5!"2+ �,q\ B"89!"4 #5!GX"2 <5!G:D#-ªP*-3/45,-3D<"8'>5!Rx+.�,-f�,­��¯;=-c+.�!7ZRx #5~��¼'*5!$&PQ/4 <-c+@-c+='>DhMKU��>�:�>�>A,��9!"2 <5!G�R('*+.'qWY/27:; +.�!'*+I"2+.9,R,? Ò�������� ��� ������������� ������� �������

Page 95: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� �

� '>A!D<-%�!M��&G � &�+ � � ( �e& � & � " $ �( � ��� � � ����!-1+&'*A!D<-%D< <"º+."0U�WY7:/�+.�!- �1� M®�!-F'>/º+�R('*+.'ª"4-c+'>5!R�"2 K�S$0D�'>"2"4 KÕ($F'*+4 <7:5S;I-0+4�!7ZR!"3U,+4�!-\;=-3'>5B'>5!R�"2+.'>5!R('*/4R�R!-0«Z <'*+. #7:5S7>W¼+.-3"º+�"4-0+%'>$0$39!/4'>$0?'>$0/47:"2"ªÕ!Ws+.-0-35�$3/27:"4"a²z«*'>D# <R('*+4 <7:5,"XÒs+.�!/2-3-c²hWY7:D<R��kq /4-0)�-3'*+.-0R�Õ!«:-X+4 <;I-3"&Ô^Mx���!-XÕ(/2"2+J+4�!/4-0-;I-0+.�,7�R!"X'>/4-��'q\ ¡"S+./4'> <5,-3R N� K+.� "4 #5!G:D#-�P>-0/45!-0D<"0U%WY7:D#D<7�N�-0R A6? +.�,- �,­��Ó'*)!)!/47:'>$&� 7>W~��¼'*5!$&PQ/4 <-c+o-0+J'>DhMKU©�>�:�6�i�§U�'¡;@'i�� #;J9!; D< #P>-0D< <�,7�7ZRq;= ´��+49!/4-=7>W%³\'>9!"4"2 �'>5,"ª$3D<'>"4"2 #Õ(-0/3U�'*5!R+.�,-C�K� 8�¯;=-c+.�!7ZRVM����!-E;='i�� <;='>D�;I-F'*5�«*'>D#9!-° <"� #5!R! #$F'*+4-3R� <5�AT7:D<R,Wf'*$3->M

;%D<G:7>/4 #+4�!;  ¡-F'*5�� �\��Q9('*R!/.'*+4 <$ �� � - � - �� � ���

�6m � �,M N�N�N*� ���M �,¢D# <5!-3'>/ �,M N:�>� �:���M �6���­�� �,M N�N�N*� ���M �,¢ ¡� �,M N>�:�,¢���,M¦�6�*��K� 8� �,M¦�:�ON:���,M¦�,¢��

������� ��� ��� ���,ÔcMÖ·-B9!"4-�+.�,/4-3-BP>-0/45!-0D<"0U�/4-0)!/4-0"4-05Q+4 <5!GG:-35!-�-^�,),/4-3"2"4 #7:5VU¥)!/27>+.-0 <5�R!7:;='> <5$37>5Q+4-356+FU�'*5!R¹)!/27>+.-0 <5�"4-3�Q9!-05!$3-�"2 <;I <D<'>/4 K+L?:M�·-B+./4'> <5�7:5!-^²z«:-0/4"29!"º²L'>D<D�$3D<'>"4"2 #Õ(-0/4"HWY7:/�¢��WY9!5!$c+. #7:5('>D�$0D�'>"2"4-0"E7*WO?>-F'>"º+ªG:-05!-3"0Mo·-H/.'*5!R!7:;ID#?¡".'>;I)!D#-JWY/47:;�+.�!-HR('*+.'S"4-0+\+47¡/2-3R!9!$0- #+4"�"4 #¶3-�+.7�N>�:�8G>-35!-0"�'>5,RH+4�!-35I)T-3/2WY7>/4; +4�!/4-0-c²zWY7>D<Ro$3/27:"4"a²z«*'>D# <R('*+4 <7:5nU>/4-0)�-3'*+. #5!G°+.�!-�-05Q+4 </2-)!/27�$0-3R!9!/2-oÕ!«:-H+. #;=-0"3M �(7:/\'*D<D©;I-0+4�!7ZR!"3UVNO-H9!"4-H+.�!-o/2-3G:9,D�'>/2 <¶F'i+. <7>5x)('>/4'>;=-c+.-0/ � � ¢��,U'>"� <5�~ �u'>5!$&PQ/2 <-0+%-0+1'>D§M#UT�>�>�>�:A,�§M¥·¯ #+4���K� 8�1U�N�-ª'>G6'> #5¡9,"4-ª7>5!-C$07:;I)�7:5,-356+1)T-3/�P>-0/45!-0D)T-3/�$3D<'>"4"� #5�+4�!-\;=7ZR!-0DhM

�©'*A!D<-\�!M �="29!;I;@'>/2 <¶0-3"�+.�!-E;I-F'>55; �8��"%7�«>-3/E¢ NJ+./4 <'>D<"¥WY7>/%'*D<DV;I-0+4�!7�R,"3M����,-ª�K� 8�;I-0+.�,7�Rq�('>"°+4�!-H�! <G:�,-3"2+E'*$3$39,/.'>$c?�WY7:/°-3 #G:�6+\7>WO+4�!-o+LN�-0D#«>-=$0D�'>"2"4-3"0Mo·-H"4)T-3$09!D�'i+.-o+.�('i+'>5�'>R,«*'>56+&'>G>-CWY7:/��o� 8� 7�«:-3/o�,­��¹ <5B+.�!-0"4-C-c��)�-0/4 #;=-05Q+4"1 #"�+4�!-J'>A, <D< K+L?X7>W©+.�!-C;= ´��+49!/4-;I7�R!-0D(+.7J$3'>),+.9,/4-1"27:;I-17>WV+4�!-8D<'*+.-05Q+O"2+4/49!$c+.9!/2-8 <5I+.�!-1R('*+&'�M+ML5X)('>/º+. #$39!D<'>/3U6+.�,-ª¢��E?>-F'>"º+WY9!5!$c+. #7:5('>D¥$0D�'>"2"4-0"=/2-3)!/2-3"4-056+@+.�,-B+47:)ÖD#-0«>-3D�7>W%+.�!-¡  M � ��WY9,5!$0+4 <7:5('*D��! <-0/.'>/2$&�Q?>MÖ���Q9!"0U+.�,-3"4-I¢��J$3D<'>"4"2-3"�$37>5Q+.'> <5B;I-F'>5! #5!G>WY9!D�"49!A,"2+./29!$0+49!/4-*UTN��, <$&�¡�o� 1� $F'*5¡-^�,),D<7: K+FM

Page 96: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� �

1 2 3 4 5 6 7 8 9 10 11 120

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

Class

RO

C

Yeast Protein Function Annotation

ExpDomSeqSDPNSKC

�© #G:9!/4-��!M¦�&G � & � � � � � & � �( � �)$'( � $�� r&�+�� � � � & ��� &)( ��$ ��� � � ( & � $ ��� � � � & � � � �

� & � � � & �� ����,-8Õ(G:9!/2-8"4�!7�N�"0U!WY7:/�-3'>$&�XWY9!5!$c+. <7>5('>DT$3D�'*"4"�'>5,RS-F'>$&�S$0D�'>"2"4 #Õ!$F'*+4 <7:5X;I-0+4�!7ZR+.�,-E;I-F'*55; �1� WY/47>;ÓÕ!«>-E+4 <;I-3"�+4�!/4-0-c²zWY7>D<R�$3/27:"4"a²z«*'>D< #R('*+4 <7:5VM

Page 97: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�>¤

� '>A!D<-ª�!M¦�&G � &�+ � �( �e& � & � ��$ ��� � � ( & � $ � � � � � & � � � � & � � � & � + $ � "%&�� � H���!-+&'*A!D<-=D< <"º+."0U©WY7:/ª-3'>$&��WY9!5!$c+. #7:5('>D�$3D<'>"4"�ÒY/47�N%Ôª'>5,R�-F'>$&��$0D�'>"2"4 #Õ!$F'*+4 <7:5¸;=-c+.�!7ZR¯Òf$07:D<9,;=5�Ô+.�,-@;I-F'>5P; �8��WY/27:;�Õ!«:-=+. <;I-3"°+4�!/4-0-c²zWY7>D<R�$3/47>"4"º²h«*'>D< #R('*+. #7:5VM=���!-=Õ(/2"2+C+.�!/2-3-@$07:D<9,;=5!"$37>/4/4-0"4)T7:5!RB+.7]�,q\ ¡"�+./4'> <5!-0R¡7>5¡"2 <5!G:D#-°P>-0/45!-0D<"oÒYG:-35,-C-^�,),/4-3"2"4 #7:5VUT)!/47>+4-3 #5¡R!7>;@'> #5S$37:5Z²+.-056+�'>5!R�"4-0�Z9,-35!$0-C"2 <;I <D�'*/4 #+L?>UQ/4-3"2)�-0$0+4 #«:-0D#?,ÔcM®���!-8Õ!5('>Dn+LNO7H$37:D#9!;=5,"¥$37:56+.'> <5S/2-3"49,D#+."¥WY7>/+.�,-��,­�� '*5!R�5!7>5!"2+.'*+. #7:5('>/º?SP>-0/45!-0D $07:;JA! #5('*+. #7:5�;=-c+.�!7ZR!"0M �(7:/�'>D<D�;I-0+4�!7�R,"3U�"2+.'>5!R('>/2R-3/2/47:/2"JÒY5!7>+�"4�,7�N�5(Ô%'>/2-EG>-35!-0/.'>D#D#?X7>5¡+.�,-E7>/4R!-0/%7>W��,M¦�6��U(-c��$0-3),+%WY7:/�$3D�'*"4"4-0"8�BÒ§��M �>�6Ô�'*5!R¤BÒ§�,M¦�ON:Ô^M

��D<'>"4" ¬©�,) ­87:; �Z-3� ��­�� �o� 1�¢ �,M¦�r�:� ��M ��¢ � �� ��� � �,M �*�`N �,M �*���� �,M¦�ON � ��M �:�*� �,M ��¢ � �,M ��N�¢ �� �����

� �,M¦�:� � ��M �>�>� �,M �:�>¤ �,M �>� � �� ��� �

� �,M N>¤:� ��M ��N*� �,M ��N:� �,M �>�:� �� ��� �N �,M �,¢�� ��M � �^� �,M � �:¤ �,M �r�>� �� ���� �� �,M¦�,¢ � ��M �:¤>� �,M¦�:� � �,M¦�:¤ � �� � -��� �,M N�N*� ��M ��¢/N �� � � � �,M �:�>� �,M �>� �� �,M N>¤>� ��M �r�>� �,M¦� �:� �,M¦�:¤ � �� �����¤ �,M N>�ON ��M N>�*� �� � � � �,M N �6� �,M N �>�¢�� �,M N�N*� ��M �,¢F� �� � � � �,M¦�:¤ � �,M¦� � �¢:¢ �,M N>�:� ��M¦���*� �,M ���:� �,M N:�*� �� � � �¢�� �,M¦� �6� ��M��:¤>� �,M � �r� �,M¦¤,¢�� �� � - �

Page 98: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�:�

� '>A!D<-��!M N8G�� � � � ���( � $'( ( &)( � &)( ��$ ��� � + $ � � �� � � r&)(*$�� O���!-%+.'>A!D#-�D< <"º+."0UQWY7>/�-3'>$&�WY9!5!$c+. #7:5('>D�$3D<'>"4"�ÒY/47�N%ÔC'*5!R�-F'>$&��$0D�'>"2"4 KÕ($F'*+4 <7:5¸;=-c+.�!7ZR¯ÒY$37:D#9!;=5(Ô\+.�,-X"2+.'>5!R('>/2R�-3/2/47:/2"'>"2"47Z$3 �'i+.-3RSN� K+.��+.�!-\$37>/4/4-0"4)T7:5!R! #5!GH;=-3'>5!"�WY/47>;�� '>A!D<-°�,M¦�!M

��D<'>"4" ¬���) ­87>; �Z-3� �,­�� �o� 8�¢ �,M �:� �,M¦�,¢ �,M¦�:�:¤ ��M �,¢3� �,M¦�,¢��� �,M �>� � �,M¦�6�>¤ �,M¦�r� � ��M �>�,¢ �,M¦�>�Q�� �,M �>� �,M¦�,¢ � �,M¦�,¢�� ��M �,¢3� �,M¦�,¢1�� �,M ��¢ N �,M¦�,¢�� �,M¦�6� ��M �,¢F¤ �,M¦�,¢ NN �,M �:�*� �,M¦�,¢ � �,M¦�,¢�¤ ��M �,¢F¤ ��M �6�� �,M ��¢ � �,M¦�,¢ � �,M¦�,¢:¢ ��M �,¢3� �,M¦�,¢ N� �,M ��¢ � �,M¦�,¢�� �,M¦�,¢ N ��M �,¢F¤ �,M¦�,¢��� �,M �:� �,M¦�r�,¢ �,M¦�6��¢ ��M �,¢F� �,M¦�,¢ �¤ �,M �:� �,M¦�ON>� �,M¦�ON � ��M �ON�� �,M¦�ON�N¢�� �,M �:��¢ �,M¦�6�*� �,M¦�,¢�¤ ��M �6�^� �,M¦�6�>�¢:¢ �,M �*�!¢ �,M¦�r�,¢ �,M¦�r�6� ��M �6�>� ��M �r�¢�� �,M �>� �,M¦�,¢1� �,M¦�:�:¤ ��M �:� � �,M¦�:� �

Page 99: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�,¢

� '>A!D<-°�,M �&G � &�+ � �( � & � & � ��$ ��� � � (*& � $ � � � � � & � � � � & � � � & � + $ � "%&�� � � � ����e$����%$ � r$ � � � � � ( � � � ( $ ¥���!-\+&'*A!D<-°D# <"2+4"3U!WY7:/�-3'>$&��³ � +4-3/2; Òf/27�N%Ô�'>5,R¡-3'>$&��$0D�'>"2"4 K²Õ($3'*+. #7:5¡;I-0+4�!7ZRÒY$37:D#9!;I5�Ô�+.�!-\;I-F'>55; �8�±WY/27:;�+.�,/4-3-\+. #;=-0"¥Õ!«:-^²zWY7:D#R¡$0/47:"2"º²h«>'*D< <R!'*+. #7:5VM���!-ªÕ!/4"2+8$37:D#9!;=5¡$37:/2/4-0"4)T7:5!R!"8+47S'@P>-0/45!-0D�'F«:-0/.'>G:-*Un+.�,-J"4-0$37:5!R�+47 �,­�� U�'>5!Rx+4�!-ª+4�! </2R+.7H5!7>5!"2+.'*+. #7:5('>/º?XP>-0/45!-0D $07:;JA! #5('*+4 <7:5VM

³ �È+.-3/2; ;%«:-0/.'>G>- ��­�� �o� 1�³ �RG¦�:�:� �,¢�� � �,M¦¤r� ���,M¦�,¢�� �,M ¤>� �:��,M ��¢ N ��M ¤>�>�r���M �,¢3�³ �RG¦�:�:��N�N>�:� �,M¦¤6� ���,M¦�,¢�� �,M ¤:� ���,M ��¢�� ��M ¤6�*� ���M �,¢��³ �RG¦�:�:�>�6�>�:� �,M � � �:��,M¦�,¢�� �,M�� �>�:��,M ��¢ N ��M�� �>� ���M �,¢/N³ �RG¦�:�>� �:�r� � �,M¦¤,¢:¢���,M¦�,¢�� �,M ¤>�:¤:��,M ��¢�� ��M ¤,¢ � ���M �,¢/N³ �RG¦�:�>�:�>���r� �,M¦¤r� ���,M¦�:� � �,M ¤*�6�:��,M �>� � ��M ¤>�,¢ ���M �:� �³ �RG¦�:�>�>�Q��N�N �,M � �*� ��,M¦�,¢ N �,M��>�>� ��,M ��¢1� ��M�� �i�r���M �,¢��³ �RG¦�:�,¢F� �ON>� �,M �r� ���,M¦�,¢ � �,M���¢��:��,M ��¢�¤ ��M��6�^� ���M �,¢ �³ �RG¦�:�>�>�Q�>�6� �,M¦¤:� �:��,M¦�:�:� �,M��>¤ ���,M �>�:� ��M ¤:�>� ���M �:� �³ �RG¦�:�:�>¤,¢:¢ � �,M �:¤:�:��,M¦�,¢�� �,M�� �:�:��,M ��¢�� ��M�� � �:���M �,¢��³ �RG¦�:�,¢F� �6�>¤ �,M¦¤r�,¢���,M¦�:� � �,M ¤:�>�:��,M �>� � ��M ¤6� � ���M �:� �

�©'*A!D<-��!M¦�8"49,;=;='>/4 #¶3-0"�'>5!7>+4�!-3/�-^��)�-0/4 <;I-356+�NO-�$37:5!R,9!$0+4-3R=WY7>/©?:-3'>"2+�)!/27>+.-0 <5JWY9!5!$c+. #7:5'>5!5,7>+&'*+4 <7:5nM%���! #"%+4 <;I->U�N�-J9,"4-ª+4�!-J"4-0�Q9!-35!$0- �*"º+./29!$0+49!/4-IR('*+.'>"4-c+1WY/47>;����!'>),+.-0/\��M%���!-;I-F'>54; �1��"J7�«:-0/S¢ N�+4/4 �'*D<"\WY7:/ªP*-3/45,-3D¥'F«>-3/.'*G: <5!G,U �,­�� U©'>5!R��K� 8��'>/2-@D# <"2+4-3RVM¡���!-3/2- <"�5!7H$3D<-3'>/�N� #5!5!-3/�A�-c+LN�-0-35x�K� 8�¯'>5!R�P*-3/45,-3Du'F«:-0/.'>G: #5!G (!�,7�NO-0«>-3/0U��K� 8� $37>5!"4 #"2+.-056+.D#?7:9,+4)�-0/2WY7:/2;="�+.�,-f�,­��¹+.-0$&�!5! #�Z9,->M1·¸-ª$07:;=),9,+.-0R��,²z«*'>D#9!-3"�9!"2 <5!G@'@7:5!-^²L"4 #R!-3R¡·¯ <D<$07F�,7>5"4 #G:5!-0R�/.'>5,Pq+4-3"º+J+.�('i+ª"2�!7�N�'¡"4 <G>5! #Õ($3'>56+J'*R,«*'>56+&'>G:-IWY7:/J�K� 8� 7�«>-3/ �,­��¼M�;%G6'> #5VU NO-Õ(5!RI+.�('i+¥'F«:-0/.'>G> <5!GE <"®"49,/4)!/2 <"4 #5!G:DK?oG:7Z7�RoN� #+4�=+4�! <"®R('*+.',M �Z+.'*+. #"2+4 <$F'*D<D#?>U:'F«:-0/.'>G> <5!GC-3�Q9('>D#"�o� 8� 7�«>-3/�+.�!-0"4-E/4-3"29!D#+4"3M

Page 100: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�6�

0.1

1

10

100

1000

10000

0 100 200 300 400 500

Tim

e (s

)

Number of examples

QUADPROGSMO

�© #G:9!/4-1�!M NJG�� � � � � � � + $ r&�+ � �( � & � & � � ��� � � � �������������! ����,-\Õ!G:9!/4-\)!D#7>+."/49,5!5! <5,G=+. #;=-C'>"%'=WY9!5!$c+. #7:5�7>W©+.�!-C5Z9,;JA�-0/17>W®-^�,'>;=),D<-3"�WY7:/�7:9!/o�!  � <;I)!D<-0;=-056+&'*+4 <7:5'>5!R�  ;����V;om �¦" �������������� S7>5B+4�!-°+.7�?SR('*+.'o"4-0+�R!-0"4$0/4 <AT-3R¡ <5 ��-0$0+. #7:5��!MK¢:M �ZM�x¾�� �¡À � ��ÃFÄ ÃFÇ��

ML5�7:/4R!-0/o+.7�-0«*'>D<9!'*+.-X+4�!-B+4 <;I-X$37>;=)!D#-c�� #+L?7>W87>9!/H7:),+. #;= #¶F'*+4 <7:5¸)!/47Z$3-0R!9!/2->U�NO-�/.'>5Ö'"4;='>D#DV+. <;I <5,Go-c��)�-0/4 #;=-05Q+%9!"2 <5!GI+.�!-E"2?Z56+.�!-c+. #$JR('*+.'I"2-0+8R,-3"4$0/4 #A�-0Rx <5���-3$c+. #7:5��!MK¢:M ��M¥·¸-$37>;=)!9�+.-3RB+.�!-ED�'i+.-356+8 �¬®­ R! #"4$3/2 <;I <5('i+. #«>-8)!/277h2-3$c+. <7>5�"2+4-3)BWY7:/�«*'>/º?Z <5!GI5Q9!;JAT-3/4"�7>W�-^�Q²'>;I)!D<-0"3M�·-¡/4-3)T-F'i+.-3R�+.�! #"=),/47Z$3-3R,9!/4-B"4-c«:-3/4'>D%+4 <;I-3"o+.7�$37>;=)!9�+.-B;=-3'>5Ö7>),+. #;= #¶F'*+4 <7:5+. #;=-0"�WY7>/%7:9,/o�!  � '*5!R�WY7:/1  ;����V;om � " �������������! BWY9,5!$0+4 <7:5VM����!-ª/4-3"29!D#+4"8'>/2-C"29!;I;@'i²/4 #¶3-0RB #5 �© <G:9,/4-°�!M N�M�·¯ #+4� N>�:�o-c�,'>;I)!D<-0"3U)�,  ��/49,5!" �ZM Nª+. #;=-0"�Wf'>"º+.-3/�+4�('>5 �������������! �M

Page 101: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�r�

� � ��� �¸� � �

� ��� � � � �¸�����

�S¾�¿ ��Å�Ä Ä ÁªÊ�Í Ë � Ñ�ËIÇXÉ�ʮà ��Å�É�Ã0Ë=Ç

·¸-X"4-c+H7:9,+ª+47x-c�Z+4-35!R�+.�!-@R!7:;='> <5¸7>W�D�'>/2G:-I;@'>/2G: <5¸$3D<'>"4"2 #Õ($3'*+. #7:5 ~ q�'>)!5! #P�U�¢�¤:¤ �*�¥'*5!RP>-0/45!-0D�;I-0+.�,7�R!"J~��Z$&� �7:D<P*7:),W�-0+°'>DhMKU ¢F¤:¤:¤*�u+.7=+.�!-J/2-F'>D#; 7>W®D�'*+4-356+8G>/.'>)!�, <$F'*D ;I7�R,-3D<"0Un'*5!R <5¡"47=R!7: <5,G!U�R! <"2$37�«:-0/4-3Rq'I5!7�«:-0D¼N�'F?¡+47@$37>;JA! <5,-CP*-3/45,-3D<"% <5�'=;J9!DK+. ´²LP>-0/45!-0D�D<-3'>/45! #5!G='>DK²G:7:/2 #+4�!;¡M%·-J$3'>D<Du+.�, <"°'>),)!/476'*$&��5,7:5!"2+.'*+. #7:5('>/º?BP>-3/25!-3D�$07:;JA! #5('*+4 <7:5�Ò§�o� 8��ÔcUnA�-0$F'>9!"2-+.�,-oP>-3/25!-3D®$07:;JA! #5('*+. #7:5�NO-3 #G:�6+."8«*'>/2?x7�«>-3/8+4�!-H <5!)!9�+°"4)('*$3->Uu/4'*+.�!-0/8+.�('*5�AT-3 #5!GB'X$37:5Z²"2+.'>56+FU�"º+&'*+4 <7:5('*/2?�R! <"º+./2 <A!9,+4 <7:5nMx�o� 8��G:-35!-0/.'>D# <¶0-3"ª9,)�7:5�-^�� <"2+4 <5!G�P>-3/25!-3D�$37:;JA, <5('*+4 <7:5+.-0$&�!5! #�Z9,-3"°~��u'>5!$&PQ/4 #-0+O-0+�'>DhMKUZ�>�:�:��U �85!GC-c+¥'*DhMKUQ�>�:�ON��hUQR!-cÕ(5! <5,GC+.�,-%$07:;JA! #5('*+. #7:5JNO-3 <G>�Q+4"9!"2 <5!GJ+4�!-8)T7:"2+4-3/4 #7:/�R, <"2+4/4 #A!9,+. #7:5@7*W¼'J;= ´��+49!/4-%;=7ZR!-0DhUQ/.'*+4�!-3/O+.�('>5�'J"2 <;I)!D<-�D< #5!-F'*/O$07:;H²A! #5('*+. #7:5VM°���!-H;I K�Z+.9,/4-ª;I7ZR!-3D©'>R!R!"°$3'>)('>$0 #+L?:U� #5�+.�,-�q%� "2-35!"2-x~ q�'>)!5! #P�U©¢�¤:¤ �*�hUT+.7S+.�,-/4-0"49!DK+. #5!G8$3D<'>"4"2 #Õ(-0/3M¼·¯�! <D#-¥ <5!$0/4-3'>"4-0RI$3'>)('>$0 #+L?CG: #«>-3"�+4�!-�$3D<'>"4"2 #Õ(-0/�;=7>/4-�)T7�N�-0/�+.7°7�«:-0/2Õ!+3U+.�,-�/2-3G:9,D�'>/2 <¶F'i+. <7>5ª <;I)('>/º+.-0RoAQ?J;= #5! <;J9,; /2-3D<'*+. K«:-�-356+4/47:)6?o)('*/.'>;I-0+4-3/�-3"º+. #;@'*+4 <7:5J'>D<7:5,GN� #+4��'J"4-05!"4 #A!D<-°)!/2 <7:/OR! <"º+./2 <A!9,+4 <7:5=-35!$07:9!/4'>G:-3"�'J"2;=7Z7>+.�@"47:D#9,+. #7:5@+.�!'*+�G:-35,-3/.'*D< <¶0-3"�NO-3D#DhMMz+H <"o #;=)T7:/º+&'>56+ª+47�5!7>+4-�+4�('*+J+4�!-� <5!$0/4-3'>"4-0RÖ$3'>)('>$0 #+L?+.'>P>-0"o+.�!-XWY7:/2; 7>W1'x"2+4/49!$c+.9!/2-3RG:-05!-3/4'*+. K«:-1;I7ZR!-3D§M©���! #"� <"O5!7>+�'>"¥'*/4A! K+./.'*/2?I'>"O <5!$0/4-F'*"4 <5,Gª$F'*)('>$3 K+L?HN� #+.�X'C;I7:/4-%G:-35!-0/.'>DP>-0/45!-0D�WY9!5!$0+4 <7:5nUV->M G!MKU '*5 �6m �¹P*-3/45,-3DhMH�K� 8� )!/4-0"4-0/2«:-0"E+4�!-H)!/4 #7:/8PQ5!7�N�D<-0R!G:-HG: K«:-35q #5+.�,-EP*-3/25!-3D#"3U�A!9,+%'>D#D<7�N�"¥;I7:/4-8»(-^�� <A! #D< #+L?= <5� K+."�9!"2->M

Page 102: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�>�

·-\)!/27:)T7:"4-0R�'o;I7:/4-°)!/2 <5!$0 <)!D#-3RSD<'*+.-05Q+% ¡¬�­ «*'>/4 <'*+. #7:5('>D�AT7:9!5!R! #5!Go+.-0$&�!5! <�Q9!-\+.�!'>5�>-3A!'>/.'�~ �>�:�>�6'i��+.�!'*+H'>$&�! #-0«>-3"='�+. <G>�Q+4D#?¸A�7>9!5!R!-0R�D#7�$3'>D<DK?q7:),+4 <;='>DO"27:D<9�+. <7>5VM¸���, <"JN�'>"'>$&�! #-0«>-3R�A6?¸'¡"4-0$37:5,R�'>)!)!D# <$3'*+. #7:5q7>W¥+.�,-X�>-05!"4-05 �¦"o #5!-3�Q9('*D< #+L?xA�7:9,5!R¸+47�-3D# <;I <5('i+.-J+.�,- <56+4/.'>$c+&'>A! #D< K+L?x/4-0"49!DK+. #5!G¡WY/27:;�+.�!-= <5!$07:/4/2-3$c+2²L$0D�'>"2"ªD#7:G*²L"29!;I"\+4�('*+ª/4-3;='> #5'*Ws+4-3/\+.�!-IÕ(/4"º+'>)!),D< <$3'*+. #7:5o7>W��>-35!"2-35 � "¥ <5,-3�Q9('>D# #+L?:M ���!-�7:/4 #G: <5('*D! <56+./4'>$0+.'>A!D#-�)('>/2+4 #+4 <7:5oWY9!5!$c+. #7:5= #"®".'>5!RZ²N� <$&�,-3R�WY/47:;ÓA�-0D<7�N '*5!RB'>A�7�«>-°A�-c+LN�-0-35�+4�!-°A�7>9!5!R! #5!GJ+.-0/4;I"�7>W +4�!-°5!-cN +./4'>$0+.'>A!D#-°)('>/º²+. K+. #7:5 WY9!5!$c+. #7:5VM ·¯�!-35¯AT7>+.� AT7:9!5!R,"¡'*/4-�+4 <G:�6+.-05!-3R «Z �'�;I <5, <;='i��7:),+4 <;I <¶F'i+. <7>5VU�+.�,-7:/2 <G: #5('>DV)('*/2+. K+. #7:5¡ #"%/2-3$07�«>-3/2-3RVM1·¸-ª$07:;JA! #5!-C+4�!-ªAT7:9!5,R�+. #G:�6+.-35, <5!GI"2+4-3)!"1N� K+.��'I;@'��Z² <;I <¶3'*+. #7:5X7�«:-0/%+4�!-C7>AJh2-3$c+. #«>->UT+.7I #+.-0/.'*+4 #«>-3D#?X$37:56«:-0/4G:-E+.7@'H+4 <G:�6+.DK?SAT7:9!5!R!-0R�D#7�$3'>D<DK?X7:)�²+. #;@'*D�"47:D#9,+. #7:5VM±·¸-�),/4-3"2-356+.-0R±R,-0+&'* <D<-0R R!-0/4 K«>'i+. <7>5!"IWY7>/=+.�,-xD�'*+4-356+X �¬®­ ;I K�Z+49!/4-B7>W³\'>9!"4"2 �'>5,"�'>5!RB-c��)!D�'* <5!-0R�+4�!-\G:-35,-3/.'*D�$F'>"2-E #5S"49,µI$0 <-356+%R!-0+.'> <D�WY7:/�7>+.�,-3/4"�+47I-^�Z+.-35,R¡+.�,-NO7:/4P�M

·-O'>D#"47�WY9!D<DK?8-^�,),D�'> #5!-3RE7:9!/¼'>)!),/476'>$&�\+.7�-0µI$0 <-356+ 7:),+4 <;I <¶F'i+. <7>51+.�!/27:9!G:�#�!  �È~ ��D�'*+2+FU¢�¤:¤>¤*�hM�·-SAT-3G:'>5�N� #+.��+4�!-�D< <5,-F'>/C"2?Z"2+4-3; 7>W%$37:5,"2+./4'> <56+4"H'>5!R�"4�!7�NO-3RÖ�!7�N�+.7�-05!"49,/4-+.�!'*+H+.�!-�$37>5!"2+4/.'> #5Q+4"H/4-3;='> #5�"4'*+. #"2Õ(-0RVU� §M¦-*M#U®+.�!'*+HN�-B/4-0;@'> #5� <5�+.�!-�5Q9!D#D�"4)('>$0-¡7*W1+.�,-D< #5!-F'*/�"2?Z"º+.-3;BU!N��! #D<-8;I7�R, #Ws?Z <5!Gª'>"¥WY-0N 'i��-3"�'>"�)T7:"4"2 <A!D#->M©·¸-\R! <"2$37�«:-0/4-0RB+4�!/4-0-ER, DC�-3/4-056+$F'*"4-3"OWY7:/l�,  � "2+.-0)@+L?Z)�-0"�'>5!R@-c��)!D< #$F'*+4-3RI+.�!-%R!-3/2 #«*'*+. #7:5!"®+.7C7:A,+&'* <5H+.�!-%$37:/2/4-3$c+�9!)TR('*+4--3�Q9('i+. <7>5!"3M�·¸-8'>D#"47E"4�('*/4-3R@7:9!/�-^��)�-0/4 <-05!$3-% <5@'>)!)!DK?� #5!G#�!  � +.7CD�'*+4-356+� ¡¬�­ ),/47:A!D#-3;I"3U'>5!Ro+4�!-�R! #µI$39,D#+L?ª+4�('*+®NO-�Wf'*$3-3RI <5o7>A,+&'> #5! <5,G°$37:5!"2 <"º+.-356+�$37>5Q«>-3/2G:-35!$0->M����!-�D�'*+4-356+O �¬®­7:AJh2-0$0+4 #«:-o #"1$07:56«:-c��UuA!9,+85!7>+8"2;=7Z7>+4�VM°���Q9!"3U� K+8 <"%)�7>"4"4 #A!D<-E+.7XAT-3$07:;I-��º+./4'>)!)T-3R�S7>5�'D<7Z$F'*D<D#?�»�'*+¼/2-3G: #7:5\7>W,+4�!-®7:AJh2-3$c+. K«:-¥'*5!RC;='>P*-®«Z #/2+.9!'>D<DK?85!7�)!/47>G:/4-0"4"u+.7�N¥'*/4RC+4�!-®;= #5! <;ª9!;N� #+4�-3'>$&��"2+4-3)VM5ML5+.�,-3"4-=$F'>"2-3"0U�N�-@WY7>9!5!R K+ª5,-3$3-0"4"4'>/2?¸+.7¡+.'>P>-@'¡A! #G:G:-0/C"º+.-3)¸+.7�N¥'*/4R+.�,-8G:D<7>A('>D�;= #5! <;ª9!;A6?X$07:5!"4 #R!-3/2 <5!GJ'>D<DT'>$c+. #«>-°'i��-3"�"4 <;ª9!D#+.'>5!-37>9!"4DK?oN� #+.�X'J$37:5!"º+./4'> <5!-0R�%-cN�+.7:5¡"2+4-3)VM¥���,-J�%-cN�+.7:5¡"2+4-3)xR!7Z-3"�5!7>+�R!-0"2+4/47�?�+.�!-E$37:;I)!9,+.'*+. #7:5('>Dn-0µI$3 #-35!$c?�7>W�+.�,-+.-0$&�!5! #�Z9,->U¼A�-0$F'>9!"2-I+4�!-I5Z9,;JA�-0/\7>W¥'*$0+. K«:-I'i��-3"E <56«>7:D#«>-3R� <5�+.�!-H #5Q«>-3/2"4 <7>5¸7>W�+.�,- °�"2?Z"º+.-3; � ' XÒ � � Ô�7>)�-0/.'*+4 <7:5 � +.-05!R!"%+47XAT-ªD<-0"4"�+.�('>5 � � � M1���,-3/4-cWY7:/4-*Un+.�,-ª+. #;=-\/4-0�Q9! </2-3RWY7:/I+.�!- �,q8­�+.7�$07:;=),9,+.-�+4�!-x5Q9!D#D1"4)!'>$3-�R!7Z-3"@5!7>+S-^�,$0-3-0R @Ò � � ÔI7�«:-0/�'>D<D%'i��-3"0U%+.�,-'F«:-0/.'>G:-E$37>;=)!D#-c�� #+L?=7>W +.�!- �!  ��'>D<G:7>/4 #+4�!;BM

Page 103: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�ON·-I$37>5!R!9!$c+.-3R�"2-0«>-3/.'*DO-0;=)! #/4 #$F'>D�"º+.9!R, <-3"E9!"2 <5!GBP>-0/45!-0D�$37>;JA! <5!'*+. #7:5VU� <5,$3D<9,R! <5!G�7:5,-

"4-c+@7*W1-^�,)T-3/2 <;I-356+."�~��u-cN� <"H-0+='>D§M#U��>�:�:�>$c�¥+.�!'*+I <56«:-0"2+. #G6'*+4-3"o+.�!-B$37>"2+ �iA�-05!-0Õ!+I+./4'>R!-^²L7�C7>W®D#-F'>/25! <5!G=P>-0/45!-0D�$37:;JA, <5('*+4 <7:5�NO-3 <G>�Q+4"8«Z �'@7:)�+. <;I <¶3'*+. #7:5S«:-0/4"49,"E9,"4 <5,G�'>5x9!56NO-3 <G>�Q+4-3R$37>;JA! <5!'*+. #7:5VM ���, <"@"º+.9!R�?¹ <"@)('>/2+4 <$09!D�'>/2D#?�/2-3D#-0«*'>56+X+.7)!/.'>$c+. K+. <7>5!-3/2"@R!9!-¡+.7+4�!-�+. #;=-/4-0�Q9! </2-3R±+47Ö$07:;I)!9,+.-�+4�!-q$37:;JA, <5('*+4 <7:5 NO-3 #G:�6+."�WY7:/SD�'>/2G:-�R('*+.'�"2-0+4"�'>5,R R!9!-q+.7�+.�,-$39,/4/4-056+%D<'>$&P@7*W¼WY/2-3-0D#?S'F«*'> #D�'>A!D#-%"27>Ws+LN�'>/4-°+.7H)T-3/ºWY7:/4; +.�!-°7:)�+. <;I <¶3'*+. #7:5VMu·-°R,-0+.-0/4;I <5!-0R+.�!'*+�9!56N�-0 <G:�6+.-0Rx$37>;JA! <5!'*+. #7:5S$F'>5¡A�-C'>"�'>$0$39!/4'*+.-C'>"%'>5¡7>),+. #;= #¶3-3R�$07:;JA! #5('*+. #7:5VM®���! #""2+49!R,?¸'>D#"47�-c�,'>;I <5!-0R�+4�!-I- C�-3$0+C7>W�;= #"4"4 #5!GSR('*+.'�N� K+.��P>-0/45!-0DO$07:;JA! #5('*+. #7:5VMo·¸-IWY7:9,5!R+.�!'*+%+4�!-ª"2 <;I)!D<-\9!56NO-3 #G:�6+.-3R�$07:;JA! #5('*+4 <7:5� <"��Q9! #+4-ª/27:A!9!"º+1+.7=;= #"4"2 <5!GHR('*+.',M�ML5�'>5!7*+.�!-0/-c��)T-3/2 <;I-356+&'>D°R, </4-0$0+4 <7:5VU%N�-q«*'>D< #R('*+.-0R +.�!-¸�o� 1��+.-0$&�!5! #�Z9,-7:5±5Z9,;=-0/47:9!"B)!/27:A!D<-0;="'>5!R¡�('F«:-ªWY7>9!5!R�+4�('*+% <5¡+4�!-E;@' h27>/4 #+L?X7>W�$F'*"4-3"0UV/4-0"49!DK+."%�('F«:-ªAT-3-05xAT-0+4+4-3/�+.�('>5�-c�� <"º+. <5,G+.-0$&�!5! #�Z9,-3"3M����!-0"4-ª/2-3"29!D#+4"�R, <R�5!7>+�/2-3�Q9! </2-\)('>/2+4 <$09!D�'>/O+.9!5! #5!GH7>W¼+.�!-E'>D#G:7:/4 K+.�!;BM

·-\�('F«>-C$0/4-F'i+.-3R¡'o$37:;I)!D#-0+.-E 5;���� ;Km �:�p1 1�"27>Ws+LN¥'*/4-\ <;I)!D<-0;=-056+&'*+4 <7:5VUZ <5,$3D<9,R! <5!G  ;����V;om $0D�'>"2"4-0"1WY7:/�P>-3/25!-3D WY9!5!$0+4 <7:5,"3UTD<-F'*/45! #5!G@'*D<G:7:/2 #+4�!;="0U�'>5!RVU�$3/27:"4"1«*'>D# <R('i+. <7>5B-^�Q²)T-3/4 #;=-056+."3M%·-C)!/47�«Z <R!-J'>5x <;I)!D#-3;I-356+&'*+4 <7:5�7>W�+4�!- �!  � 7:)�+. <;I <¶3'*+. #7:5�'>"°'X  ;����V;om �¬�� Õ(D#-�N�/2 #+2+.-35= <5X�p1$1JM�·¸-%N� #D<D(;='>P>-�+.�!-%"47>Ws+LN�'>/4-1)!9!A!D# <$3DK?H'F«*'> <D<'>A!D<-�WY7:/O'>$3'>R!-3;I <$9!"2->M ; 9!"4-0/%G:9, <R!-8+47H+47o+.�!-\"47*Ws+LN¥'>/2-C #"�)!/47�«Z <R,-3RB <5a;1)!)T-35,R! K�a;CM�S¾�� ��Å�É�Å�Ê � ÎÏÃFÊ �°Ñ�É�Ã3ËIÇ�Ð

ML5�WY7:/4;ª9!D�'*+4 <5!G�+.�,-SD�'*+4-356+I �¬®­ #+.-0/.'*+4 #«>-XA�7>9!5!R! #5!G�'>5!R�7:)�+. <;I <¶3'*+. #7:5q+.-3$&�,5! <�Q9!-*U�NO-$&�!7:"2-o'I«>-3/º?x¬� �²zD< <P*-X~�­8-3;I)!"º+.-3/�-0+8'>DhMKUu¢�¤ � ���¼'>D<G:7>/4 #+4�!;BM����!-J �²L"º+.-3)nU�N��! #$&�x9!)TR('*+.-0"+.�,-X;=7ZR!-0DO)('*/.'>;I-0+4-3/4"0U� <"CR! <"2$3/2 <;I <5('*+4 #«>-='*5!R� <56«:7>D#«:-0"o'�$07:56«:-c��7:),+. #;= #¶F'*+4 <7:5nM¡¨�7�N¥²-0«>-3/0U®+4�!-�¬©²L"º+.-3)�7>5!D#?¸ <56«:7>D#«:-0"J$37>;=)!9�+. <5,Gx"4 #;=)!D#-=-^��)�-0$0+&'i+. <7>5!"JG: K«:-35�+4�!-S;I7�R!-0D�'*5!R-3"2"4-05Q+4 �'>D#D#?H #G:5!7:/2-3"®+.�!-�R! <"2$3/2 <;I <5('*+4 #«>-�G:76'>D§M©���!-�+.-3$&�,5! <�Q9!-�N�7:/2PQ"3U!A!9�+�;='F?H"49&C�-3/�WY/47:;"4D#7�N�-0/@$37>5Q«>-3/2G:-35!$0-q7:/=D#7�$3'>D�;= #5! <;='�+.�!'>5¹ #W%N�-x'>$0+4 #«:-0D#?�7:),+4 <;I <¶0-3R�A�7>+4� )!/277h2-3$c+. #7:5"2+4-3)!"0M��¼'i+.-356+8 �¬®­$F'>5¡A�-\WY7:/2;J9!D�'i+.-3R¡'>"%'="4'>R!R!D#-c²L)T7: #5Q+�7>),+. #;= #¶F'*+4 <7:5S)!/27:A!D#-3; 7>W�'>5 <5,R!-0Õ(5, #+.-�7:AJh2-0$0+4 #«:-%WY9!5!$0+4 <7:5nM����!-1"27:D<9�+. <7>5INO7:9!D#RXA�-�WY7:9!5,R@N� #+4�X'C;I <5, <;='i�o7:)�+. <;I <¶3'i²

Page 104: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�:�

+. #7:5VMX·¸-@R! #RR!-0/4 K«:-@D<'*+.-056+o �¬®­ #5¸+.�, <"\N¥'F?o(®�!7�N�-c«:-3/0U�N�-=R! <R¸5!7>+ªÕ!5!R�'>5¸-0µI$3 #-356+N�'�?H+47C9!)TR('*+4-�+4�!-�/4-3�Q9! #/4-0R@R! #"2+./2 <A!9�+. <7>5!"3M ���!-3/2-�N�'>"�"27:;I-��,7:)�-�7>W�Õ(5!R! #5!Gª'\+./4'>$0+.'>A!D<-"47>D<9,+4 <7:5VU,'>5!R�+.�! #"�$37:9,D<R�A�-E'oR! #/4-3$c+. #7:5SWY7:/¥WY9,+.9,/4-\/4-0"4-F'*/4$&�VMML5H'>R!R! K+. #7:5VU�N�-¥"2 <;I)!D< KÕ(-3R\+.�,-¥D�'*+4-356+� �¬®­¯7>AJh2-3$c+. #«>-¥A6?ª7>;= K+4+. #5!G�+.�!-�5!7:5�²z�Z9!'>R!/.'i+. <$-356+4/47:)6?B+.-3/2;="1'>"4"27�$0 �'*+4-3R�N� K+.��+4�!- ��«*'>/4 <'*+. #7:5('>D�R, <"2+4/4 #A!9,+. #7:5!"0M����, <"%N�'>" h29,"2+. KÕ(-3R�AQ?+.�,-OWf'>$c+ +4�('*+¼+.�!-O$37:56«:-0/4G:-0RHR! <"º+./4 #A!9,+4 <7:5!"�+4-35!Rª+471AT-OD# <P*-OR!-0D#+.'�WY9!5!$c+. #7:5!"uN� #+.�ª'>D<D6NO-3 #G:�6+7:5�'="4 #5!G:D#-E$07:;I)�7:5,-356+FM����!-0/4-0WY7>/4->UT+.�!-C-356+./27:)6?�+.-35,R!"1+.7�N�'>/4R�¶3-3/27!U�'>5!R¡+4�!-ª7>AJh2-3$c+. #«>-+./29!D#?BAT-3$07:;=-0"°�Q9('>R!/4'*+. #$>M\¨%7�NO-0«>-3/3U¼'*+1-F'>/2D#?¡"2+.'>G:-3"17>W®+.�!-JD<'*+.-056+\ �¬®­�7:),+4 <;I <¶F'i+. <7>5VU+.�,-�R! <"º+./4 #A!9,+4 <7:5!"@'>/4-�5,7>+SWY9!D<DK?�$37:;I;= K+4+4-3RVU�'>5!R¹+4�!-�'>R!R! K+. #7:5 7>WE+.�,-�-356+./27:)6?¹+.-0/4;I"NO7:9!D<RSD# <P*-3D#?I�!-0D<)@+4�!-°7:),+4 <;I <¶3'*+. #7:5o+.7o)!/27�$0-3-3R�;I7:/4-%"4;I7�7*+.�!DK?I'>5!R�'F«:7: #RS$37:;I;I #+.;I-356++.7�'XD#7�$3'>D¼;= #5! <;=',M1���, <"8;I <G:�6+19!D#+4 <;='*+.-0D#?S"2)�-0-3Rq+.�!-o$07:56«:-3/2G:-35,$3-o+.7�'X;I7:/4-ªG:D<7:A!'>D<DK?7:),+4 <;='>D>"27:D<9�+. <7>5\'>5!R\)!/4-c«:-05Q+©$0?Z$3D# <$�AT-3�('F«Z <7>/3U�N��! <$&�E <"�"27:;=-c+. #;=-0"�"4-3-05CN� K+.�°+.�!-®$09!/4/2-356+ <;I)!D#-3;I-356+&'*+4 <7:5nM$Mz+\"2�!7:9!D#RqA�-o/2-3D�'i+. #«>-3DK?�-3'>"2?x+47B'>R!R�+.�!-H-05Q+4/47:)6?x+4-3/2;="8+47�+4�!- �!  �7:),+4 <;I <¶3'*+. #7:5�7:/%+47S'>R!Rx+4�!-J-356+4/47:)6?�+4-3/2;="�+.7@+4�!-J7:AJh2-0$0+4 #«:-H'*5!R�7:),+4 <;I <¶3-°+4�!-J"4-0$37:5,R�²7:/2R!-3/�� '�?ZD#7:/�'>)!)!/27F�, #;@'i+. <7>5X7>W¼+.�!-\7:AJh2-0$0+4 #«:-E9!"2 <5!G ��� M

�89!/S-c��)T-3/4 #;=-056+."X"2�!7�N�-0R �o� 8� /4-3"29!D#+4"X+.�('i+S9!"49!'>D<DK?Ö7>9,+.)T-3/ºWY7:/4;I-3R �,­�� P>-0/45!-0D$37>;JA! <5!'*+. #7:5VM ¨%7�N�-c«:-0/3U!+.�,- �,­���'>D#G:7:/2 #+.�,; ~��¼'*5!$&PQ/4 <-c+¥-c+�'>D§M#UZ�>�>�6�i�T�('>R@'ª$3D#-F'>/�'>R,«*'>5Z²+&'*G:-°WY7:/�+.�!-0"4-ª-^��)�-0/4 <;I-356+4"%AT-3$3'>9!"4-C #+� #"%'o+./4'>5!"2R!9!$0+4 #«>-C+.-0$&�!5! #�Z9,->UT hM ->MKU��,­��¹9!"4-0R�+.�,-+.-0"2+ª-c�,'>;I)!D<-0"\N��,-35�D#-F'>/25! <5!G�+.�,-=$07:;JA! #5!-3R¸P>-3/25!-3D§MS���!-���­��±WY7:/4;ª9!D�'*+4 <7:5�$07:;I)!9,+.-0"+.�,-¥/4-0G:9!D�'*/4 <¶0 <5!G�+./4'>$3-¥$07:5!"º+./.'* <56+�7:5J+4�!-¥-356+4 </4-�$37:;JA, <5!-0RJ+.�!-¥P*-3/25!-3D!;='*+4/4 K��U*"47°"4;I7Z7>+.��²5!-0"4"8 #"�-05!$37>9!/.'>G>-3Rx7�«:-0/1+.�,-E+4-3"2+1R('*+.',M �89!/%$09!/4/2-356+\�K� 8� '>D#G:7:/2 #+.�,;�R! #R¡5!7*+19!"2-ª+.�,-+.-0"2+�-^�,'>;=),D<-3"0U�+4�!7:9!G:�@ #+O$37:9!D#RX�('F«:-*M®���!-8D�'i+.-356+� �¬®­ R, <"2+4/4 #A!9,+. #7:5I$F'>5S-3'>"4 #D#?HAT-°'>9!G*²;I-356+.-0R�N� K+.��'�D�'*+4-356+J«*'>/4 <'>A!D#-@WY7:/J+.�,-SD�'>AT-3D¥7*W�+4�!-S+.-0"2+IR('*+.',U�'>5!R�N�-�$F'*5� #56+.-3G>/.'*+4-7�«:-0/J+.�('*+C«*'>/4 <'>A!D<-*M��� #5!$3-=)!/47:A!'>A! <D# <"º+. <$H;I7�R,-3D<"C�('>5!R,D<-@"2-3;I K²z"49!)T-3/º«� #"4-0R�$3D�'*"4"4 KÕ($F'i+. <7>55('*+49!/.'*D<D#?>U¥'>5,RÖ+.�, <"='>/4-3'¸�('>"=A�-0-35¹"º+.9!R, <-3RnU¥+.�! #"INO7:9!D#R AT-x'¸AT-35,-0Õ($0 �'>D�-c�Z+4-35!"2 <7:5 +47�o� 8�1M

���!7:9!G>��N�-X$07�«:-3/2-3R�+4�!-S'>)!),D< <$3'*+. #7:5q7>W�P*-3/45,-3D¥$07:;JA! #5('*+. #7:5��Z9, #+.-I+.�!7>/47:9!G>�!D#?>U +.�,-WY7:/2;@'>D# <"2;�7*WOD<'*+.-056+C �¬®­ #"8;=7>/4-oG:-05!-3/4'>D�'>5!Rq$3'>5¸"29!)!)T7:/2+\7*+.�!-0/°)!/47:A!'>A! <D# <"º+. <$C;=7ZR�²

Page 105: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� �

-3D#"3Mo���!-H5!-^�Z+CD#7:G: #$F'>D¼;=7ZR!-0D©+.7�-c��)!D#7:/4-oNO7:9!D#R�AT-o+.�!-o�, <R!R!-05� ¡'>/4P*7�«q;I7ZR!-3D¥Ò§¨8 � xÔ~p�%'>A, <5!-0/3U©¢F¤:¤ONi�§MJ¬�"4"2-356+. <'>D<DK?:UV+4�!-H¨8 x  N� #+4�¸³E'>9,"4"4 <'>5�-3;I <"2"4 #7:5!"8 #" h29!"2+°+4�!-H;= ´��+49!/4-;I7�R!-0D!N�-%'>D#/4-F'*R,?o�('F«:-�N� #+4�=5,7:5�²L # <RoR! #"2+4/4 <A,9,+. #7:5H7�«>-3/®+.�!-�;J9!DK+. #5!7:;I �'>DQD�'i+.-356+®«*'>/4 <'>A!D#->M���!-= �'>/2P>7�«q'>"2"49!;I),+4 <7:5xWY7:/\'@Õ!/4"2+º²L7:/2R!-3/°;I7ZR!-3D <"8+.�!'*+8+.�,-HWY9�+.9!/2-o <"8 #5!R!-3)T-35,R!-356+E7>W+.�,-�)!'>"2+3U6G: #«>-35H+.�!-�)!/2-3"2-356+FM®���Q9!"3UQ+.�,-�;I K�� #5!G8)!/27:)�7>/2+. #7:5!"©WY7>/�+.�!-�5!-^�Z+O"4'>;I)!D<-�R!-0)�-05!R7:5q+.�!-H$09!/4/2-356+ªD<'*+.-056+\"2+&'i+.->MI�u'*+4-356+ª �¬®­ N� #+4��¨8 x ¡"E <"8+4�!-H;=7>"2+C'>;JA! K+. #7:9!"17*W�+.�,-+&'*"4PQ"JD< #"2+4-3R�,-3/4-*Mx���!-@¨8 x  #5Q«>7:D#«>-3"J;I7:/2-=;J9,D#+. #5!7:;I �'>D R! <"º+./2 <A!9,+4 <7:5,"3U N��, <$&�� #5Q+4/47*²R!9!$0-3"8;I7:/2-C­8 #/4 #$&�!D<-c+�)!/4 #7:/4"0U�'*5!R�;I7:/4-E7:),+4 <;I <¶3'*+. #7:5X$37>5!"2+4/.'> #5Q+4"3M�;1DK+.�!7>9!G:��+.�! #"�NO7:/4PNO7:9!D<R�$07:5!"º+. #+49,+.-H'X5,-0N),/477h2-0$0+FUVNO-HA�-0D< #-0«:-ª #+8NO7:9!D#R�A�-JNO7:/2+4�6N��! <D#-JWY9,+.9!/2-ªNO7:/4P�'*5!RNO7:9!D<RBA!9! #D<RS7:5S+4�!-\$39!/2/4-356+%/4-0"4-F'*/4$&�VM

Page 106: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� �

� �©� ��������� ��� � �

�O'>"2-3;I <5<;%D#+.9,5VU&ML76'*5!5! <"���"47Z$&�('>56+&'>/2 <R! #"3U('*5!RS���!7:;='>"�¨�7>WY;@'*5!5VM�¨� <R!R,-35S;='>/4P*7�«@"49!)Z²)T7:/º+�«:-0$0+47:/�;@'*$&�! <5!-0"3M ML5�y,{i_sr¯[^](_a`cb^]Td>_fehgi]Td>j k gi]FlF`cb.`c]nm&`�gi]ÈpqdZm&rZes]n`qtu`4d>b^](es]ZvwY[ k p¡t�}iU��*�:�r�,M

¬�M�­JM/;15!R,-3/4"2-35ª'>5!R HM�­JM ;15!R!-0/4"2-35VMZ���!-�;=7:"2-3P8 #56+.-3/2 <7:/n)�7: #56+u7:),+. #;= #¶3-0/nWY7:/�D< #5!-F'*/�)!/47*²G>/.'>;I;= #5!G G�'>5� #;=),D<-3;I-356+.'*+. #7:5¡7*W�+4�!-J�!7>;=7:G>-35!-07:9!"\'>D#G:7:/4 K+.�!;BM��1eKvir���`cbslFgib*?Id>]nm&`� �T_fe'?oe3[�d>_fehgi](U,)('>G>-3"\¢�¤ ���>�6��U!�>�:�:�,M

¬�M0;15!R!-0/4"27:5VU��©M)m�'> hUT�1M m� <"2$&�!7>WaU ��M�m�D<'>$&P6WY7:/4RVU��,MT­8-3;I;I-3DhU(�,M�­87>5!G6'>/2/.',UT�,MT­89���/47:¶*U;CM�³°/4-3-05QA('>9!;BU���M�¨1'*;=;='>/4D# <5!G,UJ;CM� ¡$ \-05!5!-c?:U�'>5!R¡­JM)��7:/2-35!"2-35VM�t� ��� k���� ��`cb.���� �Zeh\Z`cM���7�$0 <-c+L?�WY7>/ ML5!R!9,"2+./2 �'>D�'>5,R);1)!)!D# <-0R� �'*+4�!-3;='*+4 <$3"0U ���! #D�'>R!-0D<)!�, �',U �f;CU +4�! </2R-0R! #+4 <7:5nUn¢�¤:¤>¤,M+MH� m¥� �i² �:¤ � �Z¢0²L�:� ��² �@Òf)('>)T-3/2A('>$&P�ÔcM

��M'�\M�m¥'>$&�nU �\M:���! #A('>9���U�'>5!R@ ¸MOM&MZ�>7:/4R!'>5VM���7>;=)!9�+. <5,G°/4-3G>9!D�'>/2 <¶3'*+. #7:5J)('*+4�!"®WY7:/�D<-3'>/45�² #5!GX;J9,D#+. #)!D<-\P*-3/45,-3D<"0M�ML5q�u'FN�/4-05!$3- oM �,'>9!D§U��O'> #/%·¸-3 <"2"3U�'*5!Rq��-37:5 m�7>+2+.7:9nUn-3R, #+.7>/4"3U 6\>bid>]nm&`&�Ces]��E`c��b2d>jV[c]FlFgib*?Id>_§ehgi]��Ob.g�m&`&�&�ces]Zv � ���c_L` ?ª�cU��¥'>;JA,/4 <R,G:->UV  ;ªUV�>�:�>�!Mn  ML���/2-3"4"0M

;ªM m�-35Z²a¨%9,/�'>5!RX· M��M!��7:A!D<-*M \-0/45!-0DV;I-0+.�,7�R!"�WY7:/¥)!/2-3R! #$0+4 <5!GC)!/47>+4-3 #5�²L)!/27>+.-0 <5X #56+.-3/4'>$c²+4 <7:5,"3M���ehgies]FlFgib*?Id>_fehm&�cU(��¢\"29!)!)!D®¢�G Y� �Z <�6��U!�>�>�ON�M

oM  �M m�7:/2G>N¥'*/4R,+3U��1M ��M �85!G!Uk��M �Z$&�!7�-05('>9!-0/3U ��MpqJM¦�CM q1 <"4�6N�'>5('*+4�('>5VU ;ªM ��;=7>D�',U�'*5!R¨�² �¼M °/4 <-0G:-3D§M ��/27>+.-0 <5�WY9!5!$c+. <7>5�),/4-3R, <$0+4 <7:5�«Z <'xG:/.'>),��P*-3/25!-3D#"3M���ehgies]FlFgib*?Id>_§ehm&�cU���¢ÒS��9!)!),DhMV¢�Ô*G¦ #���Z ZN>�,U��>�:��N�M

Page 107: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�:¤

m1M�¬�M<m�7>"4-3/0U M&M� ¸M�³°9,?>7:5VU°'>5,R/qªM��CM q�'*)!5! <P�M ; +4/.'> #5! <5!G�'>D<G:7>/4 #+4�!; WY7:/S7:),+4 <;='>D;='>/2G: <5¡$3D�'*"4"4 KÕ(-3/2"3M ML5�­JM�¨%'>9!"2"4D<-0/3U�-0R! #+47:/3U��>_sr 1](](�,d>j k p ��gib�0��&r(g�� gi] k � t :uU)!'>G:-3"\¢F�>� T¢ N:�ZU��� #+2+."4A,9!/4G:�nU��f;CU�¢�¤:¤6��M&;���  ��/4-0"4"3M

��M'm�7�?ZR='>5!RI��M>q�'>5!R!-05QA�-0/4G:�!-*M k gi]ab>` � �T_fe'?oe3[�d>_fehgi](M ��/2-356+. #$3-c²L¨1'>D#DhUQ�*�:�r�,M��¼7C'*)!)�-3'>/3M;�«*'> <D<'>A!D<-1'*+��6+4+4) G � �iN�N�N\M¦"º+&'>5�WY7:/4RVM -3R,9����FAT7�?�R �*$0«6��A�7Z7:P�M �Q+4;=D§M�\MT��7:D<D#7:A�-0/2+3U���M��� #5!¶>UT�,M!·¸-3"º+.7:5nU�'*5!R���M)m�7*+4+.7>9VM��u'>/2G:-\"4$3'>D<-°+./4'>5!"2R!9!$0+4 #«>-��,q° ¡"3M ML5),/4-3)!'>/.'*+4 <7:5nU!�%7�«>-3;JAT-3/1�>�:�ONZM

�1Mn��7:/2+4-3"°'>5,R�qJMaq�'>)!5, <P�Mo�Z9!)!)T7:/2+%«:-3$c+.7:/%5!-0+LNO7:/2PZ"0MCp�dZm&rZes]n`Etu`4d>b^](es]Zv>Un�>�&G � �>� ,�*¤ ��U¢F¤:¤ON�M

�CM���/2 <"º+. �'*5! <5! �'>5!RÖ�,M ���('FNO-c²z�©'F?ZD<7:/0M 1]�[c](_fb.ge\>��mc_fehgi] _Lg � � ���(gib^_��T`&mc_Lgib@pqdZm&rZes]n`&�cM�¥'*;JA!/4 #R!G:- �� UT�¥'>;ªA!/4 #R!G:->U � oUT�>�:�:��M

�CMT��/2 <"º+. �'*5! <5! §U(�,M����!'�NO-c²z�©'F?ZD<7>/3U0;ªM�¬�D< #"4"2-3-0WaUT'>5,Rx�,M�\'>5!R,7:D�',M �85¡P>-3/25!-3D´²z+.'>/4G:-c+%'>D< #G:5�²;I-356+3MfML5 \>bid>]nm&`&��es] �E`c�Zb4d>j�[^]FlFgib ?Id>_fehgi] �Ob.g�m&`&�&�ces]Zv � ���c_L` ?ª�K5��(MZ  ML� �®/2-3"2"3U(�*�:�6��M

;ªM � M6­8-0;=)!"º+.-0/3UQ�CMZ �M6�u'> </2RVU6'>5!RI­JM�m%M���9,A! <5VMT ¡'i�� <;J9!;�D< #P>-3D# <�!7Z7ZRCWY/47>;� #5!$37:;I)!D#-0+.-R!'*+&'\«� <'\+4�!-8¬� �'*D<G:7:/2 #+4�!;¡Mu�(gi��b^]Td>j�gal1_sr(`���g*�>d>j � _zd>_fe<�c_§ehm4d>j � g�mceh`c_h�*U �:¤&GK¢ ,�:�ZUT¢F¤ � ��M

¨CM!­8/49!$&P*-3/3U��1M��,MT�1Mm�9!/4G>-3"3U���M�\'>9�WY;@'>5nU&;ªM��Z;=7:D<',U�'>5!R�qJM q�'*)!5! <P�M ��9,)!)�7>/2+�«:-0$0+47://2-3G:/2-3"2"4 <7>5=;='>$&�! #5!-3"0MFML5 \>bid>]nm&`&��es] �E`c��b2d>j�[c]FlFgib*?Id>_fehgi] �Ob.g�m&`&�&�ces]Zv � ���c_L` ?ª�cU6)('>G:-0"¢/N�NT¢���¢:U(�¥'>;ªA!/4 #R!G:->U(  ;ªU�¢�¤>¤ ��M( 5ML� ��/4-3"2"3M

��MT­89!;='> <"0M ��"4 <5,G="º«�;I"%WY7>/�+4-c�Z+8$3'*+.-0G:7:/2 <¶F'i+. <7>5VM¥[ � � � [c](_L`cjsj£eKvZ`c](_ � ���c_L` ?ª�\pqd�v6d1[3es]n`cU¢��(Òf�QÔ^Un¢�¤>¤ �,M

 ¸M M&M!�>7:/4R!'>5 ��M�\Mm�'>$&�VU�³oM �\M(³oM!�u'>5,$&PZ/2 <-c+FM� B9!D#+4 <)!D#-1P>-0/45!-0DVD<-3'>/45, <5!G!UZ$37>5! <$8R,9('>D< K+L?:U'*5!R�+4�!-�"2;=7¸'>D#G:7:/4 K+.�!;BMmML5 y,5i�c_1[c](_L`cb^]Td>_§ehgi]Td>j k gi]FlF`cb.`c]nm&`¡gi] pqdZm&rZes]n`Stu`4d>b^](es]ZvwY[ k p¡t�}iU��*�:�>�!M

Page 108: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

¤:�

;ªM:³E'*;=;I-3/2;@'>5nU^qJM*q®7�«�P�UZ'>5!R�qªM>q�'>)!5, <P�M���-F'>/25! <5!G1AQ?C+./4'>5!"4R,9!$0+4 <7:5VM0ML5I³oM ��M:��7�7>)�-0/'*5!R ��M� ¡7>/.'>D§U,-3R, #+.7>/4"3U���b.g�m&`&`O\>es]Zvi�Cgal°_Yr(`�� gi�Zb^_a`&`c](_sr k gi]FlF`cb.`c]nm&`ªgi] � ]nm&`cb^_hd>es](_S�Hes] 1b^_fe `¥mcefd>j:[^](_a`cjsj£eKvZ`c]nm&`cU*)('>G:-0"¥¢F���T¢ N�N�U>�,'>5 �(/4'>5!$3 #"4$07!U6� ;CU,¢�¤:¤ �,M: B7:/4G6'*5*\'>9,WY;='>5!5VM

³°-35!- �°56+47:D<7:G*?C��7:5!"47>/2+. #9!;BM!³°-35!-�7:56+.7:D#7:G>?oGV+.7Z7:D6WY7:/ +4�!-�9,5! #Õ($3'*+. #7:5ª7*W(A! <7>D<7:G>?>M �\d>_f��b.`� `c]n`c_fehm&�cU���N,Òº¢�Ô*G ��N ,�>¤,U!�>�:�:�,M

�(-3R!-0/4 #$37°³° </27:"4 §U: B <$&�('>-0D!�>7>5!-3"0U6'>5!RJ�¼7:;='>"47 � 7:G:G> <7!M,��-3G:9!D<'>/4 #¶F'*+4 <7:5°+4�!-37:/º?J'*5!Rª5!-09!/.'*D5,-0+LNO7:/4PQ"%'>/4$&�! K+.-0$0+.9,/4-3"0M �E`c�Zb4d>j k g7?K�T�Z_hd>_§ehgi](U �,Òh�:Ô*G ��¢F¤ ,�>�:¤�Un¢�¤:¤�N�M

��M�¨%7:D#; '>5!R �1M �,'>5!R!-0/3M �®/27>+.-0 <5 "2+4/49!$c+.9!/2-$37>;=)('*/4 <"27:5¯A6? '>D< #G:5!;I-356+�7>WJR, <"2+.'>5!$0-;='*+4/4 <$0-3"0M��(gi��b^]Td>j©gal1p�gij<`&mc��jKd>b���ehgij<g4v>�iU��>�>�&G#¢��>� T¢1� �,U�¢F¤:¤r�,M

�°MQ�:':'*PZP*7:D�'�UQ ¸M6­8 #-3PQ�('>5!"0UQ'>5!RI­JM:¨%'>9!"2"4D<-0/3M �%"2 <5!G8+4�!-��© #"4�!-0/�P>-0/45!-0DT;I-0+4�!7ZRJ+.7°R!-c+.-3$c+/2-3;I7>+.-�)!/27>+.-0 <5I�!7:;I7:D<7>G: <-0"3M0ML5 �Ob.g�m&`&`O\>es]Zvi�°gal�_Yr(` � ` b>`c](_srª[c](_L`cbc]Td>_fehgi]Td>j k gi]FlF`cb.`c]nm&`gi]¹[c](_L`cjsj£eKvZ`c](_ � ���c_a` ?ª�olFgibBp¸gij<`&mc�ZjKd>b ��ehgij<g4v>�iU1)('*G:-3"q¢F�6¤T¢ N �,U% ¡-05!D<7 � '>/4P�U\� ;CU¢F¤:¤:¤:',M8;@; ;@M ��/2-3"4"0M

�°MQ�:':'*PZP*7:D�'�UQ ¸M:­8 #-3PQ�('>5,"3UQ'>5!RH­JM>¨1'>9,"4"4D#-3/0Mc;¹R! <"2$3/2 <;I <5('*+4 #«>-�WY/4'>;=-cN�7>/4P\WY7:/�R!-c+.-3$c+. #5!G/2-3;I7>+.-O)!/47*+.-3 #5J�!7:;I7:D#7:G: <-0"3M��(gi��b^]Td>jTgal k g7?K�T��_hd>_fehgi]Td>j ��ehgij<g4v>�iU �!Òa¢0²º�>Ô G¦¤ONT¢:¢3�!U:�*�:�:�,M

�°M��:'>'>PQP>7:D<'S'>5!Rq­JM�¨1'>9!"2"4D#-3/3ME¬©��)!D<7> #+. #5!G@G>-35!-0/.'*+4 #«:-o;I7ZR!-3D#"% #5�R! <"2$3/4 #;= #5('*+4 #«:-\$0D�'>"2"4 K²Õ!-3/4"0M ML5 6\>bid>]nm&`&�Jes] �E`c��b2d>jn[c]FlFgib*?Id>_§ehgi]��Ob.g�m&`&�&�ces]Zv � ���c_L` ?ª� 5�5>U �,'>5q ¡'*+.-07!U�� ;CU¢F¤:¤ �,M! ¡7:/4G:'>5 \'>98Cn;='>5!5VM

�°Mn�:':'>PQP>7:D<',U� ¸M� ¡-3 #D�',UT'>5,R��°Mn�>-3A('>/4',M� �'i�� #;J9!; -356+4/47:)6?BR! <"2$3/2 <;I <5('*+4 <7:5nMO�¼-3$&�!5, <$F'*D��-3)T7:/º+�;@ML�<�¥²&¢��:� �,U� �'>"2".'>$&�Q9!"2-0+2+."3Un­8-3$0-3;JAT-3/°¢�¤>¤:¤>AVM

�°M6�:'>'>PQP>7:D<',U6 ¸M> ¡-0 <D�'�U:'>5!Rª�°M:�>-0A('>/.'�M( �'i�� #;J9!; -356+./27:)6?JR! #"4$0/4 <;I <5!'*+. #7:5VM�ML5 6\>bid>]nm&`&�es] �C`c�Zb2d>jT[c]FlFgib*?Id>_§ehgi] ��b.g�m&`&�&�ces]Zv � ���c_L` ?ª�cU,«:7:D#9!;I-o¢���U(­8-0$3-3;ªA�-0/E¢F¤:¤:¤>$*M

�°M��>-3A!'>/.',M�pqdZm&rZes]n`=tu`4d>bc](es]Zv�B��\e<��mcb^e'?oes]Td>_fecb>`�d>]�\ � `c]n`cb4d>_fecb>`cM °D#9QNO-3/R;%$F'>R,-3;I <$>UmO7:"2+47:5VU�  ;CU��>�:�>�6'�M

Page 109: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

¤,¢

�°M¼�>-3A!'>/.',M= ¡9,D#+. ´²z+.'>"4P�WY-F'*+49!/4-I'>5,R¸P*-3/45,-3D®"4-0D<-3$c+. #7:5�WY7:/ �,q\ B"3M:ML5 �Ob.g�m&`&`O\>es]Zvi�@galo_sr(`[^](_a`cb^]Td>_fehgi]Td>j k gi]FlF`cb.`c]nm&`Jgi]¡p�dZm&rZes]n`8tu`4d>b^](es]Zv>U��>�:�*�:AVM

�°MQ�>-0A('>/.'°'*5!RR;ªM � -356+4D�'>5!RnMn ¡'i�� <;J9!; $37>5!R! #+4 <7:5!'>DQD< <P*-3D# <�!7Z7�R\«Z �'8AT7:9!5!Ro;='i�� <;I <¶3'*+. #7:5'*5!R=+4�!-%$0-3; '>D#G:7:/4 K+.�!;BM0ML5 6\>bid>]nm&`&�%es] �E`c�Zb4d>j,[c]FlFgib*?Id>_fehgi] �Ob&g�m&`&�&�ces]Zv � ���c_L` ?ª� 5�5>U��'>5¡ �'*+.-07!UT� ;ªU�¢F¤:¤ �,M� B7:/4G6'*5 \'>98Cn;='>5!5VM

�°M\�>76'*$&�! <;I"3M  �'>PQ <5,G D�'>/2G:-c²z"4$F'*D<-�"29!)!)T7:/2+�«>-3$0+47:/�;='>$&�! <5,-�D<-F'*/45! #5!G¹)!/4'>$0+4 <$F'*DhM ML5;CM ��;=7>D�'�m1M ��$&� �7>D<P>7>),WaU��1M m�9!/2G:-3"0U©-3R, #+.7>/3U \>bid>]nm&`&�Ies] � `cb^]n`cj©p�`c_Yr(ge\i�eB � �1���(gibc_�T`&mc_Lgib1p�dZm&rZes]n`&�cM�  ML� ��/4-0"4"0Un�¥'*;JA!/4 #R!G:-*U�  ;ªU�¢F¤:¤ �,M

�°Mn�>76'>$&�! #;="0M��¼/.'*5!"4R!9,$0+. K«:-J #5,WY-3/2-35!$0-CWY7:/�+.-^�Z+8$3D<'>"4"2 #Õ($3'*+. #7:5�9,"4 <5,G@"49,)!)�7>/2+1«>-3$c+.7:/%;@'i²$&�, <5!-0"3MdML5aM&Mam�/4'*+.P*7='*5!R ��M�­8¶3-0/47:"2PZ §U!-3R, #+.7>/4"3U���b.g�m&`&`O\>es]Zvi�Cgal°_Yr(` � e :_a`&`c](_sr=[c](_L`cb^]Td>?_fehgi]Td>j k gi]FlF`cb.`c]nm&`ogi]xpqdZm&rZes]n`\tu`4d>b^](es]Zv>U()('>G:-0"°�>�:�,�>�:¤,U���'>5 �(/.'*5!$3 #"4$37,Un� ;CU ¢F¤:¤:¤,M B7:/4G6'*5 \'>9�WY;@'>5,5VM

�°M¼�>76'>$&�, <;I"3U¼�CM¼��/2 <"2+4 �'>5, <5! §UV'>5!R�,M ���('FNO-c²z�©'F?ZD<7:/0M=��7:;=)T7:"2 #+.-oP*-3/25!-3D#"EWY7:/°�6?Z)T-3/2+4-c�Z+$3'*+.-0G:7:/2 <".'i+. <7>5VM<ML5��1M m�/27�R!D#-0?�'>5,R4;ªM¼­°'>56?ZD<9!P�U�-0R! #+47:/4"0U �Ob.g�m&`&`O\>es]Zvi�SgalI_Yr(`J[^](_a`cb_?]Td>_fehgi]Td>j k gi]FlF`cb.`c]nm&`xgi]¹pqdZm&rZes]n`Stu`4d>b^](es]Zv>U¥)('*G:-3"���N>� ,��N���U �,'*5 �(/.'>5!$0 <"2$37!U��*�:�,¢:M B7:/4G6'*5 \'>9�WY;@'>5,5VM

 ¸MT�>7:/2R('>5¡'>5!R m� #"4�!7:)nMd;15B <56+./27�R!9,$0+. #7:5X+.7IG:/4'>)!�! #$F'>D�;=7ZR!-3D#"3MdML5�)!/2-3"4"0M ¸M M&M(�>7:/4R('*5VU �©M�³°�('>�!/4'>;='>5! hUQ�°M���M(�:':'>PQP>7:D<',U!'*5!RB�®M�HMa�,'>9!D§MkML56+./27�R!9,$0+. #7:5X+.7o«*'>/2 �'i²+4 <7:5!'>Dn;I-0+4�!7�R,"¥WY7:/�G:/.'*)!�! <$3'>DV;I7�R,-3D<"0MOp�dZm&rZes]n`°t¼`4d>b^](es]Zv>U � �8GK¢ �r� ,�^�r�,Un¢F¤:¤:¤,M

��M \-0-3/º+.�! §U ��M ���!-c«>'*R!->U¼�1M m��('*+2+&'>$&�('*/2?Q?6',UV'>5!R oMV B9!/2+4�Q?>M ML;=)!/27�«:-3;I-356+4"1+.7X),D�'*+2+ � ""2;=7I'>D#G:7:/2 #+.�,; WY7>/�"2«Z; $3D<'>"4"2 #Õ(-0/�R!-3"2 <G:5VU�¢F¤:¤:¤,M

³oMQ�\M�³oM©�u'>5!$&PQ/2 <-0+3U®�°M�­8-�m� #->U®�EM���/4 #"2+4 �'>5! #5! hU� ¸MkM&M��>7:/4R('*5VU®'>5!R�· MQ��M��%7>A!D<-*M�;"º+&'*+4 <"º+. <$3'>D WY/4'>;I-0NO7:/4P�WY7>/EG>-35!7:;I <$oR!'*+&'XWY9!"2 <7:5VM ��ehgies]FlFgib*?Id>_fehm&�cU¼�>�(Òa¢��6Ô G �>�6�*� ,�>�r��N�U�*�:�>�6',M

Page 110: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

¤6�

³oMl�\M�³oM��u'>5!$&PQ/2 <-0+3U1�EM���/4 #"2+4 �'>5! #5! hU � Mlm�'>/2+4D<-0+2+FU���M¥¬�D\³°�('>7:9, hU�'>5!R  �M�M&M��>7:/2R('>5VM��-3'>/45! #5!G¡+4�!-XP*-3/45,-3D¥;='*+./2 K�qN� K+.��"2-3;I K²LR,-0Õ(5! K+.-=)!/47:G>/.'>;I;= #5!G!MaML5��1MQ�,'>;I;J9,+o'*5!R;CM!¨�7�Cn;='>5VU�-3R! K+.7:/2"3U ��b.g�m&`&`O\>es]Zvi�Cgal8_sr(` 5�7>_YrH[c](_L`cb^]Td>_§ehgi]Td>j k gi]FlF`cb&`c]nm&`Egi]¡p�dZm&rZes]n`tu`4d>b^](es]Zv>Ua�Q?�R,5!-0?>Uf;%9!"2+4/.'>D# �',U!�>�:�6��M( ¡7:/4G:'>5 E'*9&Cn;='>5VM

³oM �\M(³oM,�u'>5,$&PZ/2 <-c+FU( �M!­8-35,G!U!�EM(��/4 #"2+4 �'>5! #5! hUZ �M&M&M(�>7>/4R('>5nU!'>5!R=· Ma��M,�%7:A!D#->M °-3/45,-3DK²A!'>"4-0RER!'*+&'¥WY9!"2 <7:5E'>5!R\ K+."�'>),)!D< #$F'*+4 <7:5�+.7�)!/47*+.-3 #5°WY9!5!$0+4 <7:5°),/4-3R, <$0+4 <7:5° #58?:-3'>"2+3MOML5 �\M1m1M;%D#+4;@'>5nU�;CM oM*­89!5!P>-0/3UQ��M*¨%9!56+.-0/3U6�°M7;ªM:�>9!5!G!U6'*5!RJ�°M:¬�M °D<-3 #5VU>-0R! #+47:/4"0U �Ob.g�m&`&`O\>es]Zvi�gal�_Yr(`��¥dZmce `¥m � �7?K�(g��ces�8? gi] ��ehg�m&g7?K�T�Z_fes]Zv>U*)('*G:-3" �>�:� �,¢>¢:M�·7:/2D<R �Z$3 <-056+. #Õ!$>UQ�>�>�>�:AVM

�1MT��M��u'FN�"47>5VU �\M��,M�¨1'>5,"47:5VU�­JM)�\M ° #5!$F'> #RVU('>5,R ��M��°M °/47:G:�nMlm¥'>"2 <$C�� <5!-3'>/�;1D<G>-3A!/4'�Z9!A!)!/27:G:/.'*;="1WY7>/ ��7>/2+./4'>5�9!"4'>G:->M k p :,b2d>],�3dZmc_§ehgi],�Igi]�p�d>_Yr(` ?Id>_fehm4d>j � gal^_hA�d>b.`cU NÒh�6Ô G��:� � �6�>�,U ��-0),+.-0;JA�-0/C¢F¤ �>¤,M+MH� �,� �:�:¤ �i² �ON>�:��M

�1M(��-3"2D< #->U�¬�M!¬®"2PQ <5VU('*5!RX· M)��M,�%7:A!D#->M ���!-°"4)T-3$c+./49,; P>-0/45!-0DSGd; "º+./4 #5!GoP>-0/45!-0DVWY7:/ �'q\ ),/47>+4-3 <5¡$3D<'>"4"2 #Õ($3'*+. #7:5VM ML5��EM m1MF;%D#+4;@'>5nUo;CM oMn­89!5!P>-0/3U���M�¨%9!56+4-3/3U HM��u'>9!R!-0/4R('*D<->U'*5!R��°M�¬�M °D<-0 <5VU�-3R! K+.7:/2"3U �Ob.g�m&`&`O\>es]Zvi�=galª_Yr(` �¥dZmce `¥m � ��?K�(g��ces�J? gi] ��ehg�m&g7?K�T�Z_§es]Zv>U)!'>G:-3" N>�*� &N ��NZU!�%-cN �>-0/4"4-c?:U��>�:�:��M,·¸7:/4D#R��Z$3 <-056+. #Õ!$>M

�1Mi��-3"4D# <-*U*¬�M�¬�"4PQ #5VU6�,MF·¸-3"º+.7:5VU>'>5!RE· M*��M��%7:A,D<->MZ B <"4;='*+4$&�C"º+./4 #5!G�P>-0/45!-0D<"uWY7:/ �,q\  )!/47*²+4-3 #5o$3D�'*"4"4 KÕ($F'i+. <7>5VM0ML5]�Z9!¶F'>5,5(' mO-3$&P>-0/3U��-3A('*"2+. <'>5H���!/49,5VUZ'>5!R °D�'>9!" �8AT-3/2;@'F?:-0/3UQ-3RZ² K+.7:/2"3U 6\>bid>]nm&`&�1es] �E`c��b2d>j,[c]FlFgib*?Id>_§ehgi] �Ob.g�m&`&�&�ces]Zv � ���c_L` ?ª�cU�)!'>G:-3"%¢F�:�!¢ T¢F�:����UZ�¥'>;H²A,/4 <R,G:->U� 5;ªUT�>�:�>�,M�  ML� �®/2-3"2"3M

­JM(��-0N� #"3U!�°MT�>-0A('>/4',U('>5!RS· M���M!�%7:A!D#->M��u'>/2G:-°;='>/4G: #5X$3D<'>"4"2 #Õ($3'*+. #7:5S9!"2 <5!GH-c��)T7:5!-05Q+4 �'>DWf'*;= #D#?I;= ´�Z+.9!/2-3"3M �Z9!A!;I #+4+4-3RVU&;1)!/2 <Du�>�>�:�:',M

­JM���-0N� #"3U¼�°M¼�>-3A('*/.',U¼'>5!Rq· M ��Mu��7:A!D<-*MH�%7:5,"2+&'i+. <7>5('>/2?�P>-0/45!-0DO$07:;JA! #5('*+. #7:5VM�ML5Öy��:b \[^](_a`cb^]Td>_fehgi]Td>j k gi]FlF`cb.`c]nm&`Jgi]¡p�dZm&rZes]n`8tu`4d>b^](es]Zv�wY[ k pBt�}iU��>�:�>�>AVM

­JM���-0N� #"3Ui�°Mi�>-3A('*/.',U*'>5!R°· M*��M���7:A!D<-*M���9,)!)�7>/2+u«:-0$0+.7>/ ;='>$&�! #5!-�D<-3'>/45! #5!G¥WY/47>; �!-c+.-3/27:G:-^²5,-37:9!"©R('*+&'8G©'>5o-0;=), </4 #$F'>DZ'>5!'>D#?Z"4 #"�9!"2 <5!G8),/47>+4-3 <5o"2-3�Q9!-05!$3-�'>5!RH"º+./49,$0+.9,/4->M ��9,A!;= K+4+4-3RVU;%)!/4 #Du�>�:�>�>$>M

Page 111: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

¤r�

· M!�� §U!��M(�>-0/47:"2¶3-0N�"2PQ hUT'>5!R ;CM(³°7�R!¶0 <P�M©��D<9!"º+.-3/2 <5!Go7*W �, <G:�!DK?I�!7:;I7:D<7:G>7:9!"�"4-3�Q9!-05!$3-0"�+47/2-3R!9,$3-°+.�!-\"2 <¶3-\7>W D�'*/4G:-°)!/27>+.-0 <5�R('*+.'>A('>"2-3"0M ��ehgies]FlFgib ?Id>_fehm&�cUn¢ �!ÒS�6Ô*G � �6�,� �>�,U!�*�:�,¢:M

��MZ�u <'>7C'>5!R=· M ��M��%7>A!D<-*Mu��7:;JA! #5! <5,GE)!'> </ºN� <"4-�"4-0�Q9!-35!$0-°"4 #;= #D�'>/2 #+L?C'>5!R="49!)!)T7:/º+�«:-0$0+47:/;='>$&�! #5!-3"%WY7:/1/2-3;I7>+.-J),/47>+4-3 <5��!7:;I7:D<7:G*?�R!-0+4-3$0+4 <7:5nM$ML5 �Ob.g�m&`&`O\>es]Zvi�=galª_Yr(` � e :_Yr 1]a?](�,d>j*[c](_L`cb^]Td>_§ehgi]Td>j k gi]FlF`cb.`c]nm&`�gi] k g7?K�T�Z_hd>_§ehgi]Td>j:p�gij<`&mc��jKd>b ��ehgij<g4v>�iU*)('*G:-3"©�:��N��>�6��U·'>"2�! <5!G*+.7:5VU!­\�1U ;1)!/2 <D�¢ � ,��¢C�>�:�:��M

 ¸MT ¡ #5!"4P6?B'>5,R��TM��©'>)T-3/º+FM ��`cb&m&` �T_fb.gi],�cM�  ML� ��/2-3"4"0UV�¥'*;JA!/4 #R!G:-*U�  ;ªU�¢F¤:� ��M ¸MQ B <5!"2PQ?I'*5!R ��M �©'*)�-0/2+FM���`cb.m&` �T_§b.gi],�eB 1]H[c](_fb.ge\>��mc_fehgi]S_ag k g7?K�T�Z_hd>_§ehgi]Td>j � `&g7?@`c_fb_�*M 5ML� ��/4-0"4"3U��¥'>;ªA!/4 #R!G:->U(  ;ªU�¢�¤>�:¤,M

� M! ¸M( B9!/4)!�6?X'>5!R�­JMQ· M&;1�!',M �1� M®/4-3)T7:"2 #+.7>/2?=7>Wu;@'*$&�! <5!-%D<-3'>/45! #5!GªR!'*+&'>A!'>"4-0"3M�­8-0),+FM7*WkML5,WY7>/4;='*+. #7:5S'>5!R���7:;I)!9,+4-3/6��$0 <-35,$3->U �1� ML/2«Z #5!->U�¢�¤>¤ON�M

· M%��Mn�%7:A,D<->M ��9,)!)�7>/2+°«:-0$0+47:/°;@'*$&�! <5!-J'>)!)!D# <$F'i+. <7>5!"1 #5x$37:;I)!9,+.'*+. #7:5('>D¼A! #7:D<7:G*?:M�ML5��,M ²�¼M q®-3/º+ m1M)��$&�!7Z-3D#P>7:)�WaU�HM,��"49!R('�UT-0R! #+47:/3U � `cb^]n`cj ?@`c_Yr(ge\i�°es]m&g7?K�T��_hd>_§ehgi]Td>j =3ehgij<g4v>�*U)!'>G:-3" ��¢ �¤6��M!  ML� ��/4-0"4"3U��¥'>;ªA!/4 #R!G:->U(  ;ªUT�>�>�>�!M

�1M'��M �85!G!U�;CM6�,M��Z;=7:D<',U:'*5!R �EM:�1M>·¯ <D#D< <'>;="27:5VMQ��-F'*/45! #5!G8+.�!-�P>-3/25!-3D!N� K+.�o�6?Z)�-0/4P*-3/45,-3D<"0M�(gi�Zb^]Td>j gal8pqdZm&rZes]n`1t¼`4d>b^](es]ZvH��`&��`4d>b.m&rZU(�&GK¢��>�r� T¢�� �Z¢:U!�*�:�ON�M

;ªM*�\M �8/2+. #¶>U*�1Mi¬�M> �M>�Q+./.'*9!"4"0U:'>5!R��JM �°D#;=-3',MQ  ;8 x  �8��¨ Ò§ �'*+4$&�! <5!G�;I7:D<-0$39!D<'>/�;=7ZR�²-0D<"%7:A,+&'* <5!-0R�WY/47:; +4�!-37:/º?,Ô G ;15q'>9,+47:;='*+.-0Rx;=-c+.�!7ZR�WY7:/%;=7ZR!-0D $07:;=)!'>/4 #"47:5VM �Ob&gi_L`ces]� mceh`c]nm&`cU�¢:¢�G �>�:�:�,�>�6��¢>U!�>�>�6��M

¬�M �8"49!5('�U �\M!�(/4-09!5!RVUZ'>5!R ��MQ³° </27:"4 §M(� /4'> <5, <5!G°"29!)!)T7:/2+®«:-0$0+47:/O;='>$&�! #5!-3" G '*5@'>),)!D< #$F'*+4 <7:5+47oWf'>$3-\R!-c+.-3$c+. #7:5VUV¢�¤>¤ ��M

� M �©'F«ZD< #R! <"0UfM&M�·'>)! <5,"4PQ hU�'>5!R�· M ��M��%7:A!D#->MK��9!)!)T7:/º+1«:-0$0+47:/8;='>$&�! <5,-ª$3D<'>"4"2 #Õ($3'*+. #7:5B7:5+4�!-°N�-0AVM ��ehgies]FlFgib*?Id>_§ehm&�cU!�>�(ÒY�QÔ G N �:� 8N � ��U,�>�:�>�,M

Page 112: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

¤>�

� M!� 'F«�D# <R! #"3UZ�,M:·¸-3"º+.7:5VU,�,MZ�¥'> §UQ'>5!RH· MQ�CMZ³°/49!5!R�?:M�³°-35,-�WY9!5,$0+. #7:5('>D,$3D�'*"4"4 KÕ($F'i+. <7>5JWY/47:;�,-0+.-0/47:G>-35!-07:9!"ER('*+&'�M ML5 �Ob.g�m&`&`O\>es]Zvi�@galJ_Yr(` ��e l^_Yr 1](](�,d>ju[^](_a`cb^]Td>_fehgi]Td>j k gi]FlF`cb.`c]nm&`gi] k g7?K�T��_hd>_§ehgi]Td>jTp¸gij<`&mc�ZjKd>b���ehgij<g4v>�*U,)('>G:-0"1�i�Q�,�*� �,U(�>�>�,¢:M

� M � '�«ZD# <R! #"3UT�,M(·-0"2+47:5VUn�,Mn�¥'* hU�'>5!RB· M ��M��%7:A,D<->M¥�u-3'>/45, <5!GIG:-35,-EWY9!5,$0+. #7:5('>D�$0D�'>"2"4 KÕ($F'i²+4 <7:5,"8WY/47:;�;ª9!D#+4 <)!D#-JR('*+.'S+L?Z)T-3"0M��(gi��b^]Td>jOgal k g7?K�T�Z_zd>_fehgi]Td>j���ehgij<g4v>�iU¼¤(Òh�>Ô G �6�,¢ Z�,¢:¢:U�*�:�6��M

�,M � -3'>/4D§M ��b.g>=&d�=3esj£e<�c_fehmª��`4di��gi](es]Zv¡es]q[^](_a`cjsj£eKvZ`c](_ � ���c_a` ?ª�CB �C`c_hA�gib 0��Xgal �OjKd>�Q�ceh=3j<`C[^]a?lF`cb.`c]nm&`cM® B7:/4G6'*5 \'>9�WY;@'>5,5VUV¢�¤:¤ �,M

�,M��1M �®D<'*+4+3M ��'>"º+�+./.'* <5! #5!GH7>W�"29!)!)T7:/2+�«:-0$0+.7>/1;='>$&�! <5,-3"�9!"4 #5!GI"4-3�Q9!-056+. �'*D ;I <5! #;@'*D�7:)�+. K²;I <¶3'*+. #7:5VMdML5�m1M ��$&� �7:D#P>7:),WaU��1M��,MT�1M�m�9!/2G:-3"0Un'>5,Rt;ªMT�,M ��;I7:D<',U!-3R, #+.7>/4"3U� 6\>bid>]nm&`&�Ees]� `cb^]n`cj�p�`c_sr(ge\i�cM�  ML� ��/4-0"4"0U¼¢F¤:¤:¤,M

��M �EMk�%'*A! <5!-0/3M ;�+.9,+47:/4 <'>D�7:5 �, <R!R!-05¯ �'>/2P>7�«Ö;=7ZR!-3D#"I'>5!R¹"2-3D<-0$0+4-3R '>),)!D< #$F'*+4 <7:5!"H #5"2)�-0-3$&�¡/4-3$07:G:5! K+. #7:5VM��Ob.g�m&`&`O\>es]Zvi�ªgal\_sr(`1[�� � �OU � �!Ò§�:Ô G ��N ��� �:�,U�¢�¤:¤ON�M

��M ��7:"2-35QA!D<'*+4+3M¸���!-�)T-3/2$3-3)�+./47>5 GS'x)!/27:A('>A! #D< #"2+. #$=;I7ZR!-3D�WY7:/J <5�WY7:/4;='*+. #7:5�"2+.7>/.'>G:-�'*5!R7>/4G6'>5, <¶F'i+. <7>5X <5S+.�,-EA,/.'> #5VM��®� �Qm&r(gij<g4v>ehm4d>jT��` b�eh` A�U!�ON8G�� �:� Z�:� �,UT¢�¤ON>¤,M

­JM:¬�M>��9!;I-3D#�('>/º+FU6³oM*¬�M:¨% <56+47:5VU6'>5,R �EM:�,M*·¯ <D#D< <'>;="0MZ�u-3'>/45, <5!G8 #56+.-3/25('>D�/4-3),/4-3"2-356+&'i+. <7>5!"A6?S-0/4/27:/�)!/47>)('>G6'*+4 <7:5nM�)('>G:-0"6�,¢ � �>�6��Un¢F¤ �:�,M

m1M'�Z$&� �7:D<P*7:),WaU!�¼M6��M�m¥'>/º+.D<-c+4+3U�;ªM'�Z;=7:D<',U:'*5!RC�EM>·¯ #D<D# �'>;I"47:5nM���,/4 <5,PZ #5!G1+4�!-�+.9!AT-�G©'85!-0N"29!)!)T7:/2+�«:-0$0+47:/�/2-3G:/2-3"4"2 <7:5@'>D<G>7:/4 K+.�!;BMfML5X ¸M ��M�\-3'>/45,"3U ��M`;ªM ��7:D<D<',U6'>5,RS­JMO;ªM���7:�!5nU-0R! #+47:/4"0U 6\>bid>]nm&`&�Bes] �C`c�Zb2d>j�[^]FlFgib*?Id>_§ehgi] �Ob.g�m&`&�&�ces]Zv � ���c_a` ?ª�;5�5>U¥)('*G:-3" �r�:� ,�r�:�,U�¥'*;JA!/4 #R!G:-*U�  ;ªU�¢F¤:¤:¤,M!  ML� ��/4-0"4"3M

m1M,��$&� �7:D<P*7:),WaU��1MQ�,MZ�1M'm�9!/2G:-3"0UZ'>5!R:;ªMQ�,M,��;I7:D<',U:-3R, #+.7>/4"3M� 6\>bid>]nm&`&��es] � `cb^]n`cj�p¸`c_sr(ge\i�eB� �1���(gib^_ �T`&mc_agib8tu`4d>b^](es]Zv>M�  ML� ��/4-0"4"0UV�¥'>;ªA!/4 #R!G:->U(  ;ªU�¢�¤>¤:¤,M

m1M �Z$&� �7:D<P*7:),W1'>5!Rm;ªM ��;=7>D�',M�tu`4d>b^](es]Zv A�es_sr � `cb^]n`cj �cM� 5ML� ��/4-0"4"3U¥�¥'>;JA!/2 <R!G>->U�  ;CU�*�:�6��M

Page 113: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

¤ONM&M!�EM�Z�! <5!R�?6'>D#7�«@'>5!R �¼M,¬�M m�7:9!/25!->M��®/27>+.-0 <5X"º+./29!$0+49!/4-\'>D# <G:5,;=-05Q+�A6?X #5!$3/2-3;I-356+&'*D�$07:;H²A, <5('*+47:/4 <'>D�-^�Z+.-35,"4 <7>5ÈÒf$0-�Ôo7>W1+4�!-B7:),+. #;@'*D¥)('*+4�VM �Ob.gi_a`ces]n�O]Zv>es]n`&`cb^es]Zv>U�¢:¢�G �>�:¤ �i����U¢F¤:¤ �,M

�°M'��;I #+4�o'>5!R= ¸Mi·�'i+.-3/2;@'*5VMcMLR!-356+4 #Õ($3'*+. #7:5o7>WT$37:;I;I7:5J;I7:D<-0$39!D<'>/ "29!A!"2-3�Q9!-35,$3-3"0M��(gi��b_?]Td>j¼gal8p¸gij<`&mc�ZjKd>b ��ehgij<g4v>�iUV¢F���8GK¢�¤ON T¢�¤ ��U�¢�¤ �,¢>M

��M �Z7:5!5!-05ZA,9!/4G!U¥³ � �'*+."2$&�VU�'*5!RÖ�1M ��$&�('*WY-0/3M4; G:-05!-3/4'>D�'>5!R�-cµ=$0 <-05Q+I;J9,D#+. #)!D<-IP>-0/45!-0DD#-F'>/25! <5,Gª'>D#G:7:/2 #+.�,;¡MoML5 6\>bid>]nm&`&�8es] �E`c��b2d>j([^]FlFgib*?Id>_§ehgi] �Ob.g�m&`&�&�ces]Zv � ���c_L` ?ª�cU!�>�>�:�:',M

��M,��7>5!5!-35QA!9,/4G!U,³ � �'*+."2$&�VUZ'>5!R@�1M,��$&�('*WY-0/3MV��-3'>/45! #5!G° <56+4-3/4),/4-0+.'>A!D#-6�,q\ ¡"®WY7:/�A! #7:D<7>G: <$3'>D"2-3�Q9!-05!$3-C$3D�'*"4"4 KÕ($F'i+. <7>5VM��¥p k ��ehgies]FlFgib*?Id>_fehm&�cU �!ÒS��9!)!)!D§MV¢�Ô*G���¢ �,¤,UT�>�>�:�>AVM

m1M�� '>"4Pi'>/0UV�1M�³°9!-3"º+./4 #5VUT'>5!R�­JM�\7>D<D<-0/3M¥ �'i�B;='>/4G: #5�;@'>/2P>7�«�5!-c+LN�7:/2PQ"3M�ML5���M�m�-0$&P>-3/0U�TM(���!/49!5nUn'>5,R oM �8A�-0/4;='F?:-3/0U�-0R! #+47:/4"0U� \>bid>]nm&`&�Ees]��E`c�Zb4d>j�[^]FlFgib ?Id>_fehgi] �Ob.g�m&`&�&�ces]Zv� ���c_L` ?ª�cU��¥'>;JA!/2 <R!G>->U�  ;CUT�>�:�r��M�  ML� ��/2-3"4"0M

M&M¥��"27�$&�('*5Q+.'>/4 #R! <"0U��°M�¨%7>WY;='>5!5nU��°M��>76'>$&�! #;="0U%'*5!R �oM�;%D#+49!5VM ��9!)!)T7:/º+X«:-0$0+.7>/S;@'i²$&�, <5!-%D<-F'*/45! #5!GCWY7:/O <56+.-0/4R!-0)�-05!R!-05Q+�'*5!RS"2+4/49!$c+.9!/2-3R�7:9,+4)!9,+¥"2)('>$0-3"3M ��b.g�m&`&`O\>es]Zvi�\gal8_sr(`[^](_a`cb^]Td>_fehgi]Td>j k gi]FlF`cb.`c]nm&`Jgi]¡p�dZm&rZes]n`8tu`4d>b^](es]Zv>U��>�:�*�!M

oM,��"29!R(',M ��9,)!)�7>/2+¥«>-3$0+47:/�$3D<'>"4"2 #Õ($3'*+. #7:5@N� #+4��'>"2?Z;I;=-c+./2 <$1P*-3/25!-3DVWY9!5,$0+. #7:5VM+ML5B �M q®-3/a²D#-0?Z"4-05VU(-3R, #+.7>/3U��Ob.g�m&`&`O\>es]Zvi�o� � �� �1U()('>G:-0"C¢ �>� T¢ � ��Un¢�¤:¤>¤,M

oM¥��"49,R(',U8¨EM �,M6�Z�! <5VU%'>5!R m1M ��$&� �7:D#P>7:),WaM �T'*"2+S)!/27>+.-0 <5 $0D�'>"2"4 #Õ!$F'*+4 <7:5¹N� K+.� ;J9!DK+. #)!D<-5,-0+LNO7:/4PQ"3M ML5 � k�k ��U��>�:�ONZM

qJM��EM q�'>)!5, <P�M � _zd>_fe<�c_fehm4d>jnt¼`4d>b^](es]Zv :Vr(`&gib_�iMd;1R('*),+. K«:-E'>5!RBD<-3'>/45! #5!Go"2?Z"º+.-3;I"�WY7:/�"4 #G:5('>D),/47Z$3-3"2"4 #5!G!U($37>;=;J9,5! <$3'*+. #7:5!"3U�'>5!RB$37>5Q+4/47:D§M,·¯ <D#-0?>U(�%-cN ��7:/2PTU�¢F¤:¤ �,M

� MQ·¸-3/4AT7:"0M �8` �6gi]�\ª��`hv>b.`&�&�cehgi]�B �C` A :�g�gij �¼lFgib �Ob.`O\>ehmc_§ehgi]�d>]�\� 1]Td>j@���ce<�%es]�_sr(` �8`&r,d>b1?ehgib2d>j � mceh`c]nm&`cM �®�!­ +.�,-3"4 #"3U�¨%'>/2«*'>/2R ��5! #«>-3/2"4 #+L?>UT�¥'>;JA!/2 <R!G>->U�  ;CUu¢�¤ �*�!M

Page 114: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

¤:�

�,M�·¸-3"º+.7:5nUa��M! ¡9!PQ�!-3/'h2-3-*U �oM!���('>)T-3D#D<->U, ¸M � 7:56+. #DhUZ�°M��¼7:G:G: #7!U,'*5!R]qJM,q�'>)!5! #P�M��(-F'i+.9!/2-"2-3D#-3$0+4 <7:5ÖWY7:/��,q° ¡"3M�ML5 �,'*/.'�; �Z7:D<D<',U¥�¼7�R!R Ï��-3-05VU%'>5!R °D�'>9,"º²���7:AT-3/º+S  �9!D#D<-0/3U-0R! #+47:/4"0U� \>bid>]nm&`&�Ees]��E`c�Zb4d>j�[^]FlFgib ?Id>_fehgi] �Ob.g�m&`&�&�ces]Zv � ���c_a` ?ª�#5 �:MT  ML� ��/2-3"4"0UV�*�:�,¢:M� �%� � � ��� � � � � � � �� ����������� ���� ������������ � �� � ������������� � � ���,M

�,M©·¸-3"º+.7:5Ö'>5!RÖ�1M�·'*+.PQ <5,"3M� ¡9,D#+. ´²L$0D�'>"2"ª"49,)!)�7>/2+H«:-0$0+.7>/I;='>$&�! #5!-3"0MÖ��g*�:d>j �Cgijsj<g*A�d>�:T`&m&rZ](ehm4d>j���` �(gib^_ k � ��?�:V� ?H7� r?4{ �(Un¢�¤:¤ �,M

;ªM �n #-35�'>5,R¹�1M ��M �85!G,M);15Ö'>9,+.7>;@'*+4-3R�$37>;JA! <5!'*+. #7:5�7>W%"4-0�Z9,-35!$0-�;I7>+. KW%P*-3/25!-3D#"HWY7>/),/4-3R, <$0+4 <5!GH)!/27>+.-0 <5�"49,A�$0-3D<D#9!D�'*/�D<7Z$F'>D# <¶F'i+. <7>5VM©�¼-3$&�!5, <$F'*D ��-3)T7:/º+%�<�¥²&¢3�6�,U� �'��Z²���D�'>5!$&PML5,"2+. K+.9,+4-8WY7:/<m� #7:D<7:G> <$F'*DV�O?ZAT-3/45,-0+. #$3"0UT� �9!A, <5!G:-05VU�³°-3/2;@'>56?>U ;1)!/2 <Du�*�:�:�,M

Page 115: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

¤ �

� � � � � � ����� �

Page 116: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

� �

� � � � � � ��� �

����� � � � � � � � �

��������������������! "�#��$&%�'(��$)�! *�����#��$&+,�#�(�-+�$&+�$)+.�#����+����/�102�����43��65!��7)�!89�-3*���:5���7)$)3����#���#�(�48�����;89�!+���3<���-�=�� ($)>?'��-+�@BAC�D3�$)+�+��-EF$) ����#�F�#���D+����/�10G�����D�H�!�����I��3���EJ$&�:'�+��:�#�K�- (�-�!'�����L!�D�#�(���3���8(�#$&�! M�� �3N�6OP�#�� �+�$&�! Q����7)���#�� ?�,RTSVU�@

WX���N+����/�102�����M0Y$)7&7G$) (��5P$&�#��%�7&ZC�-�� ?��$) ?'��M�#�[��5��!7&5��Q�\�/�#�-�4�����M3��-89�!+�$]�^���_����$)+������-+�$)+�@`,�a0b��5��-�-cP�#���X�����-+�$)+�0Y$)7&7(����Ed��$) F�� F�����=�($&5���7�3��P�-'(EJ�� ?�-@eWX���������H������cf�g�-'������- "�h5!����+�$)�! F����#�($)+i��8�89�- (3�$]O�0Y$&7)7!%9�h3�$)+j�#��$)%�'(���-3�0Y$&�����#���V+����/�102������@�WX�($)+k��8�89�- �3($]Og+��-��5��-+k�#�Y�-7)����$]�/Z_�#�(��-�� ?����$&%�'(�#$&�! N���e�#�(�l+����/�10G�����m$& N�����m���! "�#�nOf�_���e�����l����$)L�$) o��7p���-+��I�����=�[�� �3N�#�d3(�f��'�EJ�� "��#�(�q$& �$&��$r��79���65P$)+�$&�! M���k�#���g+����/�10G�����g$) N�� T�����=��$]5���7s+��� �+���@

WX���DRT���=��$) (�:t��I���� �$) (LTWk�f��7)%9�aOvuwRQ�!tPW.xg+����/�102�����J�-�! "�=��$) �+lRTy�WYt�y{z|+��-��$)8(��+q�H�����'( � �$) (L:�-���!+�+};~5���7)$&3o����$)�! N�6Of89�-��$&EJ�� "�#+-@�y�'�+����{L!'�$&3��l�H�!�.�#���m�-�P3���$)+,8�����+��� ?���-3�$) N�#��$&+��8�89�- (3�$]O�@��P�!EJ��3(���=��$)7)+i�����h$) "�#�� "�#$)�� o��7)7]Z_��EJ$]���#��3��#�Y�H�f��'�+k�������- "�#$&�! l�� l���!EJEF�! �'�+���L!��@WX����$& ?���-�j�����-��+X�� �3D�!8f�#$)�� �+b�H�!�2��7)7�$&EJ89�!���#�� "�XRT�!tfW��-7)��+�+��-+Y�� (3:�H'� �����$)�! (+G�����{L!$&5��- D$& y_8(8��� �3�$]OMz_@

Page 117: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�!�

� ��� ������� ��� ������������

WX���^RT���=��$) (��t��I���� �$) (L:W �P�!7&%��IOBuwRT�!tfW.xY$)+,�d+��6�{���bRTy�WYt�y_z �-7r��+�+���+��� �3Q8����!L��#��EF+-@RQ�!tPW $)+FL!�- ����#��7,�- ���'�L!� ��� �o�� �3(7)�QEJ�� "Zv7)�-���� �$& �LB+��-�� o����$&�!+��,���a02�65!���-c,�����*��'������- "��H�P�-'�+Y$)+����-�� ��-7iEF���#�(�f3�+.�� (3NEm'�7&��$];����-�� ��-7s��7r��+�+�$��o�I����$)�! p@

z2�6�H�!���m0b�^8����P�-���-3K�#�M�� K�6O(��EF8�7)��cp$&�_$)+{ (�-�-��+�+�����ZK���D�o�I5!�FRTy�WYt�y{z u��! "D���_ ��602���=x$) (+��=��7)7)��3s@�RTy�WYt�y{z $&+b���!EJEF�-���-$)��7�+����/�10G�����{�� (3d����>?'�$)���-+b�l7)$&�-�� �+���@ey_�-��3��-EF$)�.7)$&�-�� �+���+�����X�I5���$)7r��%�7)��@$#1 4�����2�H�!7&7)�a0Y$) �L(c\0b�Y��+�+�'�EF�Y��t%#'&)(+*��!89�-�����#$& �L_+jZP+��#��E 0Y$&���-, �/.�0^+����-7&7w@

WX���gRT�!tfW +����/�10G�����{+����!'�7&3:%��,'� �8o���1���-3M$& ?�����m3($)���������!��Z�cP0Y��$&�=�d0b�_0Y$)7&79�-��7)732547698/:<;�=s@y_ "Z?0Y������� ���o���>25476787:<;�= ��8�89�I����+<$) �#��$&+<3��f��'�EF�- "�IcM$&�<+����!'�7&3 %�������8�7r���-�-3 0Y$&����#�(� �-�!���������K8o�\�#�s@ �P�#�����KRTy�WYt�y{z_c{�� �3 $) � �-�!EFEJ�� �3 0Y$& �3��a0gcm�� "�#�-�@?BADC/CDE3AF,9025476787:<;�=HG/.JI �LK:����$)+.0Y$)7&7�Ed�F���m�#�(�4RQ�!tPW +��-��$)8(��+_�-��+�$&7&ZT�I5���$)7r��%�7)�{���MRTy�WYt�y{z_@M&,�6OP�-c�- "���-�N?�OPA5QL,SRLT/U/KT�#�M+����q'�8K�#���JRQ��tfW�- "5P$)���� �EJ�� "�I@4yG�g�#��$&+�8���$) "�Ic���7)7�RT�!tfW|�-7r��+�+���+�����q���I��3fZ:�H�!�X'�+���@

� �WV XZY[��\ ]_^`�

WX���4�nO���EJ8�7&�m�nO(89�-��$)EF�- "�{0b��0Y$)7&7 89�-�j�H�!��E $)+_�d�#�����-�6;w�#$&EJ��+_����8�7)$&�I�����-3sc<��5!�n;~�H�!7&3*�-���!+�+};5���7)$&3o����$)�! u�a\O3b���5(x4� 5��-�J3�$dc��-���- "�d+������#$) (L!+J���_�#�(��e 8o������EF���#���J�����[7)$) (�I���F�/f�RCcV�! �:�#��+��l3o���=�D+����q�-�! (+�$)+j�#$& �LM���hgFi:�10b��;13($)EF�- �+�$)�! o��7 5!�������!��$)��7�$) �8('(�#+�0Y$&���[%�$) o����ZkjI;B !c� Fl7r��%���7)+-@kWX��$&+��1ZP8��X���������!+�+j;w5���7)$)3����#$&�! m�a5!���h�{8o������EJ�6�#����+��6����$) �L�$&+e�� 4�nOf������EJ��7&Zl�-�!EFEJ�� �1ZP8��m�����6Of89�-��$)EF�- "�I@Mm{�e�-�!'���+���cp�#���l�6O(��EF8�7)�q3o���#�d+��6�{$&+,+�Ed��7&7i+��d�����m�nO(89�-��$)EF�- "�_0Y$&7)7��'( B>?'�$)�1�?7]Z!c��� (3C�#�(�d����+�'�7]�#+q�I�� B%��^5P$)+�'���7)$dn-�-3p@:WX���:�nO���EJ8�7&�^�6Of8�����$&EJ�� ?�m+�����$)8f�m�-�� �I��+�$)7]Z:%9�q��3o��8(���-3M�H�!�X�������-�X8�'(��89�!+���+_�� (3T8����a5f$&3��-+.���#��EJ8(7r�����{�H�!�X'�+�����+�@

Page 118: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�iFi

WX���q�H�!7)7&� 0Y$& �L^�6O(��EF8�7)�q+��(�!'�7)3T8����a5P$)3(�m�- (�!'�L!�*$& (�H�!��Ed����$)�! :���dL!�6�{EF�!+��,'�+��-��+,+��#�������-30Y$&��� RQ�!tPW�@ WX��� �nOf8�����$)EF�- "� $&+ �H'�7&7&Z +�89�-��$d�o��3 %"Z �#��� �o7&� 25476787:<;�=PGFI5RS. � QL, .9GR��5ALO/E QDRS.7GDR��5AJO5E QDR��LG9R��5AJO/E<QDR���� Op@KWX���J�-�! "���- "�����b�#�o�\� �o7&�^$)+g����8��-���#��3 ���-���J$& $)L�;'����qyl@d �@

t����J'�+d7&�f�F� ���F�#���N�-�P3��N$) ��$)L�'����Mym@� !@ WX���T�6OP�#���-EF�-7]Z<�-�!EF8o���6�J+�$ n��T���_�#���N+�����$)8f�$) (3�$)�-���#��+^�����M�-�! "5��- �$&�- ����*���{RQ�!tfW���+F��8�7)�����H����E �H���F�����!+�+j;w5���7)$)3����#$&�! �6Of89�-��$)EF�- "�#+�@t�$) ���+�"N�� �3 bd7)�"��3*�#�������-+��q3o�\�=�:+��6�l�� �3[7r��%9�-7&+{$) "���NRTy�WYt�y{z Ed������$&�-�-+�@mzb�-L!$& � �$) (L�! C7)$) (� �fck0b�d�����-���#�^�#���F�-��7)7V�����#�IZ!c QDR/ADIDT3RDI .Pce���.RT�-3(EJ$ O�t��-���� ����l��%����-�6�#+-@ &.���#�^�#�(�8o������EF���#����$dnI����$)�! ���,�����TRT�-3�EF$]O(t��I���� �����+-@<WX���M7&�I���� ��-��+�5�����Z $& <����� e +����/�^Ed����L!$) 8o������EF���#���-@eWX�($)+h�6Of89�-��$&EJ�� "�V0Y$&7)7���'� F�I���=�:���������.���������,7&�I���� ��-��+h� 5��-�h�#���.+#��EJ�Y�#�� �3��!E+�8(7)$&��+G���i�#�(�q3����=�(cf+��4�#�(�q���-+�'�7&��+XEd�IZ:%9���-��EJ8o�����-3p@eAB���-�� sc(�H�!�X�nO(��EJ8(7)��cf�-EF8�$)��$)�-��7)7]Z+���7)�����q�d5���7)'(�l�H�!��e $) *����$)+_02�IZ!@!#~��$)+_$)EF8��!�j�=�� "�,�#�: ����#���#�����{0b�4�I�� ['�+��^�� "Z*���h�#�(�t��I���� ��-�q�-7)��+�+��-+q0Y$&�#�C�� "Z�8o������EJ�6�#���q�=�(�!$)���-+l���T���! �+j�#��'(���4�� B�6Of89�-��$)EF�- "�I@Dzb�-L!$& � �$) (L�! ^7)$& ��� gfc!0b�Y+����_���I��7)7(���g�����X�H'� ��6�#$)�� �OPA5QJ,SR9C�c?�#���,RQ��tfW �nOf8�����$)EF�- "�h3���$&5��-�-@%O A5QJ,SRDC����>?'�$)���-+,�����#��E �!%����-�6�_���-8����-+��- "�=����$)�! T���������q3o���=�fc��Jti��%9�-7&+.��%����-�6�,0Y$]�#�N�-7r��+�+Y7r��%9�-7&+-c�4�-��7)7i�����#�IZ:���et��I���� ��-�Y�!%���������+-c��� �3T�� N�!8(��$)�! o��7p7)$&+��X����8������H�����- (�-�-+�@

t����,'�+Y�6Of8�7&�!���g�#���MOPA5QL,SRDCM8o������EJ�6�#����+-@ m{ Q7&$) �� �afc������#��E �!%����-�6�_$&+Y�-�! �+j�#��'������-3T�H����#�(�,�#��+��23o���=�f@eWX�������#��E ���! �+j�#��'(���#���2$)+V�I��7)7)��3J0Y$]�#�J�����_���-+�'�7&�b���s����� ����O/E � ,SRFEF�������P3����������3�������'�7&�G �!7]Zf (�!EJ$)��7������� ���79��%����-�6�Y��7)�� �Lm0Y$&���d�#�(���-�!EF8�7)�6�#�,3o���=�lEd������$ OKu/�10Y$)���ax6@WX�������#��E �!%����-�6�l0Y$&7)7 �-�! "�=��$) K�#���43(���q8����P3�'��6�g%��6�102���- ��7&7���� 0Y+q���V�#���43����=�DEJ���#��$]O0Y$&���4$&��+��-7]�}@�WX�������6�H�!����c?���������#��E�!%���������0Y$)7&7f���! "�=��$& F� gFi�� gFi��g����EEd������$ Op@iAC�X�-�!'�7&3�o�I5!�F'�+��-3 �� ?Z[���b�����d�I5���$&7r��%�7&�����-�� ��-7h�!%����-����+q0Y$]�#�C�� "ZK���b�#����$)��8o������EF���#���g+������#$& �L!+-@y_7]�#���� o����$&5��-7&Z�c 0b�D�I�� B�-�! �+j�#��'����F�����#��E �!%����-�6���H����E �� �6Of$)+j�#$) (L����#��E�EJ���#��$]O�$) B��o7&��@eAC�q�-�� T��7)+��F'(+��gEJ���������#��E Ed������$&�-�-+G�H���XE�'�7&��$]; ���-�� ��-7�7)�-���� �$& �L�@

WX���� ��nOP� O A5QJ,SRDC:8o������EJ�6�#���-c(�� D7)$) (�- "�cf$)+2������ti��%9�-7&+G�!%��������X�#�����X8���� 5P$&3��-+G�����_�=����L!�6�7r��%���7)+_'(+��-3K���:�#�#��$) *�#�(��7)�-���� �����+�@lWX���Fti��%9�-7&+{�-�! (+��#��'������!��$)+_�I��7&7)�-3Q$) f;~8�7r�����l0Y$]�#�*�#�(�

Page 119: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�i5

����� �JI�� E/, , �ZR��5R � � ,SR R��5ALO/E QDR �JI �5.7.��FUSASQ�� C5AF,��� T R��9E3RDI���O RLT/, ADIDT��T�� � ��� A5Q7Q����� 6 �DADC C5AF,SA ALT5C QDA �PR5Q/.Q��DADC���� ��� G ��� G ��� GFC5AF,SA5GL,SRS. ,<G7Q�� T R7ADI��7C5AF,3A � ,��7,������Q��DADC���� ��� G ��� G ��� GFC5AF,SA5GL,SRS. ,<G T����/.����5Q7A �3RSQ5. � , �7,����������� I5R7AF,SR 65R/ADIDT3RDI ��� �7R�� , .QDR7ADIDTPRDIP. !#"23R9CFO$� �76SR7ADIDT3R9I��%"'& �)('*�& �+(-,.*�� � ��* �/��� �����23R9CFO$� �76SR7ADIDT3R9I��%"'& �)('*�& �+(-,.*�� � ��* ��0���� �����23R9CFO$� �76SR7ADIDT3R9I��%"'& �)('*�& �+(-,.*�� � ��* ��0�01� ,��

����� A5Q7QZR��DE3RDI2��OPRLT/, C/I���USRDIOPA5QJ,SR9C��3 ISAJO�� ��� O/E � ,SR.�54 �7Q �9T���O$�LASQ�6SRDI7T3R5Q�*WQ�� TPR/ADI�9CSAF,SA�*1Q�� TPR/ADI��DCSAF,3A1�#��* �����65A��3R5Q/.��'T����9.����5QDA �3RSQ/.#��* �����QDR/ADIDT3RDI .�* ������57 �7QLCP.��#*98.* ������ � R7RDC'��*%01���

�$&L!'����Vym@� /:�;=<�>?>A@CB�>�D EGFH>#IJLK+M/D�ENB�Jb�H�!�e�� l�6O(��EF8�7)�V�#�����-�n;~�#$&EJ��+ ���-8�7&$)�-���#��3scL��5��6;w�H�!7)3sc�-���!+�+};~5���7&$)3o����$)�! K�nOf8�����$)EF�- "�q�a5!���-ePO !c$ePO i(ck�� �3 ePO �iFi(@^WX���J+��-��$)8(�q+��6�#+l'�88o������EF���#����+h�� (3F$& "5!�D���-+��#���.RT�!tfWv�6Of89�-��$&EJ�� "�h3���$]5!�-��8(���!L!����E u OPA5QL,SRDCfx�����3����#���X���I��70b�!� ��@

Page 120: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�iDg

EJ���#��$]O^���s�-7r��+�+27)��%9�-7)+�@�WX���_�-7r��+�+27)��%9�-7P�o7)�.�-��'�7)3J�-�! "�=��$) :+���5!���#��7��-�!7&'�EF �+-cP�! ��.�H�!�b�-���=��=����L!�6�d��7r��+�+F0b�T0Y$&+�� ���B7&�I���� s@@#1 �����Q�-��+��T���{E�'(7&�#$&8�7)�D��7r��+�+���+-c OPA5QL,SRDCv�o��+F+���5��-����7+����#�����-L!$&�-+.�H�!�,��'� � �$& �L:�� Q�6Of89�-��$)EF�- "�[email protected]����3��6����'�7]�_E�'(7&�#$ ;1��7r��+�+X%����o�I5f$&�!�.$)+Y�#�:��'� Q�#�(��6Of89�-��$)EF�- "�.� 5��-�X�#�(�q��7r��+�+Y7r��%9�-7&+G$) M�I���=�Q�-��7)'�EF s@

WX��� �o o��7h�102� O A5QJ,SRDCC8o���#��EF�����-��+q�! 7&$) ���+ ��Q�� (3 �M�����J8o�����l���G�����d��8(�#$&�! �+g7)$&+��q������������ ������� 8o��$)��+-@�y, N��8(�#$&�! D o��EF��8������-��3��-+Y�#����3(�-+�$&����3N5���7&'��{�H�!�2�������!8(��$)�! s@ #1 M�!'(��6O(��EF8�7&��c 0b�:�=���P�!+��J�#�T�#�� (3��!EF7&Z[8o���j�#$]�#$)�� [�����d3����=�Q$& "�#� ��5!�d�H��7)3�+�c��#�\�#�����l�#���� B�#�(�3��6����'�7&�_�102��@lAB�F��7&+��D+�89�-��$&�/Z*�M+��-��3��H�!�,�#���^�#�� �3��!E P'(E�%�����L!�- (�-�#�\�#�!��cs�#�DEJ�F���4�#�(��6Of89�-��$)EF�- "�m3(���#����EF$) �$&+���$)�Nu����-89�I���#��%�7&�ax6@[m_�����-�q�!8(��$)�! �+q�����d�I5���$&7r��%�7&��ck��+q3��-+��-��$)%9�-3 $& �f�����#$&�! Mym@ a(@

&,�a0gc 02�e0Y$&7)7���'� ��#�(���6Of8�����$&EJ�� ?�-@ $)��+j�Ica�� ?���-�)? �JC ��� GLI5RS. � QJ, .9G9R��5AJO/E<QDRS.9GDR��5AJO5E<QDR��LGFK�#�KEF�a5!�:$& "�#�*�#�(�:�-�!���������^3�$&���-�6�#�!�jZ!@[WX���� scb�� "�#�-� ? R��5AJO/E Q9R�� KK�#�K�nO(���-'(���D�#���D+��-��$&8(�I@WX���Y5�����$&�!'�+�+�����$&8(�#+V�� �3F8����!L!�#��EJ+e0Y$&7)7�L!�� ��-�����#�.3�$)��L! ��!+j�#$&�G�!'(��8�'(�h�#�o�\�V0Y$&7)7f+��-���!7)7o�� ?����#�(���-�!EFEJ�� �3Q0Y$& �3��a0g@{A����- *����$)+_+��#��8�+_�#�(��8�����L!�#��E 0Y$&7)7k$) �3�$&�I�����q�����4�!'(���-�!EF���� �3�-7)��8�+��-3M�#$)EF��@�WX���l�nOf8�����$)EF�- "�Y+����!'�7&3T���!EJ8(7)������+�'����-��+�+��H'(7)7&Z�@

WX���{8(��$) (�-$)8���7��!'(�#8('(�G��� OPA5QJ,SR9CJ$)+b�m3�$&���-�6�#�!�jZ^�#�����{���i���-+�'(7&�#+�@�WX���{$& ?���-���-+���$) �L �o7)��+G��������G������7)�-���r;17&��5��-79���i�#���{�����-��@�WX����$) "���-�� ���7s ��P3��-+X+��-L!EF�- "�G�������6Of89�-��$)EF�- "�.���-���!��3($) �Lm���+��65!���#��7�5�����$)��%�7)��+-c!�a5��-�h0Y��$)�=� O A5QJ,SRDC4$&�#���#�����-+�@h�f$) (�-� OPASQJ,SRDC4$)+����-�-�a5��-�#��%�7)��c(�� (3J�nO(89�-�};$)EF�- "��+{�����m�6OP���- �+�$)%�7&��c�������3�$&�������#����ZM�#���-�4��7]0G�IZP+{�o��+,�#�(��+#��EF�m+j�#��'�����'�����@��.�n;1+j�=���j�#$) (L�� ^�6Of89�-��$)EF�- "�h�!���=�o�� (L!$) �Lg���-���#��$) ^8o���#��EF�����-��+�$&+��o�� �3(7)�-3^L!�����-�6�H'�7)7]Z!@kA����- F3�$)+��-'�+�+�$& �L�#�(� ��7)�-+jZP+��#��ETc�������0Y$)7&3��I����3M�=�o���#�����#���lu���xGEd�����=���-+.�� "ZD+��->?'��� ��-�������=�o���#���6�#�-��+-@

AC�_�I�� d�#��+��2�H���2����+�'�7]�#+b$) d+���5��-�#��7�02�aZP+�@ #1 J�#���,�-'������- "�X3($)���������!��Z�cP�������o7&�-+-?9�7ISAJO ��OPAD,/K�� �3 ?WQDA �PR5Q/. ��O AF,/K[+�����'�7)3C�o�I5!�:%9�-�� �-���I�����-3s@NWX���-+��D�����:RTy�WYt�y_z ���-8(���-+��- "�=�\�#$)�� �+���,�!%��������#+^���! "�=��$& �$) �LT�#���M3o���#�K�� �3v7r��%9�-7&+-@�y +��6�J���,3($)���������!��$&�-+-c�0Y$]�#�< o��EF�-+4���.�#�(��H�!��E ? I5RLE<Q�� �FAF,��� T �JKC+����!'�7&3 �o�I5��T%9�-�� �-���I�����-3s@ Sh���=� ���,�#����+��N+�����'�7)3 �-�! "�=��$) v�

Page 121: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�iFa

3�$&���-�6�#�!�jZ:�H�!�Y�I���=�T�=����L!�6�,��7r��+�+-co�H�!�X�#�($)+Y�6O(��EF8�7)��c ? �9QDA3.7. �"@ K y_7&+���c������-���l+����!'�7&3T%9�q��o7&� ? .FALO/E QDRS. ��OPAF,/Km�#�o�\�h�-�! "�=��$) �+V���#�� (3��!E +���EJ8(7)$) (L{����$) �3�$&�-��+�$) "�#���#�(�.3����=�(@ #1 J�-���=��-7)��+�+23�$)���-�����!��Z�cf�����-����+����!'(7)3D%9��� ?�O$�9./.#� T�� 0 � KF3($)���������!��Zd�� �3D'� (3��-�2���o���Y��3($)���������!��Z�H�!�l�I���=� ���Y����� ��5��:�H�!7)3(+-c ?9� �7QLC �P@ K #1 �����d�H�!7&3B3�$&���-�6�#�!��$)��+������:3�$)���-�6�#�!��$)�-+q�H�!�m�-���=�7)�-���� ($) �LB��7)L!����$&����ENcG$) ����$)+d�6O(��EF8�7)��c ?�2PRDCFO$� ��4 �5. !����5R/�#!�� � !��P@ K �$& o��7&7&Z!c2$) �#�(�7)�-���� (�-�.3�$)���-�����!��$&�-+,�����g�#�(� �o7&�-+ ?W.J,SAF,SR � OPAF,/K�ch? ,/I5A1� T ��OPAF,/K�c��� �3 ? ,SRS.J, ��OPAF,�@ K WX����+��7)�-���r;17&��5��-77�o7)��+e�-�! "�#��$) ������G+��#���#�X���o�#���2���#��$& ��-347&�I���� �$) (L{��7&L!�!��$]�#��E �� �3��#���2�-7r��+�+�$��o�I�\�#$)�� ����+�'�7]�.�! D�#�#��$) �$& �L^�� �3D�#��+���$) �L^3o���#�(co����+�89�-�6�#$&5��-7]Z!@

WX������� $)+C'�+�'���7)7]Z �� ��-��3 �#� 5��-��$&�/Z�#��� ���!EF8�7)�6�#� ������� ���M����+�'�7]�#+�@ #1 �������-cd$]�B$&+ ����JEF�I�� "�F�#�B%9�N�P'(Ed�� ���-��3o��%�7&��@ AC�T5P$)�60��#�(�Q����+�'�7]�d������ �6Of8�����$&EJ�� ?�J0Y$&��� �#�(�. � O/OPADI����SRF=SRS. � QJ, .M+�����$&8(�I@h#1 Q�����m��'������- "��3�$&���-�6�#�!�jZM$) N�#����RTy�WYt�y{z ���!EJEJ�� �3N0Y$) f;3��a0gc(�� "�#�-� ? . � O7OPADI����5RF=SRS. � QJ, .7K4�� �3J�#���,+��-��$)8(�b0Y$)7&7oL!�- ����#�������q�#��%�7&�_����+��-�!���-+2�H���b�#�(�3�$�cp�����- "�q7)�-���� (�-��+�@ #1 [�#�($)+g�6O(��EF8�7)��cs02�F+����J�� ��J���a0 ���bEJ�-�� ��m��yh(��+��-�����-+g0Y$&����! ��g���!7)'�EF D�H�!�Y�I���=�T+��6���#$& �LF���������g���-L�'�7r����$ n-���#$&�! D8o������EJ�6�#���-c e^@bWX����+��l+��-�����-+.�I�� Q%9��-��EJ8o�����-3D���J�65���7)'o����������7r����$&5!��89�-�j�H�!��EJ�� �����@

WX���X+j�=����$)+���$)�-��7(+�$)L! �$��o�I�� ��-�G���9�����G���-+�'(7&�h�I�� 4%��X���!EJ8('(�#��3�0Y$&�#�������M.#���9T3RDC9=SAFT�^+��-��$&8(�I@S� "�#�-� ?W.����DT3RDC7=SALT�/KC�#�K���!EF8�'(�#�:�*�! ��6;~+�$&3��-3 A�$&7)�-�IOf�! +�$)L! ���3f;1���� 3��+��#���#$&+��#$&�J�H�!����7)78o��$&��+X��� 7)�-���� (�-��+Y$& M�����g�6Of89�-��$&EJ�� "�I@�WX���q+�$&L! �$d���I�� ����{�#�����-+����!7)3N$)+hi� i9bP@

RT�!���m�nO���EJ8�7&�g8����!L��#��EF+.�����l$) ���7)'�3���3T$& T������RT�!tfW +����/�10G�����m3($)+�����$&%�'(�#$&�! sc���7&�! �L40Y$&����������-�g3��P�-'�EF�- "�#���#$&�! s@^WX���!+��J�nO���EJ8�7&�-+g$)7&7)'�+j�#�����#��+��!EF�F���2�#�(�FEF�!���J��3(5��� ��-��3 RQ��tfW�H�I�\�#'����-+-@^WX���^�H�!7&7)�a0Y$) �LJ+������#$&�! �+q���V�#��$&+g��8�89�- �3�$ OK8����a5f$&3��^EJ�����43��6�=��$&7e����L"����3($) �LD�#�(�+�����$&8(�#+Y'�+��-3Q$& D�#��$&+X�6O(��EF8�7)��@

Page 122: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�iL"

� ��� \ �-^`�����

WX���:RQ�!tfW �nOf8�����$)EF�- "�m3���$]5!�-��c%OPA5QJ,3RDC�c�$)+q'�+��-3 �#�T��'� C�-���!+�+};~5���7)$&3o����$)�! [�6Of89�-��$)EF�- "�#+�@#1 d�f�-�6�#$)�� Fyl@ gPcLO A5QJ,SRDC4$)+e�-��7)7&�-3��H����E|�#�(�.�nOf8�����$)EF�- "�h+��-��$&8(�Ic5R��5AJO5E QDR���� OpcP0Y$&�#�F��8(8�����;8���$r�����_����L!'�EF�- "�#+b�#����'� d�#�(��a\O3b���5J�6Of89�-��$)EF�- "�I@h`.�-����cf0b��3�$)+��-'�+�+X��7&79�����#��������L!'�EF�- "��+�H�!� OPA5QJ,3RDC�@

F���� J)>���� ��� ����������������������������� �!���#" $&%('*)+��%-,.�/ ��� ;b� ���#��E �!%����-�6�d���4�-�-7&7Y�������IZ ���,3��-+�$)����3 L��#��E ��7)�- ���EJ��+-@<WX��� �o7&�-+

+����!'�7&3�%9���=��%f;13���7)$&EJ$]�#�-3N�#�nOf�g0Y$]�#�K�#��� �o��+��g��� 0��-�! "�#��$) �$& �LD�-��7)'�EF o��EJ��+4�� �3 ����� �o��+��4���!7)'�EF ���! "�=��$& �$) �LQ���a0 o��EF�-+-@ m_�#�(�-���� ?����$&�-+E�'(+��Y%9�q ?'�EF�-��$)��@

� ��0 � �21 ;b�^ti��%9�-7)+X��%����-�6�,���.+j�#��$) �L4���! "�=��$& �$) �L4�����g7r��%9�-7&+ �o7)�� o��EF��@� � ��/ � �3/41 ;b�4�-��7)7������#�IZD���et��I���� ����.��%����-�6�#+5�687:9<;=137 ;b�47)$&+��X����&.y�RQSXc f�y_t$(,S �!8(�#$&�! D8o��$&��+

"�$&%+'*)+��%3>? AC�!� �PU{$&� ? ;V3�$&�������#����Zd�H���X�!'(�#8('(�h�o7)��+muH3�������'�7&� O ? @ ? x

? o�!7)3(+ ? ;V ?'�E�%9�-�Y���k�H�!7&3�+qu�3��6����'�7]��O g!x? �.��8�7)$&�I����$)�! �+ ? ;b�����#�IZ:���e����8�7)$&�I����$)�! (+b�#�F��'( BuH3�������'�7&� OA@ !c gfc aCB/x

? �27)��+�+��-+ ? ;V���-7)7s�������aZ:������7r��+�+Y o��EF�-+qu�3(������'�7]��O���7&7p�-��7)'�EF �+X$) � ��0 � �21 x? RT$&+�+�$& �L ? ;V+j�#��'(���.0Y$&�#�M89�-���-�- "�_EJ$&+�+�$& �L�c5���-�� ��-7k$) (3�$)���-+-c��� �3N�1ZP89�l�����CDF �$]�1ZD%��n;

�10b�-�� dEF$)+�+�$) �L��nO(��EJ8(7)�-+,uH3�������'(7&��O{+j�#��'(��� u ? 89�-���-�� ?� ? c5i(c ? �P$ O ? cE@ Bwc ? �CDF f;$]�1Z ? c3K?x�x

? �f$ n�� ? ;V+�$ n-�g��� �#�� �3��!E +#��EF8�7)�{�H���!E 3����=�^+��6��uH3�������'�7&� O�+�$ n������ �H'(7)7s3o�\�=�4+��6�nx? RT�P3�� ? ;V�! (� ��� j ? m{ �� f{+�y,7)7 ? c ? m{ ��`f_+=�(��EJ8�7&� ? c ? ��$)�j0Y$)+�� ? l u�3��n;

����'(7&��O ? m{ ��`f_+�y_7&7 ? x? �f���-3 ? ;V���� �3��!E�+��-��3 �(L�$&5!�� F5���7&'��X�!�h�-7&�f�1�l$&�95���7)'��Y$&+F@GB uH3�������'(7&��O{'� (�=�o�� �L!��3�x

Page 123: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�iDb

OPA5QL,SRDCd�����-���#��+Y�m��$)���#�����=�"Zd���k3�$&�������#����$)��+2���! "�=��$& �$) �Lq�#���_���-+�'�7&��+G���������{+�89�-��$d�o��3 �!;~�H�!7&3�-���!+�+};~5���7&$)3o����$)�! Q�6Of8�����$&EJ�� ?�-@ �.�6�H�-���#�M�nO���EJ8�7&�-+�$& [�����-25476787:<;�=PGFI5RS. � QL, .9GK3($)���������!��Z�H�!�Y���6�#'o��7�'�+#��L��q��� 5�����$)�!'�+Y����L!'�EF�- "��+-@

� ��� ���_\ \ �-� ��)��� ����_^`���

WX��� . � O7OPA9I����5RF=3RS. � QJ,<.�+��-��$&8(�4���!EJ8('(�#��+4��L!L!���-L"�\�#�F���-+�'�7&��+m�H�!��O A5QJ,SRDCB�6Of89�-��$)EF�- "�#+�@y +��-�����J�1ZP89�d�-�� %9�J+��-7)�������-3s@NWX���d3(������'�7]�q$)+g�#���J�����-�T'� (3��-�q�#���J���-���-$]5!�-�l�!89�-�#�\�#$) (L�=�o�����������-��$)+���$)�M�-'(��5!� u ��m�� yh( �Xx6@Vy EJ�-�� +��-�!���T$&+J���!EF8�'(�#��3 �a5��-�J�����N���-8(7)$)�-���#$&�! �+�� �3:�H��7)3�+V�H�!�2�-���=�M7)�I���� ����-cP�-7r��+�+-c��� �3D89�-�����- "�#$&7)�,���iEJ$&+�+�$) �Ll3o���=�f@�WX����EJ�-�� :+��-�!���-+Y�����8���$) "�#��3*$) K�F�=��%�7&��c��� �3[�d+j�#��'����g�����#�IZT$)+.���6�#'��� ��-3K0Y$&��� �o��7)3�+.�H�!�,������EF�I�� sc�+��#�� �3o����3�-�����!��c��� �3M+#��EJ8�7&��+�$dn-���H�!�X�I���=�N�#��%�7)���� "�#��Z�@

. � O/OPADI����SRF=SRS. � QJ, .F�#�#�I5��-��+��-+,����$)���#�����=�"ZD���k3�$)���-�6�#�!��$)�-+2�-�! "�=��$) �$& �Lm�#�(�����-+�'�7&��+X�-���I�����-3%"Z OPA5QJ,SR9C �i$&�,$)+.5!����ZQ���!7)���#�� "�,���h$) (�-�!EF8�7)�6�#�q����+�'�7]�#+��� (3[�������-EF8(�#+.�#�:�����#'(�� [��+,E�'��=�EF�I�� �$& �L��H'�7i$& (�H�!��EJ����$)�! T��+{89�!+�+�$)%�7&��@{WX�(�4'�+������I�� K���-+�����$&���{������3�$&���-�6�#�!��$)��+_�-�� �+�$&3��-���-3$) D�����g�-�!EF8�'(�#���#$&�! :0Y$&���N��8(�#$&�! o��7�8o���#��EJ�6�#�-��+-@

��%��8% �� K ��F F��1D�E��A>�� >#K �<� J�K�� "�$&%('*)+� %+,

5�687�9 ;=137 ;b�47&$)+��G����&.y�RQSXc f�y_t%(_S �!8(��$)�! D8o��$)��+

Page 124: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�i��

"�$&%+'*)+��%3>? AC�!� �PU{$&� ? ;V3�$&�������#����Zd�H���G02�!� ���o7)��+qu�3��6����'�7]��O ? @ ? x? m{'(� $)7)� ? ;V o��EJ�{�H�!�X��'(�#8�'f�+��7)�Fu�3(������'�7]��O{+���3��!'(�=x

? �.��8�7)$&�I����$)�! �+ ? ;b�����#�IZ:���e����8�7)$&�I����$)�! (+b�#�F��'( BuH3�������'�7&� OA@ D� g5� aCB/x? �27)��+�+��-+ ? ;V���-7)7s�������aZ:������7r��+�+���+Y���J��'� j ? ��7r��+�+� ? � ? �-7)��+�+ a ? lDuH3�������'(7&��O���7&7p��7r��+�+��-+#x

? �-���-�� ?��$)7&�-+ ? ;b�����#�IZ:���e89�-�����- "�#$&7)��+X����EF$)+�+�$& �L43o���#�^���F��'� : @ �iS� bFiCBVuH3�������'(7&��O @ iCBrx? �f�-����� ? ;h�1ZP89�_���p+��-�����,���m���!EJ8('(�#� :��! ��,���j ? WX8 ? c ? WX ? c ? �8 ? c ? � ? c ? y,�-�-'(�#���6Z ? c

? �f�- (+�$&��$&5P$&�1Z ? c ? �f8����-$��o�-$]�1Z ? c ? �.�P�-y,'�� ? lMuH3�������'(7&��O ? �.�P�-y,'�� ? x? o�!��Ed��� ? ;h�1ZP89�q�����!'f�#8�'(� :h�! ��g��� j ? W ��%�'�7)��� ? c ? `,W.RQt ? lMuH3�������'(7&��O ? W���%�'�7r��� ? x

? �2�!EF8o����� ? ;b��8(8��� �3*��3(3�$&��$)�! o��7��-�!7&'�EJ (+Y0Y$]�#�T3�$dc��-���- ����m%9���10b�-�- K+��-�!���m���!7)'�EF �+�@m{ ��g�-��7)'�EF :�H�!�X�I���=�Q���a0 $) D+�89�-��$d�o��� : @ !c a5�d !c "�BbuH3�������'(7&��O @ B/x

� ��� ��`� ���M� � �����

WX����.#���DTPRDC9=SALT��*+��-��$)8(�{�-�!EF8�'(���-+_������+��#���#$&+���$)�I��7 +�$)L! �$��o�I�� ��-�����O A5QJ,SRDCQ�6Of89�-��$)EF�- "�#+�@y +��-�����J�1ZP89�d�-�� %9�J+��-7)�������-3s@NWX���d3(������'�7]�q$)+g�#���J�����-�T'� (3��-�q�#���J���-���-$]5!�-�l�!89�-�#�\�#$) (L�=�o�����������-��$)+���$)�M�-'(��5!� u ��m�� yh(��Xx6@hy,7)7X+����!����+F�H���F�-���=� 7&�I���� ��-��c2��7r��+�+-cG�� �3 89�-���-�� ?��$)7&����_EJ$&+�+�$& �LK3o���#�C�����M'�+���3 $& <�����N�-�!EF8o����$)+��� s@<WX���NA�$&7)���aOf�! <�! (�6;1+�$)3���3 +�$)L! (�-3 ���� 3�� ;w5���7)'���+������d8���$) "�#��3 $) �N�=��%�7&��c��� �3<�QEJ���#��$]O�$)+l���6�#'��� ��-3 0Y$]�#�B����� � ;w5���7)'��^�H�!�m�-���=��=��%�7)�.�- "�#�jZ!@�WX���,+�$&L! �$d���I�� ����.��������+�����7)3d$&+ i� i9bq�� �3J$) �+�$)L! �$��o�I�� ?�V���-+�'(7&�#+b�����_3���+�$)L� o���#��3%"Z ? �����DKJ$& M�������=��%(7)��@

.#���9T3RDC9=SAFT� �#�#�I5��-��+��-+K�<��$&�-�#�����=�"Z ���43�$&���-�6�#�!��$)��+N���! "�=��$& �$) (Lv�����C���-+�'�7&��+T�����I�\�#�-3 %?ZOPA5QL,SRDC �h$&�q$)+g ����q�#��7)�-���� "�q���X$) (�-�!EF8�7)�6�#�4���-+�'(7&�#+�@M`,�a0b��5!���-ce�����d'�+��-�q�I�� B���-+j�#��$)���q�#�(�3�$&���-�6�#�!��$)��+X�-�! �+�$)3�������3T$& M�����g�-�!EF8�'(�#���#$&�! :0Y$&���T��8(�#$&�! o��7�8o���#��EJ�6�#�-��+-@

��%��8% �� K+E��2I�>�� � � I��&� "�$&%+'*)+��%+,

5�687�9 ;=137 ;b�47&$)+��G����&.y�RQSXc f�y_t%(_S �!8(��$)�! D8o��$)��+

Page 125: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�i��

"�$&%+'*)+��%3>? AC�!� �PU{$&� ? ;V3�$&�������#����Zd�H���G02�!� ���o7)��+qu�3��6����'�7]��O ? @ ? x? m{'(� $)7)� ? ;V o��EJ�{�H�!�X��'(�#8�'f�+��7)�Fu�3(������'�7]��O{+���3��!'(�=x

? �.��8�7)$&�I����$)�! �+ ? ;b�����#�IZ:���e����8�7)$&�I����$)�! (+b�#�F��'( BuH3�������'�7&� OA@ D� g5� aCB/x? �27)��+�+��-+ ? ;V���-7)7s�������aZ:������7r��+�+���+Y���J��'� j ? ��7r��+�+� ? � ? �-7)��+�+ a ? lDuH3�������'(7&��O���7&7p��7r��+�+��-+#x

? �-���-�� ?��$)7&�-+ ? ;b�����#�IZ:���e89�-�����- "�#$&7)��+G�#�F��'� :F@ �iS� bFiCBhu�3��6����'�7&� O @ iCBrx? �f�-����� ? ;h�1ZP89�_���p+��-�����,���m���!EJ8('(�#� :��! ��,���j ? WX8 ? c ? WX ? c ? �8 ? c ? � ? c ? y,�-�-'(�#���6Z ? c

? �f�- (+�$&��$&5P$&�1Z ? c ? �f8����-$��o�-$]�1Z ? c ? �.�P�-y,'�� ? lMuH3�������'(7&��O ? �.�P�-y,'�� ? x

Page 126: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�i��

� � � ��� � � �

��� � � ��� ��� ���

WX���YRT���=��$) (�Xt��I���� �$) �L,W �P�!7&%��IOduwRT�!tfW.x +����/�102�����G���! "�=��$& �+�RNy�WYtiy_z �-7)��+�+��-+e�H�!�k�-���I���j;$) (L{�� �34���!E�%�$& �$) (L)���-�� (�-7)+�c!�#����$) �$& �L.�-7r��+�+�$��o�-��+-c!8(���-3($)����$)�! pc!�� �34�����!+�+j;w5���7)$)3����#$&�! g�6Of8�����$ ;EF�- "�#+�@�WX���h�-�P3��h$)+�3(�-+�����$&%���3l%9�-7&� 0C$) q��7&8��o��%9����$)�-��7�����3����-@ o�!�pEJ�!+j�i'�+�����+�c�y_8(8��� �3�$]O�y0Y$)7&7�%9�4+�' DF��$)�- "�q�#�M3���EJ�! (+��#�����#�4�(� 0|�#�M��'( ������!+�+j;w5���7)$)3����#$&�! *�6Of89�-��$)EF�- "�#+�@4WX��$)+q��8f;89�- �3�$ O4$&+�8����a5P$)3���3^8���$&Ed����$)7]Z��H�!�e�#����+��G0Y���g0Y$)+��^���g�6OP�#�� �3F�����,RQ�!tPW $&EJ8�7&�-EF�- "�=�\�#$)�� s@

� ��� � � ��\

�27r��+�+4�H�!� ���#��E Ed������$ O �!%����-����+4�#��%��D'�+��-3 %?Z �����D7)�-���� ($) �L[��7&L!�!��$&�#�(EJ+�@BWX��� ���#��E�!%��������l�-�! "�#��$) �+�� ���#��E Ed�\�#��$&�-��+-ci+��N$&�q�I�� C%9�J'(+��-3C$) �E�'�7]�#$]; ������ ���7e7)�-���� �$& �LN��8�8�7&$];�I�\�#$)�� �+-@:y �H'�7&7 �g����E Ed�\�#��$ OKE�'(+��l%��J+�ZPEJEF������$&��ci8���+�$&��$&5��J+��-EF$)3�� �o �$&���F�� �3B���! "�=��$& �-��������+�89�! �3�$& �L��� ?����$&�-+X��7&�! �Ll���a0Y+X�� �3D���!7)'(EJ �+�@� ������#$)��7 �g����E Ed�\�#��$&�-��+G�����_���/���- D'�+��-3�H�!�{��7r��+�+�$��o�I����$)�! pcp��@ L�@]c��! ��4��� 0�H�!�,�I���=�[�#��+��g�6O(��EF8�7&�4�� �3[�! ��m�-�!7&'�EJ *�H���{�I���=�K���#��$& �6O(��EF8�7&��@�WX��� �g����E ��%����-�6�_��7)+��^�o�� �3�7)��+G�#��$&+Y�I��+���@

Page 127: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�i��

��������� � ��� ����������������������

���#��E ��7r��+�+J���! �+j�#��'(���#���-@��f�65!���#��7Y5�����$)�� "�#+^�����T8����a5f$&3��-3v�H�!�^3�$dc��-���- "�F�1Zf89�-+F���_$) �8�'f�����L!'�EF�- "�#+�@

�C��� "! D � F ��,

�C��� "! D � F �� �����$# �&%�� " $&%('*)+��%-,.�/ ���(' 0*) ; �g����E �!%����-���5�687�9<;=137 ;V7)$)+j�X���&,y{RQSXc f y{t%(_S �!8f�#$)�� D8o��$)��+

�C��� "! D � F �� �����,+ �8%+��).-C� ��� "�$&%('*)+� %+,.�/ ���0/ ��7 /�;21��1 ;2RT���#��$]OD��� �43 �65 ���#��E Ed�\�#��$&�-��+qu23 �75 � �[x

5�687�9 ;=137 ;V7&$)+j�X���&,y�RTSYc f y{t%(_S �!8(��$)�! D8���$)��+

�C��� "! D � F �� �����98 )+����� � " $&%('*)+��%-,.�/ ���0:&; � ��1 ;V�-��7)7f�������aZq����3��-+�$)����34L!�#��E ��7)�- ���EJ��+-@kWX��� �o7&�-+ E�'�+��e%��V�=��%f;~3��-7&$)EF$&���-3

�#�nOf�i0Y$]�#���#��������+��k��� 0B�-�! "�#��$) �$& �LX�-��7)'�EF � o��EF�-+i�� (3q�������o��+j�k�-�!7&'�EJ �-�! "�#��$) �$& �L4���a0 o��EF�-+-@ m_�#�(�-�X�- "����$)��+,Em'�+��Y%9�g P'(EJ����$)��@

5�687�9<;=137 ;V7)$&+��X���&,y{RQSXc f y{t%(,S���8(�#$&�! D8o��$&��+

"�$&%+'*)+��%3>? �.�a0Y+ ? ;2$& �3�$&�-�-+X������� 0Y+X���J+��-7)�����? �2��7)+ ? ;2$& �3�$&�-�-+X�������!7)'�EF �+G���F+��-7&�-���?<; ����� ? ;2$& �3�$&�-�-+X������� 0Y+.=��-��7)+X�#� n-�����

? y_8�89�- �3 ? ;2y�u23 �>5 �@?Vx,EJ���#��$]OT��� ���#��E EJ���#��$)�-��+,���M��8�89�- �3*���:�#��� ���#��E��%����-�6�I@hWX���g ���0 �!%����-�6�Y0Y$)7)7��o�I5!���BAC? Ed�\�#��$&�-��+-@

.�/ ��� O��g����E*uH�-�!EF8�'(���"u� �!7]Zf (�!EJ$)��7������� ���7wc�DicED�x�xq0Y$)7&7V���! �+j�#��'(���F�����#��E��!%����-���m�H���!E�#�(�q3����=�4EJ���#��$]O�cFDico'�+�$) �LJ�47)$& ��I��� ���-�� ��-7 @

Page 128: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

D i

��������� ��� �

�����Y�-7)��+�+.�����#��$)%�'(���-+�@

� ����� � ��>AJ��� �����$# �&%�� ��� � ��,.�/ ���(' 0*) ; �g����E �!%����-���

������� ;h�#���g o��EF����� �#���g3���+�$)���-3T��������$&%�'(�#������ � >? �.�a0+&_��EJ��+ ? ;V���a0 o��EF�-+X$) M���-7)7i�����#�IZd���e+j�#��$& �L!+? �2�!7 &_��EF�-+ ? ;V�-��7)'�EF D o��EF�-+Y$) M���-7)7s�������aZ:����+j�#��$) �L!+

�������� �� � �

�Y���#'(�� �#�(� � 3�$r��L!�! o��7&+g���X�#��� �g����E��!%��������4$& � u23 � �[xlEJ������$]O�@NWX���:3�$)��L!�! ���7)+0Y$)7&72%9�D�=�F���- <�H���!E �#���M+�>?'o�����MEd�\�#��$ OB0Y$]�#�<�-���� ����J�\�^7)�a02���^��$)L��?�4�� �3<+�$dn-�M�->?'o��7G����#�(�* ?'�E�%9�-�:���g���a0Y+-@ WX��$&+:$)+J'�+��6�H'�7,�H�!�F�#���Q�I��+��K$) 0Y�($)�=� �#�(� �g����E Ed�\�#��$&�-��+:����� ����^���!EF8�7)�6�#�[uH+�>?'o�����ax6@BWX��$)+^��+�+�'�EF�-+4�����D+�>?'o�����D�#�-+j��;w�#�-+j� ���-�� ��-7X�� "�#��$&�-+F�����:$) �#�(���$&L!�"�#EF�!+��l�-��7)'�EF �+q���X�#���JEd�\�#��$ O�@NA����� �#���JEd�\�#��$ O�$)+q�-�!EF8�7&���#��c ����$)+l+��#�����#��L�ZB��7)+��0b�!� �?+-@

� ��E:� �<�� �����$# �&% ,.�/ ���(' 0*) ; �g����E �!%����-���

��������� ������ ���������

&,����EJ��7)$dn-�Y�#���{L��#��E EJ���#��$)�-��+2+����#���_�H�-���#'(���-+X7&$)�.�! :�#�(�{+�'��j�����-�_��� �m'� �$]�G�"ZP8�����+�8(���-����c�� u D����"x O ���! #" $&%' ���! #" (%)���*$+" $�%

@dA����� C����� ���#��E Ed�\�#��$&�-��+l�����F ����g�H'�7)7 ci$w@ ��@]ci�����F3�$r��L��! o��7&+�3�� ����Y���! "�=��$& Q��7)7 � u D��&D�xG�!� � u,�-���"xX�- "����$)��+-c������g3�$r��L��! o��7&+GE�'�+j�,%9��8���� 5P$&3��-3N$) 5�687�9 ;=137 @

Page 129: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

D F

�C��� I���D�F����GE �A>E�� �����$# �&%��#"�$&%+'*)+��%+,.�/ ���(' 0*) ; �g����E �!%����-���5�687�9<;=137 ;V7)$)+j�X���&,y{RQSXc f y{t%(_S �!8f�#$)�� D8o��$)��+

"�$&%+'*)+��%3>? U{$r��L3 ? ;bU{$)��L!�! o��7��- "�#��$)��+2��+�+��P�-$)���#��3J0Y$&��� ����+��b3�$&EJ�� �+�$&�! 4�H�!� � �g����E EJ���#��$];

���-+.$) N�Nu23 � �[x2Ed������$ Op@? U{$r��L7g ? ;bU{$)��L!�! o��7(�- "����$)��+V��+�+��f��$r�����-340Y$&���F+��-���! �3d3($)EF�- �+�$)�! ��H�!� � ���#��E|Ed�\;

����$)���-+Y$) N�Nu*5 � �[xGEJ���#��$]O�@

��������� ������� ��� �

t�$) ��-����7]ZM�-�!Em%�$) ��g�#�(�mL!����E Ed������$&�-�-+�@h#~�h ��J0b�-$&L!�"�#+������mL!$]5!�� scp�� *'� "02��$)L!�"���-3K�-��E�%�$]; o����$)�! D$&+Y�-�!EF8�'(���-3s@

�C��� M��F���E I�>E�� �C���$# �.%�� "�$ %('*)+��%-,.�/ ���(' 0*) ; �g����E �!%����-���5�687�9<;=137 ;V7)$)+j�X���&,y{RQSXc f y{t%(_S �!8f�#$)�� D8o��$)��+

"�$&%+'*)+��%3>? AB��$)L!�"�#+ ? ; fh�-�6�#�!�,��� � 02��$)L!�"��+_�H�!�.7)$) (�I���.�-�!Em%�$) o�\�#$)�� s@YW �:L�'o���#�� ?���-�l8��!+�$&��$&5!�

+���EJ$&3��`�o ($&�#�� ��-+�+-ck ��! f;~ ��-L!���#$]5!��0b�-$)L��?��+g�I�� �%��4'(+��-3p@Jy,7&�#���� o�\�#$&5��-7]Z!c02��$)L!�"��+.�-�� N%��g3��6�#�-��EJ$& ��-3M'�+�$) �LJ�(U� k@

? ���-�� (�-7)+ ? ;Vy 89�-��E�'(�#���#$&�! ��� � ���o���J$) �3($)�I�\�#�-+^�#�(�TEJ��8�8�$& �L����{0b�-$)L��?��+J��������� ���7)+-@

Page 130: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

D �g

� �WV � �M� ���M^

��� � ��� � � �� � �

y %o��+��4�-7)��+�+_'�8��� *0Y��$)�=�[�-7)��+�+��-+{�H�!�.5�����$&�!'�+M���-�� (�-7��H'� (���#$&�! �+�������$&EJ8�7&�-EF�- "�#��3s@ �2'��};���� "�#7&Z�cX�#�������*$&+: ��B�H'� (���#$&�! o��7&$&�1Z<$& �#���Q%o��+��Q�-7r��+�+-@ #~�:�! �7&Zv3�� �o ���+:�#���K$& ����-��$&�#�� ��-���$&�-�#�����=�"Z!@hWX��� �g����E ��%����-�6�,$&+Y'�+���3N�H�!�����#��E�Ed�\�#��$&�-��+X�� �3N$)+Y�4EF�!����L!�� ��-����7s02�aZD���8���� 5P$&3��q� ���-�� ��-7��#�J�47)�-���� �$& �L^��7&L!�!��$]�#��EN@

��� � ��� � � ��� ��� � ������� � �� � �

WX���g����EF$)7&ZF��� 89�!7&ZP ��!EF$r��7H���-�� (�-7)+ � u D����"x�O�u�� D� � A�6x �b$)+X$&EJ8�7&�-EF�- "�#��3D%"Z:�#��$&+Y�-7r��+�+-@

������������� � �E����I �2F E � ��� >#D�I�>�� �9M��I�K J)D ��M�J ��D ,

��7&ZP ��!EF$r��7 ���-�� (�-7p��7r��+�+X�-�! (+��#��'������!�-@

$<"���� �� �8����I �FHE ����� >�D�I�> � ��,

$<"���� �� �8����I �FHE ����� >�D�I�> � �($ " ��� # �.% ,6�5 ���F' 0*) ;b k�!7&ZP ��!EF$r��7����-�� ��-79�!%��������

$<"���� �� �8����I �FHE ����� >�D�I�> � � "�$ %('*)+��%-,

5�687�9 ;=137 ;V7&$)+j�X���&,y�RTSYc f y{t%(_S �!8f�#$)�� N8���$)��+

Page 131: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

D a

"�$&%+'*)+��%3>? �2�f�3DJ��$)�� ?� ? ;h�#���gE�'(7&�#$&8�7)$&�I����$&5��,���! �+��#�� "�Ic �KuH3�������'(7&��O� x? �2�! (+��=�� ?� ? ;h�#���q��3(3�$&��$&5!�����! �+j�=�� "�Ic 4uH3�������'�7&� O i!x? S�O(89�! ��� "� ? ;h�#���g�nO(89�! ��� "�#$r��7��-�! �+j�=�� "�-c � u�3��6����'�7&� O� x

������������� M��2FHB �CJ)>

�2�!EF8�'(���l k�!7&ZP ���EJ$)��7����-�� ��-7��H'� ��6�#$&�! D5���7)'��!u�+=xn@

� M��2FHB ��J)>E�($ " ��� # �.%�� � � � ,6�5 ���F' 0*) ;V�!%����-���.��� �-7)��+�+. k�!7&ZP ��!EF$r��7����-�� ��-7

� ;V��� 0 5!�����#���muH�!�XEJ���#��$]O�xb��� �#�-+j�.�6O(��EF8�7)�!u�+=x� ;V��� 0 5!�����#���muH�!�XEJ���#��$]O�xb��� �#�#��$) D�6O(��EF8�7&�"u�+#x

��� � �� � � �� ��� � � �� � �

WX���F�#��3($r��7�%o��+�$)+��H'� (���#$&�! ���-�� ��-7&+ � u D����"x O �nO(8ku���� D�� ��� ����nxg�����^$&EJ8�7&�-EF�- "�#��3[%?Z�#�($)+X�-7)��+�+�@

������������� � ����E:����� >�D�I�>�� �%M��2I�K J+D ��M�J ��D ,

�.��3�$r��7����-�� ��-7��-7r��+�+Y�-�! (+��#��'������!�-@

��� � )4� � � ����E:����� >�D�I�>�� ��,

��� � )4� � � ����E:����� >�D�I�>�� �3��� � )4� �&# �.% ,/ ����; ��� ' 0*) ; �,��3($r��7 �g���� ���7p�!%����-���

Page 132: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

D �"

��� � )4� � � ����E:����� >�D�I�>�� � "�$&%+'*)+��%+,

5�687�9 ;=137 ;V7&$)+j�X���&,y�RTSYc f y{t%(_S �!8f�#$)�� N8���$)��+

"�$&%+'*)+��%3>? A�$)3(��� ? ;h�#�(�g0Y$&3(�#�N�-�� �+��#�� "�Ic � u�3��6����'�7&� O� x

������������� M��2FHB �CJ)>

�2�!EF8�'(��� �.��3�$)��7������� ���7��H'� ��6�#$&�! D5���7)'��!u�+=xn@

� M��2FHB ��J)>E�3�C� � )4� �&# �&%�� � � � ,/ ����; ��� ' 0*) ;V�!%����-�6�_������7r��+�+h�,��3($r��7 �g���� ���7

� ;V���a0 5��-�����!�mu��!�XEJ���#��$]O�xb���k�#��+��.�6O(��EF8�7&�"u�+#x� ;V���a0 5��-�����!�mu��!�XEJ���#��$]O�xb���k�#����$) D�nO(��EJ8(7)�"uH+=x

� ��� � ���k��^ �

y �-7r��+�+g�#�Q���! "�=��$& B7)��%���7)+g����>?'�$)���-3B%"Z[�#�(�d+�'(8�����5P$)+��-3 7&�I���� �$) �LT��7&L!�!��$]�#��EF+��� (3B�-���!+�+};5���7)$&3o����$)�! <����+�'�7]�D�!%���������+-@ WX��$&+d$)+J�-+�+��- "��$r��7&7&Z �B ?'�EF�-��$&�QEJ���#��$]O<0Y$]�#� ���-7)7,�����#�IZP+:���+�����$& �L!+G�H�!�X��� 0 �� �3N�-�!7&'�EF N ���EJ��+-@

����� ��� � � � � � � ����������������������

����������� ��&� ��>�� K ��,

Page 133: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

D �b

����������� ��&� ��>�� K � ����������� # �&%�� " $&%('*)+��%-,� ��0 � �21 ' 0*) ;V�!%��������.��� �-7r��+�+.ti��%���7)+5�687�9<;=137 ;V7)$&+��X���&,y{RQSXc f y{t%(,S���8(�#$&�! D8o��$&��+

����������� ��&� ��>�� K � ������������+ �8%(��)�� � "�$&%+'*)+��%+,� ��0 � �21 / ��7 /�;�� ;VEd������$ O:��� 7r��%���7)+

5�687�9<;=137 ;V7)$)+j�X���&,y{RQSXc f y{t%(_S �!8f�#$)�� D8o��$)��+

����������� ��&� ��>�� K � ����������� 8 )+���!� "�$&%+'*)+��%+,� ��0 � �21 :&; � � ;V o��EF�*���l3���+�$)���-3 7r��%9�-7&+ �o7&��@ WX�(� ��7)�KE�'�+j�M%��*�#��%f;~3��-7&$)EF$&�#��3 ���6OP�

0Y$&��� �#��������+��^���a0 ���! "�=��$& �$) �LQ�-�!7&'�EJ ���EJ��+4�� �3 �������o��+j�^�-�!7&'�EF �-�� ?�#��$) ($) �L4��� 0 o��EF�-+�@ m{�����-�Y�� ?����$&�-+YE�'�+j�,%9�g ?'�EJ����$&��@

5�687:9<;=137 ;V7)$&+��X����&.y�RQSXc f�y_t$(,S �!8(��$)�! M8o��$&��+

"�$&%+'*)+��%3>? �Y� 0Y+ ? ;V$) �3�$&�-��+X�����nO(��EJ8(7)�-+X���F+��-7&�-���? �2�!7)+ ? ;V$) �3�$&�-��+X������7r��+�+���+.���F+��-7&�-���

? �27r��+�+��-+ ? ;V o��EF�-+X��� �-7)��+�+��-+Y�#�^+���7)�-�6�

��� ����� ��� ��>AJ

�����Y�-7)��+�+.�����#��$)%�'(���-+�@

� ����� � ��>AJ�� ��� �C� ��� # �.%�������� �C,� ��0 � �21 ' 0*) ;bti��%���7)+X�!%����-���

������� ;h�#���g o��EJ�����k�#�(�q3(�-+�$&����3Q�����#��$)%�'(�������� � >

? &_��EJ��+ ? ;V�-��7)7������#�IZD������� 0 o��EF�-+? �27r��+�+B&_��EJ��+ ? ;V�-��7)7������#�IZD������7r��+�+muH�-�!7&'�EF �xb o��EF�-+

Page 134: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

D �

� ��� � �M�-� �����

���,� ��� � � � �� ��

WX����%o��+�����7r��+�+D�H�!�M�� �!%����-�6�M�#�v���!7)3 ������+��=�\�#�[���m� ���#��$& ��-3 �-7)��+�+�$d�o���-@ �2'������� ?��7&Z�c�#�(�-���l$)+Y ��J+�89�-�-$��o�m%���+��l�-7r��+�+Y�H'� �����$)�! ���7)$]�1Z!@Gt��-���� ���3*+�����5��-+g��+.8o�����- "�_���F�����m3�����$]5!�-3pc7)�-���� (�-�j;~+�89�-��$d�o����7r��+�+��-+�@

���,� ��� � � � ��� � � � �� ��

y�-7r��+�+X�#�J���-8(���-+��- "���4�#����$) (�-3QRT�-3�EF$]O(t��I���� ����,��7r��+�+�$d���-�-@ m{%����-�6�#+_���hRT��3�EJ$ O(ti�-���� (�-3�I�� d%9�.'(+��-3J�#�g�-7)��+�+�$&�/Z4 ��60�3o���#�(@�WX����+��,�!%����-�6�#+2��7)+��q���! "�=��$& F5�����$)�!'(+V+j�=����$)+j�#$)��+h���-L!����3f;$) (L^�������#����$) �$& �L�cP��@ L�@h�-7)��8�+���3T+��-���! �3�+�@

����� ������� � >���F EN@ ��>!�1D�I�> � �9M��I�K J)D ��M�J ��D ,

RT��3�EJ$ O(ti�-���� (�-3N�-7r��+�+Y�-�! (+��#��'������!�-@hWX�������q$)+X ��F ����-3M�#�^3�$)���-�6�#7&Zd�I��7&7p�#�($)+G�H'� ��6�#$&�! s@

����� ������� ��>AJ

�����Y�-7)��+�+.�����#��$)%�'(���-+�@

� ����� � ��>AJ��3� � � ��)���# �&%�� ��� � ��,��� ��� ;�� ' 0*) ;2RT�-3(EJ$ O�t��-���� ���3T��%����-�6�

������� ;h�#���g o��EJ�����k�#�(�q3(�-+�$&����3Q�����#��$)%�'(���

Page 135: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

D �

����� � >? 7)��%���7)+ ? ;h�#����$) D7)��%���7)+? 3�$r��L ? ;h�#����$) ���#��E 3�$r��L!�! o��7~u�+#x

? �!%�+�����5��-3 ? ;h�#����$) D�!%(+��-�j5!��3*+��#���#�? �-7)��8�+���3 ? ;V�-7)��8�+���3T+��-���! �3�+Y�H�!�G�#����$) ($) �L

? +����-3 ? ;V�#�� (3��!E +��-��3T�H�!�G���#��$& �$) �L? %9�-+j� ? ;V%���+��.���n;1$& �$&�b�H���!E ���#��$& �$) (L? $) �$]�#+ ? ;V+�����'��6�_�����#�IZD����7&�I���� ��-3M8o������EF���#����+X�H�!�X�-���=�T���6;~$) �$]�

����� ����� � M��:� K+K E�� �

�����3�$)�6�J��7r��+�+47r��%9�-7&+4L!$&5��- v�*�#����$) ���3<�-7r��+�+�$��o�-�F�� (3 ���#��E �!%��������F�H�!�^�*�#��+��F3o���#�[+����-@WX���q����+�'�7]�Y$)+Y���6�#'��� ��-3N$) N� �.��+�'�7]�Y�!%����-�6�I@ m{8(�#$&�! o��7&7&Z!c?�#��+��,7r��%9�-7&+G�I�� T%9�g8����a5P$)3���3N�H����-��EJ8o����$)+��! s@�#1 M�#�($)+X�I��+���c9� �b55�.��+�'�7]�_��%����-�6�,$&+X���6�#'��� ��-3s@

��� � � �:% M�� � K K+E���� �3� � � � )���# �.%��� �C����� "�$&%('*)+� %+,��� ��� ;�� ' 0*) ;2RT�-3(EJ$ O�t��-���� ���3T��%����-�6�

.�/ ��� ; �g����E ��%����-�6�.0Y$]�#�D�#��+��.3o���#�5�687�9<;=137 ;V7)$&+��X���&,y{RQSXc f y{t%(,S �!8(�#$&�! M8o��$&��+

"�$&%+'*)+��%3>? ti��%9�-7)+ ? ;h�#��+��,ti��%9�-7��!%��������? RT$)+�+�$) (L ? ;V+�����'��6�.���eEF$)+�+�$) (Lm�#��+��,3o���=�4�� ?����$&�-+lu�3��6����'�7]��O @GBrx

���,� �� � ��� � � � � � �� ��

y ��7r��+�+b��������8�����+��- "�.�l���#��$& ��-3:RT7)EF$]O(t��I���� ����b��7r��+�+�$d���-�-@ m{%���������+G��� RT7&EJ$ O�t��-���� ���3d�-�� %9�m'�+��-3*�#�J�-7)��+�+�$&�/ZM ��60|3����=�(@YWX����+�����%����-�6�#+���7&+��J�-�! "�=��$) T5�����$)�!'(+,+j�=����$)+���$)��+,���-L"����3�$) (L�#�(�g���#��$& �$) (L�c(��@ L�@���7r��8(+��-3N+����-�! (3�+-@

Page 136: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

D �

����� ������� � �GF E @ ��>!�1D�I�>�� �%M��2I�K J)D ��M�J ��D ,

RT7&EJ$ O�t��-���� ���3M�-7r��+�+X�-�� �+�����'��6�#�!��@bWX�������g$)+Y ��^ ����-3N�#�^3�$)���-�6�#7&Zd�I��7&7p�#�($)+G�H'� ��6�#$&�! s@

����� ������� ��>AJ

�����Y�-7)��+�+.�����#��$)%�'(���-+�@

� ����� � ��>AJ��3� � � )���# �.%�������� ��,� ��� ;�� ' 0*) ;2RT7)EF$]O(t��I���� ���3D�!%����-�6�

������� ;h�#���g o��EJ�����k�#�(�q3(�-+�$&����3Q�����#��$)%�'(�������� � >? �-7r��8�+���3 ? ;V�-7)��8�+���3T+��-���! �3�+Y�H�!�G�#����$) ($) �L

? +��-��3 ? ;V�#�� (3��!E�+��-�-3N�H�!�G�#����$) ($) �L? %9�-+�� ? ;V%���+��.���n;1$& �$&�G�H���!E ���#��$& �$) (L? $) �$]�#+ ? ;V+�����'��6�_�����#�IZD����7&�I���� ��-3N8o������EJ�6�#����+G�H�!�X�-���=�Q���6;1$& �$&�

����� ����� � M��:� K+K E�� �

�����3�$)�6�J��7r��+�+47r��%9�-7&+4L!$&5��- v�*�#����$) ���3<�-7r��+�+�$��o�-�F�� (3 ���#��E �!%��������F�H�!�^�*�#��+��F3o���#�[+����-@WX���q����+�'�7]�Y$)+Y���6�#'��� ��-3N$) N� �.��+�'�7]�Y�!%����-�6�I@ m{8(�#$&�! o��7&7&Z!c?�#��+��,7r��%9�-7&+G�I�� T%9�g8����a5P$)3���3N�H����-��EJ8o����$)+��! s@�#1 M�#�($)+X�I��+���c9� �b55�.��+�'�7]�_��%����-�6�,$&+X���6�#'��� ��-3s@

��� � � �:% M�� � K K+E���� �3� � � )���# �&%��� ������� "�$&%+'*)+��%+,� ��� ;�� ' 0*) ;2RT7)EF$]O(t��I���� ���3D�!%����-�6�

.�/ ��� ; �g����E ��%����-�6�.0Y$]�#�D�#��+��,3o���#�5�687�9<;=137 ;V7)$&+��X���&,y{RQSXc f y{t%(,S���8(�#$&�! D8o��$&��+

Page 137: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

D �

"�$&%+'*)+��%3>? tk��%���7)+ ? ;h�#�-+j�,tk��%���7��!%����-�6�

���,� ��� � �� � � � �� ��

y �-7)��+�+{���N���-8����-+��- "�4�:�#����$) (�-3C�f3�8ot��-���� ����g�-7r��+�+�$��o�-��@ m{%����-�6�#+q���X�P3�8ot��I���� ��-3C�I�� �%9�'�+��-3M�#�^�-7)��+�+�$&�/ZJ ���0 3o���=�f@�WX���-+��l�!%����-����+.��7)+��4�-�! "�=��$) D5�����$&�!'�+G+j�=����$)+���$)��+X���-L!����3�$& �L��#�(��#����$) ($) �L�cf��@ L�@��-7)��8�+��-3N+��-���! �3�+�@

����� � � ��� ����B �'>!�1D�I�>�� �%M��2I�K J+D ��M�J ��D ,

�f3�8�ti�-���� (�-3Q��7r��+�+Y�-�! �+j�#��'������!�-@hWX�������q$)+X ��^ ����-3T���^3�$)���-����7&Zd�I��7&7p�#��$&+G�H'� ��6�#$)�� s@

����� � � ��� ��>AJ

�����Y�-7)��+�+.�����#��$)%�'(���-+�@

� ����� � ��>AJ�� � � $ # �.%�������� ��,1 �36 ' 0*) ;2�f3�8ot��-���� ���3Q�!%����-���������� ;h�#���g o��EJ����� �#���g3���+�$&���-3T�����#��$&%�'(���

����� � >? �-7r��8�+���3 ? ;V�-7)��8�+���3T+��-���! �3�+Y�H�!�G�#����$) ($) �L? 7r��%���7)+ ? ;h�#����$) D7)��%���7)+? 3�$r��L ? ;h�#����$) ���#��E 3�$r��L��! o��7~u�+=x

? E�' m{8(� ? ;h�#��� ���-�� (�-7i�-�!Em%�$) o�\�#$)�� :02��$)L!�"�#+

Page 138: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

gLi

����� � � � � M��:� K+K E�� �

�����3�$)�6�J��7r��+�+47r��%9�-7&+4L!$&5��- v�*�#����$) ���3<�-7r��+�+�$��o�-�F�� (3 ���#��E �!%��������F�H�!�^�*�#��+��F3o���#�[+����-@WX���q����+�'�7]�Y$)+Y���6�#'��� ��-3N$) N� �.��+�'�7]�Y�!%����-�6�I@ m{8(�#$&�! o��7&7&Z!c?�#��+��,7r��%9�-7&+G�I�� T%9�g8����a5P$)3���3N�H����-��EJ8o����$)+��! s@�#1 M�#�($)+X�I��+���c9� �b55�.��+�'�7]�_��%����-�6�,$&+X���6�#'��� ��-3s@

��� � � �:% M�� � K K+E���� � � � $ # �.%�� ��� ��� " $&%('*)+��%-,1 �36 ' 0*) ;2�P3�8ot��I���� ��-3N�!%��������.�/ ��� ; ���#��E �!%��������Y0Y$&���D�#�-+j�.3o���=�

5�687�9 ;=137 ;V7&$)+j�X���&,y�RTSYc f y{t%(_S �!8f�#$)�� N8���$)��+

"�$&%+'*)+��%3>? tk��%���7)+ ? ;h�#�-+j�,tk��%���7��!%����-�6�

� ��� � �M�-� �����

��� � ��� � � � �� �

y %o��+��l��7r��+�+G�H���!E 0Y��$)�=�T��7&7p�-7)��+�+��-+Y�H�!�G7&�I���� �$) �L^��7)L!�!��$&����EJ+2������3(�-��$]5!��3s@byG�X����$)+G��$)EF��c��7&7{3��-��$&5��-3 7&�I���� ��-��+N�����[+�'(8�����5P$)+��-3 ��7&L!�!��$&�#�(EJ+�@ `,�a0b��5!���-c��#�(�Bt��I���� ����N$& "�#�-�j�����-�[$&+�-��EJ8�7&�����-7&ZJL!�� ��-��$)�q�� �3N�I�� N+�'(8�8������.'� �+�'�8�����5P$)+��-3N�#�-�=�( �$)>?'���+-c9��+X02��7)7 @

��� � ��� � � � ��� � � � �� �

WX��$&+��-7r��+�+h$)EF8�7)��EJ�� "�#+ �����YEd� O($&E�'�E�- "�#���!8"Z43�$&+��-��$)EF$) o�\�#$)�� DuwRTSVUgx�EF$]OP��'����X��� �g��'�+};+�$)�� �+{��7r��+�+�$��o�-��@lWX���^3�$&+�����$)EF$) ��� "�_$&+{%o��+��-3[�! K�#���47&�!L:�����#$&�:���h�102� �g��'�+�+�$r�� KEJ$ Of��'����EF�f3���7)+�@ WX�(�T�#���=�� �$&>P'(�*8�����EF$&��+J�-���=� �q��'�+�+�$r�� �-�!EF8��� ��- "�F�#� ���-+�$&3��Q$& ��+��-8����#�����

Page 139: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

g/

�H�I�\�#'����m+�8����-��cp�#�?'�+_��7)7&� 0Y$& �LJ�J�-��E�%�$) ����#$&�! T��� ������ ���7)+-@,WX��$)+,�-7)��+�+,���->?'�$&����+_�! ��l�����#�(��!8(��$)EF$ n��-��+�c(7&$)+����-3M%9�-7)�a0gc(���J%9��$) (+��=��7)7)��3s@

������������� � >���F EN@ ��>!�1D�I�>#D �%M��2I�K J+D ��M�J ��D ,

RT��3�EJ$ O(ti�-���� (�-�Y�-7)��+�+Y�-�� �+�����'��6�#�!��@

� � � � )�� � >���F E @ ��>!�1D�I�>�D ��,

� � � � )�� � >���F E @ ��>!�1D�I�>�D ��� � � � )���# �.% ,��� ��� ;�� ' 0*) ;2RT�-3(EJ$ O�t��-���� ����X�!%��������

� � � � )�� � >���F E @ ��>!�1D�I�>�D � -C"�� $<"������ % ��� "�$&%+'*)+��%+,1�5 � 6�5 � � ��7�1 ;V���-7&7������#�IZN����89�!+�$]�#$]5!�q�-7r��+�+{�� �3* ���L"���#$]5!�l�-7r��+�+_EF$]OP��'����q�-�!EF89�! ��- "��+-@

#1 4����$)+e�nO(��EJ8(7)��c5j @ �BaCB� @ B�l?c������X89�!+�$]�#$&5��2��7r��+�+�EJ$ Of��'����b�o��+e�10b�g�-�!E4;89�! ��� "�#+d���o���:'(+������-�� (�-7)+ K�� �3 a[�H���!E �#�(� �g����E m�%����-���d�� �3 ����� (�-L"����$&5��q��7r��+�+YEJ$ Of��'����_�o��+Y�! ��g�-��EJ89�! ��� ?�,�� (3N'(+��-+.�! �7]Z����-�� (�-7 !@

5�687�9 ;=137 ;V7&$)+j�X���&,y�RTSYc f y{t%(_S �!8(��$)�! D8���$)��+

"�$&%+'*)+��%3>? � ? ;V����L!'�7)����$dnI����$)�! :8����#��EF�����-�quH3�������'(7&��O� �iFi"x

? WX������+�� ? ;V�-�� ?5��-��L!�- ����l��������+����!7&3 uH3�������'�7&� O -�6;'a!x? RQ�\O5#~�#��� ? ;VEJ�\Of$)E�'�E $&���-�����#$&�! �+guH3�������'(7&��O bFi!x

? &.'�E #1 �$&��+ ? ;V ?'�E�%9�-�Y��� ���n;1$) ($&�#+�u�3��6����'�7&� O� x? m�8f�#$)EF$ n��-� ? ; ?�� (.y{U� ��m�� ? c ? R�mg�(S � ? c ? ��R�m ? u�3(������'�7]��O ?�� (.y{U� ��m�� ? x? m{%�+��-�j5!� ? ;V�!%�+��-�j5!�qEJ$ Of��'�����+j�=�����Ju�3��6����'�7&� O @GBrx

Page 140: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

gFg

������������� ��>AJ

�����Y�-7)��+�+.�����#��$)%�'(���-+�@

� ����� � ��>AJ��3� � � ��)���# �&%�� ��� � ��,��� ��� ;�� ' 0*) ;2RT�-3(EJ$ O�t��-���� ����X�!%��������

������� ;h�#���g o��EJ�����k�#�(�q3(�-+�$&����3Q�����#��$)%�'(�������� � >? �2�!EJ89�! ��� "�#+ ? ;h�����g�-�!EF89�! ��- "�j;~�#�\;������� ���7�Ed��8�8�$) (L!+

? � ? ;V���-L!'(7r����$ nI�\�#$)�� :8o������EJ�6�#���? WX�����-+�� ? ;V���! "5!����L!�� ��-�q�#�����-+��(�!7)3? RQ� OS#~���-� ? ;VEJ�\Of$)Em'�E $]�#���#����$)�! �+

? m{8(�#$&EJ$dn-��� ? ; ?�� (,y_U� � m�� ? c ? R�mg�(S � ? c ? �/f{t�y{z ? c ? �(R�m ?? m{%�+�����5!� ? ;V��%�+�����5!��3*EF$]OP�#'�����+��#���#�? (. o��EF� ? ;V'( �$)>?'���7&ZF3��-��$&5��-3: o��EJ�.%o��+��-3:�! J8o������EJ�6�#����$ n-���#$&�! s@kWX��$)+b$)+V'�+��6�H'�79$)

�����-���#$& �L^3�$)���-�����!��Z: o��EF�-+G�H�!�X�nO(89�-��$)EF�- "�=��7����-+�'�7&��+-@

����������� � J+D��1E I

Wk�#��$& �BRQShU �q��'�+�+�$r�� vEJ$ OP�#'����T��7r��+�+�$d���-�^L!$&5��- � RT��3�EJ$ O(ti�-���� (�-�F�!%����-�6�IcG���#��$& �$) �L�6O(��EF8�7&�-+V�� �3F7r��%9�-7&+-c"�� �3d�g7)$&+������s�!8(��$)�! (+-@�WX�(�,�����#'(�� ���3J�#����$) (�-3^�-7)��+�+�$d�o���V�-�� F%��Y'�+��-3�#�^8����-3�$&���.7r��%���7)+2�H�!�G���-+j�,�nO(��EJ8(7)�-+�@

Page 141: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

gLa

����������� � J+D��1E I�3� � � � )���# �.%��� �C���$# �.%�� ����������� # �&%�� "�$&%('*)+� %+,��� ��� ;�� ' 0*) ;2RT�-3(EJ$ O�t��-���� ����X�!%��������

.�/ ���(' 0*) ;h�#����$) �$& �L ���#��E ��%����-�6�I@ �G�� �$) (�-7)'(3��4�#�-+j�m3����=�M$) �7r��+j�g���a0Y+ =\�-�!7&+q�H�!��#���� �+�3('�����$&5!�q��8(8�7)$&�I����$)�! �+�@

� ��0 � �21 ' 0*) ;h�#����$) �$& �L ti��%9�-7&+N��%����-�6�I@ RT'�+j�Q���! "�=��$& ���!�����-+�89�! �3($) �L �#����$) �7)��%���7)+�! �7]Z!@

5�687�9<;=137 ;V7)$&+��X���&,y{RQSXc f y{t%(,S �!8(�#$&�! M8o��$&��+

"�$&%+'*)+��%3>? �f���-3 ? ;h5���7)'(�T�H�!�F�#�� (3��!E P'(E�%����dL!�� ��-�����#���:+����-3s@ (.+�� @ B,�H���d�-7&�f�1��@ u�3��n;

����'�7]��O{'� ��=���� �L!��3�x? RT$)+�+�$) (L ? ;V+�����'��6�.���eEF$)+�+�$) (L�3o���#�F�� ?����$&�-+lu�3��6����'�7]��O @GBrx? U{�-%('�L ? ;V�- f�H�!�����q+j�#��$)���.%�'(LF�=�(�-�1�?$) �L*u�3��6����'�7]��O_�#��'��ax

��� � �� � ��� � � � � � �� �

WX��$&+G�-7)��+�+G$&EJ8(7)�-EF�- "��+b�#�(�{Ed� O($&E�'�E 7)$d����7)$)�(�f�P3TuwRQtkx2EF$]OP�#'����_��� �g��'�+�+�$)�� �+G��7r��+�+�$d���-�-@WX���N3�$)+��-��$)EF$) o�� "�4$&+^%o��+���3 �! <�#�(�T7&�!L[�#����$)�[���.�102� �q��'(+�+�$)�� vEJ$ Of��'����MEF�f3(�-7)+�@<WX����#���=�� �$&>P'(�T89�-��EJ$]�#+��-���=� �g��'�+�+�$r�� v���!EF8��! (�- "�4�#�[����+�$&3��M$) v�K+��-8����#�����D�H�I����'����M+�8����-��c�#�?'�+,��7&7)�a0Y$) �L��^���!E�%�$& o����$)�! :���������� ���7)+�@

������������� � �GF E @ ��>!�1D�I�>�D �%M��2I�K J)D ��M�J �2D ,

RT7&EJ$ O�t��-���� ����G�-7)��+�+Y���! �+�����'��6�#�!��@

� � � )�� � � F E @ �'>!�1D�I�>�D ��,

� � � )�� � � F E @ �'>!�1D�I�>�D �3� � � )���# �&% ,� ��� ;�� ' 0*) ;2RT7)EF$]O(t��I���� ����G�!%��������

Page 142: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

gJ"

� � � )�� � � F E @ �'>!�1D�I�>�D � -�"�� $<" ��� � % � �#"�$&%('*)+� %+,1�5 � 6�5 � � ��7�1 ;V���-7&7������#�IZN����89�!+�$]�#$]5!�q�-7r��+�+{�� �3* ���L"���#$]5!�l�-7r��+�+_EF$]OP��'����q�-�!EF89�! ��- "��+-@

#1 4����$)+e�nO(��EJ8(7)��c5j @ �BaCB� @ B�l?c������X89�!+�$]�#$&5��2��7r��+�+�EJ$ Of��'����b�o��+e�10b�g�-�!E4;89�! ��� "�#+d���o���:'(+������-�� (�-7)+ K�� �3 a[�H���!E �#�(� �g����E m�%����-���d�� �3 ����� (�-L"����$&5��q��7r��+�+YEJ$ Of��'����_�o��+Y�! ��g�-��EJ89�! ��� ?�,�� (3N'(+��-+.�! �7]Z����-�� (�-7 !@

5�687�9 ;=137 ;V7&$)+j�X���&,y�RTSYc f y{t%(_S �!8(��$)�! D8���$)��+

"�$&%+'*)+��%3>? WX�����-+�� ? ;V���! "5!����L!�� ��-�q�#�����-+��(�!7)3Bu�3��6����'�7]��O� I�6;'g!x? RQ� OS#~���-� ? ;VEJ�\Of$)Em'�E $]�#���#����$)�! �+�u�3��6����'�7&� O bFi"x

? &,'�E #1 �$&��+ ? ;V ?'�Em%����.�������6;1$& �$&��+gu�3(������'�7]��O� x

������������� ��>AJ

�����Y�-7)��+�+.�����#��$)%�'(���-+�@

� ����� � ��>AJ��3� � � )���# �.%�������� ��,� ��� ;�� ' 0*) ;2RT7)EF$]O(t��I���� ����G�!%��������

������� ;h�#���g o��EJ�����k�#�(�q3(�-+�$&����3Q�����#��$)%�'(�������� � >? �2�!EJ89�! ��� "�#+ ? ;h�����g�-�!EF89�! ��- "�j;~�#�\;������� ���7�Ed��8�8�$) (L!+

? WX�����-+�� ? ;V���! "5!����L!�� ��-�q�#�����-+��(�!7)3? RQ� OS#~���-� ? ;VEJ�\Of$)Em'�E $]�#���#����$)�! �+? (. o��EF� ? ;V'( �$)>?'���7&ZF3��-��$&5��-3: o��EJ�.%o��+��-3:�! J8o������EJ�6�#����$ n-���#$&�! s@kWX��$)+b$)+V'�+��6�H'�79$)

�����-���#$& �L^3�$)���-�����!��Z: o��EF�-+G�H�!�X�nO(89�-��$)EF�- "�=��7����-+�'�7&��+-@

Page 143: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

gFb

����������� � J+D��1E I

Wk�#��$& D�4RQt �q��'�+�+�$r�� :EF$]OP��'����.�-7)��+�+�$d�o���2L!$]5!�- M��RT7)EF$]O(t��I���� ��-�V�!%��������-c(�#����$) �$& �Lm�nO(��E^;8�7&�-+{�� �3*7r��%���7)+-c��� �3*�d7)$&+��,�����!8(��$)�! (+-@_WX�(�����6�#'��� ��-3*���#��$& ��-3*��7r��+�+�$��o�-�.�I�� K%9�m'(+��-3*���8����-3�$&���.7r��%9�-7&+2�H�!�G���-+��.�nO���EJ8�7&�-+�@

����������� � J+D��1E I�3� � � )���# �&%��� �����$# �&%��#����������� # �.%�� "�$&%+'*)+��%+,� ��� ;�� ' 0*) ;2RT7)EF$]O(t��I���� ����G�!%��������.�/ ���(' 0*) ;h�#����$) �$& �L ���#��E ��%����-�6�I@ �G�� C$) ���7)'�3(���#�-+j�m3����=�M$) �7r��+j�q���a0Y+ =����!7)+��H�!�

�#���� �+�3('�����$&5!�l��8�8(7)$)�-���#$&�! �+�@� ��0 � �21 ' 0*) ;h�#����$) �$& �L<ti��%9�-7)+D��%����-�6�I@ RT'�+��N���! "�=��$& ���!�����-+�89�! �3($) �L �#����$) �7)��%���7)+

�! �7]Z!@5�687�9<;=137 ;V7)$&+��X���&,y{RQSXc f y{t%(,S���8(�#$&�! D8o��$&��+

"�$&%+'*)+��%3>? �f�-��3 ? ;h5���7)'��M�H�!�d���� �3���E ?'�Em%����:L!�- (�-�#�\�#�!�J+��-��3s@ (,+���@ B,�H�!�J�-7&�f�1��@ uH3��6;

����'�7&� O{'� ��=�o�� (L!�-3�x? U{�-%�'�L ? ;V�- (�H�!���-�g+�����$&���Y%�'�LF�=�����1�P$& �LKuH3�������'�7&� O{����'��Ix

��� � ��� � �� � � � �� �

WX��$&+{�-7)��+�+{$&EJ8(7)�-EF�- "��+,�#�(�^�(U� ��-�!E�%($) o����$)�! T��� ������ ���7)+{0Y$&����$) *�:+�'�8�89�!�j�{5!�����#����Ed�\;�=��$& ��[uw�7fgR*xl��7r��+�+�$��o�-��@QWX���:3($)+�����$&EJ$& o�� "�q$)+l�����M�/f�R 0Y$&��� �Q7)$& ��I���q���!E�%�$& o����$)�! ���������� ���7)+�@

Page 144: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

g �

������� � ��� ����B �'>!�1D�I�>�D �%M��2I�K J)D ��M�J �2D ,

�f3�8�ti�-���� (�-�Y�-7)��+�+X���! �+�����'��6�#�!��@hyG�,8(���-+��- "�Ico����$)+G��7r��+�+Y���->?'�$&����+G�#���lRT�!+����:��8(�#$&EJ$dnI����$)�! +����/�10G������co0Y��$&�=�T$&+X ����X�H������@

� � $ ����B �'>!�1D�I�>�D ��,

� � $ ����B �'>!�1D�I�>�D � � � $ # �.% ,1 �36 ' 0*) ;2�f3�8ot��-���� ����,��%����-�6�

� � $ ����B �'>!�1D�I�>�D � � ������������� "�$&%+'*)+��%+,� �3/ � � �21 ;b�����#�IZN��� ���-�� (�-7)+,�#�:'�+���@�#1 *����$)+,�6O(��EF8�7)��c @ �1aCB c9���������-�� (�-7)+- 4�� �3 a

�H���!E ����� �g����E m�%����-���.�����g�-�!Em%�$) ���3s@5�687�9 ;=137 ;V7&$)+j�X���&,y�RTSYc f y{t%(_S �!8f�#$)�� N8���$)��+

"�$&%+'*)+��%3>? � ? ;V���-L�'�7r����$ n-���#$&�! :8o������EF���#���qu�3��6����'�7]��O� �iDi"x

? RT�P3�� ? ;V�!8(�#$&EJ$dnI����$)�! �EF�f3(���H�!�[������ ���7l0b�-$&L!�"�#+-@ ? m{8(� ? $&+*�fU� ��8(�#$&EJ$dn-�-3p@? &.�7m{8(� ? $&+X�->?'o��7s0b�-$&L!�"�I@,u�3��6����'�7]��O ? m{8(� ? x

? AC�-$&L!�"�#+ ? ;h5!�-�6�#�!�.���$�(Of�-3N���-�� ��-7i���!E�%�$& o���#$&�! :0b�-$)L��?��+lu�3��6����'�7&� O @GBrx? &,�!��Ed��7&$ n�� ? ;V���6;~ ��!��Ed��7&$ n��M������ ���7)+.���/�#���Y�-�!E�%($) o����$)�! Ku�3��6����'�7&� O_����7)+��ax

������� � ��� ��>AJ

�����Y�-7)��+�+.�����#��$)%�'(���-+�@

� ����� � ��>AJ�� � � $ # �.%�������� ��,1 �36 ' 0*) ;2�f3�8ot��-���� ����,��%����-�6�������� ;h�#���g o��EJ����� �#���g3���+�$&���-3T�����#��$&%�'(���

Page 145: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

g �

����� � >? �g���� ���7)+ ? ;h�#��� ������ ���7 $& �3�$&�-�-+

? � ? ;V���-L�'�7r����$ n-���#$&�! :8o������EF���#���? RT�P3�� ? ;V�!8(�#$&EJ$dnI����$)�! �EF�f3(���H�!�[������ ���7l0b�-$&L!�"�#+-@ ? m{8(� ? $&+*�fU� ��8(�#$&EJ$dn-�-3p@

? &.�7m{8(� ? $&+X�->?'o��7s0b�-$&L!�"�I@? AC�-$&L!�"�#+ ? ;h5!�-�6�#�!�.��� ������ ���7k���!E�%�$& o����$)�! :0b�-$&L!�"�#+

? &,�!��Ed��7&$ n�� ? ;V���6;~ ��!��Ed��7&$ n��M������ ���7)+.���/�#���Y�-�!E�%($) o����$)�! ? (, o��EF� ? ;V'� �$)>?'���7&ZF3�����$&5��-3: ���EJ�.%o��+��-3:�� d8o������EF���#����$dnI����$)�! s@kWX��$&+2$)+V'�+����H'�79$)

�-���-���#$& �L^3�$)���-�6�#�!�jZD o��EF�-+X�H�!�X�nO(89�-��$)EF�- "�=��7s����+�'�7]�#+-@

������� � � � J+D��1E I

Wk�#��$& m�.E�'�7&��$]; ���-�� ��-7P�fU� [�/fgR �-7r��+�+�$��o�-�kL!$]5!�- m�{�f3(8ot��I���� ��-� �!%����-�6�Ic\�#�#��$) �$& �LY�6O(��EF8�7)��+�� �347)��%9�-7)+�c!�� (3J�,7)$)+j�e���9�!8f�#$)�� �+-@ WX���X���6�#'��� ��-34�#����$) (�-3���7r��+�+�$d���-�e�-�� ^%��G'(+��-34����8�����3�$)�6�7r��%���7)+2�H�!�G���-+j�,�nO(��EJ8(7)�-+�@

����������� � J+D��1E I� � � $ # �.%�� ��� �$# �.%�� ����������� # �&%�� " $&%('*)+��%-,1 �36 ' 0*) ;2�f3�8ot��-���� ����,��%����-�6�

.�/ ���(' 0*) ;h�#����$) �$& �L ���#��E ��%����-�6�I@ �G�� C$) ���7)'�3(���#�-+j�m3����=�M$) �7r��+j�q���a0Y+ =����!7)+��H�!��#���� �+�3('�����$&5!�l��8�8(7)$)�-���#$&�! �+�@

� ��0 � �21 ' 0*) ;h�#����$) �$& �L<ti��%9�-7)+D��%����-�6�I@ RT'�+��T�-�� ?�#��$) ����!�����-+�89�! �3($) �L<�#����$) 7)��%���7)+�! �7]Z!@

5�687�9<;=137 ;V7)$&+��X���&,y{RQSXc f y{t%(,S���8(�#$&�! D8o��$&��+

"�$&%+'*)+��%3>? U{�-%�'�L ? ;V�- (�H�!���-�g+�����$&���Y%�'�LF�=�����1�P$& �LKuH3�������'�7&� O{����'��Ix

Page 146: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

g �

� ��� � ����_^`�

����� ��� � � ��� � �

y ��7r��+�+_�H�!�,�����4����+�'�7]�����V�:��7r��+�+�$d���I����$)�! T�6Of8�����$&EJ�� ?�-@gWX��� �.��+�'�7]���!%��������g���! "�=��$& �+_�#�(�8����-3�$&���#$&�! �+Y�� (3T3�$&+�����$)EF$) ��� "�25���7)'(�-+-@

��������� ��� � >�K��<� J �%M��2I�K J+D ��M�J ��D ,

�2�! �+j�#��'������!�X�H�!�+�.��+�'�7]�I@

��� � � �:% � >#K �<� J���,

��� � � �:% � >#K �<� J��3�C��� �<�:% # �&% ,/ ��1 � � 7�' 0*) ; �.��+�'�7]�,��%����-�6�

��� � � �:% � >#K �<� J�� � )+�F-!� $ �C� � � � $ � ��� ,��;=1 1 ;V���!7)'(EJ :5��-�����!�.����3($)+�����$&EJ$& o�� "�G5���7)'(�-+68/ � � ;V���!7)'(EJ :5��-�����!�.����8(���-3($)�����-3N7r��%9�-7&+�-6 ;VEJ������$]Od��� �6Of89�-�����-3*7&�!L47)$d����7)$)�(�f�P3J�H�!�X89�!+�$&�#$]5!��EF�f3(�-7s�!� @ B� � ;VEJ������$]Od��� �6Of89�-�����-3*7&�!L47)$d����7)$)�(�f�P3J�H�!�X (�-L"����$&5��qEF�P3��-7s��� @GB

��������� ��� ��>AJ

�����Y�-7)��+�+.�����#��$)%�'(���-+�@

Page 147: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

g �

� ����� � ��>AJ��3�C��� �<�:% # �&%������ � ��,/ ��1 � � 7�' 0*) ; �.��+�'�7]�,��%����-�6�

������� ;h�#���g o��EF�����k�#���g3���+�$&���-3Q��������$&%�'(�#������ � >? U{$)+�� ? ;V���!7)'(EJ D5!�������!�Y���e3�$&+�����$)EF$) ��� "�25���7)'(�-+? h���-3 ? ;V���!7)'(EJ D5!�������!�Y���e8����-3�$&�����-3N7r��%9�-7&+? S�8 ? ;VEJ������$]Od�����6Of8��������-3Q7&�!L47)$d����7)$)�(�f�P3d�H�!�X89�!+�$]�#$]5!��EF�f3���7wcf$&� ��8�8�7&$)�-��%�7)��@? S� ? ;VEJ������$]Od�����6Of8��������-3Q7&�!L47)$d����7)$)�(�f�P3d�H�!�X ���L"����$&5!��EF�P3��-7 c($&����8�8(7)$)�-��%�7&��@

����� ��� ��� � � ��� � �

�b55�.��+�'�7]�^�6OP�#�� �3�+^�#��� �Y�-+�'�7&�^��7r��+�+��H�!�������!+�+j;~5���7&$)3o�\�#$)�� B�6Of89�-��$)EF�- "�#+�cV0Y�������D�#�(�:�#�-+j�7r��%���7)+������ �? ��a0Y s@ WX��� �b55�Y�-+�'�7&�^��7r��+�+^��7)7&� 0Y+l�#���D���!EJ8('(�=����$)�! B���Y5�����$)��'�+�+����!����+4����-7)��+�+�$d�o���X8������H�!��Ed�� ��-��@�WX���l+��-�!���-+,��������������$)�65!��3T0Y$&���D�#��� �5RF,DEJ�6�#���P3s@

������������� ��� � >�K��<� J �%M��2I�K J+D ��M�J ��D ,

�2�! �+j�#��'������!�X�H�!� �b5S�Y�-+�'�7&�-@

- � ����� � �:% ���� � >�K��<� J���,

- � ����� � �:% ���� � >�K��<� J�� - � ��� � � �:% # �.% ,1 � / ��1 � � 7�' 0*) ; �b5S�Y�-+�'�7&�.�!%����-���

- � ����� � �:% ���� � >�K��<� J��3��� � �<�:% # �.%���������������,/ ��1 � � 7�' 0*) ; �.��+�'�7]�,��%����-�6�

� ��0 � �21 ;btk��%���7��!%����-�6�Y0Y$&�#�D����'��g�-7)��+�+Y7)��%���7)+

Page 148: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�aFi

������������� ��>AJ

�����Y�-7)��+�+.�����#��$)%�'(���-+�@

� ����� � ��>AJ�� - � ��� � �<�:% # �.%�������� ��,1 � / ��1 � � 7�' 0*) ; �b5S�Y�-+�'�7&�.�!%����-���

������� ;h�#���g o��EF�����k�#���g3���+�$&���-3T�����#��$&%�'(�������� � >

? U{$)+�� ? ;V���!7)'�EF D5!�����#���.����3�$&+�����$)EF$) ��� "�G5���7)'���+? ����-3 ? ;V���!7)'�EF D5!�����#���.����8����-3�$&�����-3Q7)��%9�-7)+? S�8 ? ;VEJ���#��$]Od��� �6Of8��������-3*7&�!L47)$d���-7&$)���P�P3J�H�!�X89�!+�$]�#$]5!��EF�f3���7wcf$&����8�8�7&$)�I��%�7)��@? S� ? ;VEJ���#��$]Od��� �6Of8��������-3*7&�!L47)$d���-7&$)���P�P3J�H�!�X ���L"����$&5!�gEF�f3(�-7wcf$&����8�8�7&$)�-��%�7)��@? WX8 ? ;V ?'�E�%9�-�Y���k�#��'��g8���+�$&��$&5���8�����3�$)�6�#$)�� �+? WX ? ;V ?'�E�%9�-�Y���k�#��'��g ��-L!���#$]5!�g8�����3�$)�6�#$&�! �+? �8 ? ;V ?'�E�%9�-�Y���k����7&+���89�!+�$]�#$&5���8�����3�$)�6�#$&�! �+? � ? ;V ?'�E�%9�-�Y���k����7&+��� ���L"���#$]5!�g8����-3�$&���#$&�! �+

? y,�-�-'(�#���6Z ? ;b�����-'�������Z? �f�- �+�$&��$&5P$&�1Z ? ;V+��- �+�$&�#$]5P$&�1Z? �P8����-$d���-$&�1Z ? ;V+�8����-$d���-$&�1Z

? �.�P�-y,'�� ? ;b�����I�^'� �3����X�#���g�����-��$&5!���,��8����#����$) �L4�=�o���#���6�#�-��$)+j�#$)�

� ��� ��\ �

��R�m $)+,+��->?'��� "�#$r��7�EJ$& �$)EJ��7��!8(��$)EF$ n-���#$&�! sc��� K$]�#�-�����#$]5!�4��7)L!�!��$&����E��H�!�_+��!7&5P$& �LD�� K�!8f�#$];EF$ nI�\�#$)�� l8����!%�7&�-E 0Y$&�#���� o��7]ZP��$)�V+����-8�+��a5!���h�_EF$) �$&Ed��7" ?'�Em%����e���o5�����$)��%�7&�-+-@iAC�G8����a5P$)3(��� J$)EF8�7)��EJ�� ?�#���#$&�! ����i��R�m �H�!���#�(�{RT��3�EF$]O(t��I���� ��-��@�WX���_���f3��.$)+�0Y��$&�����- J$) � A A �� �3E�'�+j�G%9�_���!EJ8($)7)��3F�H���b�#�(�_�o����3(02����� =��!89�-�#�\�#$) (Lm+�ZP+j�#�-E 8�7r�\���H�!��ET@eRTy�WYt�y{z $& ��-7&'�3��-+2�8����!L!�#��E|�-��7)7&�-3 OPR��l���{�-��EJ8�$&7)� �<���f3(�2�H�!��'(+��G0Y$&�����#���XRTy�WYt�y{zvRQS�*�$) "�#������������@ WX���

Page 149: Department of Computer Science, Columbia Universityjebara/papers/lewisthesis.pdf · c9 bd@cf]b89 [ 9 =l6:f7^;39 ud[ b85k2h9 ; 9 04 r6:9 =3ud57m =3ua@cfkf7m 6:ps9 / p7r u6dm @budud57x

�a5

OPR��Q3��P�-'�EF�- "�#���#$&�! K$)+_�����43�� �o �$&��$&5������6�H�-���� ��-�L� �(� 0b��5��-��c $]��+�����'�7)3K%9�4+�' DF��$)�- "����� �LC25476787:<;�=PG5.JI �9G/.�O��l�� (34�-3�$]���#�(� OPR�� � E/, . � .�0 �o7&��c"��+� ����-�-+�+#���jZ��H�!�k�#���G3(�-+�$&����348�7r�����H�!��EN@WX���� T�#�(�q���!EFEd�� (3 ?�OPR�� . O � � ��E7ESKF0Y$)7&7s%�'�$&7)3:�#�(�q%($) o���jZ:���f3������o���_RTy�WYt�y{z� ��-��3�+�#�^��'� *�(R�m�@

WX��� �o o��7h+j�#�-8B$)+��#�N+�89�-��$&�/ZK�#�����mRT�-3�EF$]O(t��I���� ����l+����!'�7&3B'�+��:��R m4@iWX�o�\�m$&+q3(�! ��F%?Z8���� 5P$&3�$) �L �����K�!8(��$)�! ���7_8o���#��EF�����-��+ ?#���LE/,2��O ���5RDI'�#* � � 2����'K<�#� �����CRT�-3�EF$]O(t��I���� �����-�� �+�����'��6�#�!��@