slade, e. , keeney, e., mavranezouli, i., dias, s., fou, l

30
Slade, E., Keeney, E., Mavranezouli, I., Dias, S., Fou, L., Stockton, S., Saxon, L., Waller, G., Turner, H., Serpell, L., Fairburn, C. G., & Kendall, T. (2018). Treatments for bulimia nervosa: a network meta- analysis. Psychological Medicine, 1-8. https://doi.org/10.1017/S0033291718001071 Peer reviewed version Link to published version (if available): 10.1017/S0033291718001071 Link to publication record in Explore Bristol Research PDF-document This is the author accepted manuscript (AAM). The final published version (version of record) is available online via Cambridge Core at https://www.cambridge.org/core/journals/psychological-medicine/article/treatments-for- bulimia-nervosa-a-network-metaanalysis/E2F5EDDEF98F480DED2FB09AF87C12F8. Please refer to any applicable terms of use of the publisher. University of Bristol - Explore Bristol Research General rights This document is made available in accordance with publisher policies. Please cite only the published version using the reference above. Full terms of use are available: http://www.bristol.ac.uk/red/research-policy/pure/user-guides/ebr-terms/

Upload: others

Post on 16-Oct-2021

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

Slade, E., Keeney, E., Mavranezouli, I., Dias, S., Fou, L., Stockton, S.,Saxon, L., Waller, G., Turner, H., Serpell, L., Fairburn, C. G., &Kendall, T. (2018). Treatments for bulimia nervosa: a network meta-analysis. Psychological Medicine, 1-8.https://doi.org/10.1017/S0033291718001071

Peer reviewed version

Link to published version (if available):10.1017/S0033291718001071

Link to publication record in Explore Bristol ResearchPDF-document

This is the author accepted manuscript (AAM). The final published version (version of record) is available onlinevia Cambridge Core at https://www.cambridge.org/core/journals/psychological-medicine/article/treatments-for-bulimia-nervosa-a-network-metaanalysis/E2F5EDDEF98F480DED2FB09AF87C12F8. Please refer to anyapplicable terms of use of the publisher.

University of Bristol - Explore Bristol ResearchGeneral rights

This document is made available in accordance with publisher policies. Please cite only thepublished version using the reference above. Full terms of use are available:http://www.bristol.ac.uk/red/research-policy/pure/user-guides/ebr-terms/

Page 2: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϭ

ϭ

7UHDWPHQWV�IRU�EXOLPLD�QHUYRVD��D�Ϯ

QHWZRUN�PHWD�DQDO\VLVϯ

ϰ

)LUVW�DQG�ODVW�QDPH

,QVWLWXWLRQDO�DIILOLDWLRQV (PDLO�DGGUHVV

(ULF�6ODGH��06F

1DWLRQDO�*XLGHOLQH�$OOLDQFH�5R\DO�&ROOHJH�RI�2EVWHWULFLDQV�DQG�*\QDHFRORJLVWV�����6XVVH[�3ODFH��/RQGRQ��1:���5*��8.

HVODGH#UFRJ�RUJ�XN7������������������

(GQD�.HHQH\��06F

8QLYHUVLW\�RI�%ULVWRO�&DQ\QJH�+DOO����:KDWOH\�5RDG��%ULVWRO�%6���36

HGQD�NHHQH\#EULVWRO�DF�XN

,ILJHQHLD�0DYUDQH]RXOL��3K'

5HVHDUFK�'HSDUWPHQW�RI�&OLQLFDO��(GXFDWLRQDO��+HDOWK�3V\FKRORJ\��8QLYHUVLW\�&ROOHJH�/RQGRQ�����7RUULQJWRQ�3ODFH��/RQGRQ��:&�(��+%

1DWLRQDO�*XLGHOLQH�$OOLDQFH�5R\DO�&ROOHJH�RI�2EVWHWULFLDQV�DQG�*\QDHFRORJLVWV� ���6XVVH[�3ODFH��/RQGRQ��1:���5*��8.�

L�PDYUDQH]RXOL#XFO�DF�XN

6RILD�'LDV��3K'

8QLYHUVLW\�RI�%ULVWRO��&DQ\QJH�+DOO����:KDWOH\�5RDG��%ULVWRO�%6���36

V�GLDV#EULVWRO�DF�XN

/LQ\XQ�)RX��3K'

1DWLRQDO�*XLGHOLQH�$OOLDQFH��5R\DO�&ROOHJH�RI�2EVWHWULFLDQV�DQG�*\QDHFRORJLVWV�����6XVVH[�3ODFH��/RQGRQ��1:���5*��8.

OIRX#UFRJ�RUJ�XN

6DUDK�6WRFNWRQ��%$�+RQV

1DWLRQDO�*XLGHOLQH�$OOLDQFH��5R\DO�&ROOHJH�RI�2EVWHWULFLDQV�DQG�*\QDHFRORJLVWV�����6XVVH[�3ODFH��/RQGRQ��1:���5*��8.

VVWRFNWRQ#UFRJ�RUJ�XN

Page 3: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

Ϯ

/HDQQH�6D[RQ��3K'

5HVHDUFK�'HSDUWPHQW�RI&OLQLFDO��(GXFDWLRQDO��+HDOWK�3V\FKRORJ\��8QLYHUVLW\�&ROOHJH�/RQGRQ�������7RUULQJWRQ�3ODFH��/RQGRQ��:&�(��+%�

1DWLRQDO�*XLGHOLQH�$OOLDQFH��5R\DO�&ROOHJH�RI�2EVWHWULFLDQV�DQG�*\QDHFRORJLVWV�����6XVVH[�3ODFH��/RQGRQ��1:���5*��8.�

OVD[RQ#UFRJ�RUJ�XN��O�VD[RQ#XFO�DF�XN

*OHQQ�:DOOHU��'3KLO

'HSDUWPHQW�RI�3V\FKRORJ\�8QLYHUVLW\�RI�6KHIILHOG�)ORRU�'�&DWKHGUDO�&RXUW���9LFDU�/DQH�6KHIILHOG�6���/7

J�ZDOOHU#VKHIILHOG�DF�XN

+DQQDK�7XUQHU��3K'

6RXWKHUQ�+HDOWK�1+6�)RXQGDWLRQ�7UXVW��$SULO�+RXVH����%DWK�5RDG��%LWWHUQH��6RXWKDPSWRQ��62����(6

KDQQDKWXUQHU�#JRRJOHPDLO�FRP

/XF\�6HUSHOO��3K'

8QLYHUVLW\�&ROOHJH�/RQGRQ�������7RUULQJWRQ�3ODFH��/RQGRQ��:&�(��+%

(DWLQJ�'LVRUGHU�6HUYLFH��1RUWK�(DVW�/RQGRQ�)RXQGDWLRQ�1+6�7UXVW��3RUWHUV�$YHQXH�+HDOWK�&HQWUH������3RUWHUV�$YHQXH��'DJHQKDP��(VVH[�50���(4

O�VHUSHOO#XFO�DF�XN

&KULVWRSKHU�*�)DLUEXUQ��0'

8QLYHUVLW\�RI�2[IRUG��'HSDUWPHQW�RI�3V\FKLDWU\��:DUQHIRUG�+RVSLWDO��2[IRUG��2;���-;

FUHGR#PHGVFL�R[�DF�XN

7LP�.HQGDOO��05&3V\FK

1DWLRQDO�&ROODERUDWLQJ�&HQWUH�IRU�0HQWDO�+HDOWK��5R\DO�&ROOHJH�2I�3V\FKLDWULVWV�����3UHVFRW�6W��:KLWHFKDSHO��/RQGRQ�(���%%

WLP�NHQGDOO�#QKV�QHW

ϱ

ϲ

Page 4: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϯ

$%675$&7ϳ

%DFNJURXQG� %XOLPLD�QHUYRVD LV�D�VHYHUH�HDWLQJ�GLVRUGHU�WKDW�FDQ�EH�PDQDJHG�XVLQJ D�ϴ

YDULHW\�RI�WUHDWPHQWV�LQFOXGLQJ�SKDUPDFRORJLFDO��SV\FKRORJLFDO��DQG�FRPELQDWLRQ WUHDWPHQWV�ϵ

:H�DLPHG�WR�FRPSDUH�WKHLU HIIHFWLYHQHVV�DQG�WR�LGHQWLI\�WKH PRVW�HIIHFWLYH�IRU�WKH�WUHDWPHQW�ϭϬ

RI�EXOLPLD�QHUYRVD�LQ�DGXOWV�ϭϭ

0HWKRGV� $�VHDUFK�ZDV�FRQGXFWHG�LQ�(PEDVH��0HGOLQH��3V\F,1)2�DQG�&HQWUDO IURP�WKHLU�ϭϮ

LQFHSWLRQ�WR�-XO\������ 6WXGLHV ZHUH�LQFOXGHG�LI�WKH\�UHSRUWHG�RQ�WUHDWPHQWV�IRU�DGXOWV ZKR�ϭϯ

IXOILOOHG�GLDJQRVWLF�FULWHULD�IRU�EXOLPLD�QHUYRVD��2QO\ 5&7V�WKDW�H[DPLQHG DYDLODEOH�ϭϰ

SV\FKRORJLFDO��SKDUPDFRORJLFDO��RU�FRPELQDWLRQ�WKHUDSLHV OLFHQVHG�LQ�WKH�8.�ZHUH�LQFOXGHG�ϭϱ

:H�FRQGXFWHG D QHWZRUN�PHWD�DQDO\VLV��10$��RI�5&7V��7KH�RXWFRPH�DQDO\VHG�ZDV�IXOO�ϭϲ

UHPLVVLRQ�DW�WKH�HQG�RI�WUHDWPHQW�ϭϳ

5HVXOWV�:H�LGHQWLILHG����HOLJLEOH�WULDOV�ZLWK������ SDUWLFLSDQWV�LQYROYLQJ����WUHDWPHQWV��ϭϴ

LQFOXGLQJ�ZDLW�OLVW��7KH�UHVXOWV�RI�WKH�10$ VXJJHVWHG WKDW�LQGLYLGXDO�&%7��VSHFLILF�WR�HDWLQJ�ϭϵ

GLVRUGHUV��ZDV�PRVW�HIIHFWLYH�LQ�DFKLHYLQJ�UHPLVVLRQ�DW�WKH�HQG�RI�WUHDWPHQW�FRPSDUHG�ZLWK�ϮϬ

ZDLW�OLVW��25�����������&U,����� WR���������IROORZHG�E\�JXLGHG�FRJQLWLYH�EHKDYLRXUDO�VHOI�KHOS�Ϯϭ

�25�����������&U,����� WR���������,QFRQVLVWHQF\�FKHFNV�GLG�QRW�LGHQWLI\�DQ\�VLJQLILFDQW�ϮϮ

LQFRQVLVWHQF\�EHWZHHQ�WKH�GLUHFW�DQG�LQGLUHFW�HYLGHQFH�Ϯϯ

&RQFOXVLRQV� 7KH�DQDO\VLV�VXJJHVWHG�WKDW�WKH WUHDWPHQWV�WKDW�DUH�PRVW�OLNHO\�WR�DFKLHYH IXOO�Ϯϰ

UHPLVVLRQ�DUH�LQGLYLGXDO�&%7��VSHFLILF�WR�HDWLQJ�GLVRUGHUV��DQG�JXLGHG�FRJQLWLYH�EHKDYLRXUDO�Ϯϱ

VHOI�KHOS� DOWKRXJK�QR�ILUP�FRQFOXVLRQV�FRXOG EH�GUDZQ�GXH�WR�WKH�OLPLWHG�HYLGHQFH�EDVH��Ϯϲ

7KHUH�LV�D�QHHG�IRU�IXUWKHU�UHVHDUFK�RQ�WKH�PDLQWHQDQFH�RI�WUHDWPHQW�HIIHFWV�DQG�WKH�Ϯϳ

PHGLDWRUV�RI�WUHDWPHQW�RXWFRPH�Ϯϴ

.H\�ZRUGV� HDWLQJ�GLVRUGHU��EXOLPLD�QHUYRVD��QHWZRUN�PHWD�DQDO\VLV��RXWFRPH�UHVHDUFK��Ϯϵ

1DWLRQDO�,QVWLWXWH�RI�+HDOWK�DQG�&DUH�([FHOOHQFH�ϯϬ

:RUG�FRXQW� ��� �DEVWUDFW�� ����� �PDLQ�SDSHU�ϯϭ

Page 5: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϰ

,1752'8&7,21ϯϮ

%XOLPLD�QHUYRVD �%1��LV�DQ HDWLQJ�GLVRUGHU�ZLWK�DQ�HVWLPDWHG OLIHWLPH�SUHYDOHQFH�RI�����ϯϯ

�7UDFH�HW�DO� ������6PLQN�HW�DO��������6WLFH�HW�DO� ������ ,W�LV FKDUDFWHULVHG�E\�UHFXUUHQW�ELQJH�ϯϰ

HDWLQJ��H[WUHPH�ZHLJKW�FRQWURO�EHKDYLRXU�DQG�DQ�RYHUFRQFHUQ DERXW�ERG\�VKDSH�DQG�ZHLJKW�ϯϱ

�&RRSHU�DQG�)DLUEXUQ��������)DLUEXUQ�DQG�+DUULVRQ������� DQG�JHQHUDOO\�VWDUWV�LQ�ODWH�ϯϲ

DGROHVFHQFH�RU�HDUO\�DGXOWKRRG� $OWKRXJK�LW�XVXDOO\�EHJLQV�ZLWK VWULFW�GLHWLQJ DQG�VRPH�ϯϳ

ZHLJKW�ORVV� WKLV GLHWDU\�UHVWULFWLRQ�EHFRPHV�SXQFWXDWHG�DIWHU�VRPH�PRQWKV�RU�\HDUV�E\�ϯϴ

UHSHDWHG�ELQJHV�DQG�ZHLJKW�UHJDLQ��,Q�PRVW�FDVHV��SHRSOH ZLWK�%1�HQJDJH�LQ�SXUJLQJ�DQG�ϯϵ

FRPSHQVDWRU\�EHKDYLRXUV�WKDW�LQFOXGH WKH�XVH�RI�H[FHVVLYH�H[HUFLVH�DQG�RU�GLHWDU\�ϰϬ

UHVWULFWLRQ�ϰϭ

&RJQLWLYH�EHKDYLRXUDO�WKHUDS\ VSHFLILF�WR�HDWLQJ�GLVRUGHUV �&%7�('� KDV�EHHQ�GHPRQVWUDWHG�ϰϮ

WR�EH�DQ HIIHFWLYH�DSSURDFK�IRU�WKH�WUHDWPHQW�RI�%1 �+D\��������3RXOVHQ�HW�DO��������)DLUEXUQ�ϰϯ

HW�DO��������/LQDUGRQ�HW�DO�������� 6RPH�HYLGHQFH�VXJJHVWV WKDW�LQWHUSHUVRQDO�SV\FKRWKHUDS\�ϰϰ

�,37��FDQ�DFKLHYH�UHVXOWV�VLPLODU�WR�&%7��DOWKRXJK�LW�LV�PXFK�VORZHU�WR�DFKLHYH�WKHVH HIIHFWVϰϱ

�)DLUEXUQ�HW�DO��������$JUDV�HW�DO�������� 7KH�PRUH�UHFHQW�µHQKDQFHG¶ IRUP�RI�&%7�DSSHDUV�ϰϲ

WR�EH�PRUH�HIIHFWLYH�WKDQ�,37�HYHQ�DW�IROORZ�XS �)DLUEXUQ�HW�DO�������� 7KHUH�LV�DOVR�HYLGHQFH�ϰϳ

WKDW�VXSSRUWV WKH�XVH�RI�JXLGHG�FRJQLWLYH�EHKDYLRXUDO�VHOI�KHOS��%DLOHU�HW�DO��������:DJQHU�HW�ϰϴ

DO�������� 7KHUH�DUH�PDQ\�PRUH�WUHDWPHQWV IRU�%1� DOWKRXJK GDWD�RQ�WKHLU�RXWFRPHV�DUHϰϵ

OLPLWHG�WR�GDWH��ϱϬ

7UDGLWLRQDO�SDLUZLVH�PHWD�DQDO\VHV�RI�5&7V�DUH�XVHG WR�V\QWKHVL]H�WKH�UHVXOWV�RI�GLIIHUHQW�ϱϭ

WULDOV FRPSDULQJ WKH�VDPH�SDLU�RI�WUHDWPHQWV� WR�REWDLQ�DQ�RYHUDOO�HVWLPDWH�RI�WKH�HIIHFW�RI�ϱϮ

RQH�WUHDWPHQW UHODWLYH�WR�DQRWKHU��+RZHYHU��WKH�IHZ�H[WDQW�PHWD�DQDO\VHV�RI�WUHDWPHQWV�IRU�ϱϯ

SHRSOH�ZLWK�%1�KDYH�EHHQ�OLPLWHG�WR�FRPSDULVRQV�RI�D�QDUURZ�UDQJH�RI WUHDWPHQWV �:KLWWDO HW�ϱϰ

DO��������7KRPSVRQ�%UHQQHU�HW�DO��������+D\��������3ROQD\�HW�DO��������/LQDUGRQ�HW�DO��ϱϱ

�������1HWZRUN�PHWD�DQDO\VLV �10$� KDV�DGYDQWDJHV RYHU�VWDQGDUG�SDLUZLVH�PHWD�DQDO\VLVϱϲ

LQ�WKDW ��� DOO WKH WUHDWPHQWV�WKDW�KDYH�EHHQ�WHVWHG�LQ�5&7V�FDQ�EH�VLPXOWDQHRXVO\�FRPSDUHGϱϳ

WR�HDFK�RWKHU LQ�RQH�DQDO\VLV� DQG ��� WKHLU�HIIHFWV�FDQ�EH�HVWLPDWHG�UHODWLYH�WR�HDFK�RWKHU�ϱϴ

Page 6: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϱ

DQG�WR�D�FRPPRQ�UHIHUHQFH�FRQGLWLRQ��VXFK�DV�D�ZDLW OLVW���(VWLPDWHV�RI�WKH�UHODWLYH�HIIHFWV�RI�ϱϵ

SDLUV�RI�WUHDWPHQWV�WKDW�KDYH�RIWHQ��UDUHO\��RU�QHYHU EHHQ�GLUHFWO\�FRPSDUHG�LQ�DQ 5&7�FDQ�ϲϬ

EH�FDOFXODWHG��&RQVHTXHQWO\��DQ�10$ RYHUFRPHV�VRPH�RI�WKH�OLPLWDWLRQV�RI�D�WUDGLWLRQDO�ϲϭ

PHWD�DQDO\VLV�LQ�ZKLFK�FRQFOXVLRQV�DUH�ODUJHO\�UHVWULFWHG�WR�FRPSDULVRQV�EHWZHHQ�WUHDWPHQWV�ϲϮ

WKDW�KDYH EHHQ�GLUHFWO\�FRPSDUHG�LQ�5&7V��'LDV�HW�DO��������ϲϯ

$Q 10$ ZDV�GHYHORSHG�DQG�FRQGXFWHG�RI�DOO�SV\FKRORJLFDO��SKDUPDFRORJLFDO��DQG�ϲϰ

FRPELQDWLRQ WKHUDSLHV�WKDW�DUH�XVHG�IRU�WKH�WUHDWPHQW�RI�DGXOW�%1��DQG�ZKLFK�KDYH�EHHQ�ϲϱ

WHVWHG�LQ�5&7V��7KLV�10$�ZDV�XVHG WR LQIRUP WKH QHZ�QDWLRQDO FOLQLFDO�JXLGDQFH�IRU�HDWLQJ�ϲϲ

GLVRUGHUV LQ�(QJODQG�UHOHDVHG�E\�WKH�1DWLRQDO ,QVWLWXWH�IRU�+HDOWK�DQG�&DUH�([FHOOHQFH�ϲϳ

�1,&(���������7KH�JXLGHOLQH�ZDV�GHYHORSHG�E\�D�*XLGHOLQH�&RPPLWWHH��DQ�LQGHSHQGHQWϲϴ

PXOWL�GLVFLSOLQDU\�WHDP�FRQVLVWLQJ�RI�FOLQLFDO�DFDGHPLFV� KHDOWK�SURIHVVLRQDOV�DQG�VHUYLFH�ϲϵ

XVHUV DQG�FDUHU�UHSUHVHQWDWLYHV�ZLWK�H[SHUWLVH�DQG�H[SHULHQFH LQ�WKH�ILHOG�RI�HDWLQJ�ϳϬ

GLVRUGHUV� 7KLV�DUWLFOH�UHSRUWV�WKH�ILQGLQJV�RI�WKH�10$�WKDW�ZDV�FRQGXFWHG�WR�LQIRUP�WKH�1,&(�ϳϭ

JXLGHOLQH�RQ�WKH�PRVW�HIIHFWLYH�WUHDWPHQWV�IRU�%1�LQ�DGXOWV�ϳϮ

ϳϯ

Page 7: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϲ

0(7+2'6ϳϰ

6HDUFK VWUDWHJ\ϳϱ

$�VHDUFK�IRU�SXEOLVKHG�DQG�XQSXEOLVKHG�VWXGLHV�RQ�WKH�WUHDWPHQW�RI�DGXOWV�ZLWK�HDWLQJ�ϳϲ

GLVRUGHUV�ZDV�FRQGXFWHG�LQ�WKH�GDWDEDVHV�(PEDVH��0HGOLQH��3V\F,1)2�DQG�&HQWUDO WR�ϳϳ

LQIRUP�WKH�1,&(�JXLGHOLQH��$OO�GDWDEDVHV�ZHUH�VHDUFKHG�IURP�WKHLU�LQFHSWLRQ�WR�-XO\������ϳϴ

DQG�QR�ODQJXDJH�OLPLWV�ZHUH�VHW��7KH�VWUDWHJ\�XVHG�WHUPV�FRYHULQJ�DOO�HDWLQJ�GLVRUGHUV��LQ�ϳϵ

DFFRUGDQFH�ZLWK�WKH�1,&(�JXLGHOLQH�VFRSH��7KH�EDODQFH�EHWZHHQ�VHQVLWLYLW\��WKH�SRZHU�WR�ϴϬ

LGHQWLI\�DOO�VWXGLHV�RQ�D�SDUWLFXODU�WRSLF��DQG�VSHFLILFLW\��WKH�DELOLW\�WR�H[FOXGH�LUUHOHYDQW�ϴϭ

VWXGLHV�IURP�WKH�UHVXOWV��ZDV�FDUHIXOO\�FRQVLGHUHG��DQG�D�GHFLVLRQ�ZDV�PDGH�WR�XWLOLVH�D�ϴϮ

EURDG��SRSXODWLRQ�EDVHG�DSSURDFK�WR�WKH�VHDUFK�LQ�RUGHU�WR�PD[LPLVH�UHWULHYDO�LQ�D�ZLGH�ϴϯ

UDQJH�RI�DUHDV��7R�DLG�UHWULHYDO�RI�UHOHYDQW�DQG�VRXQG�VWXGLHV��µILOWHUV¶�ZHUH�XVHG��ZKHUH�ϴϰ

DSSURSULDWH��WR�OLPLW�WKH�VHDUFK�UHVXOWV�WR�5&7V��6HH�6XSSOHPHQWDU\�$SSHQGL[���IRU�IXOO�ϴϱ

GHWDLOV�RI�WKH�VHDUFK�WHUPV�XVHG�ϴϲ

6HOHFWLRQ�FULWHULDϴϳ

$ V\VWHPDWLF�UHYLHZ�RI�LQWHUYHQWLRQV�IRU�%1�ZDV�FDUULHG�RXW�DFFRUGLQJ�WR�3UHIHUUHG�5HSRUWLQJ�ϴϴ

,WHPV�IRU�6\VWHPDWLF�UHYLHZV�DQG�0HWD�$QDO\VHV��35,60$��JXLGHOLQHV �0RKHU�HW�DO��������ϴϵ

7KH�WLWOHV�DQG�DEVWUDFWV�RI�LGHQWLILHG�VWXGLHV�ZHUH�VFUHHQHG�E\�WZR UHYLHZHUV�DJDLQVW�ϵϬ

LQFOXVLRQ�FULWHULD�VSHFLILHG�LQ�WKH�JXLGHOLQH�UHYLHZ�SURWRFROV��XQWLO�D�JRRG�LQWHU�UDWHU�UHOLDELOLW\�ϵϭ

ZDV�REVHUYHG��SHUFHQWDJH�DJUHHPHQW������ RU�.DSSD�VWDWLVWLF�.!����� �1,&(�������� $Q\�ϵϮ

GLVDJUHHPHQWV�EHWZHHQ�UDWHUV�ZHUH�UHVROYHG�WKURXJK GLVFXVVLRQ��2QFH�IXOO�YHUVLRQV�RI�WKH�ϵϯ

VHOHFWHG�VWXGLHV�ZHUH�DFTXLUHG�IRU�DVVHVVPHQW��IXOO�VWXGLHV�ZHUH�FKHFNHG�LQGHSHQGHQWO\�E\�ϵϰ

WZR UHYLHZHUV��ZLWK�DQ\�GLIIHUHQFHV�EHLQJ�UHVROYHG ZLWK�GLVFXVVLRQ��'DWD�ZHUH H[WUDFWHG�RQ�ϵϱ

WKH�VWXG\�FKDUDFWHULVWLFV��DVSHFWV�RI�WKH�PHWKRGRORJLFDO�TXDOLW\��RXWFRPH�GDWD��DQG�ULVN�RI�ϵϲ

ELDV�ϵϳ

5&7V IRU�WKH�V\VWHPDWLF�UHYLHZ�RI�WUHDWPHQWV�IRU�%1�ZHUH�LQFOXGHG�LI�WKH\�UHSRUWHG�RQ�ϵϴ

WUHDWPHQWV�IRU�SHRSOH�DJHG�DW�OHDVW����\HDUV�ZKR�IXOILOOHG�GLDJQRVWLF�FULWHULD�IRU�%1 �L�H��'60�ϵϵ

Page 8: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϳ

,9���7ZR�UHYLHZHUV�LQGHSHQGHQWO\�DVVHVVHG�HOLJLELOLW\��VWXGLHV�ZHUH�LQFOXGHG�LI�WKH\�ZHUH�ϭϬϬ

5&7V�H[DPLQLQJ�SV\FKRORJLFDO� SKDUPDFRORJLFDO��RU�FRPELQDWLRQ�WKHUDSLHV FRPSDUHG�ZLWK�D�ϭϬϭ

ZDLW OLVW��SLOO�SODFHER��RU�DQRWKHU�DFWLYH�WUHDWPHQW� 1XWULWLRQDO PDQDJHPHQW�ZDV�QRW�ϭϬϮ

FRQVLGHUHG�LQ�WKH�UHYLHZ DV�WKLV�ZDV�VHHQ�DV�DQ�DGG�RQ�WR�WUHDWPHQWV�IRU�SHRSOH�ZLWK�%1�ϭϬϯ

$OVR��RQO\�WUHDWPHQWV�DYDLODEOH DQG�OLFHQVHG LQ�WKH�8. IRU�%1�ZHUH�LQFOXGHG��ϭϬϰ

$FFRUGLQJ�WR�WKH�1,&(�*XLGHOLQH�&RPPLWWHH¶V�H[SHUW YLHZ� LW�ZDV�LPSRUWDQW�WR�GLIIHUHQWLDWH�ϭϬϱ

EHWZHHQ�&%7�VSHFLILF�WR�HDWLQJ�GLVRUGHUV��&%7�('��DQG�JHQHULF�&%7��&%7�('�LV�WKH�ϭϬϲ

OHDGLQJ�IRUP�RI�WUHDWPHQW�IRU�%1�WKDW�SODFHV�HPSKDVLV�RQ�WKH�HDWLQJ�GLVRUGHU�ϭϬϳ

SV\FKRSDWKRORJ\�DQG�PD\�KDYH�VRPH�GLIIHUHQFHV�LQ�HIILFDF\ ZKHQ�FRPSDUHG�ZLWK�&%7�QRQ�ϭϬϴ

VSHFLILF�WR�HDWLQJ�GLVRUGHUV��,W�ZDV�DOVR�FRQVLGHUHG�LPSRUWDQW�WR�GLVWLQJXLVK�EHWZHHQ�JURXS�ϭϬϵ

DQG�LQGLYLGXDO�WUHDWPHQWV��DQG�EHWZHHQ�SXUH�DQG�JXLGHG�FRJQLWLYH�EHKDYLRXUDO�VHOI�KHOS�ϭϭϬ

EHFDXVH�WKHUH�PD\�EH�VRPH�GLIIHUHQFHV�LQ�HIILFDF\�DQG�DOVR�RQ�FRVW�HIIHFWLYHQHVV� ZKLFK�LVϭϭϭ

DQ�LPSRUWDQW�IDFWRU�ZKHQ�PDNLQJ�UHFRPPHQGDWLRQV�IRU�1,&(�JXLGHOLQHV�ϭϭϮ

1HWZRUN�PHWD�DQDO\VLVϭϭϯ

7R�WDNH�DOO�WULDO�LQIRUPDWLRQ�LQWR�FRQVLGHUDWLRQ� QHWZRUN�PHWD�DQDO\WLF�WHFKQLTXHV �PL[HG�ϭϭϰ

WUHDWPHQW�FRPSDULVRQV� ZHUH�HPSOR\HG�WR�V\QWKHVLVH�HYLGHQFH��7KH�FULWLFDO�RXWFRPHV�LQ�WKH�ϭϭϱ

V\VWHPDWLF�UHYLHZ�FRQGXFWHG�IRU�WKH�1,&(�JXLGHOLQH�ZHUH�UHPLVVLRQ��ORQJ�WHUP�UHFRYHU\��DQG�ϭϭϲ

ELQJH�HDWLQJ��7KH�JXLGHOLQH�V\VWHPDWLF�UHYLHZ�RI�WKH�FOLQLFDO�OLWHUDWXUH�LGHQWLILHG RQO\ RQHϭϭϳ

GLFKRWRPRXV�RXWFRPH�WKDW�FRXOG�EH�XWLOLVHG�LQ�WKH�10$ � IXOO�UHPLVVLRQ�DW�WKH�HQG�RI�ϭϭϴ

WUHDWPHQW ± DV�WKH�UHSRUWLQJ�RI�WKH�RWKHU�RXWFRPH�PHDVXUHV�ZDV�LQFRQVLVWHQW�DFURVV�WKH�ϭϭϵ

WULDOV��7KH�10$�ZDV DOVR XVHG�WR�LQIRUP�D�FRVW�HIIHFWLYHQHVV�DQDO\VLV�DQG�WKH�*XLGHOLQH�ϭϮϬ

&RPPLWWHH�ZDV�RI�WKH YLHZ�WKDW�IXOO�UHPLVVLRQ�DW�WKH�HQG�RI�WUHDWPHQW ZDV�DQ�LPSRUWDQW�ϭϮϭ

RXWFRPH�WR�SXUVXH�LQ�WKH�HFRQRPLF�HYDOXDWLRQ�ϭϮϮ

7KH�LGHQWLILHG�5&7V�HPSOR\HG�D�UDQJH�RI�GHILQLWLRQV�RI�IXOO�UHPLVVLRQ��XWLOLVLQJ�FULWHULD�VXFK�ϭϮϯ

DV�DEVWLQHQFH�IURP�ELQJH�HDWLQJ�DQG�SXUJLQJ��)ROORZLQJ�FRQVXOWDWLRQ�ZLWK�WKH�1,&(�*XLGHOLQH�ϭϮϰ

&RPPLWWHH��5&7V�ZHUH�LQFOXGHG�RQO\�LI�WKH\�GHILQHG�IXOO�UHPLVVLRQ�DV�HLWKHU�WKH�DEVWLQHQFH�ϭϮϱ

Page 9: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϴ

RI�EXOLPLD�UHODWHG�V\PSWRPV�RYHU�D�PLQLPXP�RI�D�WZR�ZHHN�SHULRG��RU�DV�QR�ORQJHU�PHHWLQJ�ϭϮϲ

'60�,9�FULWHULD�IRU�%1��LQFOXGLQJ�FRJQLWLYH�HOHPHQWV���7KH�GHILQLWLRQ�RI�UHPLVVLRQ�ZDV�ϭϮϳ

GHFLGHG�EHIRUH�VHOHFWLRQ�RI�VWXGLHV��$�QXPEHU�RI�H[FOXGHG�VWXGLHV�HPSOR\HG�VKRUWHU�WLPH�ϭϮϴ

IUDPHV�RU�OHVVHU�V\PSWRP�UHGXFWLRQ��+RZHYHU��VWULFWHU�FULWHULD�IRU�GHILQLQJ�IXOO�UHPLVVLRQ�ZHUH�ϭϮϵ

XVHG�EHFDXVH�WKH�IOXFWXDWLQJ�QDWXUH�RI�V\PSWRP�VHYHULW\�DQG�JDSV�EHWZHHQ�EHKDYLRXUV�LQ�ϭϯϬ

%1�PHDQ�WKDW�D�VKRUWHU�WLPH�SHULRG�ZRXOG�QRW�EH�FOLQLFDOO\�PHDQLQJIXO��,Q�VWXGLHV�ZKHUH�WKH�ϭϯϭ

WLPH�IUDPH�IRU�UHPLVVLRQ�ZDV�XQFOHDU��WKH�*XLGHOLQH�&RPPLWWHH�ZDV�FRQVXOWHG�WR�GHFLGH�ϭϯϮ

ZKHWKHU�WKH�VWXG\�VKRXOG�EH�LQFOXGHG�LQ�WKH�UHYLHZ��ϭϯϯ

$�QHWZRUN�RI�WUHDWPHQWV�LQFOXGHG�LQ�WKH�V\VWHPDWLF�UHYLHZ� IRU�ZKLFK�GDWD�RQ�IXOO�UHPLVVLRQ�DW�ϭϯϰ

HQG�RI�WUHDWPHQW�ZHUH�DYDLODEOH��ZDV�GHVLJQHG��2QO\ WUHDWPHQWV�WKDW�ZHUH�FRQQHFWHG�WR�WKH�ϭϯϱ

QHWZRUN ZHUH�FRQVLGHUHG��7UHDWPHQW�DV�XVXDO�DUPV�ZHUH�H[FOXGHG� VLQFH�WKH�GHILQLWLRQV�RI�ϭϯϲ

µWUHDWPHQW�DV�XVXDO¶ YDULHG�DFURVV�WKH�VWXGLHV�DQG�ZHUH�WKHUHIRUH�QRW�LQIRUPDWLYH�WR WKHϭϯϳ

*XLGHOLQH�&RPPLWWHH� +HDG�WR�KHDG�FRPSDULVRQV�RI�QR�LQWHUHVW��VXFK�DV�LQWHUYHQWLRQV�QRW�ϭϯϴ

DYDLODEOH�RU�OLFHQVHG�IRU�%1�LQ�WKH�8.��DV�ZHOO�DV�FRQWUROV�RI�QR�LQWHUHVW��ZHUH�H[FOXGHG�IURP�ϭϯϵ

WKH�DQDO\VLV�XQOHVV�WKH\�DOORZHG�LQGLUHFW�FRPSDULVRQV�EHWZHHQ�LQWHUYHQWLRQV�RI�LQWHUHVW��VHH�ϭϰϬ

6XSSOHPHQWDU\�$SSHQGL[���IRU�GHWDLOV�RI WKH�LQFOXGHG�VWXGLHV LQ�WKH�10$���$Q LQWHQWLRQ�WR�ϭϰϭ

WUHDW��,77��DQDO\VLV ZDV�DGRSWHG ZKHQ�HVWLPDWLQJ�IXOO�UHPLVVLRQ��WKDW�LV��DOO UDQGRPLVHG�ϭϰϮ

SDWLHQWV�ZHUH�LQFOXGHG�DQG�DQ\RQH�GLVFRQWLQXLQJ WUHDWPHQW� IRU�ZKDWHYHU�UHDVRQ� ZDV�ϭϰϯ

DVVXPHG QRW WR�EH�LQ�UHPLVVLRQ�� 7KH�IORZFKDUW GLDJUDP IRU�WKH�10$ LV�SURYLGHG�LQ�)LJXUH���ϭϰϰ

,QVHUW�)LJXUH��ϭϰϱ

7KH�&RPPLWWHH�PDGH�DQ D SULRUL DVVXPSWLRQ�WKDW�WKHUH�ZRXOG�QHHG�WR�EH�DW�OHDVW�����SHRSOH�ϭϰϲ

UDQGRPLVHG�WR�D�WUHDWPHQW�DFURVV�DOO�LQFOXGHG�WULDOV�LQ�WKH�10$�IRU�WKHP�WR�PDNH�D�ϭϰϳ

UHFRPPHQGDWLRQ�ZLWK�FRQILGHQFH��ϭϰϴ

6WDWLVWLFDO�DQDO\VLVϭϰϵ

%RWK�IL[HG�HIIHFWV DQG�UDQGRP�HIIHFWV PRGHOV��%LQRPLDO�/LNHOLKRRG�DQG�/RJLW�OLQN��ZHUH�UXQϭϱϬ

�VHH�WKH�6XSSOHPHQWDU\�$SSHQGL[�� DQG�� IRU�:LQ%8*6 IL[HG�HIIHFWV�DQG�UDQGRP�HIIHFWVϭϱϭ

Page 10: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϵ

PRGHO�FRGHV��UHVSHFWLYHO\���'LDV�HW�DO������$���7KH�JRRGQHVV�RI�ILW�RI�HDFK�PRGHO�WR�WKH�ϭϱϮ

GDWD�ZDV�PHDVXUHG�E\�FRPSDULQJ�WKH�SRVWHULRU�PHDQ�RI�WKH�VXPPHG�GHYLDQFH�FRQWULEXWLRQV�ϭϱϯ

WR�WKH�QXPEHU�RI�GDWD�SRLQWV �'HPSVWHU�������� 7KH�'HYLDQFH�,QIRUPDWLRQ�&ULWHULRQ��',&���ϭϱϰ

ZKLFK�LV�HTXDO�WR�WKH�VXP�RI�WKH�SRVWHULRU�PHDQ�RI�WKH�UHVLGXDO�GHYLDQFH�DQG�WKH�HIIHFWLYH�ϭϱϱ

QXPEHU�RI�SDUDPHWHUV� ZDV�XVHG�DV�WKH EDVLV�IRU�PRGHO�FRPSDULVRQ �6SLHJHOKDOWHU�HW�DO��ϭϱϲ

������ 0RGHO�VHOHFWLRQ�ZDV�DOVR�LQIOXHQFHG�E\ WKH�SRVWHULRU�PHDQ�EHWZHHQ�VWXG\�ϭϱϳ

KHWHURJHQHLW\ VWDQGDUG�GHYLDWLRQ �6'�� $QDO\VHV�ZHUH�XQGHUWDNHQ�LQ�D�%D\HVLDQ�IUDPHZRUN��ϭϱϴ

XVLQJ�:LQ%8*6 ����� �/XQQ�HW�DO��������ϭϱϵ

5HODWLYH�HIIHFWV�DUH�UHSRUWHG�DV�RGGV�UDWLRV�ZLWK�����FUHGLEOH�LQWHUYDOV��&U,���7UHDWPHQWV�ϭϲϬ

ZHUH�DOVR�UDQNHG�EDVHG�RQ�WKHLU�HIIHFWLYHQHVV��ZLWK ORZHU�UDQNV LQGLFDWLQJ�PRUH�HIIHFWLYH�ϭϲϭ

WUHDWPHQWV� 0HGLDQ�UDQNV�DQG�����&U,�DUH�SUHVHQWHG�IRU�HDFK�WUHDWPHQW�ϭϲϮ

&RQWLQXLW\�FRUUHFWLRQϭϲϯ

,Q�WKH�GDWDVHW��VHYHUDO�VWXGLHV�UHSRUWHG�]HUR HYHQWV RI�LQWHUHVW LQ�VRPH�DUPV �WKDW�LV��WKH�ϭϲϰ

QXPEHU�RI�SHRSOH�DFKLHYLQJ�IXOO�UHPLVVLRQ�ZDV ]HUR���&RPELQLQJ�VXFK�GDWD�FDQ�EH�ϭϲϱ

SUREOHPDWLF� ZKHQ�]HUR�HYHQWV�RFFXU�LQ�VRPH�DUPV RI�D�VWXG\��WKH�ORJ�RGGV�UDWLR�EHFRPHVϭϲϲ

XQGHILQHG��DV�GRHV WKH�YDULDQFH�� ZKLFK FDXVHV�SUREOHPV LQ�WKH�DQDO\VLV DQG�SUHFOXGHV�WKH�ϭϲϳ

HVWLPDWLRQ�RI�UHODWLYH�HIIHFWV� $V�D�UHVXOW� FRQWLQXLW\�FRUUHFWLRQV�DUH�QHHGHG��8VLQJ�D�ϭϲϴ

FRQWLQXLW\�FRUUHFWLRQ�IRU�VWXGLHV�ZLWK�]HUR�FRXQWV�DOORZV�WKH�ORJ�RGGV�UDWLR�WR�EH�HVWLPDWHG��ϭϲϵ

DQG�KHQFH�DOORZV�V\QWKHVLV�YLD�VWDQGDUG�10$�PHWKRGV��7KHUH�DUH�PDQ\�SRVVLEOH�FRQWLQXLW\�ϭϳϬ

FRUUHFWLRQ�PHWKRGV �6ZHHWLQJ�HW�DO�������� ,Q�WKH�SUHVHQW�VWXG\� D�FRQWLQXLW\�FRUUHFWLRQ�RI�����ϭϳϭ

ZDV�DGGHG�WR�ERWK�WKH�QXPEHU�RI�HYHQWV�DQG�WKH�QXPEHU�RI�QRQ�HYHQWV DFURVV�DOO�VWXG\�ϭϳϮ

DUPV� LQ VWXGLHV�LQ�ZKLFK�RQH�RU�PRUH��EXW�QRW�DOO��DUPV�KDG ]HUR�HYHQWV�ϭϳϯ

,QFRQVLVWHQF\�FKHFNVϭϳϰ

$�EDVLF�DVVXPSWLRQ�RI�DQ�10$�LV�WKDW�GLUHFW�DQG�LQGLUHFW�HYLGHQFH�HVWLPDWH�WKH�VDPH�ϭϳϱ

SDUDPHWHU� 7KDW�LV��WKH�UHODWLYH�HIIHFW�EHWZHHQ�$�DQG�%�PHDVXUHG�GLUHFWO\�IURP�DQ�$�YHUVXV�ϭϳϲ

%�WULDO�LV�WKH�VDPH�DV�WKH�UHODWLYH�HIIHFW�EHWZHHQ�$�DQG�%�HVWLPDWHG�LQGLUHFWO\�IURP�$�YHUVXV�ϭϳϳ

&�DQG�%�YHUVXV�&�WULDOV��,QFRQVLVWHQF\�DULVHV ZKHQ�WKHUH�LV D�FRQIOLFW�EHWZHHQ�GLUHFW�ϭϳϴ

Page 11: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϭϬ

HYLGHQFH �IURP�DQ�$�YHUVXV�%�WULDO� DQG�LQGLUHFW�HYLGHQFH��JDLQHG�IURP�$ YHUVXV�&�DQG�%ϭϳϵ

YHUVXV�&�WULDOV�� 7KLV�FRQVLVWHQF\�DVVXPSWLRQ�KDV�DOVR�EHHQ�WHUPHG�WKH�VLPLODULW\�RU�ϭϴϬ

WUDQVLWLYLW\�DVVXPSWLRQ �0DYULGLV�HW�DO��������ϭϴϭ

(YLGHQFH�RI�LQFRQVLVWHQF\ ZDV�FKHFNHG�IRU E\�FRPSDULQJ�WKH�VWDQGDUG�QHWZRUN�FRQVLVWHQF\�ϭϴϮ

PRGHO�WR�DQ�µLQFRQVLVWHQF\¶��RU�XQUHODWHG�PHDQ�HIIHFWV� PRGHO �'LDV�HW�DO�������� 7KH�ODWWHU�LV�ϭϴϯ

HTXLYDOHQW�WR�KDYLQJ�VHSDUDWH��XQUHODWHG�PHWD�DQDO\VHV�IRU�HYHU\�SDLU�ZLVH�FRQWUDVW�EXW�ZLWK�ϭϴϰ

D�FRPPRQ�YDULDQFH�SDUDPHWHU�LQ�UDQGRP�HIIHFWV PRGHOV��,PSURYHPHQW�LQ�PRGHO�ILW�RU�D�ϭϴϱ

VXEVWDQWLDO�UHGXFWLRQ�LQ�KHWHURJHQHLW\ LQ�WKH�LQFRQVLVWHQF\�PRGHO FRPSDUHG�WR�WKH�10$�ϭϴϲ

FRQVLVWHQF\�PRGHO� LQGLFDWHV HYLGHQFH�RI�LQFRQVLVWHQF\��7KH�:LQ%8*6�FRGH�IRU�WKH�ϭϴϳ

LQFRQVLVWHQF\�PRGHO�LV�SURYLGHG�LQ�WKH�6XSSOHPHQWDU\�$SSHQGL[�� �'LDV�HW�DO������%��ϭϴϴ

Page 12: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϭϭ

5(68/76ϭϴϵ

,GHQWLILHG�VWXGLHV�DQG�WUHDWPHQWVϭϵϬ

6HYHQW\�ILYH SRWHQWLDOO\�HOLJLEOH�VWXGLHV ZHUH�LGHQWLILHG���� RI�ZKLFK�ZHUH�H[FOXGHG �)LJXUH�ϭϵϭ

��� 7ZHQW\�RQH WULDOV�ZLWK������ SDUWLFLSDQWV�SURYLGHG�GLUHFW�RU�LQGLUHFW�HYLGHQFH�RQ�IXOO�ϭϵϮ

UHPLVVLRQ�DVVRFLDWHG�ZLWK����WUHDWPHQW�RSWLRQV� ZDLW OLVW��LQGLYLGXDO�&%7�('��LQGLYLGXDO�ϭϵϯ

LQWHUSHUVRQDO�SV\FKRWKHUDS\��,37���JXLGHG�FRJQLWLYH�EHKDYLRXUDO�VHOI�KHOS��LQGLYLGXDO�ϭϵϰ

EHKDYLRXU WKHUDS\��%7���SXUH FRJQLWLYH�EHKDYLRXUDO�VHOI�KHOS �L�H���VHOI�KHOS�ZLWK�QR�VXSSRUW���ϭϵϱ

JURXS�&%7�('�JURXS��IOXR[HWLQH��UHOD[DWLRQ��LQGLYLGXDO�&%7�(' SOXV�IOXR[HWLQH��JURXS�%7��ϭϵϲ

DQG�VXSSRUWLYH�SV\FKRWKHUDS\� $PRQJ�WKH����WULDOV�WKHUH�ZHUH ��VWXGLHV��1� �����ϭϵϳ

FRPSDULQJ�WKH�VDPH�WUHDWPHQW�LQ�ERWK�DUPV �H�J��&%7�('�YV��&%7�('��HWF��� 1HYHUWKHOHVV��ϭϵϴ

WKHVH�ZHUH�UHWDLQHG�LQ�WKH�10$ DV�WKH\�FRQWULEXWHG�WR�WKH�HVWLPDWLRQ�RI�EHWZHHQ�VWXG\�ϭϵϵ

KHWHURJHQHLW\��7KH�UHVXOWLQJ QHWZRUN�RI�WULDOV�FRQWULEXWLQJ�GDWD�WR WKH�10$ LV SUHVHQWHG�LQ�ϮϬϬ

)LJXUH��� �)XOO�GHWDLOV�RI�WKH�H[FOXGHG�VWXGLHV�DUH�SURYLGHG�LQ�WKH�6XSSOHPHQWDU\�$SSHQGL[��ϮϬϭ

DQG�WKH�ILQDO�GDWD�ILOH�XVHG�LQ�WKH�10$�LV�VKRZQ�LQ�6XSSOHPHQWDU\�$SSHQGL[����ϮϬϮ

,QVHUW�)LJXUH��ϮϬϯ

5LVN�RI�ELDV�DVVHVVPHQWϮϬϰ

$OO�LQFOXGHG�WULDOV ZHUH�DVVHVVHG IRU�ULVN�RI�ELDV XVLQJ�WKH�*5$'(�ULVN�RI�ELDV�WRRO �%DOVKHP�ϮϬϱ

HW�DO��������*X\DWW�HW�DO�������� 6HTXHQFH�JHQHUDWLRQ�DQG DOORFDWLRQ�FRQFHDOPHQW�ZHUH�ϮϬϲ

DGHTXDWHO\�GHVFULEHG�LQ�HOHYHQ�DQG�WKUHH WULDOV��UHVSHFWLYHO\��7ULDOV�ZHUH�UHJDUGHG DW�KLJK�ϮϬϳ

ULVN�RI�ELDV�IRU�ODFN�RI�SDUWLFLSDQW�DQG�SURYLGHU�PDVNLQJ��,Q�IRXU VWXGLHV� DVVHVVRUV�ZHUH�ϮϬϴ

DZDUH�RI�WUHDWPHQW�DVVLJQPHQW� DQG LQ�IRXU WULDOV�LW�ZDV�XQFOHDU�LI�WKH�DVVHVVRUV�ZHUH�ϮϬϵ

EOLQGHG��$WWULWLRQ�ZDV�KLJK�LQ�PRVW�WULDOV��+RZHYHU��ZH�XVHG�,77�DQDO\VLV�DQG�WUHDWHG�GURS�ϮϭϬ

RXWV�DV�IDLOXUHV��$V�D�UHVXOW� DWWULWLRQ�ELDV�ZDV�QRW�FRQVLGHUHG�LQ�WKH�DVVHVVPHQW��,QFOXGHG�Ϯϭϭ

WULDOV�UHSRUWHG�D�YDULHW\�RI�RXWFRPHV��2QO\�WZR WULDOV�ZHUH�UHJLVWHUHG RQ�D�WULDOV�GDWDEDVH��ϮϭϮ

&RQVHTXHQWO\��PRVW�VWXGLHV ZHUH�MXGJHG�DV�EHLQJ�DW�XQFOHDU ULVN�RI�UHSRUWLQJ�ELDV� 1R�RWKHU�Ϯϭϯ

Page 13: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϭϮ

SRWHQWLDO�ELDVHV�ZHUH�LGHQWLILHG� �5LVN�RI�ELDV�WDEOHV�DUH�SUHVHQWHG�LQ�WKH�6XSSOHPHQWDU\�Ϯϭϰ

$SSHQGL[ ���Ϯϭϱ

10$�PRGHO�ILW�VWDWLVWLFVϮϭϲ

&RQYHUJHQFH�ZDV�VDWLVIDFWRU\�DIWHU DW�OHDVW��������LWHUDWLRQV��0RGHOV�ZHUH�WKHQ�UXQ�IRU�D�Ϯϭϳ

IXUWKHU��������LWHUDWLRQV�RQ�WZR�VHSDUDWH�FKDLQV��DQG�UHVXOWV�DUH�EDVHG�RQ�WKLV�IXUWKHU�Ϯϭϴ

VDPSOH� 7KH�IL[HG�DQG�UDQGRP�HIIHFWV�PRGHOV�KDG�D�VLPLODU�ILW�WR�WKH�GDWD�ZKHQ�FRPSDULQJ�Ϯϭϵ

WKH�SRVWHULRU�PHDQ�UHVLGXDO�GHYLDQFH�DQG�',&�YDOXHV� 0RGHUDWH�WR�KLJK�EHWZHHQ�WULDOV�ϮϮϬ

KHWHURJHQHLW\�ZDV�REVHUYHG�ZKHQ�D�UDQGRP�HIIHFWV�PRGHO�ZDV�XVHG��IJ ����������&U,�����ϮϮϭ

WR �������ZKLFK�ZDV�RI�D�VLPLODU�PDJQLWXGH�WR�WKH�UHODWLYH�HIIHFWV�H[SUHVVHG�RQ�WKH�ORJ�RGGV�ϮϮϮ

UDWLR�VFDOH��VHH�6XSSOHPHQWDU\�$SSHQGL[�����1R�VXEVWDQWLDO�GLIIHUHQFHV�ZHUH�REVHUYHG�LQ�ϮϮϯ

SRVWHULRU�PHDQ�UHVLGXDO�GHYLDQFH�RU ',&�YDOXHV�FRPSDUHG�WR�WKH�LQFRQVLVWHQF\�PRGHO��ZKLFKϮϮϰ

VXJJHVWV QR�LQFRQVLVWHQF\� 0RGHO�ILW�VWDWLVWLFV�IRU�WKH�IL[HG�DQG�UDQGRP�HIIHFWV�PRGHOV��ϮϮϱ

FRQWLQXLW\�FRUUHFWHG��DQG�IRU�WKH�UDQGRP�HIIHFWV�LQFRQVLVWHQF\�PRGHO�DUH�SURYLGHG�LQϮϮϲ

6XSSOHPHQWDU\�$SSHQGL[���� 7KH�UDQGRP�HIIHFWV�PRGHO KDG�D�VOLJKWO\�PRUH�IDYRXUDEOH�ILW�ϮϮϳ

WKDQ�WKH�IL[HG�HIIHFWV��WKHUHIRUH DOO�IXUWKHU�DQDO\VHV�DUH�EDVHG�RQ WKDW PRGHO��ϮϮϴ

7UHDWPHQW�RXWFRPHVϮϮϵ

7KH�SRVWHULRU�PHGLDQ�RGGV�UDWLRV��25��DQG�����&U,�IRU�HDFK�WUHDWPHQW IRU�DFKLHYLQJ�IXOO�ϮϯϬ

UHPLVVLRQ�DW�WKH�HQG�RI�WUHDWPHQW�FRPSDUHG�WR�HYHU\�RWKHU�WUHDWPHQW DUH�UHSRUWHG�LQ�7DEOH����Ϯϯϭ

&RPSDUHG�ZLWK�ZDLW OLVW� LQGLYLGXDO�&%7�('��25�����������&U,����� WR���������JXLGHG�ϮϯϮ

FRJQLWLYH�EHKDYLRXUDO�VHOI�KHOS��25�����������&U,����� WR�������� SXUH FRJQLWLYH�EHKDYLRXUDO�Ϯϯϯ

VHOI�KHOS �25�����������&U,����� WR���������JURXS�&%7�('��25�����������&U,����� WR�Ϯϯϰ

��������DQG�JURXS�%7 �25������������&U,����� WR������� ZHUH�VLJQLILFDQWO\�EHWWHU DW�Ϯϯϱ

DFKLHYLQJ�IXOO�UHPLVVLRQ DW�WKH�HQG�RI�WUHDWPHQW��*URXS %7 ZDV�DOVR�EHWWHU�WKDQ�,37��Ϯϯϲ

IOXR[HWLQH��LQGLYLGXDO�%7��DQG�UHOD[DWLRQ��+RZHYHU��DV�LQGLFDWHG�E\�WKH�YHU\�ZLGH�����&U,�Ϯϯϳ

WKHUH�ZDV�KLJK�XQFHUWDLQW\�UHJDUGLQJ�WKH�WUHDWPHQW�HIIHFWV�RI�JURXS�%7 DQG�JURXS�&%7�('�Ϯϯϴ

7KHVH WKHUDSLHV�KDG�YHU\�VPDOO�QXPEHUV�UDQGRPLVHG�DFURVV�DOO�VWXGLHV DQG� DV�D�UHVXOW�Ϯϯϵ

WKHLU HIIHFWV ZHUH YHU\�XQFHUWDLQ� $OWKRXJK�WKHUH�ZHUH GLIIHUHQFHV�LQ�WKH�PHDQ�HIIHFWVϮϰϬ

Page 14: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϭϯ

EHWZHHQ�DQ\�RWKHU�WUHDWPHQWV��WKHVH ZHUH�QRW VWDWLVWLFDOO\�VLJQLILFDQW� 7KH�SRVWHULRU�PHGLDQ�Ϯϰϭ

ORJ�RGGV�UDWLRV��/25��DQG�����&U, IRU�HDFK�WUHDWPHQW FRPSDUHG�WR�HYHU\�RWKHU�IRU�DFKLHYLQJ�ϮϰϮ

IXOO�UHPLVVLRQ�DW�WKH�HQG�RI�WUHDWPHQW�DV�HVWLPDWHG�E\�WKH�10$��DQG��ZKHUH�DYDLODEOH��WKH�Ϯϰϯ

UHVSHFWLYH�UHVXOWV�IURP�WKH�SDLUZLVH�DQDO\VLV� DUH�SURYLGHG�LQ�6XSSOHPHQWDU\�$SSHQGL[���Ϯϰϰ

7KH�10$�DQG�SDLUZLVH�UHVXOWV�ZHUH�LQ�DJUHHPHQW�LQ�DOO�FDVHV��ZKLFK�VWUHQJWKHQV�WKH�UHVXOWV�Ϯϰϱ

RI�WKH�10$�Ϯϰϲ

)LJXUH���VKRZV�WKH�25V��RQ�D�ORJ�VFDOH��LQ�UHPLVVLRQ�FRPSDUHG�WR�ZDLW�OLVW� 0RVW�RI�WKH�Ϯϰϳ

WUHDWPHQWV�KDG YHU\�ZLGH�&U,�DQG�FURVVHG WKH�OLQH�RI�QR�HIIHFW� 0RVW�&U, DOVR RYHUODSSHG�Ϯϰϴ

LQGLFDWLQJ�QR�GLIIHUHQFH�EHWZHHQ�WKH�WUHDWPHQWV�Ϯϰϵ

,QVHUW�7DEOH��ϮϱϬ

,QVHUW�)LJXUH��Ϯϱϭ

7UHDWPHQW�UDQNLQJV�ϮϱϮ

7KH�WUHDWPHQWV ZLWK�WKH�ORZHVW SRVWHULRU�PHGLDQ UDQN�ZHUH�JURXS�%7 ��VW������&U,��VW WR �WK���Ϯϱϯ

IROORZHG�E\�JURXS�&%7�('���UG������&U,��VW WR �WK���LQGLYLGXDO�&%7�('���WK������&U,��QG�WR �WK���Ϯϱϰ

DQG�JXLGHG�FRJQLWLYH�EHKDYLRXUDO�VHOI�KHOS���WK������&U,��QG WR �WK���7DEOH�� VKRZV�WKH�Ϯϱϱ

SRVWHULRU�PHGLDQ UDQNV�DQG�WKH�DVVRFLDWHG�����&U,�Ϯϱϲ

,QVHUW�7DEOH��Ϯϱϳ

7KH�IXOO�UHVXOWV�RI�WKH�10$�DUH�SURYLGHG�LQ�6XSSOHPHQWDU\�$SSHQGL[�����Ϯϱϴ

Ϯϱϵ

Page 15: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϭϰ

',6&866,21ϮϲϬ

7R�RXU�NQRZOHGJH��WKLV�LV�WKH�ILUVW�UHSRUWHG�10$�LQ�SHRSOH�ZLWK�%1��2QO\�RQH�SUHYLRXV 10$Ϯϲϭ

LQ�SHRSOH�ZLWK�HDWLQJ�GLVRUGHUV�ZDV�LGHQWLILHG� H[DPLQLQJ�WKH�HIIHFWLYHQHVV�RI�SV\FKRORJLFDO�ϮϲϮ

DQG�SKDUPDFRORJLFDO�LQWHUYHQWLRQV IRU ELQJH�HDWLQJ�GLVRUGHU �3HDW�HW�DO�������� 2YHUDOO��WKH�Ϯϲϯ

UHVXOWV�RI�WKH�SUHVHQW�10$�VXJJHVW�WKDW�JURXS�%7��JURXS�&%7�('��LQGLYLGXDO�&%7�('�DQG�Ϯϲϰ

JXLGHG�FRJQLWLYH�EHKDYLRXUDO�VHOI�KHOS�DUH�PRUH�HIIHFWLYH�WKDQ�RWKHU�WUHDWPHQWV�LQ�DFKLHYLQJ�Ϯϲϱ

IXOO�UHPLVVLRQ�DW�WKH�HQG�RI�WUHDWPHQW��7KH�ILQGLQJV�IRU�JURXS�%7�DQG�JURXS�&%7�('�ZHUH�Ϯϲϲ

EDVHG�RQ�YHU\�VPDOO�QXPEHUV�UDQGRPLVHG �1�� �����DQG�ZHUH�FKDUDFWHULVHG�E\ YHU\�ZLGHϮϲϳ

&U,� 6LPLODUO\��WKH�HYLGHQFH�IRU�RWKHU�WUHDWPHQWV� ZLWK�WKH�H[FHSWLRQ�RI�,37� ZDV�OLPLWHG��Ϯϲϴ

+RZHYHU��WKH�PHDQ�HIIHFWV IRU�WKHVH�WUHDWPHQWV VXJJHVW�D�OHVV�JRRG RXWFRPH�ZKHQ�Ϯϲϵ

FRPSDUHG�ZLWK�FRJQLWLYH�RU�EHKDYLRXUDO�WKHUDSLHV� $V�D�UHVXOW��LQGLYLGXDO�&%7�('�DQG�JXLGHG�ϮϳϬ

FRJQLWLYH�EHKDYLRXUDO�VHOI�KHOS�DUH�WKH�WUHDWPHQWV�IRU�ZKLFK�WKHUH�LV�WKH�PRVW�UHOLDEOH�Ϯϳϭ

HYLGHQFH� $OVR��WKH LQFRQVLVWHQF\�FKHFNV GLG�QRW�LGHQWLI\�DQ\�VLJQLILFDQW�LQFRQVLVWHQF\�ϮϳϮ

EHWZHHQ�WKH�GLUHFW�DQG�LQGLUHFW�HYLGHQFH�LQFOXGHG�LQ�WKH�10$��ZKLFK�VWUHQJWKHQV�WKH�Ϯϳϯ

FRQFOXVLRQV�RI�WKH�DQDO\VLV�Ϯϳϰ

1RW�DOO�WULDOV�LGHQWLILHG�LQ�WKH�V\VWHPDWLF�UHYLHZ�SURYLGHG�GDWD�RQ�IXOO�UHPLVVLRQ��µ)XOO�Ϯϳϱ

UHPLVVLRQ¶ ZDV�QRW�FOHDUO\ GHILQHG LQ�VRPH 5&7V� DQG WKHUH�ZDV ZLGH�YDULDWLRQ�LQ LWV�Ϯϳϲ

GHILQLWLRQ�ZKHQ�LW�ZDV�UHSRUWHG� ,Q�SDUWLFXODU��D�QXPEHU�RI�5&7V�ZHUH H[FOXGHG�EHFDXVH�Ϯϳϳ

UHPLVVLRQ�ZDV�GHILQHG�DV�DEVWLQHQFH�IURP�EXOLPLD�UHODWHG�V\PSWRPV�RYHU�D SHULRG�RI�OHVV�Ϯϳϴ

WKDQ���ZHHNV��$FFRUGLQJ�WR�WKH�1,&(�*XLGHOLQH�&RPPLWWHH¶V H[SHUW�RSLQLRQ�RQO\�DEVWLQHQFH�Ϯϳϵ

IURP�ELQJHLQJ�RYHU�DQG�DERYH�WZR�ZHHNV�VKRXOG�EH�FRQVLGHUHG� $OWKRXJK�WKLV�WZR�ZHHN�ϮϴϬ

SHULRG�ZDV�VHHQ�DV�D�UHODWLYHO\�ZHDN�GHILQLWLRQ��PRUH�VWULQJHQW�LQFOXVLRQ�FULWHULD�ZRXOG�KDYH�Ϯϴϭ

H[FOXGHG�WKH�PDMRULW\�RI�VWXGLHV�VLQFH�RQO\�IHZ RI�WKHP KDG�ORQJHU�UHSRUWHG�SHULRGV�ϮϴϮ

,W LV�DFNQRZOHGJHG�WKDW�QRW�PHHWLQJ�IXOO�'60�,9�FULWHULD�LV�QRW�WKH�VDPH�DV�DEVWLQHQFH�IURP�Ϯϴϯ

ELQJH�HDWLQJ�DQG�FRPSHQVDWRU\�EHKDYLRXUV��DQG�LW�FRXOG�SRWHQWLDOO\�LQFOXGH�SHRSOH�LQ�SDUWLDO�Ϯϴϰ

UHPLVVLRQ��+RZHYHU��JLYHQ�D OLPLWHG�HYLGHQFH�EDVH�WKH�FRPPLWWHH�PDGH�D�GHFLVLRQ�WR�Ϯϴϱ

Page 16: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϭϱ

LQFOXGH�VXFK�VWXGLHV��8VH�RI�WKH '60�9 FULWHULD�ZRXOG�KDYH�EHHQ�PRUH�LQFOXVLYH�EXW '60�,9�Ϯϴϲ

FULWHULD�ZDV�VWLOO�LQ�RSHUDWLRQ�ZKHQ�QHDUO\�DOO�RI�WKH�VWXGLHV�ZHUH�FRQGXFWHG�Ϯϴϳ

,W�VKRXOG�DOVR EH�QRWHG�WKDW�SDSHUV�XVHG�LQFRQVLVWHQW�GHILQLWLRQV RI�EHKDYLRXU�FKDQJH� )XWXUH�Ϯϴϴ

UHVHDUFK QHHGV�WR�DGRSW�FRQVLVWHQW�DQG�ULJRURXV�GHILQLWLRQV��,W�LV�SURSRVHG�WKDW�µDEVWLQHQFH¶Ϯϴϵ

EH�GHILQHG�DV�����QR�REMHFWLYH�ELQJHV�RU�SXUJLQJ�EHKDYLRXUV�RYHU�WKH�SUHYLRXV�WKUHH�PRQWKVϮϵϬ

DQG�����EHLQJ�QRW�XQGHUZHLJKW��6LPLODUO\��µIXOO�UHPLVVLRQ¶ VKRXOG�EH�GHILQHG�DV�DEVWLQHQFH��Ϯϵϭ

SOXV�DWWLWXGHV�WRZDUGV�HDWLQJ��ZHLJKW�DQG�VKDSH ZLWKLQ�RQH�VWDQGDUG�GHYLDWLRQ�RI�WKH�ϮϵϮ

FRPPXQLW\ UDQJH�IRU�WKH�UHOHYDQW�SRSXODWLRQ�Ϯϵϯ

7KH�,77�DQDO\VLV�PHDQW�WKDW�DOO�SDUWLFLSDQWV�ZHUH�DQDO\VHG�LQ�WKH�JURXS�WR ZKLFK�WKH\�KDG�Ϯϵϰ

EHHQ�UDQGRPL]HG�DQG�DOO�VWXG\�QRQ�FRPSOHWHUV�ZHUH�DVVXPHG�WR�QRW EH�LQ�UHPLVVLRQ��7KLV�Ϯϵϱ

VWUDWHJ\�ZDV�VXSSRUWHG�E\�WKH�1,&(�JXLGHOLQH�FRPPLWWHH�DQG SURYLGHV�D�FRQVHUYDWLYH�Ϯϵϲ

HVWLPDWH�RI�WUHDWPHQW�HIIHFWV�Ϯϵϳ

,W�ZDV�QRW�SRVVLEOH�WR�LQYHVWLJDWH�ZKHWKHU�WKH�HQG�RI�WUHDWPHQW�HIIHFWV�SHUVLVWHG RU�Ϯϵϴ

GLPLQLVKHG LQ�WKH�ORQJ�WHUP�EHFDXVH�PRVW�WULDOV�VWRSSHG�DW�WKH�HQG�RI�WUHDWPHQW��XVXDOO\�DWϮϵϵ

���ZHHNV�� +HQFH��WKHUH�ZDV�LQVXIILFLHQW�HYLGHQFH�WR�LQIRUP�DQ�10$�XVLQJ�UHPLVVLRQ�GDWD�DWϯϬϬ

ORQJ�WHUP�IROORZ�XS� $OVR��HYHQ�WKRXJK�ZH�LQFOXGHG�RQO\�WKRVH�WUHDWPHQWV�DYDLODEOH�DQG�ϯϬϭ

OLFHQVHG�IRU�XVH�LQ�WKH�8.� RQO\�RQH WULDO�ZDV�H[FOXGHG�RQ�WKH�JURXQGV�RI�EHLQJ�RI�QR�LQWHUHVWϯϬϮ

�3RSH�HW�DO� ������ZKLFK FRPSDUHG WUD]RGRQH�ZLWK�SLOO�SODFHER���7KH�ILQGLQJV�VKRXOG�ϯϬϯ

WKHUHIRUH�EH�RI�LQWHUHVW�WR DQ LQWHUQDWLRQDO�DXGLHQFH�ϯϬϰ

2QH�OLPLWDWLRQ RI�WKH�VWXG\ LV�WKDW WKH�OLWHUDWXUH�VHDUFK�LV�RYHU D�\HDU�ROG� +RZHYHU��D�ϯϬϱ

OLWHUDWXUH VHDUFK�RQ 3XE0HG �FRQGXFWHG�0DUFK ����� IDLOHG�WR�LGHQWLI\�DQ\�UHOHYDQW�QHZ�ϯϬϲ

5&7V��ϯϬϳ

7KH�ILQGLQJ�WKDW� DPRQJ�WKH�WUHDWPHQWV�ZLWK�D�UREXVW�HYLGHQFH�EDVH��LQGLYLGXDO�&%7�('ϯϬϴ

DSSHDUV�WR�EH�WKH�PRVW�HIIHFWLYH�RSWLRQ�WR�DFKLHYH UHPLVVLRQ�DW WKH HQG�RI�WUHDWPHQW�IRU�ϯϬϵ

SHRSOH�ZLWK�%1 LV�LQ�OLQH�ZLWK�RWKHU�V\VWHPDWLF�UHYLHZV��/LQDUGRQ�HW�DO��������3ROQD\�HW�DO��ϯϭϬ

������+D\��������6KDSLUR�HW�DO���������2XU DQDO\VLV�VXJJHVWV�WKDW�JXLGHG�FRJQLWLYH�ϯϭϭ

Page 17: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϭϲ

EHKDYLRXUDO�VHOI�KHOS LV�DOVR�HIIHFWLYH� 7KLV�RXWFRPH�LV�DOVR�FRQVLVWHQW ZLWK�WKH�ILQGLQJV�RIϯϭϮ

V\VWHPDWLF UHYLHZV�E\ %HLQWHU�HW�DO�������� DQG�/LQDUGRQ�HW�DO����������ZKLFK VKRZHG WKDW�ϯϭϯ

FRJQLWLYH�EHKDYLRXUDO�VHOI�KHOS WUHDWPHQWV�DUH�XVHIXO�LQ�WKH�WUHDWPHQW�RI�%1 �HVSHFLDOO\�LI�WKH�ϯϭϰ

IHDWXUHV�RI�WKHLU�GHOLYHU\�DQG�LQGLFDWLRQV�DUH�FRQVLGHUHG�FDUHIXOO\���ϯϭϱ

$�UHYLHZ�E\�3ROQD\�HW�DO���������VXJJHVWHG�WKDW�JURXS�&%7�ZDV�HIIHFWLYH�FRPSDUHG�ZLWK�QR�ϯϭϲ

WUHDWPHQW��+RZHYHU��WKHUH�ZDV�LQVXIILFLHQW�HYLGHQFH LQ�WKHLU�UHYLHZ RQ WKH�HIIHFWLYHQHVV�RI�ϯϭϳ

JURXS�&%7�UHODWLYH�WR LQGLYLGXDO�&%7��2XU�XVH�RI�PL[HG�WUHDWPHQW�PHWKRGRORJ\�HQDEOHG�XV�ϯϭϴ

WR�FRPSDUH JURXS�WKHUDSLHV ZLWK�RWKHU�DYDLODEOH�WUHDWPHQW�RSWLRQV� $OWKRXJK�JURXS�&%7�('ϯϭϵ

DQG JURXS %7�ZHUH�HIIHFWLYH�LQ�DFKLHYLQJ�UHPLVVLRQ�DW�WKH�HQG�RI�WUHDWPHQW� WKH�HVWLPDWHV�RI�ϯϮϬ

HIIHFW�ZHUH�H[WUHPHO\�XQFHUWDLQ��6LPLODUO\� HYHQ�WKRXJK FRPELQDWLRQ�WKHUDSLHV��H�J��&%7�SOXV�ϯϮϭ

IOXR[HWLQH��DQG�RWKHU�SV\FKRORJLFDO�WKHUDSLHV��LQFOXGLQJ�LQGLYLGXDO�,37�DQG LQGLYLGXDO %7��ϯϮϮ

KDYH�VKRZQ�VRPH�HIILFDF\�LQ�LQGLYLGXDO�VWXGLHV��RXU�V\QWKHVLV�SRROHG�HYLGHQFH XVLQJ�GLUHFW�ϯϮϯ

DQG�LQGLUHFW�FRPSDULVRQV�DQG�IRXQG�WKHLU�HIIHFWV�VPDOO�FRPSDUHG�ZLWK�RWKHU�DYDLODEOH�ϯϮϰ

WUHDWPHQWV��ϯϮϱ

7KH�SUHVHQW DQDO\VLV�IRXQG�QR�FRQYLQFLQJ�HYLGHQFH�IRU�WKH�HIIHFWLYHQHVV�RI�SKDUPDFRORJLFDO�ϯϮϲ

WUHDWPHQWV DOWKRXJK IHZ�VWXGLHV�SURYLGHG�GLUHFW�FRPSDULVRQV�EHWZHHQ�SV\FKRORJLFDO�ϯϮϳ

WKHUDSLHV�DQG�SKDUPDFRORJLFDO�WUHDWPHQWV�ϯϮϴ

7DNLQJ�DOO�WKHVH�IDFWRUV�LQWR�DFFRXQW��WKH�1,&( JXLGHOLQH�UHFRPPHQGHG WKDW EXOLPLD�ϯϮϵ

QHUYRVD�IRFXVHG�JXLGHG�VHOI�KHOS�VKRXOG�EH�RIIHUHG�DV�WKH�ILUVW�WUHDWPHQW IRU�DGXOWV�ZLWK�%1ϯϯϬ

LQ�D�VWHSSHG�FDUH�WUHDWPHQW�VWUDWHJ\��ZLWK�WKH�VHFRQG�VWHS�EHLQJ LQGLYLGXDO�HDWLQJ�GLVRUGHU�ϯϯϭ

IRFXVHG�FRJQLWLYH�EHKDYLRXUDO�WKHUDS\��&%7�('���1,&(��������ϯϯϮ

2YHUDOO WKH�HYLGHQFH�EDVH�ZDV�OLPLWHG� LQ�SDUWLFXODU�IRU�D�UDQJH�RI�WUHDWPHQWV��7KHUH�LV�D�ϯϯϯ

FOHDU�QHHG�IRU�ZHOO�FRQGXFWHG�KHDG�WR�KHDG�VWXGLHV�WKDW�H[DPLQH WKH�HIIHFWLYHQHVV�RI�ϯϯϰ

SKDUPDFRORJLFDO��LQGLYLGXDO DV�ZHOO�DV JURXS SV\FKRORJLFDO��DQG�FRPELQHG�SKDUPDFRORJLFDO�ϯϯϱ

DQG�SV\FKRORJLFDO WKHUDSLHV�FRPSDUHG�WR�HDFK�RWKHU�IRU�DGXOWV�ZLWK�%1� ,Q�SDUWLFXODU��ORQJ�ϯϯϲ

WHUP�FRPSDUDWLYH�RXWFRPH�GDWD DUH�QHHGHG�ϯϯϳ

Page 18: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϭϳ

&2175,%87256ϯϯϴ

(.�FRQWULEXWHG�WR�WKH�10$�DQDO\VHV��FRQGXFWHG�LQFRQVLVWHQF\�FKHFNVϯϯϵ

(6�FDUULHG�RXW�WKH�10$�DQG�WKH�DVVRFLDWHG�DQDO\VHV��DQG�ZURWH�WKH�ILUVW�GUDIW�RI�WKH�ϯϰϬ

PDQXVFULSWϯϰϭ

,0�FRQWULEXWHG�WR�WKH�VWXG\�FRQFHSWLRQ��SODQQLQJ��DQG�10$�DQDO\VHVϯϰϮ

/)�FRQWULEXWHG�WR�FDUU\LQJ�RXW�WKH�V\VWHPDWLF�UHYLHZV��GDWD�H[WUDFWLRQ��SURRI�UHDGLQJ�DQG�ϯϰϯ

FRS\�HGLWLQJϯϰϰ

/6D�FRQWULEXWHG�WR�FDUU\LQJ�RXW�WKH�V\VWHPDWLF�UHYLHZV��DQG�GDWD�H[WUDFWLRQϯϰϱ

6'�FRQWULEXWHG�WR�WKH�10$�DQDO\VHV��DQG�FRQGXFWHG�LQFRQVLVWHQF\�FKHFNVϯϰϲ

67�SHUIRUPHG�VHDUFK�VWUDWHJ\ϯϰϳ

7.�FRQWULEXWHG�WR�WKH�VWXG\�FRQFHSWLRQ�DQG�LQWHUSUHWDWLRQ�RI�WKH�UHVXOWVϯϰϴ

&*)��*:��+7�DQG�/6H�SURYLGHG�FOLQLFDO�LQSXW�DQG�LQWHUSUHWDWLRQ�RI�WKH�UHVXOWV�DQG�WKHLU�ϯϰϵ

FOLQLFDO�LPSOLFDWLRQVϯϱϬ

$OO�DXWKRUV�FRQWULEXWHG�WR�WKH�ZULWH�XS�RI�WKH�PDQXVFULSW�DQG�DSSURYHG�WKH�ILQDO�YHUVLRQ�IRU�ϯϱϭ

VXEPLVVLRQ�ϯϱϮ

$&.12:/('*0(176ϯϱϯ

:H�WKDQN�WKH�*XLGHOLQH�&RPPLWWHH IRU�WKH�1,&(�JXLGHOLQH�RQ�µ(DWLQJ�GLVRUGHUV��UHFRJQLWLRQ�ϯϱϰ

DQG�WUHDWPHQW¶ �$QWKRQ\�%DWHPDQ��-DQH�'DOJOLHVK��,YDQ�(LVOHU��&KULVWRSKHU�)DLUEXUQ��/HH�ϯϱϱ

+XGVRQ��0LNH�+XQWHU��'DVKD�1LFKROOV��-HVVLFD�3DUNHU��'DQLHO�3HUU\��8UVXOD�3KLOSRW��6XVDQ�ϯϱϲ

5LQJZRRG��0DQG\�6FRWW��/XF\�6HUSHOO��3KLOOLS�7D\ORU��'RPLQLTXH�7KRPSVRQ��-DQHW�7UHDVXUH��ϯϱϳ

+DQQDK�7XUQHU��&KULVWLQH�9L]H��DQG�*OHQQ :DOOHU�� :H�DOVR�WKDQN�1LFN�+DUULV�DQG�%DUU\�ϯϱϴ

-RKQVWRQ�IRU�HGLWRULDO�LQSXW�ϯϱϵ

),1$1&,$/�6833257ϯϲϬ

7KLV ZRUN�ZDV�LQLWLDWHG E\�WKH�1DWLRQDO�&ROODERUDWLQJ�&HQWUH�IRU�0HQWDO�+HDOWK��1&&�0+��ϯϲϭ

DQG�FRQWLQXHG�E\�WKH�1DWLRQDO�*XLGHOLQH�$OOLDQFH��1*$��DW�WKH�5R\DO�&ROOHJH�RI�ϯϲϮ

Page 19: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϭϴ

2EVWHWULFLDQV�DQG�*\QDHFRORJLVWV��5&2*��IURP��VW�$SULO�������1&&�0+�DQG�1*$�UHFHLYHG�ϯϲϯ

IXQGLQJ�IURP�1,&(�WR�GHYHORS�FOLQLFDO�DQG�VRFLDO�FDUH�JXLGHOLQHV��7KH�YLHZV�H[SUHVVHG�LQ�WKLV�ϯϲϰ

SXEOLFDWLRQ�DUH�WKRVH�RI�WKH�DXWKRUV�DQG�QRW�QHFHVVDULO\�WKRVH�RI�WKH�5&2*��1*$��1&&�0+�ϯϲϱ

RU�1,&(� ³1DWLRQDO�,QVWLWXWH�IRU�+HDOWK�DQG�&DUH�([FHOOHQFH��������(DWLQJ�GLVRUGHUV��ϯϲϲ

UHFRJQLWLRQ�DQG�WUHDWPHQW��$YDLODEOH�IURP�KWWSV���ZZZ�QLFH�RUJ�XN�JXLGDQFH�QJ����ϯϲϳ

7KH�IXQGHU�RI�WKH�VWXG\�KDG�QR�IXUWKHU�UROH�LQ�VWXG\�GHVLJQ��GDWD�FROOHFWLRQ��GDWD�DQDO\VLV��ϯϲϴ

GDWD�LQWHUSUHWDWLRQ��RU�ZULWLQJ�RI�WKH�UHSRUW��$OO�DXWKRUV�KDG�IXOO�DFFHVV�WR�DOO�WKH�GDWD�LQ�WKH�ϯϲϵ

VWXG\�DQG�KDG�ILQDO�UHVSRQVLELOLW\�IRU�WKH�GHFLVLRQ�WR�VXEPLW�IRU�SXEOLFDWLRQ�ϯϳϬ

&21)/,&76�2)�,17(5(676ϯϳϭ

(6��,0��/)��/6D��67��DQG�7.�UHFHLYHG VXSSRUW�IURP�WKH�1*$� ZKLFK�ZDV�LQ�UHFHLSW�RI�IXQGLQJ�ϯϳϮ

IURP�1,&(�IRU�WKH�VXEPLWWHG�ZRUN��ϯϳϯ

6'�DQG�(.�UHFHLYHG�VXSSRUW�IURP�WKH�1,&(�*XLGHOLQHV�7HFKQLFDO�6XSSRUW�8QLW��8QLYHUVLW\�RI�ϯϳϰ

%ULVWRO��ZLWK�IXQGLQJ�IURP�WKH�&HQWUH�IRU�*XLGHOLQHV��1,&(���7KH�IXQGHU�KDG�QR�UROH�LQ�VWXG\�ϯϳϱ

GHVLJQ��GDWD�FROOHFWLRQ��DQG�DQDO\VLV��GHFLVLRQ�WR�SXEOLVK��RU�SUHSDUDWLRQ�RI�WKH�PDQXVFULSW�ϯϳϲ

&*)�LV�WKH�DXWKRU�RI�UHVHDUFK�SDSHUV��UHYLHZ�DUWLFOHV�DQG�ERRNV�WKDW�KDYH�FRPPHQWHG�RQ�ϯϳϳ

WKH�HIIHFWLYHQHVV�RI�YDULRXV�WUHDWPHQWV�IRU�HDWLQJ�GLVRUGHUV��LQFOXGLQJ�%1���5R\DOWLHV�ϯϳϴ

UHFHLYHG�IURP�SXEOLVKHUV�RI�WKH�ERRNV�FRQFHUQHG��&*)�KHOG��SDLG�DQG�XQSDLG��WUDLQLQJ�ϯϳϵ

ZRUNVKRSV�IRU�FOLQLFLDQV�RQ�HDWLQJ�GLVRUGHUV��RQ�HDWLQJ�GLVRUGHU�WUHDWPHQW�LQ�JHQHUDO��DQG�RQ�ϯϴϬ

VSHFLILF�WUHDWPHQWV�IRU�HDWLQJ�GLVRUGHUV��&%7��,37��JXLGHG�VHOI�KHOS���&*)�LV�LQYROYHG�LQ�ϯϴϭ

GHYHORSLQJ�DQ�RQOLQH�PHDQV�RI�WUDLQLQJ�WKHUDSLVWV�LQ�D�VSHFLILF�WUHDWPHQW�IRU�HDWLQJ�GLVRUGHUV��ϯϴϮ

LQFOXGLQJ�&%7��&*)�LV�VXSSRUWHG�E\�D�3ULQFLSDO�)HOORZVKLS�IURP�WKH�:HOOFRPH�7UXVW�ϯϴϯ

���������ϯϴϰ

/6U KDV�QR�GHFODUDWLRQV�RI�FRQIOLFW�RI�LQWHUHVW�ϯϴϱ

+7�LV�WHDFKLQJ�DQG�FRQGXFWLQJ�UHVHDUFK�SXEOLFDWLRQV�LQ�&%7��6KH�LV�DOVR�LQYROYHG�LQ�WKH�ϯϴϲ

GHYHORSPHQW�DQG�HYDOXDWLRQ�RI�EULHI�&%7�LQWHUYHQWLRQV�IRU�HDWLQJ�GLVRUGHUV�DQG�LQ�DQ�ϯϴϳ

HIIHFWLYHQHVV�VWXG\�RI�&%7�ZKHQ�GHOLYHUHG�LQ�URXWLQH�FOLQLFDO�VHWWLQJV�ϯϴϴ

Page 20: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϭϵ

*:�SXEOLVKHG�ERRNV�DQG�D�UDQJH�RI�SDSHUV�DQG�ERRN�FKDSWHUV�RQ�&%7�IRU�HDWLQJ�GLVRUGHUV��ϯϴϵ

UHJXODUO\�JLYHV�ZRUNVKRSV�RQ�HYLGHQFH�EDVHG�&%7�IRU�HDWLQJ�GLVRUGHUV�ϯϵϬ

6833257,1*�,1)250$7,21ϯϵϭ

$GGLWLRQDO�6XSSRUWLQJ�,QIRUPDWLRQ�PD\�EH IRXQG�LQ�WKH�RQOLQH�YHUVLRQ�RI�WKLV�DUWLFOH�ϯϵϮ

$SSHQGL[����6HDUFK�VWUDWHJ\�ϯϵϯ

$SSHQGL[����&KDUDFWHULVWLFV�RI WKH�LQFOXGHG�VWXGLHV DQG�UHIHUHQFHVϯϵϰ

$SSHQGL[����:LQ%8*6�FRGH�IRU�WKH�IL[HG�HIIHFWV�PRGHOϯϵϱ

$SSHQGL[����:LQ%8*6�FRGH�IRU�WKH�UDQGRP�HIIHFWV�PRGHOϯϵϲ

$SSHQGL[����:LQ%8*6�FRGH�IRU�WKH�LQFRQVLVWHQF\�PRGHOϯϵϳ

$SSHQGL[����/LVW�RI�H[FOXGHG�VWXGLHVϯϵϴ

$SSHQGL[����)LQDO�GDWD�ILOH�IRU�WKH�10$ϯϵϵ

$SSHQGL[����5LVN�RI�ELDV�RI�LQFOXGHG�VWXGLHVϰϬϬ

$SSHQGL[����3RVWHULRU�PHGLDQ�ORJ�RGGV�UDWLRV�DQG�����FUHGLEOH�LQWHUYDOV�IRU�HDFK�WUHDWPHQWϰϬϭ

FRPSDUHG�ZLWK�HYHU\�RWKHUϰϬϮ

$SSHQGL[�����0RGHO�ILW�VWDWLVWLFV�IRU�WKH�IL[HG�DQG�UDQGRP�HIIHFWV�PRGHOV��FRQWLQXLW\�ϰϬϯ

FRUUHFWHG��DQG�IRU�WKH�UDQGRP�HIIHFWV�LQFRQVLVWHQF\�PRGHOϰϬϰ

$SSHQGL[�����6XPPDU\�VWDWLVWLFV�RI�:LQ%8*6�UDQGRP�HIIHFWV�PRGHOϰϬϱ

Page 21: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϮϬ

5()(5(1&(6ϰϬϲϰϬϳ

$JUDV�:6��:DOVK�7��)DDLUEXUQ�&*��:LOVRQ�*7��.UDHPHU ��������$�PXOWLFHQWHU�ϰϬϴ

FRPSDULVRQ�RI�FRJQLWLYH�EHKDYLRUDO�WKHUDS\�DQG�LQWHUSHUVRQDO�SV\FKRWKHUDS\�IRU�EXOLPLD�ϰϬϵ

QHUYRVD��$UFKLYHV�RI *HQHUDO 3V\FKLDWU\ ������������ϰϭϬ

%DLOHU�8� 'H�=ZDDQ�0��/HLVFK�)� 6WUQDG��$� /HQQNK�:ROIVEHUJ�&��(O�*LDPDO�1��+RUQLN�ϰϭϭ

.��.DVSHU�6���������*XLGHG�VHOI�KHOS�YHUVXV�FRJQLWLYH�EHKDYLRUDO�JURXS�WKHUDS\�LQ�WKH�ϰϭϮ

WUHDWPHQW�RI�EXOLPLD�QHUYRVD��,QWHUQDWLRQDO -RXUQDO�RI (DWLQJ�'LVRUGHUV ������������ϰϭϯ

%DOVKHP�+� +HOIDQG�0��6FKXQHPDQQ�+- ��������*5$'(�JXLGHOLQHV�����5DWLQJ�WKH�TXDOLW\�ϰϭϰ

RI�HYLGHQFH��-RXUQDO�RI�&OLQLDO�(SLGHPLRORJ\ ������������ϰϭϱ

%HLQWQHU�,��-DFREL�&��6FKPLGW�8+ ��������3DUWLFLSDWLRQ�DQG�RXWFRPH�LQ�PDQXDOL]HG�VHOI�ϰϭϲ

KHOS�IRU�EXOLPLD�QHUYRVD�DQG�ELQJH�HDWLQJ�GLVRUGHU�� D�V\VWHPDWLF�UHYLHZ�DQG�PHWDUHJUHVVLRQ�ϰϭϳ

DQDO\VLV��&OLQLFDO 3V\FKRORJ\ 5HYLHZ �����������ϰϭϴ

&RRSHU�3-��)DLUEXUQ�&* ��������&RQIXVLRQ�RYHU�WKH�FRUH�SV\FKRSDWKRORJ\�RI�EXOLPLD�ϰϭϵ

QHUYRVD��,QWHUQDWLRQDO -RXUQDO RI�(DWLQJ 'LVRUGHUV ������������ϰϮϬ

'HPSVWHU�$���������7KH�GLUHFW�XVH�RI�OLNHOLKRRG�IRU�VLJQLILFDQFH�WHVWLQJ��6WDWLVWLFV�DQG�ϰϮϭ

&RPSXWLQJ �����������ϰϮϮ

'LDV�6��:HOWRQ�1-��6XWWRQ�$-��$GHV�$( �����$���1,&(�'68�7HFKQLFDO�VXSSRUW�GRFXPHQW�ϰϮϯ

���D�JHQHUDOLVHG�OLQHDU�PRGHOOLQJ�IUDPHZRUN�IRU�SDLU�ZLVH�DQG�QHWZRUN�PHWD�DQDO\VLV�RI�ϰϮϰ

UDQGRPLVHG�FRQWUROOHG�WULDOV��ODVW�XSGDWHG�������ϰϮϱ

'LDV�6��:HOWRQ�1-��6XWWRQ�$-��&DOGZHOO�'0��/X *��$GHV�$(������%���1,&(�'68�ϰϮϲ

7HFKQLFDO�VXSSRUW�GRFXPHQW����LQFRQVLVWHQF\�LQ�QHWZRUNV�RI�HYLGHQFH�EDVHG�RQ�UDQGRPLVHG�ϰϮϳ

FRQWUROOHG�WULDOV��ODVW�XSGDWHG�������ϰϮϴ

Page 22: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

Ϯϭ

'LDV�6��:HOWRQ�1-��6XWWRQ�$-��&DOGZHOO�'0��/X *��$GHV�$( ��������(YLGHQFH�V\QWKHVLV�ϰϮϵ

IRU�GHFLVLRQ�PDNLQJ����LQFRQVLVWHQF\�LQ�QHWZRUNV�RI�HYLGHQFH�EDVHG�RQ�UDQGRPL]HG�ϰϯϬ

FRQWUROOHG�WULDOV��0HGLFDO 'HFLVLRQ 0DNLQJ ������������ϰϯϭ

)DLUEXUQ�&*� %DLOH\�6WUDHEOHU�6� %DVGHQ�6��'ROO�+$� -RQHV�5� 0XUSK\�5��2&RQQRU 0(��ϰϯϮ

&RRSHU�= ��������$�WUDQVGLDJQRVWLF�FRPSDULVRQ�RI�HQKDQFHG�FRJQLWLYH�EHKDYLRXU�WKHUDS\�ϰϯϯ

�&%7�(��DQG�LQWHUSHUVRQDO�SV\FKRWKHUDS\�LQ�WKH�WUHDWPHQW�RI�HDWLQJ�GLVRUGHUV��%HKDYLRXUϰϯϰ

5HVHDUFK�DQG 7KHUDS\ ����������ϰϯϱ

)DLUEXUQ�&*��+DUULVRQ�3- ��������(DWLQJ�GLVRUGHUV��/DQFHW �������������ϰϯϲ

)DLUEXUQ�&*��-RQHV�5��3HYHOHU�5&��+RSH�5$��2¶&RQQRU�0 ��������3V\FKRWKHUDS\�DQG�ϰϯϳ

EXOLPLD�QHUYRVD��/RQJHU�WHUP�HIIHFWV�RI�LQWHUSHUVRQDO�SV\FKRWKHUDS\��EHKDYLRU�WKHUDS\��DQG�ϰϯϴ

FRJQLWLYH�EHKDYLRU�WKHUDS\��$UFKLYHV RI�*HQHUDO 3V\FKLDWU\ ������������ϰϯϵ

*X\DWW�*� 2[PDQ�$'��$NO�($��.XQ]�5��9LVW�*��%UR]HN�-��1RUULV�6��)DOFN�<WWHU�<��ϰϰϬ

*ODV]LRX�3��'HEHHU�+��-DHVFKNH�5��5LQG�'��0HHUSRKO�-��'DKP�3��6FKXQHPDQQ�+-ϰϰϭ

��������*5$'(�JXLGHOLQHV�����,QWURGXFWLRQ�*5$'(�HYLGHQFH�SURILOHV�DQG�VXPPDU\�RI�ϰϰϮ

ILQGLQJV�WDEOHV��-RXUQDO�RI &OLQLFDO (SLGHPLRORJ\ ������������ϰϰϯ

+D\�3 ��������$�V\VWHPDWLF�UHYLHZ�RI�HYLGHQFH�IRU�SV\FKRORJLFDO�WUHDWPHQWV�LQ�HDWLQJ�ϰϰϰ

GLVRUGHUV�������������,QWHUQDWLRQDO -RXUQDO�RI (DWLQJ 'LVRUGHUV ������������ϰϰϱ

/LQDUGRQ�-��:DGH�7'��GH�OD�3LHGDG�*DUFLD�;��%UHQQDQ / ��������7KH�HIILFDF\�RI�FRJQLWLYH�ϰϰϲ

EHKDYLRUDO�WKHUDS\�IRU�HDWLQJ�GLVRUGHUV��$�V\VWHPDWLF�UHYLHZ�DQG�PHWD�DQDO\VLV��-RXUQDO�RI�ϰϰϳ

&RQVXOWLQJ�DQG�&OLQLFDO�3V\FKRORJ\ ��������������ϰϰϴ

/XQQ�'��-DFNVRQ�&��%HVW�1��7KRPDV�$ ��������7KH�%8*6�ERRN��%RFD�5DWRQ��)ORULGD��ϰϰϵ

&5&�3UHVV�ϰϱϬ

0DYULVLV�'��*LDQQDWVL�0��&LSULDQL�$��6DODQWL�* ��������$�SULPHU�RQ�QHWZRUN�PHWD�DQDO\VLV�ϰϱϭ

ZLWK�HPSKDVLV�RQ�PHQWDO�KHDOWK��(YLGHQFH %DVHG�0HQWDO +HDOWK ����������ϰϱϮ

Page 23: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

ϮϮ

0RKHU�'��/LEHUDWL�$��7HW]ODII�-��$OWPDQ�'*��*URXS�3 ��������3UHIHUUHG�UHSRUWLQJ�LWHPV�IRU�ϰϱϯ

V\VWHPDWLF�UHYLHZV�DQG�PHWD�DQDO\VHV��WKH�35,60$�VWDWHPHQW��-RXUQDO�RI &OLQLFDOϰϱϰ

(SLGHPLRORJ\ ������������ϰϱϱ

1,&(���������(DWLQJ�GLVRUGHUV��UHFRJQLWLRQ�DQG�WUHDWPHQW��1,&(�FOLQLFDO�JXLGHOLQH�����ϰϱϲ

/RQGRQ��1DWLRQDO�,QVWLWXWH�IRU�+HDOWK�DQG�&DUH�([FHOOHQFH�ϰϱϳ

3HDW�&0��%HUNPDQ�1'��/RKU�.1��%URZQOH\�.$��%DQQ�&0��&XOOHQ�.� 4XDWWOHEDXP�0-��ϰϱϴ

%XOLN�&0 ��������&RPSDUDWLYH�(IIHFWLYHQHVV�RI�7UHDWPHQWV�IRU�%LQJH�(DWLQJ�'LVRUGHU��ϰϱϵ

6\VWHPDWLF�5HYLHZ�DQG�1HWZRUN�0HWD�$QDO\VLV��(XURSHDQ (DWLQJ 'LVRUGHU 5HYLHZ ��������ϰϲϬ

����ϰϲϭ

3ROQD\�$��-DPHV�9$��+RGJHV�/��0XUUD\�*'��0XQUR�&��/DZULH�60 ��������*URXS�WKHUDS\�ϰϲϮ

IRU�SHRSOH�ZLWK�EXOLPLD�QHUYRVD��V\VWHPDWLF�UHYLHZ�DQG�PHWD�DQDO\VLV��3V\FKRORJLFDOϰϲϯ

0HGLFLQH ��������������ϰϲϰ

3RXOVHQ�6��/XQQ�6��'DQLHO�6,��)RONH�6��0DWKLHVHQ�%%��.DW]QHOVRQ�+��)DLUEXUQ�&*ϰϲϱ

��������$�UDQGRPL]HG�FRQWUROOHG�WULDO�RI�SV\FKRDQDO\WLF�SV\FKRWKHUDS\�RU�FRJQLWLYH�ϰϲϲ

EHKDYLRUDO�WKHUDS\�IRU�EXOLPLD�QHUYRVD��$PHULFDQ -RXUQDO�RI 3V\FKLDWU\ �������������ϰϲϳ

6KDSLUR�-5��%HUNPDQ�1'��%URZQOH\�.$��6HGZD\�-$��/RKU�.1��%XOLN�&0 ��������%XOLPLD�ϰϲϴ

QHUYRVD�WUHDWPHQW��D�V\VWHPDWLF�UHYLHZ�RI�UDQGRPL]HG�FRQWUROOHG�WULDOV��,QWHUQDWLRQDO -RXUQDOϰϲϵ

RI�(DWLQJ 'LVRUGHUV ������������ϰϳϬ

6PLQN�)5��9DQ +RHNHQ�'��+RHN�+: ��������(SLGHPLRORJ\��FRXUVH��DQG�RXWFRPH�RI�HDWLQJ�ϰϳϭ

GLVRUGHUV��&XUUHQW 2SLQLRQ�LQ 3V\FKLDWU\ ������������ϰϳϮ

6SLHJHOKDOWHU�'��%HVW�1��&DUOLQ�%��9DQ 'HU /LQGH�$ ��������%D\HVLDQ�PHDVXUHV�RI�PRGHO�ϰϳϯ

FRPSOH[LW\�DQG�ILW��-RXUQDO�RI�WKH�5R\DO�6WDWLVWLFDO�6RFLHW\��6HULHV�%��6WDWLVWLFDO�0HWKRGRORJ\�ϰϳϰ

���ϰϳϱ

Page 24: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

Ϯϯ

6WLFH�(��0DUWL�&1��5RKGH�3 ��������3UHYDOHQFH��LQFLGHQFH��LPSDLUPHQW��DQG�FRXUVH�RI�WKH�ϰϳϲ

SURSRVHG�'60���HDWLQJ�GLVRUGHU�GLDJQRVHV�LQ�DQ���\HDU�SURVSHFWLYH�FRPPXQLW\�VWXG\�RI�ϰϳϳ

\RXQJ�ZRPHQ��-�-RXUQDO�RI�$EQRUPDO�3V\FKRORJ\��������������ϰϳϴ

6ZHHWLQJ�-��-DFNVRQ�&��%HVW�1��7KRPDV�$� 6SLHJHOKDOWHU�' ��������:KDW�WR�DGG�WR�ϰϳϵ

QRWKLQJ"�8VH�DQG�DYRLGDQFH�RI�FRQWLQXLW\�FRUUHFWLRQV�LQ�PHWD�DQDO\VLV�RI�VSDUVH�GDWD��ϰϴϬ

6WDWLVWLFV�LQ�0HGLFLQH ��������������ϰϴϭ

7KRPSVRQ�%UHQQHU�+��*ODVV�6��:HVWHQ�' ��������$�0XOWLGLPHQVLRQDO�0HWDǦ$QDO\VLV�RI�ϰϴϮ

3V\FKRWKHUDS\�IRU�%XOLPLD�1HUYRVD��&OLQLFDO�3V\FKRORJ\��6FLHQFH�DQG�3UDFWLFH ������������ϰϴϯ

7UDFH�6(��7KRUQWRQ�/0��5RRW�7/��0D]]HR�6(��/LFKWHQVWHLQ�3��3HGHUVHQ�1/��%XOLN�&0ϰϴϰ

��������(IIHFWV�RI�UHGXFLQJ�WKH�IUHTXHQF\�DQG�GXUDWLRQ�FULWHULD�IRU�ELQJH�HDWLQJ�RQ�OLIHWLPH�ϰϴϱ

SUHYDOHQFH�RI�EXOLPLD�QHUYRVD�DQG�ELQJH�HDWLQJ�GLVRUGHU��LPSOLFDWLRQV�IRU�'60����ϰϴϲ

,QWHUQDWLRQDO�-RXUQDO�RI�(DWLQJ�'LVRUGHUV�������������ϰϴϳ

:DJQHU�*��3HQHOR�(��:DQQHU�&��*ZLQQHU�3��7URIDLHU�0/��,PJDUW�+��:DOGKHUU�.��:REHU�ϰϴϴ

%LQJRO�&��.DUZDXW]�$) ��������,QWHUQHW�GHOLYHUHG�FRJQLWLYH�EHKDYLRXUDO�WKHUDS\�Y��ϰϴϵ

FRQYHQWLRQDO�JXLGHG�VHOI�KHOS�IRU�EXOLPLD�QHUYRVD��ORQJ�WHUP�HYDOXDWLRQ�RI�D�UDQGRPLVHG�ϰϵϬ

FRQWUROOHG�WULDO��%ULWLVK -RXUQDO�RI 3V\FKLDWU\ �������������ϰϵϭ

:KLWWDO�0/��$JUDV�:6��*RXOG�5$ ��������%XOLPLD�QHUYRVD��$�PHWD�DQDO\VLV�RI�ϰϵϮ

SV\FKRVRFLDO�DQG�SKDUPDFRORJLFDO�WUHDWPHQWV��%HKDYLRXU�7KHUDS\ ������������ϰϵϯ

ϰϵϰ

Page 25: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

Ϯϰ

)LJXUH����35,60$�IORZFKDUW�

7LWOHV�DQG�DEVWUDFWV�LGHQWLILHG��1 �������

)XOO�WH[W�DUWLFOHV�DVVHVVHG�IRU�HOLJLELOLW\��1 ���

$UWLFOHV�H[FOXGHG��1 ��������QRW�UHOHYDQW�SRSXODWLRQ��GHVLJQ��LQWHUYHQWLRQ��FRPSDULVRQ��RXWFRPHV��XQDEOH�WR�UHWULHYH�

3XEOLFDWLRQV�LQFOXGHG�LQ�WKH�QHWZRUN�PHWD�DQDO\VLV��1 ��

3XEOLFDWLRQV�H[FOXGHG�IURP�WKH�QHWZRUN�PHWD�DQDO\VLV��1 ���UHIHU�WR�WKH�H[FOXGHG�VWXGLHV�OLVW�

� )XOO�UHPLVVLRQ�ZDV�QRW�UHSRUWHG��1 ���� 'HILQLWLRQ�RI�UHPLVVLRQ�GLGQ¶W�PHHW�WKH�LQFOXVLRQ�FULWHULD��1 ���� 7UHDWPHQWV�ZHUH�QRW�FRQQHFWHG�WR�WKH�UHVW�RI�WKH�QHWZRUN��1 ��� ,QWHUYHQWLRQ�ZDV�FRPSDUHG�WR�WUHDWPHQW�DV�XVXDO�RQO\��1 ��� 7UHDWPHQW�ZDV�FRQQHFWHG�YLD�D�SODFHER�DUP�ZLWK�]HUR�HYHQWV��1 ��� 7UHDWPHQW�ZDV�QRW�DYDLODEOH�OLFHQVHG�LQ�WKH�8.��1 ��� &RQWURO�ZDV�RI�QR�LQWHUHVW��1 ��

'XSOLFDWH�WLWOHV�DQG�DEVWUDFWV�H[FOXGHG��1 ������

Page 26: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

Ϯϱ

)LJXUH����1HWZRUN�GLDJUDP�RI�VWXGLHV�LQFOXGHG�LQ�DQDO\VLV�RI�EXOLPLD�QHUYRVD�WUHDWPHQWV��

1RWH��7KH�ZLGWK�RI�WKH�OLQHV�LV�SURSRUWLRQDO�WR�WKH�QXPEHU�RI�WULDOV�GLUHFWO\�FRPSDULQJ�HDFK�SDLU�RI�WUHDWPHQWV��7KH�VL]H�RI�HDFK�QRGH�LV�SURSRUWLRQDO�WR�WKH�QXPEHU�RI�UDQGRPLVHG�SDUWLFLSDQWV WR�HDFK�LQWHUYHQWLRQ �VDPSOH�VL]H��

/HJHQG��&U,��&UHGLEOH�,QWHUYDO��%7��EHKDYLRXU�WKHUDS\��&%7�('��FRJQLWLYH�EHKDYLRXUDO�WKHUDS\�VSHFLILF�WR�HDWLQJ�GLVRUGHUV��,37��LQWHUSHUVRQDO�SV\FKRWKHUDS

:DLW�OLVW��1 �����

&%7�('�LQGLYLGXDO��1 ����

*XLGHG�FRJQLWLYH�EHKDYLRXUDO�VHOI�KHOS�

�1 ����

&%7�('�JURXS��1 ���

)OXR[HWLQH��1 ���

%7�LQGLYLGXDO��1 ���

5HOD[DWLRQ��1 ���

&%7�('�LQGLYLGXDO�SOXV�IOXR[HWLQH�

�1 ���

%7�JURXS��1 ���

6XSSRUWLYH�SV\FKRWKHUDS\�

�1 ���

,37��1 ����

3XUH�FRJQLWLYH�EHKDYLRXUDO�VHOI�KHOS�

�1 �����

Page 27: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

Ϯϲ

)LJXUH��

Page 28: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

Ϯϳ

Page 29: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

Ϯϴ

7DEOH����0HGLDQ�RGGV�UDWLRV�DQG�����&U,�IRU�HYHU\�LQGLYLGXDO�WUHDWPHQW�FRPSDUHG�ZLWK�HYHU\�RWKHU���/RZHU�WULDQJOH�SUHVHQWV�WKH�UHVXOWV�RI�WKH�QHWZRUN�PHWD�DQDO\VLV�DQG�WKH�XSSHU�WULDQJOH�WKH�UHVXOWV�RI�DYDLODEOH�GLUHFW�SDLU�ZLVH�FRPSDULVRQV�

/HJHQG��&U,��&UHGLEOH�,QWHUYDO��%7��EHKDYLRXU�WKHUDS\��&%7�('��FRJQLWLYH�EHKDYLRXUDO�WKHUDS\�VSHFLILF�WR�HDWLQJ�GLVRUGHUV��,37��LQWHUSHUVRQDO�SV\FKRWKHUDS\�

6XSSRUWLYH�SV\FKRWKHUDS\

� � � � � � � � �����

�������������

���� *URXS�%7� � � � � � � � �

�����

������������ ��������������

���� ����� ,QGLYLGXDO�&%7�('�SOXV�IOXR[HWLQH

� � � � � � �����

�������������� �������������� ������������

���� ����� ���� 5HOD[DWLRQ ����� � � � � � �

������������� �������������� ������������� ������������

���� ����� ���� ���� ,QGLYLGXDO�%7� � � � � �

�����

������������� �������������� ������������ ������������ ������������

���� ����� ���� ���� ���� )OXR[HWLQH� � � �

�����

������������� �������������� ������������ ������������ ������������ ������������

���� ���� ���� ���� ���� ����*URXS�&%7�('�

� �����

�����

������������ ������������� ������������ ������������ ������ ����� ��������������������������

�������������

���� ���� ���� ���� ���� ���� ���� 3XUH�FRJQLWLYH�EHKDYLRXUDO�VHOI�KHOS�

� � �

����

������������ �������������� ����������� ������������ ������������ ������������ ��������������������������

���� ����� ���� ���� ���� ���� ���� ���� ,37�

�����

������������� �������������� ������������ ������������ ������������ ������������ ������������� ������������� ������������

���� ���� ���� ���� ���� ���� ���� ���� ���� *XLGHG�FRJQLWLYH�EHKDYLRXUDO�VHOI�KHOS

���� ����

������������ �������������� ������������ ������������ ������������ ������������ ������������� ������������ ������������������������ �������������

���� ���� ���� ���� ���� ���� ���� ���� ���� ���� ,QGLYLGXDO�&%7�('�

����

������������ �������������� ������������ ������������ ������������ ������������ ������������� ������������ ������������ ������������ �������������

���� ����� ���� ���� ���� ���� ���� ���� ���� ���� ���� :DLW�OLVW

������������� �������������� ������������� ������������ ������������ ������������ ������������� ������������� ������������ ������������� �������������

Page 30: Slade, E. , Keeney, E., Mavranezouli, I., Dias, S., Fou, L

Ϯϵ

7DEOH����3RVWHULRU�PHGLDQ�UDQN�DQG�����&U,���7KH�ORZHU�WKH�UDQN�WKH�EHWWHU�WKH�WUHDWPHQW��

7UHDWPHQW 3RVWHULRU�PHGLDQ UDQN ����&U,*URXS�%7� � ��± �*URXS�&%7�('� � ��± �,QGLYLGXDO�&%7�('� � ��± �*XLGHG�FRJQLWLYH�EHKDYLRXUDO�VHOI�KHOS � ��± �3XUH�FRJQLWLYH�EHKDYLRXUDO�VHOI�KHOS � ��± ��6XSSRUWLYH�SV\FKRWKHUDS\ � ��± ��,QGLYLGXDO�&%7�('�SOXV�IOXR[HWLQH � ��± ��,QGLYLGXDO�%7� � ��± ��,37 � ��± ��)OXR[HWLQH �� ��± ��5HOD[DWLRQ �� ��± ��:DLW�OLVW �� ��± ��

/HJHQG��&U,��&UHGLEOH�,QWHUYDO��%7��EHKDYLRXU�WKHUDS\��&%7�('��FRJQLWLYH�EHKDYLRXUDO�WKHUDS\�VSHFLILF�WR�HDWLQJ�GLVRUGHUV��,37��LQWHUSHUVRQDO�SV\FKRWKHUDS\�