3xusrvh - edgeedge.rit.edu/edge/r16301/public/testing specifications... · 0,/ 67' *...

13
0,/67'* 0(7+2' 0(7+2' +,*+ 7(03(5$785( 127( 7DLORULQJ LV HVVHQWLDO 6HOHFW PHWKRGV SURFHGXUHV DQG SDUDPHWHU OHYHOV EDVHG RQ WKH WDLORULQJ SURFHVV GHVFULEHG LQ 3DUW 2QH SDUDJUDSK DQG $QQH[ & $SSO\ WKH JHQHUDO JXLGHOLQHV IRU ODERUDWRU\ WHVW PHWKRGV GHVFULEHG LQ 3DUW 2QH SDUDJUDSK RI WKLV VWDQGDUG 6&23( 3XUSRVH 8VH KLJK WHPSHUDWXUH WHVWV WR REWDLQ GDWD WR KHOS HYDOXDWH HIIHFWV RI KLJK WHPSHUDWXUH FRQGLWLRQV RQ PDWHULHO VDIHW\ LQWHJULW\ DQG SHUIRUPDQFH $SSOLFDWLRQ 8VH WKLV PHWKRG WR HYDOXDWH PDWHULHO OLNHO\ WR EH GHSOR\HG LQ DUHDV ZKHUH WHPSHUDWXUHV DPELHQW RU LQGXFHG DUH KLJKHU WKDQ VWDQGDUG DPELHQW /LPLWDWLRQV /LPLW XVH RI WKLV PHWKRG WR HYDOXDWLQJ WKH HIIHFWV RI UHODWLYHO\ VKRUWWHUP PRQWKV DV RSSRVHG WR \HDUV HYHQ GLVWULEXWLRQV RI KHDW WKURXJKRXW WKH WHVW LWHP 7KLV PHWKRG LV QRW JHQHUDOO\ SUDFWLFDO IRU D (YDOXDWLQJ WLPHGHSHQGHQW SHUIRUPDQFH GHJUDGDWLRQ DJLQJ HIIHFWV WKDW RFFXU GXULQJ FRQVWDQW ORQJWHUP H[SRVXUH WR KLJK WHPSHUDWXUHV XQGHU VWRUDJH RU RSHUDWLRQDO PRGHV ZKHUH V\QHUJHWLF HIIHFWV PD\ EH LQYROYHG )RU VXFK KLJK WHPSHUDWXUH DJLQJ HIIHFWV WHVW LQ WKH QDWXUDO HQYLURQPHQW E (YDOXDWLQJ PDWHULHO LQ D KLJK WHPSHUDWXUH HQYLURQPHQW ZKHUH VRODU UDGLDWLRQ SURGXFHV VLJQLILFDQW WKHUPDO JUDGLHQWV LQ WKH PDWHULHO )RU VLPXODWLQJ GLUHFW VRODU LPSLQJHPHQW XVH 0HWKRG 3URFHGXUH , F (YDOXDWLQJ DFWLQLF SKRWRFKHPLFDO HIIHFWV XVH 0HWKRG 3URFHGXUH ,, G (YDOXDWLQJ WKH HIIHFWV RI DHURG\QDPLF KHDWLQJ H $OWKRXJK KLJK WHPSHUDWXUH WHVWLQJ PD\ EH FRQVLGHUHG IRU DVVHVVPHQW RI PXQLWLRQV DFFRPSOLVK VDIHW\ RU KD]DUG WHVWLQJ LQ DFFRUGDQFH ZLWK 0,/67'& SDUDJUDSK UHIHUHQFH G 7$,/25,1* *8,'$1&( 6HOHFWLQJ WKLV 0HWKRG $IWHU H[DPLQLQJ UHTXLUHPHQWV GRFXPHQWV DQG DSSO\LQJ WKH WDLORULQJ SURFHVV LQ 3DUW 2QH RI WKLV VWDQGDUG WR GHWHUPLQH ZKHUH KLJK WHPSHUDWXUHV DUH IRUHVHHQ LQ WKH OLIH F\FOH RI WKH PDWHULHO XVH WKH IROORZLQJ WR FRQILUP WKH QHHG IRU WKLV PHWKRG DQG WR SODFH LW LQ VHTXHQFH ZLWK RWKHU PHWKRGV ,W LV SUHIHUDEOH WR FRQGXFW 0HWKRG 3URFHGXUH , SULRU WR 0HWKRG LQ RUGHU WR REWDLQ PD[LPXP UHVSRQVH DQG VWDELOL]DWLRQ WHPSHUDWXUHV IRU LWHPV H[SRVHG WR GLUHFW VRODU UDGLDWLRQ (IIHFWV RI KLJK WHPSHUDWXUH HQYLURQPHQWV +LJK WHPSHUDWXUHV PD\ WHPSRUDULO\ RU SHUPDQHQWO\ LPSDLU SHUIRUPDQFH RI PDWHULHO E\ FKDQJLQJ SK\VLFDO SURSHUWLHV RU GLPHQVLRQV RI WKH PDWHULDOV RI ZKLFK LW LV FRPSRVHG 7KH IROORZLQJ DUH H[DPSOHV RI SUREOHPV WKDW FRXOG UHVXOW IURP KLJK WHPSHUDWXUH H[SRVXUH WKDW PD\ UHODWH WR WKH PDWHULHO EHLQJ WHVWHG &RQVLGHU WKH IROORZLQJ W\SLFDO SUREOHPV WR KHOS GHWHUPLQH LI WKLV PHWKRG LV DSSURSULDWH IRU WKH PDWHULHO EHLQJ WHVWHG 7KLV OLVW LV QRW LQWHQGHG WR EH DOOLQFOXVLYH D 3DUWV ELQG IURP GLIIHUHQWLDO H[SDQVLRQ RI GLVVLPLODU PDWHULDOV E /XEULFDQWV EHFRPH OHVV YLVFRXV MRLQWV ORVH OXEULFDWLRQ E\ RXWZDUG IORZ RI OXEULFDQWV F 0DWHULDOV FKDQJH LQ GLPHQVLRQ HLWKHU WRWDOO\ RU VHOHFWLYHO\ G 3DFNLQJ JDVNHWV VHDOV EHDULQJV DQG VKDIWV EHFRPH GLVWRUWHG ELQG DQG IDLO FDXVLQJ PHFKDQLFDO RU LQWHJULW\ IDLOXUHV H *DVNHWV GLVSOD\ SHUPDQHQW VHW I &ORVXUH DQG VHDOLQJ VWULSV GHWHULRUDWH

Upload: others

Post on 05-Aug-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 3XUSRVH - EDGEedge.rit.edu/edge/R16301/public/Testing Specifications... · 0,/ 67' * 0(7+2' whpshudwxuhv gxulqj shuirupdqfh 7kh wdfwlfdo vwdqge\ wr rshudwlrqdo surfhgxuh hydoxdwhv

0,/�67'����*�0(7+2'�������

0(7+2'�������+,*+�7(03(5$785(

127(�� � 7DLORULQJ� LV� HVVHQWLDO�� � 6HOHFW�PHWKRGV�� SURFHGXUHV�� DQG� SDUDPHWHU� OHYHOV� EDVHG� RQ� WKH�WDLORULQJ� SURFHVV� GHVFULEHG� LQ� 3DUW� 2QH�� SDUDJUDSK� ������� DQG� $QQH[� &�� � $SSO\� WKH� JHQHUDO�JXLGHOLQHV�IRU�ODERUDWRU\�WHVW�PHWKRGV�GHVFULEHG�LQ�3DUW�2QH��SDUDJUDSK���RI�WKLV�VWDQGDUG��

�� 6&23(����� 3XUSRVH����8VH�KLJK�WHPSHUDWXUH�WHVWV�WR�REWDLQ�GDWD�WR�KHOS�HYDOXDWH�HIIHFWV�RI�KLJK�WHPSHUDWXUH�FRQGLWLRQV�RQ�PDWHULHO�VDIHW\��LQWHJULW\��DQG�SHUIRUPDQFH����� $SSOLFDWLRQ����8VH� WKLV�PHWKRG� WR�HYDOXDWH�PDWHULHO� OLNHO\� WR�EH�GHSOR\HG� LQ�DUHDV�ZKHUH� WHPSHUDWXUHV� �DPELHQW�RU� LQGXFHG��DUH�KLJKHU�WKDQ�VWDQGDUG�DPELHQW������ /LPLWDWLRQV����/LPLW� XVH� RI� WKLV� PHWKRG� WR� HYDOXDWLQJ� WKH� HIIHFWV� RI� UHODWLYHO\� VKRUW�WHUP� �PRQWKV�� DV� RSSRVHG� WR� \HDUV��� HYHQ�GLVWULEXWLRQV�RI�KHDW�WKURXJKRXW�WKH�WHVW�LWHP���7KLV�PHWKRG�LV�QRW�JHQHUDOO\�SUDFWLFDO�IRU��

D� (YDOXDWLQJ� WLPH�GHSHQGHQW�SHUIRUPDQFH�GHJUDGDWLRQ� �DJLQJ�� HIIHFWV� WKDW� RFFXU�GXULQJ� FRQVWDQW� ORQJ�WHUP�H[SRVXUH� WR� KLJK� WHPSHUDWXUHV� �XQGHU� VWRUDJH� RU� RSHUDWLRQDO� PRGHV�� ZKHUH� V\QHUJHWLF� HIIHFWV� PD\� EH�LQYROYHG���)RU�VXFK�KLJK�WHPSHUDWXUH�DJLQJ�HIIHFWV��WHVW�LQ�WKH�QDWXUDO�HQYLURQPHQW��

E� (YDOXDWLQJ�PDWHULHO�LQ�D�KLJK�WHPSHUDWXUH�HQYLURQPHQW�ZKHUH�VRODU�UDGLDWLRQ�SURGXFHV�VLJQLILFDQW�WKHUPDO�JUDGLHQWV�LQ�WKH�PDWHULHO���)RU�VLPXODWLQJ�GLUHFW�VRODU�LPSLQJHPHQW��XVH�0HWKRG��������3URFHGXUH�,��

F� (YDOXDWLQJ�DFWLQLF��SKRWRFKHPLFDO��HIIHFWV��XVH�0HWKRG��������3URFHGXUH�,,���G� (YDOXDWLQJ�WKH�HIIHFWV�RI�DHURG\QDPLF�KHDWLQJ��H� $OWKRXJK�KLJK� WHPSHUDWXUH� WHVWLQJ�PD\�EH�FRQVLGHUHG� IRU� DVVHVVPHQW�RI�PXQLWLRQV�� DFFRPSOLVK� VDIHW\�RU�

KD]DUG�WHVWLQJ�LQ�DFFRUGDQFH�ZLWK�0,/�67'�����&��SDUDJUDSK������UHIHUHQFH����G������� 7$,/25,1*�*8,'$1&(����� 6HOHFWLQJ�WKLV�0HWKRG����$IWHU� H[DPLQLQJ� UHTXLUHPHQWV� GRFXPHQWV� DQG� DSSO\LQJ� WKH� WDLORULQJ� SURFHVV� LQ� 3DUW� 2QH� RI� WKLV� VWDQGDUG� WR�GHWHUPLQH�ZKHUH�KLJK�WHPSHUDWXUHV�DUH�IRUHVHHQ�LQ� WKH�OLIH�F\FOH�RI� WKH�PDWHULHO��XVH�WKH�IROORZLQJ�WR�FRQILUP�WKH�QHHG� IRU� WKLV�PHWKRG�� DQG� WR�SODFH� LW� LQ� VHTXHQFH�ZLWK�RWKHU�PHWKRGV�� � ,W� LV�SUHIHUDEOH� WR� FRQGXFW�0HWKRG��������3URFHGXUH�,�SULRU� WR�0HWKRG�������� LQ�RUGHU� WR�REWDLQ�PD[LPXP�UHVSRQVH�DQG�VWDELOL]DWLRQ� WHPSHUDWXUHV�IRU� LWHPV�H[SRVHG�WR�GLUHFW�VRODU�UDGLDWLRQ�������� (IIHFWV�RI�KLJK�WHPSHUDWXUH�HQYLURQPHQWV����+LJK�WHPSHUDWXUHV�PD\�WHPSRUDULO\�RU�SHUPDQHQWO\�LPSDLU�SHUIRUPDQFH�RI�PDWHULHO�E\�FKDQJLQJ�SK\VLFDO�SURSHUWLHV�RU�GLPHQVLRQV�RI�WKH�PDWHULDO�V��RI�ZKLFK�LW�LV�FRPSRVHG���7KH�IROORZLQJ�DUH�H[DPSOHV�RI�SUREOHPV�WKDW�FRXOG�UHVXOW�IURP� KLJK� WHPSHUDWXUH� H[SRVXUH� WKDW� PD\� UHODWH� WR� WKH� PDWHULHO� EHLQJ� WHVWHG�� � &RQVLGHU� WKH� IROORZLQJ� W\SLFDO�SUREOHPV�WR�KHOS�GHWHUPLQH�LI�WKLV�PHWKRG�LV�DSSURSULDWH�IRU�WKH�PDWHULHO�EHLQJ�WHVWHG���7KLV�OLVW�LV�QRW�LQWHQGHG�WR�EH�DOO�LQFOXVLYH��

D� 3DUWV�ELQG�IURP�GLIIHUHQWLDO�H[SDQVLRQ�RI�GLVVLPLODU�PDWHULDOV��E� /XEULFDQWV�EHFRPH�OHVV�YLVFRXV��MRLQWV�ORVH�OXEULFDWLRQ�E\�RXWZDUG�IORZ�RI�OXEULFDQWV��F� 0DWHULDOV�FKDQJH�LQ�GLPHQVLRQ��HLWKHU�WRWDOO\�RU�VHOHFWLYHO\��G� 3DFNLQJ�� JDVNHWV�� VHDOV�� EHDULQJV� DQG� VKDIWV� EHFRPH� GLVWRUWHG�� ELQG�� DQG� IDLO� FDXVLQJ� PHFKDQLFDO� RU�

LQWHJULW\�IDLOXUHV��H� *DVNHWV�GLVSOD\�SHUPDQHQW�VHW��I� &ORVXUH�DQG�VHDOLQJ�VWULSV�GHWHULRUDWH��

��������

Page 2: 3XUSRVH - EDGEedge.rit.edu/edge/R16301/public/Testing Specifications... · 0,/ 67' * 0(7+2' whpshudwxuhv gxulqj shuirupdqfh 7kh wdfwlfdo vwdqge\ wr rshudwlrqdo surfhgxuh hydoxdwhv

0,/�67'����*�0(7+2'�������

J� )L[HG�UHVLVWDQFH�UHVLVWRUV�FKDQJH�LQ�YDOXHV��K� (OHFWURQLF�FLUFXLW�VWDELOLW\�YDULHV�ZLWK�GLIIHUHQFHV�LQ�WHPSHUDWXUH�JUDGLHQWV�DQG�GLIIHUHQWLDO�H[SDQVLRQ�RI�

GLVVLPLODU�PDWHULDOV��L� 7UDQVIRUPHUV�DQG�HOHFWURPHFKDQLFDO�FRPSRQHQWV�RYHUKHDW��M� 2SHUDWLQJ�UHOHDVH�PDUJLQV�RI�UHOD\V�DQG�PDJQHWLF�RU�WKHUPDOO\�DFWLYDWHG�GHYLFHV�DOWHU��N� 6KRUWHQHG�RSHUDWLQJ�OLIHWLPH��O� 6ROLG�SHOOHWV�RU�JUDLQV�VHSDUDWH��P� +LJK�SUHVVXUHV�FUHDWHG�ZLWKLQ�VHDOHG�FDVHV��SURMHFWLOHV��ERPEV��HWF����Q� $FFHOHUDWHG�EXUQLQJ�RI�H[SORVLYHV�RU�SURSHOODQWV��R� ([SDQVLRQ�RI�FDVW�H[SORVLYHV�ZLWKLQ�WKHLU�FDVHV��S� ([SORVLYHV�PHOW�DQG�H[XGH��T� 'LVFRORUDWLRQ��FUDFNLQJ�RU�FUD]LQJ�RI�RUJDQLF�PDWHULDOV��U� 2XW�JDVVLQJ�RI�FRPSRVLWH�PDWHULDOV��

������� 6HTXHQFH�DPRQJ�RWKHU�PHWKRGV��D� *HQHUDO���6HH�3DUW�2QH��SDUDJUDSK������E� 8QLTXH�WR�WKLV�PHWKRG���7KHUH�DUH�DW�OHDVW�WZR�SKLORVRSKLHV�UHODWHG�WR�WHVW�VHTXHQFH���2QH�DSSURDFK�LV�WR�

FRQVHUYH�WHVW�LWHP�OLIH�E\�DSSO\LQJ�ZKDW�DUH�SHUFHLYHG�WR�EH�WKH�OHDVW�GDPDJLQJ�HQYLURQPHQWV�ILUVW���)RU�WKLV�DSSURDFK��JHQHUDOO\�DSSO\�WKH�KLJK�WHPSHUDWXUH�WHVW�HDUO\�LQ�WKH�WHVW�VHTXHQFH���$QRWKHU�DSSURDFK�LV�WR�DSSO\�HQYLURQPHQWV� WR�PD[LPL]H� WKH� OLNHOLKRRG�RI�GLVFORVLQJ�V\QHUJHWLF�HIIHFWV�� �)RU� WKLV�DSSURDFK��FRQVLGHU�KLJK�WHPSHUDWXUH� WHVWLQJ�IROORZLQJ�G\QDPLF�WHVWV��VXFK�DV�YLEUDWLRQ�DQG�VKRFN�� �$OWKRXJK�QRW�ZULWWHQ�IRU�VXFK��WKLV�WHVW�PD\�EH�XVHG�LQ�FRQMXQFWLRQ�ZLWK�VKRFN�DQG�YLEUDWLRQ�WHVWV�WR�HYDOXDWH�WKH�HIIHFW�RI�G\QDPLF�HYHQWV��L�H���VKLSSLQJ��KDQGOLQJ��DQG�VKRFN��RQ�KRW�PDWHULDOV���$OVR��WKLV�WHVW�PD\�FRQWULEXWH�VLJQLILFDQWO\�WR�WKH�UHVXOWV�RI�ORZ�SUHVVXUH�WHVWLQJ�RI�VHDOV��H�J���VHH�SDUDJUDSKV������G��H��DQG�I��

��� 6HOHFWLQJ�3URFHGXUHV����7KLV� PHWKRG� LQFOXGHV� WKUHH� WHVW� SURFHGXUHV�� 3URFHGXUH� ,� �6WRUDJH��� 3URFHGXUH� ,,� �2SHUDWLRQ��� DQG� 3URFHGXUH� ,,,��7DFWLFDO�6WDQGE\�WR�2SHUDWLRQDO����'HWHUPLQH�WKH�SURFHGXUH�V��WR�EH�XVHG��

127(���7KH�PDWHULHO¶V�DQWLFLSDWHG�/LIH�&\FOH�(QYLURQPHQWDO�3URILOH��/&(3��PD\�UHYHDO�RWKHU�KLJK�WHPSHUDWXUH�VFHQDULRV�WKDW�DUH�QRW�VSHFLILFDOO\�DGGUHVVHG�LQ�WKH�SURFHGXUHV���7DLORU�WKH�SURFHGXUHV�DV�QHFHVVDU\�WR�FDSWXUH�WKH�/&(3�YDULDWLRQV��EXW�GR�QRW�UHGXFH�WKH�EDVLF�WHVW�UHTXLUHPHQWV�UHIOHFWHG�LQ�WKH�EHORZ�SURFHGXUHV����6HH�SDUDJUDSK�����EHORZ����127(���&RQVLGHU�WKH�SRWHQWLDO�V\QHUJLVWLF�HIIHFWV�RI�WHPSHUDWXUH��KXPLGLW\�DQG�DOWLWXGH��DQG�WKH�XVH�RI�0HWKRG�������LQ�DGGLWLRQ�WR�WKLV�PHWKRG��

������� 3URFHGXUH�VHOHFWLRQ�FRQVLGHUDWLRQV����:KHQ�VHOHFWLQJ�SURFHGXUHV��FRQVLGHU��D� 7KH�RSHUDWLRQDO�SXUSRVH�RI�WKH�PDWHULHO��E� 7KH�QDWXUDO�H[SRVXUH�FLUFXPVWDQFHV��DPELHQW�RU�LQGXFHG���F� 7KH�WHVW�GDWD�UHTXLUHG�WR�GHWHUPLQH�ZKHWKHU�WKH�RSHUDWLRQDO�SXUSRVH�RI�WKH�PDWHULHO�KDV�EHHQ�PHW��G� 3URFHGXUH�VHTXHQFH���,I�ERWK�WKH�VWRUDJH�DQG�RSHUDWLRQ�SURFHGXUHV�DUH�WR�EH�DSSOLHG��SHUIRUP�3URFHGXUH�,�

EHIRUH� 3URFHGXUH� ,,�� � &RQVLGHU� XVLQJ� 3URFHGXUH� ,,,� LQ� OLHX� RI� 3URFHGXUH� ,,� IRU� XQLTXH� FDVHV� ZKHUH�PDWHULHO� LQ� LWV� RSHUDWLRQDO� FRQILJXUDWLRQ� LV� QRQ�RSHUDWLRQDO� �DZDLWLQJ� XVH�� DQG� LV� H[SRVHG� WR� VRODU�KHDWLQJ��H�J���DLUFUDIW�FRFNSLWV��JURXQG�YHKLFOH�SDVVHQJHU�FRPSDUWPHQWV��HWF��

H� 2WKHU�VLJQLILFDQW�KHDW�VRXUFHV�WKDW�FRXOG�DIIHFW�WKH�PDWHULHO�VXFK�DV�PRWRUV��HQJLQHV��SRZHU�VXSSOLHV��RU�H[KDXVW�DLU��

������� 'LIIHUHQFH�DPRQJ�SURFHGXUHV����:KLOH�DOO�WKUHH�SURFHGXUHV�LQYROYH�WHPSHUDWXUH�FRQGLWLRQLQJ�DQG�SHUIRUPDQFH�WHVWLQJ��WKH\�GLIIHU�RQ�WKH�EDVLV�RI�WKH�WHPSHUDWXUH� ORDG� SULRU� WR� DQG� GXULQJ� SHUIRUPDQFH� WHVWV�� � 7KH� VWRUDJH� SURFHGXUH� DVVHVVHV� WKH� HIIHFWV� RI� KLJK�WHPSHUDWXUH� VWRUDJH� RQ� VXEVHTXHQW� PDWHULHO� SHUIRUPDQFH�� � 7KH� RSHUDWLRQ� SURFHGXUH� DVVHVVHV� WKH� HIIHFWV� RI� KLJK�

��������

Page 3: 3XUSRVH - EDGEedge.rit.edu/edge/R16301/public/Testing Specifications... · 0,/ 67' * 0(7+2' whpshudwxuhv gxulqj shuirupdqfh 7kh wdfwlfdo vwdqge\ wr rshudwlrqdo surfhgxuh hydoxdwhv

0,/�67'����*�0(7+2'�������

WHPSHUDWXUHV� GXULQJ� SHUIRUPDQFH�� � 7KH� WDFWLFDO�VWDQGE\� WR� RSHUDWLRQDO� SURFHGXUH� HYDOXDWHV� WKH� DELOLW\� RI�PDWHULHO��XVXDOO\� HQFORVHG� E\� WUDQVSDUHQW� RU� WUDQVOXFHQW� PDWHULDO�� WKDW� KDV� VRDNHG� LQ� WKH� VXQ� LQ� D� KLJK� WHPSHUDWXUH�HQYLURQPHQW�WR�EHFRPH�RSHUDWLRQDO�LQ�D�UHODWLYHO\�VKRUW�SHULRG�RI�WLPH����

D� 3URFHGXUH� ,� �� 6WRUDJH�� � 8VH� 3URFHGXUH� ,� WR� LQYHVWLJDWH� KRZ� KLJK� WHPSHUDWXUHV� GXULQJ� VWRUDJH� DIIHFW� WKH�PDWHULHO� �LQWHJULW\� RI� PDWHULDOV�� DQG� VDIHW\�SHUIRUPDQFH� RI� WKH� PDWHULHO��� � 7KLV� WHVW� SURFHGXUH� LQFOXGHV�H[SRVLQJ�WKH�WHVW�LWHP�WR�KLJK�WHPSHUDWXUHV��DQG�ORZ�KXPLGLW\�ZKHUH�DSSOLFDEOH��WKDW�PD\�EH�HQFRXQWHUHG�LQ�WKH�PDWHULHOV�VWRUDJH�VLWXDWLRQ��IROORZHG�E\�DQ�RSHUDWLRQDO�WHVW�DW�FRQWUROOHG�RU�KLJK�WHPSHUDWXUH�DPELHQW�FRQGLWLRQV�� � )RU� PDWHULHO� LQVLGH� DQ� HQFORVXUH� WKDW� LV�� LQ� WXUQ�� H[SRVHG� WR� VRODU� KHDWLQJ�� FRQVLGHU� XVLQJ�0HWKRG� ������� 3URFHGXUH� ,� WR� GHWHUPLQH� WKH� DFWXDO� OHYHO� RI� KHDWLQJ� RI� WKH� WHVW�PDWHULHO� FDXVHG� E\� VRODU�ORDGLQJ��

E� 3URFHGXUH� ,,� �� 2SHUDWLRQ�� � 8VH� 3URFHGXUH� ,,� WR� LQYHVWLJDWH� KRZ� KLJK� DPELHQW� WHPSHUDWXUHV� PD\� DIIHFW�PDWHULHO�SHUIRUPDQFH�ZKLOH�LW�LV�RSHUDWLQJ���7KHUH�DUH�WZR�ZD\V�WR�SHUIRUP�3URFHGXUH�,,����� ([SRVH�WKH�WHVW� LWHP�WR�F\FOLF�FKDPEHU�FRQGLWLRQV�ZLWK�WKH�WHVW� LWHP�RSHUDWLQJ�HLWKHU�FRQWLQXRXVO\�RU�

GXULQJ�WKH�SHULRG�RI�PD[LPXP�UHVSRQVH��KLJKHVW�LWHP�WHPSHUDWXUH������ ([SRVH�WKH�WHVW�LWHP�WR�D�FRQVWDQW�WHPSHUDWXUH�DQG�RSHUDWH�WKH�WHVW�LWHP�ZKHQ�LWV�WHPSHUDWXUH�VWDELOL]HV����

�7R� EH� XVHG� RQO\� IRU� LWHPV� VLWXDWHG� LQ� FORVH� SUR[LPLW\� WR� KHDW�SURGXFLQJ� HTXLSPHQW� RU� ZKHQ� LW� LV�QHFHVVDU\�WR�YHULI\�RSHUDWLRQ�RI�DQ�LWHP�DW�D�VSHFLILHG�FRQVWDQW�WHPSHUDWXUH�����

F� 3URFHGXUH� ,,,� �� 7DFWLFDO�6WDQGE\� WR� 2SHUDWLRQDO�� � 7KLV� SURFHGXUH� LV� QRW� D� VXEVWLWXWH� IRU� VRODU� UDGLDWLRQ��0HWKRG��������� �7KLV�SURFHGXUH�HYDOXDWHV� WKH�PDWHULHO¶V�SHUIRUPDQFH�DW� WKH�RSHUDWLQJ�WHPSHUDWXUHV�DIWHU�EHLQJ� SUHVRDNHG� DW� QRQ�RSHUDWLRQDO� WHPSHUDWXUHV�� � 6LQFH� DFWLQLF� HIIHFWV� DQG� GLUHFWLRQDO� KHDWLQJ� DUH� QRW�DSSOLFDEOH�LQ�WKLV�PHWKRG��FRQVLGHU�DSSO\LQJ�WKLV�SURFHGXUH�ZKHQ�PDWHULHO�LV�LQ�DQ�HQFORVHG�HQYLURQPHQW���H�J��� DLUFUDIW� DQG�JURXQG�YHKLFOHV�ZLWK� FORVHG� WUDQVSDUHQW� RU� WUDQVOXFHQW� DUHDV� FDQ�GHYHORS�KLJK� LQWHUQDO�WHPSHUDWXUHV�SULRU�WR�HTXLSPHQW�RSHUDWLRQ�GXH�WR�VRODU�KHDWLQJ��HQFORVXUHV�VXFK�DV�FRPPXQLFDWLRQV�VKHOWHUV�PD\�UHTXLUH�LPPHGLDWH�RSHUDWLRQ�DIWHU�EHLQJ�H[SRVHG�WR�VRODU�KHDWLQJ����7KHVH�DUH�QRW�LWHPV�LQ�VWRUDJH�RU�WUDQVLW� VLWXDWLRQ�� EXW� UDWKHU� LWHPV� LQ� WKH� RSHUDWLRQDO� FRQILJXUDWLRQ� �UHDG\�WR�JR� DV� QHHGHG�� WKDW� PXVW� EH�RSHUDWLRQDO�LQ�D�UHODWLYHO\�VKRUW�SHULRG�RI�WLPH���8VXDOO\��WKH�³FRROLQJ´�RSWLRQ�UHIHUV�WR�PHUHO\�RSHQLQJ�WKH�HQFORVHG� DUHDV� DQG� DOORZLQJ� WKH� DPELHQW� DLU� WR� EHJLQ� FRROLQJ� WKH� LQWHULRU� DUHDV� VR� QRUPDO� RSHUDWLRQ� FDQ�EHJLQ����

7KH�WHUP�³WDFWLFDO´�LV�XVHG�KHUH�WR�LGHQWLI\�PDWHULHO�WKDW�LV�QRW�LQ�VWRUDJH��EXW�LV�LQ�D�VWDQGE\�RSHUDWLRQDO�FRQILJXUDWLRQ��DQG�DV�VXFK�LV�VXEMHFWHG�WR�H[WHQGHG�QRQ�RSHUDWLRQDO�FRQGLWLRQV�LPPHGLDWHO\�SULRU�WR�RSHUDWLRQ��

��� 'HWHUPLQH�7HVW�/HYHOV�DQG�&RQGLWLRQV����+DYLQJ� VHOHFWHG� WKLV� PHWKRG� DQG� UHOHYDQW� SURFHGXUHV� �EDVHG� RQ� WKH� WHVW� LWHPV� UHTXLUHPHQWV� GRFXPHQWV� DQG� WKH�WDLORULQJ� SURFHVV��� FRPSOHWH� WKH� WDLORULQJ� SURFHVV� E\� LGHQWLI\LQJ� DSSURSULDWH� SDUDPHWHU� OHYHOV� DQG� DSSOLFDEOH� WHVW�FRQGLWLRQV�DQG�WHFKQLTXHV�IRU�WKHVH�SURFHGXUHV���%DVH�WKHVH�VHOHFWLRQV�RQ�WKH�UHTXLUHPHQWV�GRFXPHQWV�DQG�WKH�/LIH�&\FOH�(QYLURQPHQWDO�3URILOH��DQG�LQIRUPDWLRQ�SURYLGHG�ZLWK�WKLV�SURFHGXUH���&RQVLGHU�WKH�IROORZLQJ�ZKHQ�VHOHFWLQJ�WHVW�OHYHOV��

������� &OLPDWLF�FRQGLWLRQV����,GHQWLI\� WKH� DSSURSULDWH� FOLPDWLF� FRQGLWLRQV� IRU� WKH� JHRJUDSKLF� DUHDV� LQ�ZKLFK� WKH�PDWHULHO� ZLOO� EH� RSHUDWHG� DQG�VWRUHG�� �7KHUH�DUH� WZR�FOLPDWLF�FDWHJRULHV�ZKHUH�KLJK�WHPSHUDWXUHV�DUH� W\SLFDOO\�HQFRXQWHUHG�� �+RW�'U\�DQG�%DVLF�+RW��3DUW�2QH��$QQH[�&��)LJXUH�&����� �'DWD�IRU�WKHVH�DUHDV�DUH�VKRZQ�LQ�7DEOHV�������,���,,��DQG��,,,�� �'HWHUPLQH�KLJK�WHPSHUDWXUH�OHYHOV�ZLWK�UHVSHFW�WR��

D� &OLPDWLF�DUHD�RI�FRQFHUQ��E� ([SRVXUH� WR� VRODU� UDGLDWLRQ�� � ,V� WKLV� H[SRVXUH� GLUHFWO\� RQ� WKH�PDWHULHO�� VKLSSLQJ� FRQWDLQHU�� SURWHFWLYH�

SDFNDJH�VKHOWHU��HWF�"�F� $QDO\VLV�RI�WKH�SDWK�RI�KHDW�WUDQVIHU�IURP�WKH�DPELHQW�DLU�DQG�VRODU�UDGLDWLRQ�WR�WKH�PDWHULHO��

��������

Page 4: 3XUSRVH - EDGEedge.rit.edu/edge/R16301/public/Testing Specifications... · 0,/ 67' * 0(7+2' whpshudwxuhv gxulqj shuirupdqfh 7kh wdfwlfdo vwdqge\ wr rshudwlrqdo surfhgxuh hydoxdwhv

0,/�67'����*�0(7+2'�������

7DEOH�������,���6XPPDU\�RI�KLJK�WHPSHUDWXUH�GLXUQDO�F\FOH�UDQJHV���'HVLJQ�7\SH� /RFDWLRQ� $PELHQW�$LU�

&���� )�����,QGXFHG������

&��� )�����%DVLF�+RW��$��� 0DQ\�SDUWV�RI�WKH�ZRUOG��H[WHQGLQJ�RXWZDUG�

IURP�WKH�KRW�GU\�FDWHJRU\�RI�WKH�VRXWKZHVWHUQ�8QLWHG�6WDWHV��QRUWKZHVWHUQ�0H[LFR��FHQWUDO�DQG�ZHVWHUQ�$XVWUDOLD��6DKDUDQ�$IULFD��6RXWK�$PHULFD��VRXWKHUQ�6SDLQ��DQG�VRXWKZHVW�DQG�VRXWK�FHQWUDO�$VLD��

�������������������

�������������������

+RW�'U\��$��� 6RXWKZHVW�DQG�VRXWK�FHQWUDO�$VLD��VRXWKZHVWHUQ�8QLWHG�6WDWHV��6DKDUDQ�$IULFD��FHQWUDO�DQG�ZHVWHUQ�$XVWUDOLD��DQG�QRUWKZHVWHUQ�0H[LFR��

�������������������

�������������������

���7KH�GLXUQDO�F\FOHV�IRU�WHPSHUDWXUH�DQG�KXPLGLW\�DUH�JLYHQ�LQ�WDEOHV�������,,�DQG��,,,����� ,QGXFHG�FRQGLWLRQV�DUH�DLU� WHPSHUDWXUH� OHYHOV� WR�ZKLFK�PDWHULHO�PD\�EH�H[SRVHG�GXULQJ�H[WUHPH�VWRUDJH�RU� WUDQVLW�VLWXDWLRQV��RU�QRQ�RSHUDWLRQDO�EXW�LQ�WKH�RSHUDWLRQDO�FRQILJXUDWLRQ�ZLWKRXW�FRQWDLQHUL]DWLRQ��

��������

Page 5: 3XUSRVH - EDGEedge.rit.edu/edge/R16301/public/Testing Specifications... · 0,/ 67' * 0(7+2' whpshudwxuhv gxulqj shuirupdqfh 7kh wdfwlfdo vwdqge\ wr rshudwlrqdo surfhgxuh hydoxdwhv

0,/�67'����*�0(7+2'�������

7DEOH�������,,���+LJK�WHPSHUDWXUH�F\FOHV��FOLPDWLF�FDWHJRU\�$����%DVLF�+RW���

7LPH�RI�'D\�$PELHQW�$LU�&RQGLWLRQV� ,QGXFHG��6WRUDJH�DQG�7UDQVLW��&RQGLWLRQV�

7HPSHUDWXUH��&������ )��

+XPLGLW\����5+�

7HPSHUDWXUH��&������ )��

+XPLGLW\����5+�

������������������������������������������������������������������������������������������������������������������������

������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������

������������������������������������������������������������������������

������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������

�����������������������������������������������������������������

��� 7KHVH� F\FOHV� ZHUH� REWDLQHG� IURP� $5� ������� �� $XJXVW� ����� �VHH� SDUDJUDSK� ����� UHIHUHQFH� F��� DQG� HVVHQWLDOO\�FRQIRUP�WR�WKRVH�LQ�0,/�+'%.�����DQG�1$72�67$1$*�������$(&73������SDUDJUDSK������UHIHUHQFHV�D�DQG�E��� � 7KHVH� YDOXHV� UHSUHVHQW� W\SLFDO� FRQGLWLRQV� WKURXJKRXW� D� W\SLFDO� GD\� LQ� WKLV� FOLPDWLF� FDWHJRU\�� � �,QGXFHG�&RQGLWLRQV��DUH�DLU�WHPSHUDWXUH�OHYHOV�WR�ZKLFK�PDWHULHO�PD\�EH�H[SRVHG�GXULQJ�VWRUDJH�RU�WUDQVLW�VLWXDWLRQV�WKDW�DUH� DJJUDYDWHG�E\� VRODU� ORDGLQJ�� RU�GXULQJ�QRQ�RSHUDWLQJ� VLWXDWLRQV�EXW� LQ� DQ�RSHUDWLRQDO� FRQILJXUDWLRQ� DQG�QRW�FRQWDLQHUL]HG�����+XPLGLW\�FRQWURO�GXULQJ�KLJK�WHPSHUDWXUH�WHVWLQJ�LV�JHQHUDOO\�QRW�QHFHVVDU\���8VH�WKHVH�YDOXHV�RQO\�LQ�VSHFLDO�FDVHV�ZKHUH��IRU�LQVWDQFH��LW�LV�NQRZQ�WKDW�KLJK�OHYHOV�RI�WHPSHUDWXUH�DQG�KXPLGLW\�RFFXU�VLPXOWDQHRXVO\��

���'DWD�ZHUH�RULJLQDOO\�UHFRUGHG�LQ� )�DQG�FRQYHUWHG�WR� &���+HQFH��WDEOH�GDWD�FRQYHUVLRQ�PD\�QRW�EH�FRQVLVWHQW��

��������

Page 6: 3XUSRVH - EDGEedge.rit.edu/edge/R16301/public/Testing Specifications... · 0,/ 67' * 0(7+2' whpshudwxuhv gxulqj shuirupdqfh 7kh wdfwlfdo vwdqge\ wr rshudwlrqdo surfhgxuh hydoxdwhv

0,/�67'����*�0(7+2'�������

7DEOH�������,,,���+LJK�WHPSHUDWXUH�F\FOHV��FOLPDWLF�FDWHJRU\�$��±�+RW�'U\���

7LPH�RI�'D\�$PELHQW�$LU�&RQGLWLRQV� ,QGXFHG��6WRUDJH�DQG�7UDQVLW��&RQGLWLRQV�

7HPSHUDWXUH��&������ )��

+XPLGLW\����5+�

7HPSHUDWXUH��&������ )��

+XPLGLW\����5+�

������������������������������������������������������������������������������������������������������������������������

������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������

������������������������������������������������

������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������

������������������������������������������������

��� 7KHVH� F\FOHV� ZHUH� REWDLQHG� IURP�$5� ������� �� $XJXVW� ����� �VHH� SDUDJUDSK� ����� UHIHUHQFH� F��� DQG� HVVHQWLDOO\�FRQIRUP�WR�WKRVH�LQ�0,/�+'%.�����DQG�1$72�67$1$*�������$(&73������SDUDJUDSK������UHIHUHQFHV�D�DQG�E��� � 7KHVH� YDOXHV� UHSUHVHQW� W\SLFDO� FRQGLWLRQV� WKURXJKRXW� D� W\SLFDO� GD\� LQ� WKLV� FOLPDWLF� FDWHJRU\�� � �,QGXFHG�&RQGLWLRQV��DUH�DLU�WHPSHUDWXUH�OHYHOV�WR�ZKLFK�PDWHULHO�PD\�EH�H[SRVHG�GXULQJ�VWRUDJH�RU�WUDQVLW�VLWXDWLRQV�WKDW�DUH�DJJUDYDWHG� E\� VRODU� ORDGLQJ�� RU� GXULQJ� QRQ�RSHUDWLQJ� VLWXDWLRQV� EXW� LQ� DQ� RSHUDWLRQDO� FRQILJXUDWLRQ� DQG� QRW�FRQWDLQHUL]HG�����+XPLGLW\�FRQWURO�GXULQJ�KLJK�WHPSHUDWXUH�WHVWLQJ�LV�JHQHUDOO\�QRW�QHFHVVDU\���8VH�WKHVH�YDOXHV�RQO\�LQ�VSHFLDO�FDVHV�ZKHUH��IRU�LQVWDQFH��LW�LV�NQRZQ�WKDW�KLJK�OHYHOV�RI�WHPSHUDWXUH�DQG�KXPLGLW\�RFFXU�VLPXOWDQHRXVO\��

���'DWD�ZHUH�RULJLQDOO\�UHFRUGHG�LQ� )�DQG�FRQYHUWHG�WR� &���+HQFH��WDEOH�GDWD�FRQYHUVLRQ�PD\�QRW�EH�FRQVLVWHQW��������� ([SRVXUH�FRQGLWLRQV����%HIRUH�GHWHUPLQLQJ�WKH�OHYHOV�DW�ZKLFK�WR�VHW�WHVW�WHPSHUDWXUHV��GHWHUPLQH�WKH�ZD\�LQ�ZKLFK�WKH�PDWHULHO�LV�H[SRVHG�

WR�KHDW�LQ�QRUPDO�VWRUDJH�DQG�RSHUDWLRQDO�FLUFXPVWDQFHV���5HYLHZ�WKH�/LIH�&\FOH�(QYLURQPHQWDO�3URILOH��/&(3��WR�KHOS�PDNH�WKLV�GHWHUPLQDWLRQ�� �&RQVLGHU�DW� OHDVW�WKH�IROORZLQJ�H[SRVXUH�FRQGLWLRQV��DQG�WKH�SRVVLEOH�DOWHUQDWLYH�RI�XVLQJ�0HWKRG��������3URFHGXUH�,��

D� 'HSOR\PHQW�FRQILJXUDWLRQ������� ([SRVHG���2I�LQWHUHVW�DUH�WKH�PRVW�VHYHUH�FRQGLWLRQV�WKDW�PDWHULHO�ZRXOG�H[SHULHQFH�ZKHQ�GHSOR\HG�

LQ�DQ\�FOLPDWLF�DUHD�RI�WKH�ZRUOG�ZLWKRXW�WKH�EHQHILW�RI�D�SURWHFWLYH�FRYHU�RU�VKHOWHULQJ�HQFORVXUH����� 6KHOWHUHG���2I�LQWHUHVW�DUH�WKH�PRVW�VHYHUH�FRQGLWLRQV�WKDW�PDWHULHO�ZRXOG�H[SHULHQFH�ZKHQ�GHSOR\HG�

LQ�DQ\�FOLPDWLF�DUHD�RI�WKH�ZRUOG�ZKHQ�XQGHU�FRYHU�RU�LQVLGH�D�VKHOWHULQJ�HQFORVXUH���7KH�DPRXQW�RI�YHQWLODWLRQ�DYDLODEOH�DQG�WKH�SUHVHQFH�RI�DGMDFHQW�VKDGH�FDQ�VLJQLILFDQWO\�DIIHFW�WKH�WHPSHUDWXUH�RI�WKH�DLU�VXUURXQGLQJ�VKHOWHUHG�PDWHULHO���([DPSOHV�RI�WKHVH�VLWXDWLRQV�DUH�SURYLGHG�EHORZ����1RWH���,I�ILHOG� GDWD� DUH� QRW� DYDLODEOH�� WKH� FRQGLWLRQV� IRU� WKLV� H[SRVXUH� PD\� EH� DSSUR[LPDWHG� XVLQJ� 0,/�+'%.����� RU� 1$72� 67$1$*� ������ $(&73� ���� �SDUDJUDSK� ����� UHIHUHQFHV� D� DQG� E��� � 7KH�

��������

Page 7: 3XUSRVH - EDGEedge.rit.edu/edge/R16301/public/Testing Specifications... · 0,/ 67' * 0(7+2' whpshudwxuhv gxulqj shuirupdqfh 7kh wdfwlfdo vwdqge\ wr rshudwlrqdo surfhgxuh hydoxdwhv

0,/�67'����*�0(7+2'�������

RXWGRRU� DPELHQW� DLU� WHPSHUDWXUH� DQG� KXPLGLW\� FRQGLWLRQV� GHVFULEHG� LQ� WKHVH� UHIHUHQFHV� DUH� WKRVH�PHDVXUHG� LQ� VWDQGDUG� PHWHRURORJLFDO� VKHOWHUV� DW� D� KHLJKW� RI� ���� WR� ���� P� ��� WR� �� IW�� DERYH� WKH�JURXQG����6HH�3DUW�7KUHH��SDUDJUDSK���������IRU�IXUWKHU�JXLGDQFH����D� ,QVLGH�XQYHQWLODWHG�HQFORVXUHV���E� :LWKLQ�HQFORVHG�YHKLFOH�ERGLHV���F� :LWKLQ�DLUFUDIW�VHFWLRQV�KDYLQJ�VXUIDFHV�H[SRVHG�WR�VRODU�KHDWLQJ���G� ,QVLGH�RI�WHQWV���H� 8QGHU�FORVHG�WDUSDXOLQV���I� /RFDWHG�DERYH��RQ��RU�EHORZ�WKH�VXUIDFH�RI�WKH�(DUWK��

E� 6SHFLDO�FRQGLWLRQV���$OWKRXJK�KLJK�WHPSHUDWXUH�WHVWLQJ�LV�JHQHUDOO\�EDVHG�RQ�WKH�DYHUDJH�WHPSHUDWXUH�RI�WKH� DLU� HQYHORSH� VXUURXQGLQJ� WKH� PDWHULHO�� VLJQLILFDQW� ORFDOL]HG� KHDWLQJ� FDQ� RFFXU� EHFDXVH� RI� VSHFLDO�KHDWLQJ�FRQGLWLRQV���7KLV�ORFDOL]HG�KHDWLQJ�FDQ�EH�ZHOO�DERYH�WKH�DYHUDJH�VXUURXQGLQJ�DLU�DQG�WKHUHIRUH�FDQ�VLJQLILFDQWO\�DIIHFW�WKH�HYDOXDWLRQ�RI�WKH�PDWHULHOV�WKHUPDO�EHKDYLRU�DQG�SHUIRUPDQFH���:KHQ�WKHVH�FRQGLWLRQV�H[LVW��DV�GHVFULEHG�EHORZ���LQFOXGH�RU�VLPXODWH�WKHP�LQ�WKH�KLJK�WHPSHUDWXUH�WHVW�VHWXS�WR�WKH�H[WHQW�SUDFWLFDO���7KHVH�H[WUHPH�FRQGLWLRQV�ZRXOG�EH�DSSOLHG�E\�H[WHQGLQJ�WKH�OHYHOV�RI�WKH�WHPSHUDWXUHV�JLYHQ� LQ� WDEOHV� ������,� DQG� ������,,� EDVHG� RQ� DFWXDO� ILHOG�PHDVXUHPHQWV�� � 6HH� 3DUW� 7KUHH�� SDUDJUDSK���������IRU�IXUWKHU�JXLGDQFH����� $JJUDYDWHG�VRODU�� �7KHVH�FRQGLWLRQV�DUH� LQGXFHG�EXW� LQYROYH� WHPSHUDWXUHV�DV�KLJK�DV���� � WR���� �&�

�������WR������)���PDNLQJ�JUHDWHU�DOORZDQFH�IRU�WKH�HIIHFWV�RI�VRODU�UDGLDWLRQ���$SSOLFDEOH�FRQGLWLRQV�IRU�VXFK�WHVWLQJ�LQFOXGH�HTXLSPHQW�WKDW�LV�HPSOR\HG�LQ�WKH�RSHQ��IRU�ZKLFK�PHWKRG�������VKRXOG�EH�XVHG��DQG�LQ�HQFORVHG�FRPSDUWPHQWV�KDYLQJ�JOD]HG�RU�WUDQVSDUHQW�SDQHOV��DLUFUDIW�FRFNSLWV��YHKLFOH�FRPSDUWPHQWV��HWF����

��� 0DQ�PDGH� VRXUFHV�� � 0DQ�PDGH� KHDW�SURGXFLQJ� GHYLFHV� �PRWRUV�� HQJLQHV�� SRZHU� VXSSOLHV�� KLJK�GHQVLW\�HOHFWURQLF�SDFNDJHV��HWF���PD\�VLJQLILFDQWO\�UDLVH�WKH�ORFDO�DLU�WHPSHUDWXUH�QHDU�WKH�PDWHULHO��HLWKHU� E\� UDGLDWLRQ�� FRQYHFWLRQ�� RU� LPSLQJHPHQW� RI� H[KDXVW� DLU�� � 7KLV� QHDU� FRQVWDQW� WHPSHUDWXUH�HQYLURQPHQW�PD\�QHJDWH�WKH�HIIHFWV�RI�WKH�GLXUQDO�F\FOH����

����� ([SRVXUH�GXUDWLRQ����'HWHUPLQH�WKH�GXUDWLRQ�RI�H[SRVXUH�WKDW�WKH�PDWHULHO�ZLOO�H[SHULHQFH�IRU�HDFK�RI�WKH�H[SRVXUH�FRQGLWLRQV�LGHQWLILHG���([SRVXUH�PD\�EH�FRQVWDQW�RU�F\FOLF��LQ�ZKLFK�FDVH��DOVR�LGHQWLI\�WKH�QXPEHU�RI�WLPHV�WKDW�WKH�H[SRVXUH�RFFXUV��

&DXWLRQ�� :KHQ� WHPSHUDWXUH� FRQGLWLRQLQJ�� HQVXUH� WKH� WRWDO� WHVW� WLPH� DW� WKH� PRVW� VHYHUH�WHPSHUDWXUH�GRHV�QRW�H[FHHG�WKH�OLIH�H[SHFWDQF\�RI�DQ\�PDWHULDO��VHH�3DUW�2QH��SDUDJUDSK�������

�������� &RQVWDQW�WHPSHUDWXUH�H[SRVXUH��)RU�FRQVWDQW�WHPSHUDWXUH�H[SRVXUH��XVHG�RQO\�IRU�LWHPV�VLWXDWHG�LQ�FORVH�SUR[LPLW\�WR�KHDW�SURGXFLQJ�HTXLSPHQW�RU�ZKHQ�LW�LV�QHFHVVDU\�WR�YHULI\�RSHUDWLRQ�RI�DQ�LWHP�DW�D�VSHFLILHG�FRQVWDQW�WHPSHUDWXUH���VRDN�WKH�WHVW�LWHP�XQWLO�LWV�WHPSHUDWXUH�KDV�VWDELOL]HG��DQG�PDLQWDLQ�WKH�WHVW�WHPSHUDWXUH�DW�OHDVW�WZR�KRXUV�IROORZLQJ�WHVW�LWHP�VWDELOL]DWLRQ����

127(� �7KLV�LV�QRW�D�VXEVWLWXWH�IRU�VLWXDWLRQV�LQ�ZKLFK�GLXUQDO�F\FOLQJ�LV�W\SLFDO���������� &\FOLF�WHPSHUDWXUH�H[SRVXUH��)RU�F\FOLF�H[SRVXUH��GHWHUPLQH�WKH�WHVW�GXUDWLRQ�EDVHG�RQ�DQ�HVWLPDWH�RI�WKH�QXPEHU�RI�F\FOHV�UHTXLUHG�WR�VDWLVI\�WKH�GHVLJQ�UHTXLUHPHQWV�DQG�WKH�JXLGDQFH�EHORZ���7KH�GXUDWLRQ�RI�KLJK�WHPSHUDWXUH�H[SRVXUH�PD\�EH�DV�VLJQLILFDQW�DV�WKH�WHPSHUDWXUH�LWVHOI���%HFDXVH�3URFHGXUHV�,�DQG�,,�FRXOG�H[SRVH�WKH�WHVW�LWHPV�WR�F\FOLF�WHPSHUDWXUHV��WKH�QXPEHU�RI�F\FOHV�LV�FULWLFDO����&\FOHV�DUH����KRXU�SHULRGV�XQOHVV�RWKHUZLVH�VSHFLILHG���

D� 3URFHGXUH�,���6WRUDJH���7KH�QXPEHU�RI�F\FOHV�IRU�WKH�VWRUDJH�WHVW�LV�VHW�DW�D�PLQLPXP�RI�VHYHQ�WR�FRLQFLGH�ZLWK� WKH� RQH� SHUFHQW� IUHTXHQF\� RI� RFFXUUHQFH� RI� WKH� KRXUV� RI� H[WUHPH� WHPSHUDWXUHV� GXULQJ� WKH� PRVW�VHYHUH�PRQWK� LQ� DQ� DYHUDJH� \HDU� DW� WKH�PRVW� VHYHUH� ORFDWLRQ�� � �7KH�PD[LPXP� WHPSHUDWXUH� RFFXUV� IRU�DSSUR[LPDWHO\� RQH� KRXU� LQ� HDFK� F\FOH��� � :KHQ� FRQVLGHULQJ� H[WHQGHG� VWRUDJH�� FULWLFDO� PDWHULDOV�� RU�PDWHULDOV�GHWHUPLQHG�WR�EH�YHU\�VHQVLWLYH�WR�KLJK�WHPSHUDWXUH��LQFUHDVH�WKH�QXPEHU�RI�F\FOHV�WR�DVVXUH�WKH�GHVLJQ�UHTXLUHPHQWV�DUH�PHW��

��������

Page 8: 3XUSRVH - EDGEedge.rit.edu/edge/R16301/public/Testing Specifications... · 0,/ 67' * 0(7+2' whpshudwxuhv gxulqj shuirupdqfh 7kh wdfwlfdo vwdqge\ wr rshudwlrqdo surfhgxuh hydoxdwhv

0,/�67'����*�0(7+2'�������

E� 3URFHGXUH�,,���2SHUDWLRQ���7KH�PLQLPXP�QXPEHU�RI�F\FOHV�IRU�WKH�RSHUDWLRQDO�H[SRVXUH�WHVW�LV�WKUHH���7KLV�QXPEHU�LV�QRUPDOO\�VXIILFLHQW�IRU�WKH�WHVW�LWHP�WR�UHDFK�LWV�PD[LPXP�UHVSRQVH�WHPSHUDWXUH���$�PD[LPXP�RI�VHYHQ�F\FOHV�LV�VXJJHVWHG�ZKHQ�UHSHDWHG�WHPSHUDWXUH�UHVSRQVH�LV�GLIILFXOW�WR�REWDLQ��

127(�� � 7KLV� PD[LPXP� UHVSRQVH� WHPSHUDWXUH� LV� UHIHUHQFHG� LQ� VHYHUDO� RWKHU� PHWKRGV� RI� WKLV�VWDQGDUG�VXFK�DV�0HWKRG��������

������ 7HVW�LWHP�FRQILJXUDWLRQ����'HWHUPLQH�WKH�WHVW�LWHP�FRQILJXUDWLRQ�EDVHG�RQ�UHDOLVWLF�FRQILJXUDWLRQ�V��RI�WKH�PDWHULHO�DQWLFLSDWHG�IRU�VWRUDJH�DQG�RSHUDWLRQ���$V�D�PLQLPXP��FRQVLGHU�WKH�IROORZLQJ�FRQILJXUDWLRQV��

D� ,Q�D�VKLSSLQJ�VWRUDJH�FRQWDLQHU�RU�WUDQVLW�FDVH��E� 3URWHFWHG�RU�XQSURWHFWHG��XQGHU�FDQRS\��HQFORVHG��HWF����F� ,Q�LWV�QRUPDO�RSHUDWLQJ�FRQILJXUDWLRQ��UHDOLVWLF�RU�ZLWK�UHVWUDLQWV��VXFK�DV�ZLWK�RSHQLQJV�WKDW�DUH�QRUPDOO\�

FRYHUHG���G� 0RGLILHG�ZLWK�NLWV�IRU�VSHFLDO�DSSOLFDWLRQV��H� 6WDFNHG�RU�SDOOHWL]HG�FRQILJXUDWLRQV��

������� +XPLGLW\����*HQHUDOO\��UHODWLYH�KXPLGLW\��5+��FRQWURO�GXULQJ�KLJK�WHPSHUDWXUH�WHVWV�LV�QRW�QHFHVVDU\���,Q�VSHFLDO�FDVHV��H[WUHPHO\�ORZ�5+�PD\�KDYH�D�VLJQLILFDQW�HIIHFW�RQ�VRPH�PDWHULHO�GXULQJ�KLJK�WHPSHUDWXUH�WHVWLQJ���,I�WKH�PDWHULHO�KDV�VSHFLDO�FKDUDFWHULVWLFV�WKDW�FRXOG�EH�DIIHFWHG�E\�H[WUHPHO\�ORZ�5+��XVH�WKH�YDOXHV�IRU�5+�VKRZQ�LQ�7DEOHV�������,,�DQG��,,,������� 7HVW�,WHP�2SHUDWLRQ����:KHQ�LW�LV�QHFHVVDU\�WR�RSHUDWH�WKH�WHVW�LWHP��XVH�WKH�IROORZLQJ�JXLGHOLQHV�IRU�HVWDEOLVKLQJ�WHVW�RSHUDWLQJ�SURFHGXUHV��

D� *HQHUDO����6HH�3DUW�2QH��SDUDJUDSK��������E� 8QLTXH�WR�WKLV�PHWKRG��

��� ,QFOXGH�RSHUDWLQJ�PRGHV�WKDW�FRQVXPH�WKH�PRVW�SRZHU��JHQHUDWH�WKH�PRVW�KHDW������ ,QFOXGH�WKH�UHTXLUHG�UDQJH�RI�LQSXW�YROWDJH�FRQGLWLRQV�LI�FKDQJHV�LQ�YROWDJH�FRXOG�DIIHFW�WKH�WHVW�LWHP�

WKHUPDO�GLVVLSDWLRQ�RU�UHVSRQVH��H�J���SRZHU�JHQHUDWLRQ�RU�IDQ�VSHHG������ ,QWURGXFH�WKH�FRROLQJ�PHGLD�WKDW�QRUPDOO\�ZRXOG�EH�DSSOLHG�GXULQJ�VHUYLFH�XVH��H�J���IRUFHG�DLU�RU�

OLTXLG� FRRODQW��� � &RQVLGHU� XVLQJ� FRROLQJ�PHGLXP� LQOHW� WHPSHUDWXUHV� DQG� IORZ� UDWHV� WKDW� UHSUHVHQW�ERWK�W\SLFDO�DQG�ZRUVW�FDVH�GHJUDGHG�WHPSHUDWXUH�DQG�IORZ�FRQGLWLRQV���

��� )RU� VWHDG\�VWDWH� WHPSHUDWXUH� WHVWLQJ�� FRQVLGHU� WKHUPDO� VWDELOL]DWLRQ� WR� EH� DFKLHYHG� ZKHQ� WKH�WHPSHUDWXUHV�RI�FULWLFDO� LQWHUQDO�RSHUDWLQJ�FRPSRQHQWV�DUH�UHODWLYHO\�FRQVWDQW� �DV�GHVFULEHG� LQ�3DUW�2QH��SDUDJUDSK�����������%HFDXVH�RI�WHVW�LWHP�GXW\�F\FOLQJ�RU�WKH�RSHUDWLQJ�FKDUDFWHULVWLFV��D�FRQVWDQW�RSHUDWLQJ�WHPSHUDWXUH�PD\�QHYHU�EH�DFKLHYHG���

��� )RU�F\FOLF�WHPSHUDWXUH�WHVWLQJ�DQG�GHSHQGLQJ�RQ�WKH�F\FOH�DQG�WHVW�LWHP�FKDUDFWHULVWLFV��WKHUH�PD\�EH�QR�WKHUPDO�VWDELOL]DWLRQ���,Q�WKLV�FDVH��WKH�WKHUPDO�UHVSRQVHV�RI�WKH�WHVW�LWHP�ZLOO�DOVR�EH�F\FOLF��L�H���WKH�SHDN�UHVSRQVH�WHPSHUDWXUH�LV�ZLWKLQ�� &����� )��RI�WKDW�RI�WKH�SUHYLRXV�F\FOH��

��� &RQVLGHU� QRQ�RSHUDWLRQDO� FRQGLWLRQV� VLPLODU� WR� WKRVH� RI� VWRUDJH� � WUDQVLW�� DQG� WKH� QHHG� IRU�LPPHGLDWH�RSHUDWLRQ�ZLWKRXW�FRROLQJ�±�RWKHU�WKDQ�WKDW�RI�WKH�VXUURXQGLQJ�DPELHQW�DLU����

��� $GGLWLRQDO�JXLGHOLQHV�� �5HYLHZ�WKH�PDWHULHO�VSHFLILFDWLRQV�DQG�UHTXLUHPHQWV�GRFXPHQWV�� �$SSO\�DQ\�DGGLWLRQDO�JXLGHOLQHV�QHFHVVDU\�� �3DUW�7KUHH�RI�WKLV�GRFXPHQW�LQFOXGHV�IXUWKHU�LQIRUPDWLRQ�RQ�WKH�KLJK�WHPSHUDWXUH�HQYLURQPHQW��H�J���SDUDJUDSKV�����DQG�������� ,1)250$7,21�5(48,5('����� ��3UHWHVW����7KH�IROORZLQJ�LQIRUPDWLRQ�LV�UHTXLUHG�WR�FRQGXFW�KLJK�WHPSHUDWXUH�WHVWV�DGHTXDWHO\��

D� *HQHUDO�� � ,QIRUPDWLRQ� OLVWHG� LQ� 3DUW� 2QH�� SDUDJUDSKV� ���� DQG� ����� DQG� $QQH[� $�� 7DVN� ���� RI� WKLV�VWDQGDUG��

��������

Page 9: 3XUSRVH - EDGEedge.rit.edu/edge/R16301/public/Testing Specifications... · 0,/ 67' * 0(7+2' whpshudwxuhv gxulqj shuirupdqfh 7kh wdfwlfdo vwdqge\ wr rshudwlrqdo surfhgxuh hydoxdwhv

0,/�67'����*�0(7+2'�������

E� 6SHFLILF�WR�WKLV�PHWKRG������� 5HODWLYH�KXPLGLW\�FRQWURO�UHTXLUHPHQWV��LI�QHFHVVDU\�����6HH�SDUDJUDSK�������RI�WKLV�PHWKRG�������� 7KHUPRFRXSOH� ORFDWLRQV�� � 7KH� FRPSRQHQW�DVVHPEO\�VWUXFWXUH� WR� EH� XVHG� IRU� WKHUPDO� UHVSRQVH� DQG�

WHPSHUDWXUH�VWDELOL]DWLRQ�SXUSRVHV����6HH�3DUW�2QH��SDUDJUDSK���������� )RU� 3URFHGXUH� ,,,�� EDVHG� RQ� WKH� /&(3�� LGHQWLI\� WKH� DQWLFLSDWHG� PD[LPXP� QRQ�RSHUDWLRQDO�

WHPSHUDWXUH� �H[SRVXUH� WR� KLJK� WHPSHUDWXUHV� DQG� VRODU� ORDGLQJ�� IRU� WKH� PDWHULHO�� DV� ZHOO� DV� WKH�DFFRPSDQ\LQJ�KLJK�DPELHQW�WHPSHUDWXUH���7KH�/&(3�VKRXOG�GHILQH�ZKHWKHU�RU�QRW�WKH�LWHP�ZLOO�EH�RSHUDWHG�DW�WKH�PD[LPXP�RSHUDWLRQDO�WHPSHUDWXUH�LPPHGLDWHO\�IROORZLQJ�WKH�VWRUDJH�HQYLURQPHQW��

F� 7DLORULQJ���1HFHVVDU\�YDULDWLRQV�LQ�WKH�EDVLF�WHVW�SURFHGXUHV�WR�DFFRPPRGDWH�/&(3�UHTXLUHPHQWV�DQG�RU�IDFLOLW\�OLPLWDWLRQV�����

��� 'XULQJ�7HVW����&ROOHFW�WKH�IROORZLQJ�LQIRUPDWLRQ�GXULQJ�FRQGXFW�RI�WKH�WHVW��D� *HQHUDO�� � ,QIRUPDWLRQ� OLVWHG� LQ�3DUW�2QH��SDUDJUDSK�������DQG� LQ�$QQH[�$��7DVNV�����DQG�����RI� WKLV�

VWDQGDUG��E� 6SHFLILF�WR�WKLV�PHWKRG��

��� 5HFRUG�RI�FKDPEHU�WHPSHUDWXUHV��DQG�KXPLGLW\��LI�DSSOLFDEOH��YHUVXV�WLPH�FRQGLWLRQV����� 5HFRUG�RI�WKH�WHVW�LWHP�WHPSHUDWXUH�YHUVXV�WLPH�GDWD�IRU�WKH�GXUDWLRQ�RI�WKH�WHVW��

��� 3RVW�WHVW����7KH�IROORZLQJ�SRVW�WHVW�GDWD�VKDOO�EH�LQFOXGHG�LQ�WKH�WHVW�UHSRUW��

D� *HQHUDO���,QIRUPDWLRQ�OLVWHG�LQ�3DUW�2QH��SDUDJUDSK�������DQG�LQ�$QQH[�$��7DVN�����RI�WKLV�VWDQGDUG��E� 6SHFLILF�WR�WKLV�PHWKRG��

��� /HQJWK�RI�WLPH�UHTXLUHG�IRU�HDFK�SHUIRUPDQFH�FKHFN����� 7HPSHUDWXUH�YHUVXV�WLPH�GDWD��WHVW�LWHP�DQG�FKDPEHU������ $Q\�GHYLDWLRQV�IURP�WKH�RULJLQDO�WHVW�SODQ��

�� 7(67�352&(66����� 7HVW�)DFLOLW\��

D� 7KH�UHTXLUHG�DSSDUDWXV�FRQVLVWV�RI�D�FKDPEHU�RU�FDELQHW�WRJHWKHU�ZLWK�DX[LOLDU\�LQVWUXPHQWDWLRQ�FDSDEOH�RI� PDLQWDLQLQJ� DQG� PRQLWRULQJ� WKH� UHTXLUHG� FRQGLWLRQV� RI� KLJK� WHPSHUDWXUH� �DQG� KXPLGLW\�� ZKHUH�UHTXLUHG��WKURXJKRXW�DQ�HQYHORSH�RI�DLU�VXUURXQGLQJ�WKH�WHVW�LWHP�V���VHH�3DUW�2QH��SDUDJUDSK���������

E� 8QOHVV� MXVWLILHG� E\� WKH� PDWHULHO� SODWIRUP� HQYLURQPHQW� DQG� WR� SUHYHQW� XQUHDOLVWLF� KHDW� WUDQVIHU� LQ� WKH�PDWHULHO��PDLQWDLQ�WKH�DLU�YHORFLW\�LQ�WKH�YLFLQLW\�RI�WKH�WHVW�LWHP�VR�DV�WR�QRW�H[FHHG�����P�V������IW�PLQ����

F� &RQWLQXRXVO\�UHFRUG�FKDPEHU�WHPSHUDWXUHV�DQG��LI�UHTXLUHG��WHVW�LWHP�WHPSHUDWXUHV����� &RQWUROV��

D� 7HPSHUDWXUH�� �8QOHVV�RWKHUZLVH� VSHFLILHG� LQ� WKH� WHVW� SODQ�� LI� DQ\� DFWLRQ�RWKHU� WKDQ� WHVW� LWHP�RSHUDWLRQ��VXFK�DV�RSHQLQJ� WKH�FKDPEHU�GRRU�� UHVXOWV� LQ�D� VLJQLILFDQW�FKDQJH�RI� WKH� WHVW� LWHP� WHPSHUDWXUH� �PRUH�WKDQ�� &����� )���RU�FKDPEHU�DLU�WHPSHUDWXUH��UH�VWDELOL]H�WKH�WHVW�LWHP�DW�WKH�UHTXLUHG�WHPSHUDWXUH�EHIRUH�FRQWLQXLQJ� WKH� WHVW�� � )RU� 3URFHGXUH� ,,�� LI� WKH� RSHUDWLRQDO� FKHFN� LV� QRW� FRPSOHWHG� ZLWKLQ� ��� PLQXWHV��UHHVWDEOLVK�WHVW�LWHP�WHPSHUDWXUH�5+�FRQGLWLRQV�EHIRUH�FRQWLQXLQJ��

E� 5DWH�RI�WHPSHUDWXUH�FKDQJH���8QOHVV�RWKHUZLVH�VSHFLILHG��XVH�D�UDWH�RI�WHPSHUDWXUH�FKDQJH�QRW�H[FHHGLQJ�� &��� )��SHU�PLQXWH�WR�SUHYHQW�WKHUPDO�VKRFN��

F� 5HFRUG�FKDPEHU�WHPSHUDWXUH�DQG�KXPLGLW\�LQ�DFFRUGDQFH�ZLWK�3DUW�2QH��SDUDJUDSKV�����DQG�������DQG�DW�D�VXIILFLHQW�UDWH�WR�VDWLVI\�WKH�SRVW�WHVW�DQDO\VLV��VHH�3DUW�2QH��SDUDJUDSK�������

��� 7HVW�,QWHUUXSWLRQ��7HVW�LQWHUUXSWLRQV�FDQ�UHVXOW�IURP�WZR�RU�PRUH�VLWXDWLRQV��RQH�EHLQJ�IURP�IDLOXUH�RU�PDOIXQFWLRQ�RI�WHVW�FKDPEHUV�RU�DVVRFLDWHG�WHVW�ODERUDWRU\�HTXLSPHQW���7KH�VHFRQG�W\SH�RI�WHVW�LQWHUUXSWLRQ�UHVXOWV�IURP�IDLOXUH�RU�PDOIXQFWLRQ�RI�WKH�WHVW�LWHP�LWVHOI�GXULQJ�UHTXLUHG�RU�RSWLRQDO�SHUIRUPDQFH�FKHFNV�������

��������

Page 10: 3XUSRVH - EDGEedge.rit.edu/edge/R16301/public/Testing Specifications... · 0,/ 67' * 0(7+2' whpshudwxuhv gxulqj shuirupdqfh 7kh wdfwlfdo vwdqge\ wr rshudwlrqdo surfhgxuh hydoxdwhv

0,/�67'����*�0(7+2'�������

������ ,QWHUUXSWLRQ�GXH�WR�FKDPEHU�PDOIXQFWLRQ��D� *HQHUDO���6HH�3DUW�2QH��SDUDJUDSK�������RI�WKLV�VWDQGDUG��E� 6SHFLILF�WR�WKLV�PHWKRG��

��� 8QGHUWHVW�LQWHUUXSWLRQ��D� &\FOLQJ���,I�D�F\FOLF�KLJK�WHPSHUDWXUH�WHVW�LV�EHLQJ�FRQGXFWHG�DQG�DQ�XQVFKHGXOHG�LQWHUUXSWLRQ�

RFFXUV�WKDW�FDXVHV�WKH�WHVW�FRQGLWLRQV�WR�IDOO�RXW�RI�DOORZDEOH�WROHUDQFHV�WRZDUG�VWDQGDUG�DPELHQW�WHPSHUDWXUHV��FRQWLQXH�WKH�WHVW�IURP�WKH�HQG�RI�WKH�ODVW�VXFFHVVIXOO\�FRPSOHWHG�F\FOH��

�E� 6WHDG\�VWDWH���,I�D�VWHDG\�VWDWH��QRQ�F\FOLF��WHVW�LV�EHLQJ�FRQGXFWHG��RQO\�IRU�LWHPV�QHDU�FRQVWDQW��KHDW�SURGXFLQJ�VRXUFHV���DQG�DQ�XQVFKHGXOHG�LQWHUUXSWLRQ�RFFXUV�WKDW�FDXVHV�WKH�WHVW�FRQGLWLRQV�WR�IDOO�RXW�RI�DOORZDEOH�WROHUDQFHV�WRZDUG�VWDQGDUG�DPELHQW�FRQGLWLRQV��UH�VWDELOL]H�WKH�WHVW�LWHP�DW�WKH�UHTXLUHG�WHVW�WHPSHUDWXUH�DQG�FRQWLQXH�WKH�WHVW�IURP�WKH�SRLQW�ZKHUH�WHVW�FRQGLWLRQV�ZHUH�OHIW���5HFRUG�WKH�GXUDWLRQ�RI�LQLWLDO�DQG�ILQDO�WHVW�SHULRGV��

��� 2YHUWHVW�LQWHUUXSWLRQ��H�J���ORVV�RI�FKDPEHU�FRQWURO���D� ,QVSHFWLRQ�DQG�SHUIRUPDQFH�FKHFN���,I�DQ�LQWHUUXSWLRQ�LQ�D�F\FOLF�RU�VWHDG\�VWDWH�WHVW�UHVXOWV�LQ�

PRUH�H[WUHPH�H[SRVXUH�RI�WKH�WHVW�LWHP�WKDQ�UHTXLUHG�E\�WKH�PDWHULHO�VSHFLILFDWLRQV��IROORZ�WKH�LQWHUUXSWLRQ�E\�D�FRPSOHWH�SK\VLFDO�LQVSHFWLRQ�DQG�DQ�RSHUDWLRQDO�FKHFN��ZKHUH�SRVVLEOH��EHIRUH�FRQWLQXLQJ�WKH�WHVW��

�E� 6DIHW\��SHUIRUPDQFH��PDWHULDOV�SUREOHPV���:KHQ�WKHVH�W\SHV�RI�SUREOHPV�DUH�GLVFRYHUHG�DIWHU�DQ�RYHUWHVW��WKH�SUHIHUDEOH�FRXUVH�RI�DFWLRQ�LV�WR�WHUPLQDWH�WKH�WHVW�DQG�UH�LQLWLDWH�WHVWLQJ�ZLWK�D�QHZ�WHVW�LWHP���,I�WKLV�LV�QRW�GRQH�DQG�D�WHVW�LWHP�IDLOXUH�RFFXUV�GXULQJ�WKH�UHPDLQGHU�RI�WKH�WHVW��WKH�WHVW�UHVXOWV�FRXOG�EH�FRQVLGHUHG�LQYDOLG�EHFDXVH�RI�WKH�RYHUWHVW�FRQGLWLRQV���,I�QR�SUREOHP�KDV�EHHQ�HQFRXQWHUHG��UHHVWDEOLVK�SUH�LQWHUUXSWLRQ�FRQGLWLRQV�DQG�FRQWLQXH�IURP�WKH�SRLQW�ZKHUH�WKH�WHVW�WROHUDQFHV�ZHUH�H[FHHGHG��

������ ,QWHUUXSWLRQ�GXH�WR�WHVW�LWHP�RSHUDWLRQ�IDLOXUH��)DLOXUH�RI�WKH�WHVW� LWHP�V��WR�IXQFWLRQ�DV�UHTXLUHG�GXULQJ�PDQGDWRU\�RU�RSWLRQDO�SHUIRUPDQFH�FKHFNV�GXULQJ�WHVWLQJ�SUHVHQWV�D�VLWXDWLRQ�ZLWK�VHYHUDO�SRVVLEOH�RSWLRQV��� � D�� 7KH�SUHIHUDEOH�RSWLRQ�LV�WR�UHSODFH�WKH�WHVW�LWHP�ZLWK�D�³QHZ´�RQH�DQG�UHVWDUW�IURP�6WHS����� E�� $�VHFRQG�RSWLRQ�LV�WR�UHSODFH���UHSDLU�WKH�IDLOHG�RU�QRQ�IXQFWLRQLQJ�FRPSRQHQW�RU�DVVHPEO\�ZLWK�RQH�WKDW�

IXQFWLRQV�DV�LQWHQGHG��DQG�UHVWDUW�WKH�HQWLUH�WHVW�IURP�6WHS����127(���:KHQ�HYDOXDWLQJ�IDLOXUH�LQWHUUXSWLRQ��FRQVLGHU�SULRU�WHVWLQJ�RQ�WKH�VDPH�WHVW�LWHP�DQG�FRQVHTXHQFHV�RI�VXFK��

��� 7HVW�6HWXS����D� *HQHUDO���6HH�3DUW�2QH��SDUDJUDSK������E� 8QLTXH� WR� WKLV� PHWKRG�� � ,QFOXGH� LQ� WKH� WHVW� VHWXS� DQ\� DGGLWLRQDO� KHDW� VRXUFHV� RU� DQ� DSSURSULDWH�

VLPXODWLRQ��VHH�SDUDJUDSK������E������ 7HVW�([HFXWLRQ��7KH�IROORZLQJ�VWHSV��DORQH�RU�LQ�FRPELQDWLRQ��SURYLGH�WKH�EDVLV�IRU�FROOHFWLQJ�QHFHVVDU\�LQIRUPDWLRQ�FRQFHUQLQJ�WKH�PDWHULHO�LQ�D�KLJK�WHPSHUDWXUH�HQYLURQPHQW��

������� 3UHSDUDWLRQ�IRU�WHVW����������� 3UHOLPLQDU\�VWHSV����%HIRUH� VWDUWLQJ� WKH� WHVW�� UHYLHZ�SUHWHVW� LQIRUPDWLRQ� LQ� WKH� WHVW�SODQ� WR�GHWHUPLQH� WHVW�GHWDLOV� �H�J���SURFHGXUHV�� WHVW�LWHP�FRQILJXUDWLRQ��F\FOHV��GXUDWLRQV��SDUDPHWHU�OHYHOV�IRU�VWRUDJH�RSHUDWLRQ��HWF������6HH�SDUDJUDSK������DERYH������������ 3UHWHVW�VWDQGDUG�DPELHQW�FKHFNRXW����$OO� WHVW� LWHPV� UHTXLUH� D� SUHWHVW� VWDQGDUG� DPELHQW� FKHFNRXW� WR� SURYLGH� EDVHOLQH� GDWD�� � &RQGXFW� WKH� FKHFNRXW� DV�IROORZV��

6WHS���� ,Q�RUGHU�WR�GHWHUPLQH�WKHUPDO�UHVSRQVH��SDUDJUDSK����F���LQVWDOO�WHPSHUDWXUH�VHQVRUV�LQ��RQ��RU�DURXQG�WKH�WHVW�LWHP�DV�GHVFULEHG�LQ�WKH�WHVW�SODQ���

���������

Page 11: 3XUSRVH - EDGEedge.rit.edu/edge/R16301/public/Testing Specifications... · 0,/ 67' * 0(7+2' whpshudwxuhv gxulqj shuirupdqfh 7kh wdfwlfdo vwdqge\ wr rshudwlrqdo surfhgxuh hydoxdwhv

0,/�67'����*�0(7+2'�������

6WHS���� &RQGXFW�D�YLVXDO�H[DPLQDWLRQ�RI�WKH�WHVW�LWHP�ZLWK�VSHFLDO�DWWHQWLRQ�WR�VWUHVV�DUHDV��VXFK�DV�FRUQHUV�RI�PROGHG�FDVHV��DQG�GRFXPHQW�WKH�UHVXOWV��

6WHS���� &RQGXFW� DQ�RSHUDWLRQDO� FKHFNRXW� �3DUW�2QH�� SDUDJUDSK�������� DW� VWDQGDUG� DPELHQW� FRQGLWLRQV� �3DUW�2QH��SDUDJUDSK������DV�GHVFULEHG�LQ�WKH�SODQ�DQG�UHFRUG�WKH�UHVXOWV��

6WHS���� ,I�WKH�WHVW�LWHP�RSHUDWHV�VDWLVIDFWRULO\��SURFHHG�WR�SDUDJUDSK���������������RU�������DV�DSSURSULDWH���,I�QRW��UHVROYH�WKH�SUREOHPV�DQG�UHSHDW�6WHS���DERYH��

������� 3URFHGXUH�,���6WRUDJH��127(���,I�WKH�/&(3�KDV�GHILQHG�WKH�QHHG�WR�RSHUDWH�WKH�WHVW�LWHP�DW�WKH�KLJK�RSHUDWLRQDO�

WHPSHUDWXUH�LPPHGLDWHO\�IROORZLQJ�VWRUDJH��FRQVLGHU�XVLQJ�3URFHGXUH�,,,��6WHS���� 3ODFH�WKH�WHVW�LWHP�LQ�LWV�VWRUDJH�FRQILJXUDWLRQ�DQG�LQVWDOO�LW�LQ�WKH�FKDPEHU��6WHS���� $GMXVW� WKH�FKDPEHU�HQYLURQPHQW� WR� WKH� UHTXLUHG� WHVW� FRQGLWLRQV� IRU� HLWKHU� F\FOLF� H[SRVXUH� �7DEOHV�

������,,�RU�������,,,��RU�FRQVWDQW�H[SRVXUH��VHH�SDUDJUDSK����������IRU�WKH�VWDUW�RI�WKH�WHVW�SHULRG�DQG�PDLQWDLQ�IRU�WKH�VSHFLILHG�WLPH�IROORZLQJ�WHPSHUDWXUH�VWDELOL]DWLRQ�RI�WKH�WHVW�LWHP��

6WHS���� D�� )RU� F\FOLF� VWRUDJH�� H[SRVH� WKH� WHVW� LWHP� WR� WKH� WHPSHUDWXUH� �DQG� KXPLGLW\�� LI� DSSOLFDEOH��FRQGLWLRQV� RI� WKH� VWRUDJH� F\FOH� IRU� D�PLQLPXP�RI� VHYHQ����KRXU� F\FOHV�� RU� DV� VSHFLILHG� LQ� WKH�/&(3�DQG�WKH�WHVW�SODQ���5HFRUG�WKH�WKHUPDO�UHVSRQVH�RI�WKH�WHVW�LWHP���

� E�� )RU� FRQVWDQW� WHPSHUDWXUH� VWRUDJH� �WR� EH� XVHG� RQO\� IRU� LWHPV� VLWXDWHG� LQ� FORVH� SUR[LPLW\� WR�HTXLSPHQW� SURGXFLQJ� FRQVWDQW� KLJK� WHPSHUDWXUHV�� VHH� SDUDJUDSK� �����E������ PDLQWDLQ� WKH� WHVW�WHPSHUDWXUH� DW� OHDVW� WZR� KRXUV� IROORZLQJ� WHVW� LWHP� WHPSHUDWXUH� VWDELOL]DWLRQ� �VHH� 3DUW� 2QH��SDUDJUDSK� ������ � 7KH� DGGLWLRQDO� WZR� KRXUV� ZLOO� KHOS� HQVXUH� XQPHDVXUHG� LQWHUQDO� FRPSRQHQWV�DFWXDOO\� UHDFK� VWDELOL]DWLRQ�� � ,I� QRW� SRVVLEOH� WR� LQVWUXPHQW� LQWHUQDO� FRPSRQHQWV�� EDVH� DQ\�DGGLWLRQDO�VRDN� WLPH�RQ� WKHUPDO�DQDO\VLV� WR�HQVXUH� WHPSHUDWXUH�VWDELOL]DWLRQ� WKURXJKRXW� WKH� WHVW�LWHP���

6WHS���� $W� WKH� FRPSOHWLRQ� RI� WKH� FRQVWDQW� WHPSHUDWXUH� VRDN� RU� WKH� ODVW� F\FOH�� DGMXVW� WKH� FKDPEHU� DLU�WHPSHUDWXUH� WR� FRQWUROOHG� DPELHQW� FRQGLWLRQV� DQG� PDLQWDLQ� XQWLO� WKH� WHVW� LWHP� WHPSHUDWXUH� LV�VWDELOL]HG��

6WHS���� &RQGXFW�D�YLVXDO�H[DPLQDWLRQ�DQG�RSHUDWLRQDO�FKHFNRXW�RI�WKH�WHVW�LWHP��DQG�UHFRUG�WKH�UHVXOWV�IRU�FRPSDULVRQ�ZLWK�SUHWHVW�GDWD���6HH�SDUDJUDSK���IRU�DQDO\VLV�RI�UHVXOWV��

������� 3URFHGXUH�,,���2SHUDWLRQ��6WHS���� :LWK�WKH�WHVW�LWHP�LQ�WKH�FKDPEHU�LQ�LWV�RSHUDWLRQDO�FRQILJXUDWLRQ��LQVWDOO�DQ\�DGGLWLRQDO�WHPSHUDWXUH�

VHQVRUV� QHFHVVDU\� WR� PHDVXUH� WKH� PD[LPXP� WHPSHUDWXUH� UHVSRQVH� RI� WKH� WHVW� LWHP�� HQVXULQJ� WKH�IXQFWLRQLQJ�FRPSRQHQWV�DUH�LQFOXGHG���

6WHS���� ,I�SHUIRUPLQJ�WKH�FRQVWDQW�WHPSHUDWXUH�H[SRVXUH��JR�WR�6WHS�����2WKHUZLVH��JR�WR�6WHS����6WHS���� &RQVWDQW�WHPSHUDWXUH�H[SRVXUH���$GMXVW�WKH�FKDPEHU�DLU�FRQGLWLRQV�WR�WKH�UHTXLUHG�WHPSHUDWXUH��DQG�

KXPLGLW\��LI�DSSOLFDEOH��DW�ZKLFK�WKH�PDWHULHO�PXVW�RSHUDWH��6WHS���� 0DLQWDLQ�WKH�FKDPEHU�FRQGLWLRQV�DW�OHDVW�WZR�KRXUV�IROORZLQJ�WHVW�LWHP�WHPSHUDWXUH�VWDELOL]DWLRQ��VHH�

3DUW�2QH��SDUDJUDSK��������,I�QRW�SRVVLEOH�WR�LQVWUXPHQW�LQWHUQDO�FRPSRQHQWV��EDVH�WKH�DGGLWLRQDO�VRDN�WLPH�RQ�WKHUPDO�DQDO\VLV�WR�HQVXUH�WHPSHUDWXUH�VWDELOL]DWLRQ�WKURXJKRXW�WKH�WHVW�LWHP���

6WHS���� &RQGXFW�DV� WKRURXJK�D�YLVXDO�H[DPLQDWLRQ�RI� WKH� WHVW� LWHP�DV�SRVVLEOH�FRQVLGHULQJ�FKDPEHU�DFFHVV�OLPLWDWLRQV��DQG�GRFXPHQW�WKH�UHVXOWV�IRU�FRPSDULVRQ�ZLWK�SUHWHVW�GDWD����

6WHS���� 2SHUDWH�WKH�WHVW�LWHP�DQG�DOORZ�LWV�WHPSHUDWXUH�WR�UH�VWDELOL]H���&RQGXFW�DQ�RSHUDWLRQDO�FKHFNRXW�RI�WKH�WHVW�LWHP�LQ�DFFRUGDQFH�ZLWK�WKH�WHVW�SODQ�DQG�GRFXPHQW�WKH�UHVXOWV�IRU�FRPSDULVRQ�ZLWK�SUHWHVW�GDWD���,I�WKH�WHVW�LWHP�IDLOV�WR�RSHUDWH�DV�LQWHQGHG��IROORZ�WKH�JXLGDQFH�LQ�SDUDJUDSK�������IRU�WHVW�LWHP�IDLOXUH���

6WHS���� 6NLS�6WHSV���WKURXJK����DQG�SURFHHG�GLUHFWO\�WR�6WHS�����

���������

Page 12: 3XUSRVH - EDGEedge.rit.edu/edge/R16301/public/Testing Specifications... · 0,/ 67' * 0(7+2' whpshudwxuhv gxulqj shuirupdqfh 7kh wdfwlfdo vwdqge\ wr rshudwlrqdo surfhgxuh hydoxdwhv

0,/�67'����*�0(7+2'�������

6WHS���� &\FOLQJ�WHPSHUDWXUH�H[SRVXUH���$GMXVW�WKH�FKDPEHU�DLU�WHPSHUDWXUH��DQG�KXPLGLW\��LI�DSSOLFDEOH��WR�WKH�LQLWLDO�FRQGLWLRQV�RI�WKH�RSHUDWLRQDO�F\FOH�DSSURSULDWH�IRU�PDWHULHO�GHSOR\PHQW��DQG�PDLQWDLQ�XQWLO�WKH�WHVW�LWHP¶V�WHPSHUDWXUH�KDV�VWDELOL]HG��

6WHS���� ([SRVH�WKH�WHVW�LWHP�WR�DW�OHDVW�WKUHH�F\FOHV�RU�WKH�QXPEHU�RI�F\FOHV�QHFHVVDU\�WR�DVVXUH�UHSHDWHG�WHVW�LWHP� UHVSRQVH�� �'RFXPHQW� WKH�PD[LPXP� WHVW� LWHP� UHVSRQVH� WHPSHUDWXUH�� �&RQGXFW� DV� FRPSOHWH� D�YLVXDO�H[DPLQDWLRQ�RI� WKH�WHVW� LWHP�DV�SRVVLEOH�FRQVLGHULQJ�FKDPEHU�DFFHVV� OLPLWDWLRQV�� �'RFXPHQW�WKH�UHVXOWV��

6WHS�����2SHUDWH� WKH� WHVW� LWHP�GXULQJ� WKH�PD[LPXP� WHVW� LWHP� WHPSHUDWXUH� UHVSRQVH� SHULRG� RI� WKH� H[SRVXUH�F\FOH�� � ,I� WKH� WHVW� LWHP�IDLOV� WR�RSHUDWH�DV� LQWHQGHG�� IROORZ� WKH�JXLGDQFH� LQ�SDUDJUDSK�������IRU� WHVW�LWHP� IDLOXUH�� � 7KH� PD[LPXP� WHVW� LWHP� WHPSHUDWXUH� UHVSRQVH� SHULRG� PD\� QRW� FRLQFLGH� ZLWK� WKH�PD[LPXP�WHPSHUDWXUH�F\FOH�FRQGLWLRQV�EHFDXVH�RI�WKH�WKHUPDO� ODJ�RI�WKH�WHVW� LWHP���5HSHDW�XQWLO�D�VXFFHVVIXO� RSHUDWLRQDO� FKHFNRXW� RI� WKH� WHVW� LWHP� KDV� EHHQ� DFFRPSOLVKHG� LQ� DFFRUGDQFH� ZLWK� WKH�DSSURYHG�WHVW�SODQ��DQG�WKH�UHVXOWV�KDYH�EHHQ�GRFXPHQWHG��

6WHS�����:LWK�WKH�WHVW�LWHP�QRW�RSHUDWLQJ��DGMXVW�WKH�FKDPEHU�DLU�WHPSHUDWXUH�WR�FRQWUROOHG�DPELHQW�FRQGLWLRQV�DQG�PDLQWDLQ�XQWLO�WKH�WHVW�LWHP�WHPSHUDWXUH�KDV�VWDELOL]HG��

6WHS�����&RQGXFW�D�FRPSOHWH�YLVXDO�H[DPLQDWLRQ�DQG�RSHUDWLRQDO�FKHFNRXW�LQ�DFFRUGDQFH�ZLWK�WKH�DSSURYHG�WHVW�SODQ�DQG�GRFXPHQW�WKH�UHVXOWV�IRU�FRPSDULVRQ�ZLWK�SUHWHVW�GDWD���6HH�SDUDJUDSK���IRU�DQDO\VLV�RI�UHVXOWV��

������� 3URFHGXUH�,,,�±�7DFWLFDO�6WDQGE\�WR�2SHUDWLRQDO��6WHS���� :LWK�WKH�WHVW�LWHP�LQ�WKH�FKDPEHU�DQG�LQ�LWV�WDFWLFDO�FRQILJXUDWLRQ��LQVWDOO�DQ\�DGGLWLRQDO�WHPSHUDWXUH�

VHQVRUV� QHFHVVDU\� WR�PHDVXUH� WKH� WHPSHUDWXUH� UHVSRQVH� RI� WKH� WHVW� LWHP�� HQVXULQJ� WKH� IXQFWLRQLQJ�FRPSRQHQWV�DUH�LQFOXGHG��

6WHS���� $GMXVW� WKH� FKDPEHU� DLU� WHPSHUDWXUH� WR� WKH� DQWLFLSDWHG� PD[LPXP� QRQ�RSHUDWLQJ� WHPSHUDWXUH�� DQG�PDLQWDLQ� WKLV� WHPSHUDWXUH� XQWLO� WKH� WHVW� LWHP� WHPSHUDWXUH� KDV� VWDELOL]HG�� SOXV� D� PLQLPXP� RI� WZR�DGGLWLRQDO�KRXUV�WR�HQVXUH�FRPSOHWH�VWDELOL]DWLRQ��

6WHS���� $GMXVW� WKH� FKDPEHU� DLU� WHPSHUDWXUH� WR� WKH�KLJK�RSHUDWLRQDO� WHPSHUDWXUH� LGHQWLILHG� LQ� WKH�/&(3�DV�TXLFNO\�DV�SRVVLEOH��DW�D�UDWH�QR�OHVV�WKDQ����R)�SHU�PLQXWH����$V�VRRQ�DV�WKH�FKDPEHU�LQVWUXPHQWDWLRQ�LQGLFDWHV� WKLV� WHPSHUDWXUH�KDV�EHHQ�UHDFKHG��RSHUDWH� WKH�WHVW� LWHP�LQ�DFFRUGDQFH�ZLWK�WKH�DSSURYHG�WHVW�SODQ�DQG�GRFXPHQW�WKH�UHVXOWV�IRU�FRPSDULVRQ�ZLWK�SUHWHVW�GDWD���,I�WKH�WHVW�LWHP�IDLOV�WR�RSHUDWH�DV�LQWHQGHG��IROORZ�WKH�JXLGDQFH�LQ�SDUDJUDSK�������IRU�WHVW�LWHP�IDLOXUH���

6WHS���� �:LWK� WKH� WHVW� LWHP� QRW� RSHUDWLQJ�� DGMXVW� WKH� FKDPEHU� DLU� WHPSHUDWXUH� WR� FRQWUROOHG� DPELHQW�FRQGLWLRQV�DQG�PDLQWDLQ�XQWLO�WKH�WHVW�LWHP�WHPSHUDWXUH�KDV�VWDELOL]HG��

6WHS���� &RQGXFW�D�FRPSOHWH�YLVXDO�H[DPLQDWLRQ�DQG�RSHUDWLRQDO�FKHFNRXW�LQ�DFFRUGDQFH�ZLWK�WKH�DSSURYHG�WHVW�SODQ��DQG�GRFXPHQW�WKH�UHVXOWV�IRU�FRPSDULVRQ�ZLWK�SUHWHVW�GDWD���6HH�SDUDJUDSK���IRU�DQDO\VLV�RI�UHVXOWV��

�� $1$/<6,6�2)�5(68/76����,Q�DGGLWLRQ�WR�WKH�JXLGDQFH�SURYLGHG�LQ�3DUW�2QH��SDUDJUDSKV������DQG�������WKH�IROORZLQJ�LQIRUPDWLRQ�LV�SURYLGHG�WR�DVVLVW�LQ�WKH�HYDOXDWLRQ�RI�WKH�WHVW�UHVXOWV���$SSO\�DQ\�GDWD�UHODWLYH�WR�IDLOXUH�RI�D�WHVW�LWHP�WR�PHHW�WKH�UHTXLUHPHQWV�RI�WKH�PDWHULHO�VSHFLILFDWLRQV�WR�WKH�WHVW�DQDO\VLV��DQG�FRQVLGHU�UHODWHG�LQIRUPDWLRQ�VXFK�DV��

D� 5HVXOWV�RI�QRQGHVWUXFWLYH�H[DPLQDWLRQV��LI�DQ\��RI�PDWHULHO�IROORZLQJ�WKH�VWRUDJH�WHVW�PD\�EH�FRQGXFWHG�DW�WKH�H[WUHPH�WHPSHUDWXUHV��

E� 'HJUDGDWLRQ�RU�FKDQJHV�LQ�RSHUDWLQJ�FKDUDFWHULVWLFV�DOORZHG�DW�WKH�KLJK�H[WUHPH�WHPSHUDWXUHV��F� 1HFHVVLW\�IRU�VSHFLDO�NLWV�RU�VSHFLDO�RSHUDWLQJ�SURFHGXUHV�IRU�KLJK�WHPSHUDWXUH�H[SRVXUH��G� (YLGHQFH�RI�LPSURSHU�OXEULFDWLRQ�DQG�DVVXUDQFH�WKDW�WKH�OXEULFDQWV�VSHFLILHG�IRU�WKH�HQYLURQPHQWDO�FRQGLWLRQ�

ZHUH�XVHG��H� )RU�3URFHGXUH�,,,��WKH�DPRXQW�RI�WLPH�UHTXLUHG�IRU�WKH�WHVW�LWHP�WR�EHFRPH�RSHUDWLRQDO��

���������

Page 13: 3XUSRVH - EDGEedge.rit.edu/edge/R16301/public/Testing Specifications... · 0,/ 67' * 0(7+2' whpshudwxuhv gxulqj shuirupdqfh 7kh wdfwlfdo vwdqge\ wr rshudwlrqdo surfhgxuh hydoxdwhv

0,/�67'����*�0(7+2'�������

���������

�� 5()(5(1&(�5(/$7('�'2&80(176����� 5HIHUHQFHG�'RFXPHQWV��

D� 0,/�+'%.������*OREDO�&OLPDWLF�'DWD�IRU�'HYHORSLQJ�0LOLWDU\�3URGXFWV���E� 1$72� 67$1$*� ������ $(&73� ����� &DWHJRU\� ����� 6HFWLRQ� ������ :RUOGZLGH� ([WUHPH� &OLPDWLF� �

(QYLURQPHQWDO�&RQGLWLRQV�)RU�'HILQLQJ�'HVLJQ�7HVW�&ULWHULD��F� $5��������5HVHDUFK��'HYHORSPHQW��7HVW�DQG�(YDOXDWLRQ�RI�0DWHULHO�IRU�([WUHPH�&OLPDWLF�&RQGLWLRQV��G� 0,/�67'�����&��7HVW�0HWKRG�6WDQGDUG�±�+D]DUG�$VVHVVPHQW�7HVWV�IRU�1RQ�1XFOHDU�0XQLWLRQV��

��� 5HODWHG�'RFXPHQWV��D� 6\QRSVLV�RI�%DFNJURXQG�0DWHULDO�IRU�0,/�67'����%��&OLPDWLF�([WUHPHV�IRU�0LOLWDU\�(TXLSPHQW���%HGIRUG��

0$���$LU�)RUFH�&DPEULGJH�5HVHDUFK�/DERUDWRULHV�����-DQXDU\��������'7,&�QXPEHU�$'����������E� 1$72�67$1$*�������(QYLURQPHQWDO�7HVWLQJ��F� $OOLHG�(QYLURQPHQWDO�&RQGLWLRQV�DQG�7HVW�3URFHGXUH��$(&73�������&OLPDWLF�(QYLURQPHQWDO�7HVWV� �XQGHU�

67$1$*��������0HWKRG������G� (JEHUW��+HUEHUW�:��³7KH�+LVWRU\�DQG�5DWLRQDOH�RI�0,/�67'�����´�)HEUXDU\�������,QVWLWXWH�RI�(QYLURQPHQWDO�

6FLHQFHV� DQG� 7HFKQRORJ\�� $UOLQJWRQ� 3ODFH� 2QH�� ����� 6�� $UOLQJWRQ� +HLJKWV� 5RDG�� 6XLWH� ����� $UOLQJWRQ�+HLJKWV��,/��������������

�&RSLHV� RI� 'HSDUWPHQW� RI� 'HIHQVH� 6SHFLILFDWLRQV�� 6WDQGDUGV�� DQG� +DQGERRNV�� DQG� ,QWHUQDWLRQDO� 6WDQGDUGL]DWLRQ�$JUHHPHQWV� DUH� DYDLODEOH� RQOLQH� DW� KWWS���DVVLVW�GDSV�GOD�PLO�TXLFNVHDUFK�� RU� IURP� WKH� 6WDQGDUGL]DWLRQ� 'RFXPHQW�2UGHU�'HVN������5REELQV�$YHQXH��%XLOGLQJ��'��3KLODGHOSKLD��3$��������������5HTXHVWV� IRU� RWKHU� GHIHQVH�UHODWHG� WHFKQLFDO� SXEOLFDWLRQV�PD\� EH� GLUHFWHG� WR� WKH� 'HIHQVH� 7HFKQLFDO� ,QIRUPDWLRQ�&HQWHU��'7,&���$771��'7,&�%5��6XLWH������������-RKQ�-��.LQJPDQ�5RDG��)RUW�%HOYRLU�9$���������������������������� �$VVLVWDQFH��VHOHFWLRQ� ��� RSWLRQ� ���� KWWS���VWLQHW�GWLF�PLO�LQIR�V�VWLQHW�KWPO�� DQG� WKH� 1DWLRQDO� 7HFKQLFDO�,QIRUPDWLRQ�6HUYLFH��17,6���6SULQJILHOG�9$������������������17,6���������KWWS���ZZZ�QWLV�JRY���