kris gram - dtic
TRANSCRIPT
II
PHOTOGRAPH THIS SHEET
S IL ; :.
LEVEL J ava( I -ea/ INVENTORY
z Aontem~ C#9SVoece &Co4?";,f#on a. ai rriu+ Modald~ f . e
w Tescce. z*&,qk Zhm+ .(,vb*4 sk j,, f~e 3-C A'rcaDOCUMENT IDENTIFICATIONTC T 0e.f, da . ; \0401fe IFoh. 2 ). l
DISTBIrON STATEMENT A
Approved to- public release;Dib-tribuiton Unlimited
DISTRIBUTION STATEMErT
ACCESSION FOR OfKris GRAMDTIC TAB D] 4UNANNOUNCED aL f,usTIICA O lllELECTE E
a ~~JUSTIFICATION OT118i I OCT 16 1981 I
BYDISTRIBUTION /AVAILABILITY CODESDIST AVAIL AND/OR SPECIAL DATE ACCESSIONED
DISTRIBUTHON STAMP
8110 15klDATE RECEIVED IN DTIC
PHOTOGRAPH THIS SHEET AND RETURN TO DTIC-DDA-2
-TI FORM 70A DOCUMENT PREESSING SHEET-DTIC OCT 790A
~ --~A
NAVAL POSTGRADUATE SCHOOLrMonterey, California
THESISVoice'Recognition as an Input ModalityI
for the Tacco Preflight Dat- Insertion TaskIin the ?-3C A.-,.raft ~
by
John Laughlin Taggart Jr. ICharles Darwin Wolfe I
3 March 1981
Thesis advisors: Doug Neil RGary .Poock
Approved for public release, dtstribution unlimited. i
iti
S- c XM _
SECURITY CLASSIFICATION OF THIS 6AAGE (Ut1%ou Dat S. neered) _______________
REPORT DOCUMENTATION PAGE BFREDISRCIN
V EPR 4MUR2. GOVT ACCESSION NO. 3. RZCIPIENT3 CATALOG NUMBERq
4. TTLE ~d Sb~lt.) . YYPC OF REPOR-. A PEIOO COVERED
Voice recognition as an input modalit Masr's Thesifoy the TACCO preflight data insertion Mrh18task in the P- 3C aircraft 6- PERFORMING ORG. REPORT NUMBER
V7. AUTHOR(@) 6. CONTRACT OR GRANT NUNER(s)
John Laughlin Taggart, Jr., and
9. PERFORMING ORGANIZATION NAME AND ADORESS 10. PROGRAM ELEMENT. PROJECT, TASKM AREA A WORK UNIT NUMUERS
ltNaval Postgraduate School3Monterey, California 93940
1.CNvaLLN OFFICE NAME AND ADORCSS 12. REPORT OATE
NvlPostgraduate School March 1981Monterey, California 93940 IS. NUMBER OF PAGES
14 MONITORING AGENCY NAtME A AOORESS1 dferentfro Cnring 011fice) 15. SEUIYCLASS. (of this taon
UnclassifiedIS. OECLASSIFICATION/OOWNGRAOING
SCIIEOULE
IS. DISTRIBUTION STATEMENT (of this X011H)
Approved for public release, distribution unlimited. M
17. OISTP18UTION STATEMENT (of the abstract entered IR Stock MIf it dioen *hRw)
1S. SUPPLEMENTARY NOTES
soI
It. KEY WORDS (Coathwe an fevwr* side itf ocooav and Idealty by block embot)
P-3C, TACCO, Voice Recognition, Speech Recognition I
20. ABSTRACT (Conthwm. an revrn. Ol*b It 8*0000M7 ME idvf I s-F - jAn exneriment was conducted to compare accuracy and entry Ispeed capabilities of a standard keyboard with the ThresholdTechnology T-600 voice recognition unit in the performance of -an operational data entry task in the P-3C aircraft. A computer -program was written to simulate the data entry capabilitiesof the P-3C operational software. Thirteen military officersexecuted a P-3C Tactical Coordinator's preflight task of entering
kD,~P 1473 EDITION OF I NOV 60 IS OIOL9TEfS/N 002-O4~ 601 SCuniTy CLASSFIcATION4 OF T$HIS PAGE (tMW D918 8011~)
20. cont.data into the Stores Management and Navigation Preflighttableaux.
Overall, voice entry was found to be faster for theStores Management data entry task and slower for theNavigation Preflight tableau task, with comparable acc-uracy. But, for subjects with prior voice input exper-
bohience, tablex input vcewas faster than keyboard entry for i
bot talax
DD ora 147
F1 0111-0 1*tIioW"spsrhieD*to"s
Ac~nrovadi f nr cp)i) r r1 o ~ ~ Ie-iI i tsI r i b It I ion r)1 r rn r
Vn ire rhpce)o1 1 mor , ict ri [ n tt ;,I n oxd, I it Yfnr tho Td3rcP Pr-f I inht 1),t~ a. prl rt n i, sk
Jo)hn 1 IAtj,'PhIi (- 1IqrL Jr.
h .A i r i rmec;t a foi Ph r it Lbei o
h fnr I tjq rn j) n ,e
ro(jijreetsfr h ee of
- - - - - - -- - - -- --
Aorrmrvpd by
Cha ASW Academic 'orour,
Aca emic Dean
ABSTRACT
4n experiment was conducted to compare accuracy and
en~try soeed capabilities of a standard keyboard with the
Threshold Technolooy T-600 voice recognition unit in the
airraf. Acomputer program was written to simulate the
datA en aanilitaek in the P-Coeaina otee
Threnmilitary officers executed a P-3C Tactical
[Coordinator's preflight task 6ientering data into the
Stores~ Mbnagement and Navigation Preflight tableaux.
Overall# voice entry was found to be faster for the21
Stores Management data entry task anu slower for the
Navioation Preflight tableau task# with comparable accuracy.
Butt for sublects with prior voice input experience, voice
input was fast'ir than keyboard entry for both tableaux.
urn--
TABLE OF CONTENTS
PAGE
T. INTRODUCTION ................... 9
A. THE P-3 MI3SION ......
B. GENERAL CONSIDERATIONS IN MAN-COMPUTERINTERACTION .... ................... 12
C. SPEECH RECOGNITION - AN OVERVIEW ............ 13 1
D. PREVIOUS WORK WITH VOICE INPUT .............. 20
II. METHOD .......................... * ............... 31
A. VOICE INPUT HAROWARE .. o........... 31
B. THE SIMULATION "...........................* 34
1. The Purpose of the Simulation .......... 34
2. Simulation Descriotion .................. 35U
3* hardware 39 eoeooeeeeoeooe.oeoeog
4. Simulation Software ............. ,,oo°. 39 I
C. THE EXPERIMENT .....e..................... 42 '1. Design considerations ...... 42e......e 42 1:2. Subjeets 45 m
3. 'faterials ...,.,... ,~.,,.,.. 46
4. Proedupes .... 4...C... ... ...
5o Data Analysis .,...,,,@,°°e,.° so. RESULTS ..................................... 52
A. ENTRY SPEED .......................... 55 [B, OPERATIONAL. ERRORS ,,,-.,.,e....e66
C. ENTRY ERRORS ........ 66
Fi
D. EXPERIENCE WITH VOICE INPUT ................. 74
E. OTHER CONSIDERATIONS 80
IV. CONCLUSIONS AND RECO,4MENDATIONS ................. 81
A. CONCLUSIONS •......................... 81
TIB RECOMMENDATIONS ............ 83
APPENDIX A. SIMULATION TABLEAUX .....°............... 85
APPENDIX B. SIMULATION PROGRAM FUNCTIONAL OUTLINE *, • 89
APPENDIX C. VOICE RECOGNITION USERS GUIDE ........ .... 91 a
APPENDIX D. SIMULATION OVERVIEW ....................... 92
APPENDIX E. SIMULATION FAMILIARIZATION ............... 97
!PPENDIX F. PREFLIGHT DATA SHEETS ....................o I
APPENDIX G. VOICE INPUT VOCABULARY ................ .o109 i
APPENDIX H. DATA FORMS*-o-*.*****................
APPENDIX I. RECOGNITION ERROR SUMMARY ............. .*11S
SIMULATION PROGRAM LISTING ...... ............... . .. .t122
LIST OF REFERENCES .,..... .. ,,,,... ...... .. 133
INITIAL DISTRIBUTION LIST o . . 0o ... ° o....... ,134
21Ii
6
I _ ~ _
LIST OF TABLES
NUMBER N A M E PAGE------------------ -----S C0~ --- 0-------eeeee-- ----
I. RAW DATA TRIAL ONE S................... 3
TI. RAW DATA TRIAL TWO ............. ..... 54... SU
III. MEAN ENTRY TIME SUMMARY ....................... , 56
IV. ANOVA: STORES MANAGEMENT TABLEAU ENTRY TIMES ... 57 !
V. ANOVA: NAV PREFLIGHT TABLEAU ENTRY TIMES........ 58
VI. ANCVA: STORES MANAGEMENT TABLEAU ENTRY TIMESTACCO VS OTHER BACKGROUNDS ................... 64 j
VII. ANOVA: STORES MANAGEMENT TABLEAU !OPERATIONAL ERRORS...... ........... .... *....... 67
VIII. ANOVA: NAY PREFLIGHT TABLEAU I
OPERATIONAL ERRORS .................. ............ 68
I!IX. BASIC ERRORS - STORES MANAGEMENT TABLEAU ....... 69
X. ANOVA: BASIC ERROR RATESTORES MANAGEMENT TABLEAUBY ENTRY METHOD......................... .. 69
XI. UTTERANCES WITH.GREATER THiAN TWO PERCENTRECOGNITION ERROR RATE...............,.... 71
XII. VOICE ENTRY TIME AND BASIC ERROR RATE eBY EXPERIENCE LEVEL ............................ 76 1
II
,111
LIST OF FIGURES
NUMBER N A M E PAGE----- S----- ---- - --- ---- 'I
1. CONCEPTUAL DESIGN OF !HE EXPERIMENT .............. £3
2. MEAN ENTRY TIMES -
STORES MANAGEMENT TABLEAUTRIAL I VS. TRIAL 2 *........................... 9
3. MEAN ENTRY TIMES -
NAY PREFLIGHT TABLEAUTRIAL I VS. TRIAL 2 ........... .. , ..... 60
L4* MEAN ENTRY TIMES -
STORES MANAGEMENT TABLEAUVOICE VS. KEYSET ENTRY ..................... 61
5. MEAN ENTRY TIMES -NAV PREFLIGHT TABLEAUVOICE VS. KEYSET ENTRY 6...................... 2
6. DISTRIBUTION OF ENTRY TIMES -STORES M44AGEMENT TABLEAUEXPERIENCE VS. INEXFERIENCE
WITH VOICE ENTRY ....................... ..... 77
7. DISTRIBUTION OF BASIC ERROR RATESSTORES MANAGEMENT TABLEAUEXPERIENCE VS. INEXPERIENCEWITH VOICE ENTRY 78
8. DISTRIBUTION OF ENTRY TIMES -NAV PREFLIGHT TABLEAU
EXPERIENCE VS. INEXPERIENCEWITH VOICE ENTRY 7.....ooo....... .............
4 3"i 2jw
g27t
N~~I ,
I n
sol )r nrfe r;,-SD. Tf a~ETE~%I)~Cen rrra
co!YmmunlcetlOn c an eccr' e ovP r e~~o ff- l -'Iin- th t-3 nrn -a>n 1hjnr, jfl the l envirmre - m ao u-nn-
[ eat e nee t o he h%!orinuslv enter-- t , _
sucn as rccu rs our In2 ore f'i-2nt da er st rc r
weaoons i-ventory anj nev1aetion rret-Iiofr -aa n*-*
j weanon sy-sterr.
The P-IC is -i four enuine, Ioii win;- ai rcraft -desio4
for oatrol a3nd! Antisutarine warfare. Tt carries a- reM wOfj
t,'Ive ofies ndenisev ecmi iaofn. ar
Javioator Communicatnr (ULVC3')I, Fliont Pn-no~er R~~ej-Stat ion lIe and 3 (SSlSS-2, S*) , Infli-aht tel;cknCeI an a ndO an 7Oi-dnancetan.
The mission of the P-3f is varied0 ana inclr,-es Serh
and R--gc-ue, Ptboto/Recon, andl Mintnie n Addto to '
ersr ?k of ASif . The ASW task o' W-e -c i
* I=
deoetion I e I her t1inf n -r43tr prti
nt t j-ZS 1S -issor r~c-e r% eavCe'etP rssess a.
t S
t a ea
zrc sn and is- I :t ace----S ~aa?~ e r one ra tor S
F and va-ious aircraft e-luu-nt. Vtt~n nr-cse hs
1fl01JV tr,:
1. Control, synchronize, s _ -a--aeo n
I ~~tactical and auxiliaryo- raV
*r . rvide for roeroolo I yi.4 4 C T aa *.-r S~ je i nflight recovery orev~ Bing oos -ht an-alysis of
2- theM -ission.f
."anace a-a cont rol te ai rcraft avfato --Ste0-S. ]4. Vanaoe search stlore A--4 weac-nn 1nvart-r-0s
5. control search store -no w-aoaffn lae ij6 . Cotn-unicete with *Vher St at --s via oatsa in and
7. oniorand control srObof'-uv rece-iver assionwerts. _
R anaoe ano control the ei@CttoiC SUPC easureS
q. Perform orefliont - ai noe- testinG Ofj
F associated eouioment.A f
most of the date tnat is Oorresen - mte AS-l isW
bsdOn instructiors that are Contained i ,-! t- one rat* ional
orogras- which is loaded into ---orv 4-rn-- A -A-netic ta.
10-
'14.
Additionally, oata which ~s rission sreri fic i s loaded onto
the end Of the ooera-.ion;?. Proor;%n t ar,; i nt o a o r e fIi oht
data insertion nrog1 ram or VD1P ky oersonnol from trie 5SW~r.
nne of the areas of difficui~y :n coinrietina the PUTP is
the insertion of qearch stores into t~e tStorns Management"
tableau. Search stores t~re comorised of sonooouvsp smoke
"Stokrs andqmet bihterooreeu C~aqiqrteteetsa
and subsequent to lo-idinn of the oo'-rallional r rog ram'. ]he
distractions from other crewmemvers and because of the-
redunant nature of the task.
Previcus studiest byt e Ikef. 11 and Fueoe and Greer
iRef . 21 have looked at the work load of crew members and 1have exr~lored the' Possible use 04 iUtofpated speech
technolooy to increase onerator nerforrnance during various
portion' of the P-3C mission. This stuav will evaluate. the -'use of the Model 1600 Threshold Technoloay, Tinc. Vjoice
recoanition unit durinq pre-tlicdht dita etitry tasks
oerformed Dy the Tactical Coordinator in the P-3C aircraft.
I-Results of the voice data entry method will be compared
with those usinq standard kjeyboard entry Method considering
the metrics of 1) entry speed, and 2) accuracy.
R~. GENERAI. ru!%STOFRA I UN'S I 01 UM~t INf~TI~G NI
Mori has fine cnannel - qupecn -with which he flops most
of his comrruniratinq wiOh other necole, and three channels-
manual, visual and audio - with which ne 'foes most of his
communicatinn with his Mach::-es. Tn oenera1, manual m-'ans
are uspdj in -ran-comoutpr communiration and visual means are
used in comouter-man communications. Keyboa3rds, of ccou rse,
are the rnrimTArv inout device in most aoolications, However,
that dopsn't -ean that thr-y are, '-ecessarilv, the oest tyoeF
for most acouiications. The followina Qutestions ShOUld heI
1. Ters the inorut al'ohanurneric:, strictlv digits or words,
or senten'ces etc.?
2 Tsthe inr)Li' strictly formatted.'
3. Ts there considerahle mental or visual effort reouired
to menipulate the diate before it can be entered?
4l. To what extent will the inout ke interective with thecomputer?
~.What wil I bte thfe mob iIi tyv requirements f or thenoerator.
6. Ts it desirable for the operatL.& to he able to performseconcdarv tasks alono with the data entr-y taskl?
7. Will the oroerator be unider unusual environmental
Stress?
8. Wfho will the ocerators be?
q~How much experience will the operators have w t h thedata input device?
Or. How important is -incrut error rate to the application?
1-1. How~ important is entry speed to the apolication?--
12
12. ~Il I the onerator he re-aiui redq to i nterf ce wi tf oth Pr
nPeritors while 1 iq tisinn thp inotit diev ice?
r.SPFECH RFLOGMITIrliq A,, 0% FRV1Fv
Al human l ang t~ o; of q ro u o 9 f 5o un Ms ca IeI ea
Dhonernes which atr C, elli by the interaCt-.o of various
speech articulators: lios, tor-ou, , teeth and palate. Ihere
are five, ceneralil accepted catejories of Articulation
rRef . and 41~
1. PLOSTVFS or SIl'PS which act to stop the passaqe ofIa ir, Such as 't' in "too" .
2. FRI~CAITVES which ape caused by fnrmina a narrow slitfor air oassage; Such as 'th' in the word 'their'.
3. LATERALS whicr are formed by closing the middle lineof the mnouth;i qucn as ']* in the wor'd 'laurih'.
11. TRTLLS which are formed by the raoia vibration of anlarticulator SuCh as the t rilIIe # in FomI anguaaes.
S. VOWELS which are formed by unobstructed air flow overthe vocal chords.
In English, there are about lb different vowel sounds
and 2? different consonant variations* orovidiino "about 38
different ohonemes. Besides the actual sound generated by
the different cateaorie-s of ohonemes, the intensity or power
generated varies sig~nificantly fro," case to caze. Vowels
allow much more nower trins-nission thtan consonants, with the
greatest di'fference oeing about 28 d8 a factor of
approxizmsteiv 68-0 (Ref. 31!
Speech lauality' is a rather elusi-ve term, but can be
thought of as a measure of two qualities! oitcb( frequency )
13
t 41w.C
and louaness (power). Intrilit-Ility s a n even more
elusive rnarameter. Tt varies with oualitv, context,
vocabulary size aond haC~orounj noise level. Generally,6
tntell I i iitiv I C enhanced when the s iz e of the users
v ocabulary is reduced, as is the case with air traffic icontroller-to-aircraft comrmunications (Ref. bil. Both the
nilIot of tne aircraft and the cont rfoIIe use standard
ohraseology from a defined vocabulary for the bulk of thei r
transmissions. Also, intelligibility is enhanced in this
situation by the ex.Pectatinn on the part of both
narticipants -the controller and the% cilot -as to what the
other will say, in effect, further reducing the size of the Ivocabulary. Aircraft comnmunications also make use of
another aspect Of int'lIlioihility: that of improving the
Dower of the sooken sounds by usino the phonetic alphabet
instead of standard letter oronuinciations or the use of the
word Orocero instead of 'UK'. ISince human speech often in processed by electronicj
systems, 6nother factor to consider is that of freouency
filterino. Some phonemes,, such as the * ssss' sound are
sharoly affected by filtering of frequencies above IA KiIZ,
while most short vowels are affected by filtering c
frequencies below 1 KH-Z. Althouoh frequency components of
human speeen vary between men and women, from nerson to
aerson, and even from day to day f',)f a single person, most I
are contained withIn the- range of 40~0 H7 to 4000 HZ. The
4.l~
L
INA
bul k is hetwpen Vri7 anI 3 tWZ rwPf. 5. Generallv,
filterino will not make sppern unirtelliolhle. However, it
will make it seem 'unnatural.
The very nature of sceech, with its rich endowment of I
sounds, inflction: iios end variety, mak S it an
extremely difficult modality to ouantily. Lea (0ef. 51 nuts u
it this way:
"No two utterances are exactly alike, and the
communicative ability of spech is due to resemblance
between successive utterances."
Thus, it would seem that the real challenge of human
speech n.ocessinq by machine is to determine what features
carry the information in sreech And then use them to process
the utterance and decioher its 'meanina'.
Conceptually, there are a numoer of aroProacles to the
development of a human sneech orocessing machine (Ref. 51:
1. ALOUSITCAL SIGNAL APPROACH: treats the problem as
ourely one o4 determining the fleauency spectrum of
the speech input. This orocess l.o' been enhanced by
the develooment of the rast Fourier Transform (FFT)
aloorithm which allows a considerable time savic indoing the spectral analysis.
2. SPEECH PRODUCTION APPROACH: considers the methco of -
speech Droduction in humars and attempts to decioher -
: tne speech by considerino the effects of vocal tract
resonances, vibration of the vocal cords# and methods
* of articulation.
3. SENSORY RECEPTION APPROACH: Sugqests that speech
could be deciphered by duolicatino the processes that
occur in tre ear a,6 the 4-nt-arrtive components of
the brain.
4. SPEECH PERCEPTION APPROACH! Attemots to extract
features and make' categorical distinctions that are .,'
exoerimentally established as being important to human
MWr
___ __s_ !
Zr - 7-
,erceotion of speecn. all so-called vowel-listinuishers fall into tih- cateoory.
Soeecn processino syStpns: are naturallv divided into two
distinct catecories: continuous s0e0'0 systems and isolatea
soeecn svste,'s. Isoltpd sceec" systems oenerally deal with
distinct utterances, tvpicl'v of uo to two secon-is in
length [Pe 4 . 6). Also, most current systems require a 10o
Is rause between utterances iRof. qj. N-te the use of the
term utterance vice word, as the ut terance may consist of a
single word or a ohraqe. jzolated speech processors have
found their way into industrv in qreat numbers. ]hey allow IA mail service employee to nv his hands free to rroperly
orient packaqes so that he may announce their destinations
to the voice recognizer. They Der-it oaraolegics to use use
£ voice-controlled wheelcnAirs. lhev are used on oroduction
lines and per-pit user mobility in performino ouality
assurance tasks. Most current isolated speech orocessors
utilize a f:rm of soectral analysis to 'recoonize' the
input.
Continuous sneech nrecessinq systems have an inherently
more difficult analysis to oerform. They must actually
interpret the spoKen languaoe. This is a monumental
undertakina. Even if we do not consider the oroblem of
interpreting homonvms-- words which have exactly the same
sound - there remains the problem of defining word
boundaries within the Context of sentences. The boundaryf
16
_2
sounds of a word 4rp hiohly oeondent on whet words occur
immediatply before and aftor it as it is spoken. Also I
Contractions Occur freoupntly, further molifyinn the word
sound. Thus, the phrase "would you net..." mioht Smund
more like "wouja get..." when ectuall% sooken.
The locical follow-on to a Syste- which could recognizeMEt
continuous speecn woulo ue one which actually 4ould oe able
to understand it. Tnis is anot'her quantum lear, i n
complexity. V'hen humans communicate with -peech, they use a
CMODex, learned ben3vior which considers many a,;pects of
the incomino pattern of soeech. A human considers the I
context of the utterance, the task b-inq performea and his ii
understandinq of Englisn syntax to form an expectation of -
what the words will be and what they should mean. !hen he t
Performs semantic analysis on his oerception of what the
utterance was to determine if it makes sense [ef. 111. if
not, the process is repeated. This iterative Process is
continued until the inout makes sense.
Continuous speech recoqnition Svstems do currently
exist, and they do work. However present tecnnolocy has not
been able to provide the execution soeed n6cessary to allow
these machines to operate at anyth-ino aooroachino real time.
They may take many minutes to Process 30 seconds of speech.
Tt is certainly valid to ask wLy it is that, given che
difficulties involvedt we continue to pursue the use of
speech as an input modality.' The answer has manv facetst
17
IrI
some of which Are more obvious tkan others 1Ref. 71. First,
it is speech Whirh T.an uses in nis daily communications with
others. Thus it is bOth convenient and natural Tf
artificial svn t ax or unnaturally restrictive vocabularies V
can be avoiapd, the qoeech input lanquaae requires very
little learninq or adantation as woulP oe necessary with
special kevboara cooes. peech is a very high caoacity input
modality. ]Able 1 shows that tna date rate achieved when
speaking non-technical orose is nearly twice that achievable
ty the skilled tvPist. I!s ino sneecht i t i s oossiole to !=
communicate with otner oeOolI and the computer|.
simultaneously. This .av have advantaaes in certain time-
critical anolications.
A maior advantage of usino snpch input is that it
allows the user unusual mobility. Since the input device is
a microphone, nenerallv worn as an attachment to a head
band, there is comolete freedom within the area allowed by
the length of the nicroohone cord to move about a. work area. KThere is actually freedom to move in any of the three axis,
to any arbitr.-y orientation. At the same time, the system
also allows suoplementary tasks to be oerformed as the vdtce
input is being made. Certain, inDuts to critical operations
may reauire verification before continui'n on to a
subsequent step. Generallv, this would require two
successive keyboard inouts. This orocessreould be performed
J18 - f
2= .t vlrrrr ..... . .. .
f
IHmore auickly if voica input was , sed As a verification or IIorimarv command innut device.
One nuitP interestino asnert of Qp-ecp com-u-ication is
that each Person's voicn oualitieq And- -anneris-s are ouite
unique, and may be used to verify the soeaker's identity. KThe qualities of the vnice als- channe for a sinole Person ,
from oay to day, in response to stresa, Pmotional conoitiOnl,
cols and other factnrs, which may cornrlicete the oroblem.
However, aiven a sonhisticated enough orocessor, these
chanoes coul be uSeo ov a mechine to tell its user that he
has heen unoer too much stress a-a that he shoulo see a
doctor and ston workino so nard-I
Of course, soeech inout is not a Panacea ano it has its
disadvantaces. Ihe constraints of a-tificial syntax ano
hiahly restrictive vocabularies may outweigh anv claims to Iits beino natural, thus renuirino consioerable learnina.
Backaround noisp can adversely offert the recognition
accuracy of the machine. The individual differences in
voice characteristics which -rakes it Possible to verifv a
oerson's identity, also qenerally makes voice input systems
one Person machines. Thij is meneraliv manifested by the
requirement for a training session, during which a
-roSoective user will soeak each word of the vocabulary up
to 10 times. The results are loaced onto a cassette tape,
which must then be read by the machine orior to its use by
ary new user.
19
0. PRFvTu-IS .dn' WIT" VoirF IPIIl
A techrical r eort ndM 1 Qi°ed in 6ppte-o-r 1977 by JThreshold icI'ncIo-lMv Jnc. ftr thn --rnmA Air DavelIooent
Center,e 4 . i descr-il-es emrk which compareo the Y
effectiveness ni thrpe -jiffp p t input levices u-'er
various conditions. The thrpe i out aevic-s tasted wPre a
cOmmOn rorouter terminal, a braf oen, ano the OIP 100 voice
recoanition system cuilt T Tnresrml Tecn!hOeOy Ike
Graf oe- is a somewnat unusual dr1viCanhich is used in the
same Afnner as the more modern oiait.zer taclet or CPI lightrfl.. it allows the us-r t- innut a woro ov touching the
Oevice to the place w^ the wnrd anoears on a menu'.
The treft oen 'ifferst *r-m the -ore -odern oevices in that jiit generates a snark when oressed4 anainst the menu the souna U'
of which is received by sonsors located around the
oerioherv of the menu area. The sensors allow the system to S I -
thus fix the Position of the pen when it was Pressed against [the renu, thus, locating the desir.o inout string. I
There were two cateflories of tests used in the
Comoarison: a hion speed Oita entry task and a hich I'cOmPlexity data entry tasw. ie high sneed data entry task
renuired subjects to enter strinas of characters as they
were oresented on a Rurrnunhs 16 character Self Scan
display. Numerous fectors were used as variables during
- - this experiment, among them:
1- Length of Strings
20
3. The tyne o# chiracters, 0e-1hniirc or srcl
Tne h-ano occunation tastc, ~fef jsed, con-si st ed of the'j
renuire-rrent to si-ultaneouslv deoress tno cushbuttons
seosrated !v III inchas o.'fo rp the reoui red i nout strinos Iwoujld- I-e disolavyed -or- tn0 Qurrouo7hs unit. *
Tne results were categorized by factors affecting entry Ispeedi, inout error rate, and-. ooerational error rate - a
measure of erors ren'ainino ifter the noerator corrected all
of his ct'served errors. Tn this test, the keyboard was the Lfastest device - renu ir ini 20 vercent less t imeF per
character than voice wtich finished last in speed. This was [
fri 'Parilv -a resulIt of t 6te r, jc n h ioher A nout error rateI
e0Ofstrated by the voice unit - twice that of either of the:I
other modes. Al~oanumeric dat;a r e qui rred. -225 Percent more-
time than nume r ic ent-ry for all of the devices anid wast
jugdthe most sianificant vaibe affec-tino data entry[1
speed. T h-er e was no s ion, f ic ant difference in the-
operational error rate amiong the6 varidus entry devices. The
most significant factor affectina the errors remainiria ~after -
c-orrection mas the type of characters used. Alohantfmeric
Strings hao neagrly -twice the ?rror rate as pure numeric
strings. This w As partially attributed ,to r-eadin-g of r- -
inepetto rrors such as mis takiiio -3 zero for the -
letter 'o' or tbe number o'e f or. the W1;tter ''
21 - -
-~ \ tiI________ - -Q
-A- ~ ..-
The secona enar:l cateanrv -f tasts co-norisaO what waS
called tne hi0 h conloxitv data entrv tak. iHs task
simulated an air trarffc control flinht r|in aendments ano
corrections scenario. !he desired amendment was aiven to
the subjects 'I text for- And thay were required to enter
the cha n nto the sySten. The sutiects were first
reouirec to enter tn* category o f the amiend!e nt (CAN-CEL a
flight, ameno routin-1, At jOFF A *i aht, etlc after -hicn
the SyStem would o-esent orootS to Ootain the octa recuirec
to carry oult thn recuest. The text o f tne detired chance
contained aI1 of the information reaured to make the
cnar-oe. Poweve-, in the text verSion,'the date items were
not presented in the sane secuence in which the system
oromnts reoueste4 the data. thus tht subjects were recuired
to interoret the text version to determine the oroper
responses to the system oromots.
The Sbg-I~ ficant variat:'*-3 included hand occupation,
subject experience with the entry -evice and number of
trials already completed. 4aain, factors affectinp the
three cateoories of entrv speed, operational error rate, and -
input error rate were examined. The choice of entry device
was a sionificant factor in entry soepa, with the voice
system and Caf Den not sionificantlv different, out both
about 30 percent fatter than the kevboarOeven tnouoh the
keyboaro uSers were permitted to use two-letter
abbraViations o r the commands.
-" 22
... . -
Exverien ce ieval, flfaP r orovarlel a n eic-n greater
variance in e-ttv svpel. IIc, inc-epse in entry time per woro
f or anqanoeriencedi kev-oar use-so. us'~na tne kevooara as t he 1
LZ --)'~trv dievice was 5:6 oercnh. Tno- increase for inercerienceo
Graf Den use6rs usiao the braf Den As the entry device was 14
nercent: and' 1nr, lnpxneriele vnice rttoonitior svste0~
ujsers, onlt C p.cent' I fUSr it wOUla appear that
inexoerlenced- ;-asers of voice input achieve their max1imum
daainput sreeo with m'urrtls rcieta inexperienced
users of KevhoarA input. Not? t-1:t ti-is is indicateo for 11enItry spee-d only' The lueStion of e-ntry accuracy wilI te
addressed subseauentlv. i60-he in occue-ation task rqO-cuire
depressing both- of tote pusho=uttons previously -ention.ed for ZI
3.5 seconds for each inpOut -.essaoe. As rniont he expected, I-F this task affected the Gaf ppn users (30 Percent slower)f
LIand the keyboard use-S (26 percent slowier) to a much greeter1
extnt han the voice uSerst0 nercent Slower). lAqithere were no siZ iicn differences between the
three ent ry de vi ces InA operational eoror -rate.
Sioniticantly, though, the bUtlk of the vomice syste*p errors-L
-were reeeonitibn errorstie h-ioh basic-error rate) _;hile the
malority of the errors with tie other two systems were
Peadlino or interpretation errors. As a group, the
finexpoerient~ed users of all three incut deie ufrd a SO3
cercent increase in total, word errors after correction.
There was no signi'lfI Cant i ndicat ions of differences in this
_423 -
observation amonQ tra. tnrer n'Prodecz. T-tus, i: arrears
that although ontrv sonei suffers te ss *r nexoerincef
with voice 4-out as tne ontrv -on'e. *ne br ror rate s a 64-utI
SO oerre-t hicaher renardltqs -j ntry -~ Incombination I
tendeo to increate the nukr.f roaejina errors. th csic
'rror rate o4 tne voice inrut srF45e. ws to-r t i es hIner
; ta- tnAt of tne oth~er ten -o-es. This WaS cue to its 0--or
recoonition perf nr-atnc Anl con'usinQ error cIorre-ztionf-[systeffz- The cnkrroction al~*~ lic.go-a -3 hcspace Plr a
j -orevious character or an erase no' the entire jflout line.I
There was sn~me confusion ovprt meaning of thne correction
woras, So that the LQASE cema-0-_- was occaspionally useo wheni
a oacksoace was Aesiredi, thrb recauiring the entire tireJI
to h-e reentered. Aaoit ional IV. -h e coor recognition
oerfor-ance led t~o numerous incorrect watches with these
correction words, causino addtin0 cnusion.
An FAA recort relIeasel i n Aucust 1070t tRef. 91,
describes work done by its evoerimental center on the use of
a voiceL innut system in a sirculated air traffic control1
environment. There wer;e actuallyv two ecXOrimaflts eonducte6.il
the first ex-am-med just the recoonition accuracy of the VTP
100 voice recoonition unit manufactured nY Thresbola-
desc formive of the data eA-trv laguaqge already in use wt
Tn., uin avcauar ~ tad2d teh
keyset svstc-m,. lhe secnn -r1*ri-~ent comnareo the sneel
and accuracy of the voice innut Kyqtpip with tnat of a eyspt
System currently in use within Vhe a r traffic control I
System.
Tn the first experi iint, a- %o-rational vocabulAry %as
divided into three sul-vocahularips: Nlessaqe tynest15
woros), renqraohical Fixes( ? wnrds) and Dioitt ano Control
Words(Ie words). f)ato for each -f these subvocab|laries was
maintained saparatelv. rhe suhvocaciularies were toen each
expanoed into e list Consistlnq of ten renetitions of the
member words randomlv ositioneki so that the Messane list
contained ISO words, the Fixes list ?10 words, ano the
Dinits and Control words 00U. Each subject was required to
read these lists durinq multiple testina sessions - ten
sessions for the tessaoe ano Fix subvocabularies an five
sessions for the Lontroe words subvocaularyi a
The resuitq of these tests demonstrated some interesting
characteristics of thp voice irout orocess. Considerinq an ierror to ne either a fpilure to recocnize an input(ie. no
output strino) or an incorrect match, the Messaae
subvocabulary had the hionest error rate with 3.2 percent-
the Fixes subvocabula-v nad the next highest with. 2.2 and
the Diaits and Control words had the lowest with 1.8
percent. The Message subvocaoulary also was the first
vocabula-py tested, followed b-y the Fixes vocabulary and,
finallv, the Control words vocabulary. Thus, the subnects
L
25
tendea to decrmpse tnpi- err-r rdte as they 0airpo
exoerience with toe SvStem. Tpe -iroo from .? Percent to
I.P percent renrpsonts a " nercent iecrpose in error rate,
a figure wnich Areas closelv witF tim results of reference
l Ref. ,1 vresenteri orviousl y.
Tt i s also i-port -it to note the variability in the
error rate within each quhvoc4oularV. There are words in Ieacn which show error rateq frnm one fourth nf the averacie
to four times or more ot tle averane rate. Not shown on the Itables is the fact tnt fhe performance of individual
speakers shows similar variability. T he individual soeaker
Prror rates varied from zero to nearly 7 percent. From one-
half to two-thirds ot the errors reported for the most z
error-oronp words were accounted for oy one or two of the
sneakers.
Thp secfsno experiment was deSioned to compare the
nerformance of the voice input system to a currently used Ikeyset aevice in scenarios which simulate an actual ATC -
nonredar control position task snmewhat similar to that useo
in the HCDE exnerimet descrioea in reference [Ref. 8]. Two
sets of 100 realistic messaaes were constructed using the
three subvocabularies tested in the first experiment. These
two groups of 1041 messaaes were further aivided into four
oroups of ?5 messanes which were used as a sinole run with
sh-rt rest periods oetween -oups. The proportions of the
various cateoories of messages was carefully controlled to
26
-iMU~ate thP aoo'-Yivlate Tr'Y hiCh > cm'ntrollep h)Ul(
5actuatl IV ee whi e :ic' UA 1 1 Euorforminq the Pon ra d ar
controllers OO~itiOn iob in an rnrout'o Centpr. The order of
the mess'4ues "as rar-voom, -pPt h essages didH not
W noreSent uate in the S.irne order as tlie svsterr reluireo it to
he enteren. 11hjr Ya s necgassary tnr e.ric' of the operators
to translatr. the dlesired entry into trie Syntax Which his
entry rdevirce reouire-d an,4-i order thl rdaa So that the host
system -nuld accppt it.j
Five onerators Oarticinated in this testr Only one of
whom hiad particinatei in the first exoerimont. Thus, four Iof the five hadl no exoprience with voice e-ntry dievices ano
renuired oasic trainini in the -,3rooer lisp of that system. It
shoula als0 be noted that tthp kevset entry device did empoloy
so cafl ed 'quick act ion ' uttoris for the most common mpssaae
types. This allowed the Pntr\y Of the msore frequently
encountered me Ss ane t yoes w it h a sinale key stroke. AllI
other message tynes ovre entlrad usina a two character
abbreviation.
I Data was collected on hoth data entrv sneed and error
1 rates for each of the five narticioants. Total errors were
divided into three grouos,accordina to their cause:
1. LANGUAnE errors caused by usino an incnrrect command,such as "droo traCK" on the voice svste.!n or "IRS" on
£the kevset instead of "cancel" or "CN" respectively.
2. FORMAT errors caused bv not using oroper delimitersor so8ces between the narts of an input message.
ii 27'IE
2[
3. ChAt-,ALTLP errors CAuSed hy reco nitinn arrors with the voice innut nr KPyStroLe errorq with the Keyset.
Voicp innut de-onstratea a significantly lower overall
operational rror rate. That is, errors rma1iinng -fter the
operator naa finishe the trial. The overall rate for voice
input was less than half of that 4 nr the Keyset.
Sionificantlv, the voice itouL demonstrated ;ts forte for
easily handlinq St rCtlv formatted nutcut Lv a formatting
error rate of zero. The character error rit3 was 25 prcent i
S:less, ara the lanouage Prror rate was b6 nerc-nt less using
voice incue. The fact thit ]anou~qp errors are three times
more frenuent usin the kevset than th-y are u~inq the voice I
system quvo ots the concert of ' natural lanouage'i
advantaqe for voice Inout. Cnrrohoratina data was cathered i 1
on the 'translatinn time' for each message - defined as the
time Period hetween receiot of the desired message by the I
operator and nis first data entry. This rouohly
corresOnog to the time reouired to translate the text Areouest into a syntactically correct system message. VI
Throughout the testing there remained a distinct advantaqe
for the voice inptjt in this area. Tnitialv, the 7:_
translation process took 50 percent lonqer with the keysetL
This advantaoe continued to accumulate until near the end of
teStino, as the users of t-he voice system became more adept
it using it, translation time was 100 oercent l'nger with
the-keyset. Aoain, there was considerable variance in error
28
-1 _ _ _ _WE]
A-i
rates a-mono tne five o-epators, wifnr ver1ce inpout showing t1ke
most extre-re effacts. I Ie ' 10 - 3 t ' ones, orndjc -o v- or-re r otI
maan it uoe -iore e rro rs t h;4 t he 'he qt ' o-ns.
The results for tnP Iatae entry r a tes showed no clIea r
advanta4p to either )a' ut -'vice wrian all of the input
messages were consifierea, altho-jqhk thce fastest rate- wasrecoried oy o orerator wriile ujsir- voice inout, ana theR
Slowest rate wAS recorded by' ore onerat-op usini the KPYset.
z::::rhe::enat ti f anal yl scon-;i Her:-Ionly tnp:tynesof
messages whi r!h reou ire-' sho rt c o m -a n Hs and mostIy dig)i t
the current work. ]he conclusionc have Provided the Iincentive to pursue i nractical 3prllicatio-n of voice input
technalooy to current Fleet oroblems. A brief summary of jthese conclusions aornears hello-.
1. Voice innut tech-clony his been demtonstrated to have adefinite aovantaae in Oata entry rate ano/or accuracyover k'evboar-j devices for aproliCationS requiringsuhstantial mer-tal or visual effort, or tho~sereouirinn. tereicus, strictly for~matted inout.
2. Very hiah recoonition accuracy is possible withcommercially avail,)ble units.
3. A users lack of exoerien~e affects The data entryspeed of voice input mr.uch less than it does keyboardinnut. This suggests that 'trainees' mialit achieve4their 'raximu' inDut speed with voice input much soonerthan they would witn Keyboard input.
r 4. Discr~ete word voice recooriition units are not wqellsuited for date entry tasks reauiring entries of larme
_ _ _ _ 17 -29
A0_ __ _-
numters of sin'-ije CnaraCtetr~s mrn)uos 04 ThiCh cannot jt, e o u tp ut b y t t v nice iflf)ut un It with a singleut te rar CP
~.Cu-rent voi ce i rr'ut kin i Are sensitive to operatorCnracteristics ano nrav reali re erir othI
vocabuidry if those characteristics chanaeaporpciah1 v,
A. data e-trly (J-vico shoula hav, a sirnnI',looical a n tiPasily undsrstnodi Correction svster. I
30L
A. VCITCF TN~PuT PA~APE
h !he Thresno1'H AIJO is a -isc--ete snepch vrecoqnit ion unit
f-anu #(N ttiroad by 1hresholo~ Techrlolocy Tnc, Pe Irai-, New I
Jersey. it has Avotbauldry Cainaci ty cf u utt er anc e s
each 'nf which ran he fro- n.1 to two seconds in lenatn. A ~
minimumi IVO ms P-itie is renuir-o netwe-n uttprances in order ifor the macninp 4-o aafin- qoperh boundAries. An oerator may
speak As raoialy aq he d-sOreso as there is n o requirement[
for nile to wait Ket~ae- uttpranceq for the machine toI complete orocecs'inn ^n thie orevin'us one. rowever, the 100 ms
oause must nccur hetw-en eachi o4 thp utterances. Processinq Itime is deoencent on the size of the vocabulary fRef. b1.
However, typical t imriS are oracticallv instantaneous
averauino ?50) ms as renort-d by Porock tRef. 101. The ranae 1
is aoroximateiv 100 mq to 500 mns. Procpssing time may be
reduce-I t~y restricting the vocaoularv search to any of uo to
16 different sets of suovocahularies. fhe words in each may [he exclusive or shared a-.onQ any or all of subvocabularies.
The system consiqts of an analog speech orocessor, an
LST 11 microccnniuter with a diqital inout-outotit interface, :a display screen and keyboard, a iicroohone/P'eamn, and a
Cartridge tape ~ri ve. Ttie speech processnr and ImiCrocomouter are nackaqed in a single unit abovt the size I:
31
o f horal utae, ~ ~ b rpmnotelIY ocate0 aur' to
2000) feet 4rorm t"e r eTCinnfl cnroents. tlectronicallv,
the svste' -1c'~ Yi~ any TA stanrjd)rd P3-23er or 2n m'a
Crrorlt 10Oo Ir't OPV'Cp An"~ it-. inn-i a P oe a r tc a
==host Computor I I le; t n At f rom a Common' Vev)o a r tPrm Ina.
Thus, thorn is no %pecial nr-ocessira. rpquire-i of thle o Ut pt
be4ore it car. he usedi ry t'e niost qystem.
The sueech processor uqe An Undliqcboqed algorithmf to
extraCt the signiica3nt cntmC'oneflts of the snpch inou*. Tt
then converts tnmsp 'n:.s-igJhtq' into 1-intal sionals which
can c.e vrocesspa hv the micrpocomouter. the microcomputer
41ses a-~other onaiscioseuaQ loorjthm to Compare the ciigitizea
iflOut wi t h '.'at haq been stored in its volatile
serriconciuctor eor. 1' tr.- mecessarv numner or ciualitv of
char,,cteristiCS aora5e 4 t h a nv o f t hose stored for the
vocabulary, a ~t ch i s iec I ared, and t hse predetermined
Output t str.flg ntv to 16 charicters is transmitted to thle
host system. Tf no tc'is -ade, an~ audiole tone 7#S
produced to so in-jic;t. .
9efore the Svstem is usee~, however, the onerational
vocabulary must be 'trained*. frainino consists of speaking-
each of the utterances in the vocabularv 10 times in
succession leavifln th-e -inim 100 ms pause between each.
The system. must also op aiven the Character strings whichJ
are to De outou! when a memoer OT the vocabularv is
recoarlized. These outout strinas are determined bv the-
3 2
VA _
_
operit -r ort ior t' th:- svs'-m'q Ise an-! entereH 'nce usl'"Io
the the ter,'in~I kPytbo-rA. n'ir- t~j~ h e en c omv Ioe ted,
the contents 0 f t he i"r or 1 j t Pr core ~pqrv wnerP t Ii s
infor.,ndion iS Storer-! is rea- O'jro a~ cissetto tane usir'Q tthe
taoe orive ijrst. Trnis -tis t ke oi)r., for the? f irSt user a ftF-r
07 a new Vocabulry has h'ean 'ASfah I1isheA. SUuseriuent users
need oniy reaO' tkis rnaqt-r t~np into t'e 'iraCt ine anO perforr,the I-raininq, after wnick their V for-ab'u 1a.Y i S r e a on to
thei r tane fnr SLU~Sequ~rt -uSp.
Th- Threshol'-! 600) has t.n ovelational ro'ies: huffereo
and ur.-ufferpu. i r t he 'snhu ff,?re1 i jnpf t hP sys temr f inds Ia match for tnp svoken utteraInCe, the rt-spective ouitput Z
Strina iS sent irnrreiatelv to the h -sr. 74 dce watck was
not correct, the~n, of Course~, an 1nr % utnut strino isIsent w itrhout n IV;z4 t'he oneraror A. Ot,.ortunjty tointerve.ns?. This in conrarat7,I to standard tyoewriter
which outs a Character on the Daipr as soon as a key is
Strucik. At this 9o7int, any error Corro~tjori is a function
o f tnp host svste-. It no suf~i errnrs can be tolerated, or
if error correction on the host system is oarticuiarly Idifficult, the buffered MOde m~ay be In this mrode, the
T-6On acts like a Stanlara ferminpl which- allows YOU to
check your input and make any necessary Correct-ions before2
you send the inout to the ho-st with a 'CArMPIAGF RETUIJr'n= 'EIJTFR I T;vp T-6u0 oervnits u;3 to 12P- innruts to be stored :n-
the buffer, then -sent in a 0--cK mnde with a sinole transmit
33
comment. Iwo -o-rpc 4i1 n roljt ino S Ire av a I ao)e in the
hufforpo moop. i.-fle aI~ ~ tn nrei S ouu trinonS
(which are st ii n t e :nj t fe r' tn re S P iue nt allV dieIe tesH.
The ser oni- jolIetos t Ie ent r- con tonl to' tn.> buf fer.£
R*IHF SV--uiLATJif-
Tr-is socti-in oascric'as th~e s~mu!-tior, ')seu ir, evelua~i-yvoice .3n keS j nnpt *or th.- T-rUFI orti lbataenr
task jin tno F-3C aircra3ft; n -gjinilf Att- LaomP a-nerai
consiaratiCnS, vnflre~silflf t- t ke hardware uiseO P eaa
*jnish'no with A Zepscrrict i-n n f the simuIat ion zronram Iitself.
I Thfb Purpose nt tlhe -Si'tn Ia t'o-
T ne rurvnsp cf tie sirruietion rogram is trt crovirHe
a Meanls by- Which th onr'or-5nre of a voice input device
coul De evaluated uts ino a- onerat ililel vocabulary t o
tr~r 11n Ira Onner.t naI da te nhDut function. The
the P-3C ARKn natrol aircraft The Specific tasks involve
informigo Tanprrrrgtlidaha ito entr iTRSYAA -NT
anted n tyVicalO prefluigh dta intox th Sifau AtAreMsEtNh
tablau ad to hanfl- tp ineraciveexchanoe o
infrmaionhy n oaxrtnrsimlatna ho AC~~sdata entry
funct ions.
34
iJ- - - 2
T n a lo it ion r, t e or-e v-a tinn -m II u- at l n wa s
necessrv f^r tn- urori o D-rtinent aata on Fsubjects' ncrfnrsancp c -rctrv t aS .s nber f
nossirle -PeasureSs- f ert i ve-st r-A ts) were-C i P
Two, hnw-vnr, were jjllei -ost relovant accuracy ano entry
speed; ano the sIu'atInn rn- g4thered necessary
statistics or- rnoeb -:t--
M? Svnul at ;nn Descript ion
Three tahleaux f-o- the P-Sr onerational software 1
are functional in the Sl-u13tIon: T=fL 6TUPLS YANAGLMEI
and !AV DREFLIGrT. TnP T!.flY t-nlea is jisolaved on a
standara video t-rmi-al Crt when the sirulation is f'rst
calIea un - ee aooe-ax a4 The l'*&FA taoleau is a corplete
reoresentatinn o' that founj in the actual aircraft as every Ktableau ava;ble to An noprator in tat aircraft Is
Oresentes. rroP the T=;ntY, the simulation allows the
operator tn select either tfe SqPRS M.ArGEMFNT tableau or iLNV DPFLIGHIT tableau Dv eterino the aonrooriate line
numoer - see aovenlir A.
Once the desirpo tanleag is displayed, the operator
has a number of functions availacle to operate on the dnta.
A nex.t line function Provides a means hy whiptn lines in the
tableau may be accesteI senuentially. Any inaividual line
may be accessed usina an enter line number f tnccion. A
subsequent naoe of the STO S MANAGEMENT tabieau ma, be
displayel using the next oeae function. Correction
-- =-- -- --- - ------ _--=--- -.. . .. . . .. .. .. .
functions op r-r it a qh& -7o -h ,vio':sly enterec
Character a s .ith -%n o-iarv ty-ewriter -or a ntLETL
LINE w hich al le,&q 41-iletbon of the, Pntire strinn of enterea
Character's, nertnitting roer'trv of correct iata. Ale rt s are
r Presente-i to jrnf-r- tn- no-rallr that an 1onv.ilicd line nu'noer
has been recniectea, tnat 0,e currert line # 'js no modifiaule
characters in it or t.*IL ithe clirlent line is the last line
of the Dage.
TnP simulnation alsm o (-M'CtS Oat4 o0 a nunoeDr o f
irnodrtant 'eactors u Sed i o 1t Pr n in 4 he mpiasure of
effectiveness of the two inout jovices. ]he t ime renui rea
to pnter the test riat a i s l.=int-i-e- SeCearatel-, for the
sTnkFs MANAGcMEN4T a- 'AV PcfI 1rriT tableaux. Thie ti--e is
Measure~j as the. sum of the neridos between the ti-e the
ctirznr is oro-perly onSitioned -ready to accept mnout - ano
the j:A R;;I A G F FIt* is sent. The~ nuroer of tim'es that the
nELETE III#' and' 9ArK5PaCF funrtion5 Are used for each
tableau iq also countp--. This i's later used as en indicator[
of input eernr rate. when the simulation run, consistina of
data entry for the two teoleaux, is Comocletedt the data in
the tatieauxt as entprea toy theb ooDrtnr, is p a C d in a
IUN~TX file for subseau?nt eaeluation Of otierational err-or
f rate ov the 'IVTX utility "VFVF Also, the entry Itimes, and
delete line/Diacksoace, counts are displaved on the screen at
4 36
1XM ___
Trio syst-nnOpScr3 *1nP. q~ fear nas hbee n kent
aenera1 , to nr-v IOPa n~ fVPrV ~ t' it c a'ebit'- eS. M
foll(o.ina few reranrnzs jl -rt.-nt
f~ aja fctors
aSvert'; ^ t e svste= 'in S 2 Pkd et Ai.
T h0. tunc t'c- i iel tr th -,p r atr a3r e
icentira1 ftn r htn f t a tnroleaux. -'hen the re-cjuested
MJtableau is Inily rrsne Pn fis tr wt ha
mo~froe inorai"'- t 0 or4o ie-i isclaved at
the bo'to:, of tn ' sreQ:o, tider *-Ie ahl (seo the l astIcae o t RprenaOii Li--e innn us' spsitioned o
the newt line qfirecti-y ueil the- tr St moo0ifiabe characterI
nft tfle Crnot li n I ia * C r Iat - inut. 'i i:- a
slint-tly Jifferent - f~u unctionally euilnt -S
Present at ion f ro tnfl iA I -C3f icra t that system
olaces the cufrsor un~er tro i al-'i P ci1aratters 01 the
actual line in thef taolei--". th~us writjflo over tie orevious
data, as the curs r si I over any non-oifal A
characters. Tn tne acru~u' Svs te- then. there is n Fgenerate Prompt or inCut line.
T n'S i s n c.t considered' a
sianificanT departure rom- fc'el i v t o tne P-3C system.
althouch during trne S F-nulettor0 trials, subjects W itht
orevious P-3( ewnerience Ais l wxre*Ss A oreference for the[
method use1 in the gim'ulation r-ec zuse they felt it made
spotting errors easier. Ourroi- the initial 3sign chase of
the sioul at ion =JevODl ft noe t;jIt tn2_.!iy E the actuall systemso
*etno of handling tfl at input was not Cnsidereil as
37
-77 -1z' V
crri t tcrielt 1% ha zt cvtt V t. ha e
f orm~at t io 'soar Ina-fl tf te Trlus tne si'muiati
hanole s t he ioiti oI ne aa So thkat It + Is not
necessary toC Drov]A an IKtereween thp --gta
I elements o-- a line.
A-prtn it- ~ ns- In rn!2 out area on the
neren itese itqj1 edt
Ct 1 tih T -.p Q n n t b'aJ e u e=ces-
seduentiall -y 5-isn: It' k e 'v inilowed by a
CFkR1 CQTA- IF P RU Mc- a iuaii 'I - enri- Wn n di0iZ
n lie nunoe r o ow'en 4b. a A"' : 4 is nlacn the
= desiredI lire irtn tne prm~ -0% T k fucto
is avallaole hpen t n ~i~~ 4T tlu '5
displayed. it reouires- aCtiv_=tinf o t he tJEL1 PA GF 'cV
foiloe rfcvr fai CQ!G Fi'R T h? TrigP-EX reav be recisplayea
usiflo the !NflEY key foline tivU.6TG Ttfj
The re a re t 1* c. rec t1on kCvs available. -1heI' m by moves te cursor- t n t' rv sV enre
character An" !ilows the 'onerao-or to reenter that character.$
BACKaSPACE hy be Wzed to m-ve thIe cur~artacvt the
beginnino ef th~e Iflflh i It i f fies ired . DEEIE LhUE.
followed by a CkQjiT AGE -MWR42 howeker IS a fatter ehdj;This function deleteS-al o-f the vbharaeterS entere-d on tlpe
ifout lAsint -afn reoostions- t he. cUrL3or to tTt i
*601if iib!le chat-at' ter of tat lin_ Tfe onp er a tor 'ma- Then ---
reenter tkc data.~ thisfunct -fvwirl? S6e'i_*t ov.f ferent
Xa
71 6. ACNW - ---
than t..e t)LF rF --io(A'~~ u~c'n 'r, the nircraft hiCh
del et es t e charac t s P- t ?rp'c f or t he Ii ne and termi nat fs
the oata i nDut fuCt i Tho- sr a t f unc ton then
reou irieS t he onro t .- reter he P u node if
add'itionail chang-s -3-e oeSirPJ.
3. araware
T h g s;iuilat ion h ar (,;ar e on.SsstS ent irelIY o f
oquio~raft oo-ratea bv tne N~aval Postoraduate School Comouter
Laboratory. The miaintra're com-outers were PDP 11-50'si
manufactured by Digital Eouiompet tornoration. Thp terminal
was a stanlarij0 U 0 ib 1nt e I iaan t terminal -anufactu,-ea b y
Oatarne'ia Cono. Ihe mooel variant used consisted ofI
separate keyboard a nr CRT units which nerni,ie the CO( to
he offset from the keyboard1. This oermitted duplicating the
aircraft confinuratiOn where the CP SOffSet Vertically
from the KeYset.
i F. imulation SoftwareThe simulatinn software was written by the authors
entirely i- the "C" proorafnrini_ lanauage. The supporting Ldata retrevial macros were written for a FW6/UNIY version 6
time snarina operating System - Which also was written iPrimarilv in the L lanouaae. while the QueSt ion of a[
l anguage for the simulation rrogram was first beingf
considered, it becam~e apoarent that the Droject called for a
Structured I Ancluage I one we Il sui ted t o moaularized
Programming techninues. 'ei ther o f the authors had P en
39
extensive oacw~orotiru-4 i n the 4,nerA i Sis0i neS Of COMputer
science# or the specific arpc if oevelopino interactive
comoutpr orngqra'ns. However, they were familiar with the
Pascal P,,oarqmmring innounop and -any Characteristics of that
PE;lanquaae qeemaO well suitei to the reqcuirementl of the
simulation - particularly the r-cord and clr Vrbe
c o nstru c ts. Pascal was l at er r-i e c t eo because o f
undesirahle inonjt/outout and file-handling idiosyncrasies of
the avaiIaul e c onn-lIe r . C., the9nr aooearei as a Ii kel y
candida--tte for thin simulationi crcaram lanauage for a number
of reasons:
1. Tt is a structured lanquaaie with Pascal-record-likeconstruct s (structures)
?. t interfaces easily with th#e oeratino systemj-
3. It easily sunoorts interactive oroorammir'g
In addition to the obvious goal of simulatina the
dlata inout functions of the P-3C softwapr, there were a t
number of other ideils to which the authors strove in
develoning t h,? simulation software. F rom a Personal [viewroint, it was stronalv desired that the program be
'readable' with no 'maoic numibers' (mysterious constants) or
tricky code. That is to say* since neither of the authors
had any previous exnerience in C orogc'arnminq, they wanted
the code to be easily understood and "debuagable". This was
Accomplished Primaerily through the use of comments when the
Purpose of the code was not obvious, the liberal use of the
40:
"-'-
is
- - ~ - - ~ ~ - - -------- ---
I)EFINE ,tatement to set valups for constants of, create macro
f unctions, ana a strict mrodularity b,.;ich aiviaeS the proaram.
into ciscr-le! functional elements.
Af t er P-'rfonmino some in it iAlI teas t q it hecamreK
obvious tht A rrit'irca Rrea of th- simulation which hiad
FIR formerly not receiveri any consioeration was the problem of
Ireal timre' nrncessina of trne screen data on an occa ,ionally
heavily loaaeo timp snarino system. Mlore soecifically, each
tableau hia twentv-fnrep lines -.-f data to foe written to the
screen (twenty taoleau lines Plus alert line, oromot line
endinpt line blanking - e nedxA.), and even with
the termincil ocverating at 90QO beid1, writing each character
on each line every time a sinofle line was modified, or when IN
a NEXT LTNE reauest was sent was introducing unrealistic
delays waiting for the system to write the tableau to the
screen. Direct cursor addiressing, a techniciue which is
apoarently usPO in the aircraft system, was initially
considebr, but reiectea as it was believed that this would
make tr-e simulation deoen-dent on a single type of terminal,
and i-. was desired to make the simulation as hardware-[
indeoenae',t as Possible,
The solution wes to restrict, to an absolute
minirnu-' the numoer of lines written each time a command or
data was entered. Thus, when data is entered to modify a
line, a maximum~ of three lines is written to the screen; the
modified line, an alert if necessary (or removed if no
41.
%
longer necessary), and A new orrmnt Iin . dnen a NFXT LINE
or a sfecific line rejust is -e-t, a saxium of two lines
is written: %n al rt if necesSarv tor rpmoveOd), and a new
oromot line. All othe- li-es re-ain 4isolaved, unchanqed.
Of c(urse, every line nt a tar'eau Tvust he written when that
R tableau is Initially disrlayea, or when, for the S1nRFS
MANA(EMLNT tahleau, a -WT ,cF request is orocessed.
However, this scheme nerzits oata entry at a normal,
unrestricted so-ed unoer all out tHe most extreme system
loads.
A ornoram listino foilOsS tme aooendces. For those
who are more interested in a functional desct-intion of the
j simulation prooram. a osetAo-core outline of the major
routires ar!'-ars : ;:te'c .I
C. THE EXPEPIMEPNT
The ob ective of the r-i1enr wat to evaluate the use
of voice recn.,rition as Ir i _ut modal itv for oref light data
in the P-3C ASK ai-craft considerino the NIOE's of input i
speed and accuracy.
1. Desion Considerations L
Figure I shows the exoer*imental design graphically;
a treatment by treatment 1y suhject aDoroach. [here were,
in fact, two such exoeri'ents: one for the Stores Manaoement
tableau data entry taak and one for the Navigation Preflight
tableau data entry task. The exoperiment was designed to
42
- -- - -- W
ICA'
12I w
CD,
I -
a) LI
I.-f~t LI! A~~Lii
U)-
cr-~ Lai
t-e
43 L
_ _ _ 6
simulate sctujAl soft.war- An-4 r .w re Confiaurat ions of the
P-3C aircraft, srec iiiv ekre TaCtiCal1 Conrelinators
ositinn durinq Oreflight. T" r jCrd coi-'runicates witr- the
computer thrnuan his M-itrix select switches ana Vat r;X
readout switches for tactical co'-ta-ol o~f his ',,ulti Data
MEDisplav, and thronn the TLI'Cp y-or for control and
h-viewino Of Navioation ,At, Ttia so.s, ni
Tntelligence oAta availall via th_.n.Snt a tact~4 cal
simulator was not availahi- for us in the conduct of t'nis
experiment it was not fea;sitle toC evaluate the vcc rI
mality to control a tactical '-colav and the dyn,---ic
interactions involveH in so Hoina. Th ava~lability of the-5
#eQuiovient in the Naval PostorAmiuate cho Computer-
Laboratory allnwpd the desion of simulation for use ir.
inoutir'Q -ata into trie crefliont tablpux of the P-3C. The
Datamedia Elite 2500 CRT was used as th-e disolay device for
both the Keyset anJ voice recoanition methods of entrv.
During the keyset entry trials the disolay Console was
Ot)Ys!Celly seoarated from, the subjects which required them
to Physically move their heads in order to verify a data
entry. The senaration of the console and the keyset eauates
td the separation of the [AC(7's 'Keyboard and the ARO in the
T he PVcabularv f or the voice input unit was
restricted to 61 entries in orcer to minimize the time
*reauired for traiiinq arid verification of the vocabulary. A
414
complete operational vncibulirv Woulo have 140l to 190
entries. Rastrictinoa the vnc~omjlirv to Al en t r ies I C not
=co-sioprpi to save -iffect-j the proc-esSinn tirres of the
Systen. -)c -l1l f r=m sect i nt T I t nat ot her ir-veStlaatorS
- MED have indc at e ( t )at t he I ar(jer vocakUlary would not be
MR exnectoa to CazuS- noticeat'hy lner nreCesSinq times for the
I ;voice racnamition tin it f rk, R-f. 10;. 4owever, the
effect that lroer v-Caouliarv would nave on the
recoonition error rate iq not know. t
?. qbjects
Thirteen subiects rarticipated in thp exo(rifment o n ia volunteer basis witn n,) mornetarv incPntive. Ihev inclucea I
twelve m~ale officers and one female officer froft the Navy
and A r-y, all1 0 Wt whnIT we re students a t the Naval I-PoStnraouate School. Five wore enrolled in the ASh Icurriculum, sever. were enro.lle'I in the UnerationS AnalysisjI
curriculum ano o-e as enrol lea in tne Computer Science
curriculum-. Mi Ii tarv experience levels ranged from jLieutenant to Lieutenant Comn-naoer in the Navy and Captain
in the Army.. All subjects had previous experience with some
= type of keyboard input to a compouter system with experience
level ranqitig from novice to oroficient. Four of the
subjects were eitner P-3C or S-3h TACCOqs and had previous
experience with the prefliqht data entry -tasle of the =exoeriment using the mauai keyboard entry imethod of either
the P-3C o.- S-3A. Only on-e of the subjects had ever usedI
45 U
voicP recoonition ePrinT.nt. Tne^ other t~plve ari 'itner
seen n-mr uqe-i voice recornition crinr~nt kefore.
-a'erials useao +nr'v io ronauct of the Pxn)eri"!ent
i nc I ij!J
a. AtyflifQ ZOS!' wliCr, was tuse to determine a sub)jec tsME SO( 'eve1 i- jri-- a sta-oar-4 tyflevritor key/board.
110 5. i yu e f or. usi-0 tnp voice reroonition System I(annenlixV
C. A s - -ul at ionn overv iew I anrrnd i x wn wi ch desc r i ed +o jsubjects, the nrHeCt've of the exneriment, thes1ulaf ion that %-as to -' --sea alertsrentrv Iommands
Is ~n cnrrect~ons,.1 a oy of tne tableaux that were
to ce rollfsa. Id.A sirulatinn tamii1iariZati4cn Capnenoix t)which w as
-4e s in eo to jive eacr, stioiect timp to oecom- 'amiliarwith data entry 'oito tle s'mulet ion. The noel oef t h isacrenli x was to- a IVn_ sueoiects to read and onysi callyI Uenter renresentative eata into tne sim.ulation usinga!-Orr. voi ce and kevonaro innut nooalIi ty. It also UThilowe.1 subilectz to DrCOCICe uiJnfCi correctiono-roceoures fnr tle Sjmula tion.
e* Profliaht lets iao-renoix F )whicrh consisted of threeI ',4fergnt ict6 sheets.
!iAviaation Preflinht daeta, wvhich wan usedl to fillin tns? Mavioati-n Preflioht tableau.
(2) Voice Snnnt.uy Status Chart, which was used 'to
fill i" the Stores manaciement tableau using thevoice iTodelitv.
!3) Ksyhoarli S3ootiuy Status Chart, which was used tofill in, the Stores Manaceme-t tableau using the Skeyboard modality. The only difference between -the voice and koytoerd Sonohouy Status Charts wasthe ase 3f true svlbols for the deoth and lifesettings of the sonobouve. For trials where
voice Was the input mojalitv, the deotns (shallowor deD) an thelife settinas (Short o oo
(S or 01 and trle lif settings aor 1 sdol
t
- ~-~r-= -~= ~ __ _46
the first 't-tter rt the .nr- 4s. A!hole ir~s wereused for tno- Voice qoohu Status C.art to avoioconfusinn o-tween sla~low ens short ,n i Ch mightother~ise ecru .e n kj ItCsfr the svmbol.ulther tha- those rinon jiifferences ho0t r St at usCh-arts corntaine- tr.- sane dAti.
Svoabulary list (anoixf nich consisted of the
IMP 61i words usedI to i-vut da tA to the simujation orogramn.Tnp voce1'u1 cry acs Kont at a minimum lenoath so as t 0
eef t'eaonzI e soon, i n t-ainino thethreshold Pbvl a4s i as was practiceole whi le still'raintainino ont'ni us a .10 of voice te-chnclIoay. ihevocahulary list kaq rnrep Columns of informiation. TheF6U~i MU. colu'r is use(_ to conmunicate with the f-oOOT no PPOt4 T Cni1u- Containq ut te rances th1)at eacnsuh jeC t tra'nea Asn., uqeri wnon inoutting data to the
simulation. i4-e th-ies colujmn headasu nUTP'J1 comt;ins Icharacters that -Ire son! to taPr Paramredia ?500 for I'rout to the Siiujlqtjon proorAmt,. For exampl e wo rorumrbo r 10 requires; top sujbject to sneAk the utterance :"tten isnn" ibitterarnCa, when rcgie ovtheTb6ufl will sen'j the cutout 'xrxl~xxxL' ("x" defines aIflank space) kt - a tfAla O eed ia ;)50U. The utterancesays to se-g three sraces,a ten, three soaces, ano theI 1ett-r L wlhicn stanos for "ion" to the Datan'edia 2500for inout to the si-1ulAtion tableauix.
Q . t nurber -3f 'orms we-e usedI to record each subjectsda a-I ri n heexperimnent (aooenli x H ) T hese
inc Iuo~oo
(j' A Vhire Necoon-ition Data Sheet for each trialwr'ere time an-4 error data here recorded.I
(2) An operational error Sheet that "-4s compiled by
the I!i T A system which comoared the data enteredDv eacn subject with a mnaster file of tableauxcontents reqjjent in the UNIX memory.
(3) A manually kent ioo of T-5O0 recognition errors4for each voice trialran 4 ,
f4A) A Voice Input Exoerimnent Questionnaire 4thichsolicitec gen-ral impressions of the voicerecog~nition system usefulness and expectations.
F"II- 4 E
LI r-.ccoures
f '"st staaie n r -e-tir'- -UIkJ-CtqS ;P If'ii1UalV With the
exoeri -entpr ano A -- t, '1 ve Mi !Ute t -i no t&St. Ta no
were he~n a iver. di S~t O f 1 ~ido, T.traswi
dIeSCriker' tnp rurp-S- e%: th- e-xoprim-nt, OD~ratic-' Of the
w ~voice r-co .ntion v~'ic~rni n-&ee~arv to use the
IRR ~~S i -u 1atI (n , an-! - c 01 1 0 t n tr'm Fa'niliarj7atjo-, handout
whlich t "ev -nO I!-r e lorl' a Syte'i fami!iari?aejr~nI
[workei .3ne i a'. C c-Di ' "USi-i fhe VOICS r<PCO-aition
SvsteT". Tne exneri-ev-tr s'-ciwe,4 Poch sutiect now to wear
a nd u~e the npadsat cmoe-one an-1 'low to eff-ctively use
*hp voice syqten. rliOwlnr; thiq hasic familiariZation Pach
Iu j ~ c I~ Iiv e S~ v o ~ ~ v l t a n d t r a i n ed t &,e
vocabulary 'jn~' r~eo~ar an-' monitorin, of the
exoer i 'erter.
Pepin nf *, rpounri noise level - in 0)8A - wastaken. durina the trainima session and entered into the
subjects "Voice iRecnnijnn Fxnerimient Cover Sheet" for
later reference. DACk9roun-l noise level reading wasL
obtained eacth tive subiectq nerformed a voice entry trial.V
After conmoietina- traininn of the vocabulary each
subject Spok,- each of tho 61 worls four tim~es. Tf the T-000
!!8de a correct m~atch for thee of the four utterances it was
considerea that the word was oroorly trained for
4P
=
recoonition. T;f tn.er tr rfte o, t rr f vUrU ttte r ancS
were correctlY _ ,t C i_ - se t t s'~et relrainel tnet
r-articjilr fnrc. This firer~ 505$jftr vrre n a-,! '~nn
half hours in~ !enotn.
Tn' s#-cnd o-' tsiT- i saes f t~ I-s xert
rrecui r-o the suciprcto 1 Ij in tle otcores Vaae..e-t ano
F =~~av Pr-fliont tahloau :A t~ r4%r.Laf u:c s
to I1 inl tflp [ti 4 IeZv vith -eta containeo; on tnp -lata
Sheets in aaren-aiz F. li-ev wer ro.4uireA to enter the -leta
twice f -r ieacn i r ai' o-ce- -is;nn v-ice s ' r-nce using the
feyooaro r-try ?et'-oH. the suc~ets were renlonlv tolit into
to e--ua g1 rouvs. irh , N renrf~r-f- tn-c *irst rumn of the
Trial snovoicea r'nut. T-^ -tfer Or-Un us-no kevt'oard for
thp first run of tn- Trial - rf t---eon trial the orOer
was 0everseo. a~e emkorrirarn wan rt-en in this fashion to
cotmte- tna effert of le !rn--ni 3 Q0?C and ACcuracy.
In ujcsrerurne4 *o- the SCcoflO st 40e vetWee-n
one arc three Jays, after co-v' eti qg sstnn one. this aee
them a chance to l-ok over the fat-:;iirization mat*C4a1.I
The subjects steonel! throuob -h- famulimrization orocedures
-during the first naif ,nur Of t$ke session. Durin6 the
re~ainino 4aS minutes the subiez7ts executed the first trial
of the experiment. Faeft t-iel consist"c of cerforrino theF
Ftask ofl entering oreflioht date into the Nay Preflight
tableau and sonobtour inventory Into the ~Sctres Manooeinent
tableau. Both che kevset and voice.modaiities Vei usej
49
wit t one n=l of t' e 3moer, sr" Z tr k-Y Se" e- ry
-ethr-z! ne-4 the n ther ef -~ :v~?ety=e tn r-f
fi rst T rial. Si-ce lit t t ia meoc ~ac~q
the ec r~fl~ astst r'- st!ec ?-I * rro t rCi IT
t hc 5t!c!Of-t oxrerl.,nreA4 0-;U tooe ust5 -3 flo rorrPCtlIof
---- co uros rorrectifin r ern-~~in 1~ nu0t1 ere -
cons-.le-d t o te tcev V Ar ;1fI S n -~- c-n-st n4 hne
schefiulon oet we-n "flu t 0- r- -C lr
seSS iCan. rflC t'lt- Sastfl-n t r~ v- t n-rm h
i dentlical3 tasks esr a-vrSe oar-er. Afte-r
Fineri-ent 2uiesmnlar t. --- tciitPo their
oeneralimreso zou er vt'
. )ara AnaiySis
y 'rats, t abee , 1r er met -0. h raw dat a
Of innut sceed, the cnrrecto -ca1con as usedI as an [indicator Of inpu!t orsr error rate, and3 In h roeedL
=tableaus were eva",ined, to t- Aetermifla -P~rtt'a ei-'-rs-
errors remaining a'ter t; zk co-o'etion. [:so
9____ pil
tr-p- -sIe
AE.t e.j ri~ " -r S I ="c
~aavmn~t #-p S-o x~p~
I--
Iner Tr S r~r -ra a~ wIF It~ i 'n Te enrI ~ ~ ~et~~e~ in '~~-ic t ~ec~~rf -r rrr
Anid et r vsoee, f ~ M oerattanAl erro-r rat"-a-
nata e~itv ti~a~t ae t St~n~ a *fa i v
was ste two 04tr4~~a wr oftct1 ~V en try vet nn0 and ti-s r c.;. M aa- aarr
I -Stan--ara- 'tn::tmOt k. r t 9 A D-v suk,hict analysis -f ijaiac r- a-pi~z- f tne 4,3ta
were emav~une" uslfl- ime A mIvS15 '- vj-ialce -cfl~ml ' it
-
a~oeard that there -int r- r-relatinns not anTitiflrel"
the mner~entr ~~r I-rovr Pates were t-sf rof-
US-ino t a Ar~in --asop- --r-A1=
L
"LTZ4
vo c I I0A rc FIff O= e
adveant C^'Ve r COn~n ?1rI <ov -'-sert h~ --a r rrtArce nrf
sPC itfi c onerat-n-i tsk r--s( T Se C ritical
EM -easurnrontS -,ro -ftrv : - _- c e ra o-A rasl r ror rat e, die. -entrv n rrcrs ^Sirnl -r'e t detsctoo nv tc oeret ~r and
Wflr ra?~rn- n-;tn-jte .- ask -
errors werle tatbu Iat e-1, b'ut a-v z IF foss'o~v exolein S In -t' ~ ilranc-es .M
t tites. Iw 1 literen* thefux mr se r
j effects nfulnkie n~ ~re -ore ~~naeu
L Slu~ie' NSere one Jlt-verce orovbneS -ore t*,r- 1n -jo nt
* d~~ata Outnut-es W.tn t _ tores Vron e t a n h
r ess anvefltaO*us Sl tutt ior whgrn one Ujtterenre eives nriy
jonte !,it Oata nut~t-as w~w the d oigi -Dy-dji enryvi
the v -vt'a tion Nzfi~tt~.emu. Iso trialIs were used to=
allow exiraio %f the ir-teraictinr o si'bea anc accuracy
with exneri-rnce. itle re-a Its eq nr esnte ri a wie the-se
Consitnelatio-as -3uven Orirar, at tentn Ht.;ever, -hI
alvaino te. Cat it be e aoparent t t ~e
'nteeecuionws nao tak.en olare. ;n4 tnese alitional re SultsE
are Pres-- ,nti. The ent ire raw data sotn r
the two tra*S cp si tahles i. and- T'.
52
t4
TAPL r 1.
t ! I)t J A T"T,1 A ;,
II NiF
SUPJ oDL (seroro) r;, T,'v OPFKAI [UNA LS* J
v cqI I A
I,
696 164 u 4 1 nV S9o 16. Io 1 I
670 165 1: 0 1 r
V 43A
4 K 457 109 0 1 1 1FV 530 11I 0 I 0
5 K 619 13b 0 0 2 0
v 136 1C0 10 I6 K 5?7 105 5 0v 560 1 r, 8 5v ?
K 6 2 118 7 1 2 0V 767 145 15 0 PK 051 211 1 0 0 0
v Ad? 17o 1i 0 1 0
9 K 667 133 1 1 a iv 572 133 7 0 1 0
t0 657 1I15 0 0 0 0V 521i 1 0 6 o 0 0
11 K 701 121 2 0 1 0V 619 122 10 1 0
12 K 71? 119 3 1 0 0V 592 1?9 14 1 i
13 K 513 u 4 0 0V 447 81 3 0 0 n
(14) V 437 P0 1 6 0 0--------- W------------------------------------aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa- f* S : STORES MANAGEMENT TABLEAUJ V * VOTCE ENTwY
N : NAV PREFLIGHT TABLEAI K : KEYSET ENTRY
53
T. . 11 L2 L_=
T*:LIIF Ti
A. I T T-AI Tf r.
UPJ UIL. . (_ e ont CP T tIAL
VLE5 ,., 9 u 0
0 6 2 1t, i
4 N 04147 I
v 9,2 -7 0 0,v 1J 7 1 5 0
K 51 io 15 . 0
9 A26 1t9 17 2 0
84 K pb Ii X 2 uuv 6o 17$ 4 0 0 0
K 69 1 5 i 0 0
• 10 K 5'411 11!a 0 0 0 U,v 1l, 1IJ 0 3 0 0 II
11 K 685 1 35 13 0 4 0 |i
V 126 137 3 0 2 0 1:
12 K QI Q9 7 Q1 0
13 K 19?) 75 4 0 v 0v 371 79 4 n 0
(14) v 32? 71 2 0 0 0----------------------------- ---------
4 54_-R_K _- _
'1 _ - *
A. ENTtY SPrLr
TahIl I11 oives a su..rV ot the -rean entry times for
the two tabIPaux hy tria!s, anz' entry method. For eacn
tableau, there -is a significant ditference in entry time
both bet een t e tri-is An' (sntry methoo, ihe statistical
treatiient is Showr, in 'ahisS IV and V. Figurp 2 compares
the ent v ies o- trial no n o two for tne Stores
manaoe-ent taolea~z. Ie keylet was Q.1 percen, faster on
trial e ana the voice was ! .6 oercent fester on trial 2 (p
[ O.Ofl Thp A.WnvA InaicetoO nO siqniticant interaction 1
between L riI entry nethoi. Fioure 3 shows the same Idata for the avigation refi t tableau hhere trial 2P times were, 30ain, faster: ty II.o oercent for kpyset and by
9.0 Dercent tor voice Mo < (.15). There was also a 4
sionificant oiffe-ence i soepa oetween the entry methods
for the tvn tabl|atix. Figtirp n shows the comparison for the
Stores -anagement tahIeau, where voice entry was 9.7 percent
faster than kevset ent-y (n < n.i). Fiaure 1 ahows this I
data for the Navioation oreflight tableau where the keYset _
was 1'.7 oercent faster than voice entry (p < 0.1) The
reversal of fastest e-try method between the two tableajx
orobably reflects the character-bv-character inDut reouired
for voice input in the Navination Preflight tableau and the
multiple character ootput use of voice for the StorLrs
Manaaement taoleau.
55-
_ _ _ _ _ _ _ _ _F_ _ _ _
- -- - -- - -------- - - - - - - - - ---
6 19
tra i*63 2qW
60 1221
V
ti -i 1i2 13881
trial je 63714144i
-- -- -- - - -- - - -- - - -- - -2-- - -- - -
1P -11
-ML
58 _______
~~ ---- - _ _ _
I AUI E T V
ANOVa STORLS MANWrELMEt .9 TA13LEAU ENTRY rTMFS
SOURCE SS ef rnqF
TOTAL 761b,2?0.9? S1
SUBJECTS 423,813.9? 12
entry 44,0go.b9 1 £J4,0 0..bO 4.53 < 0.10
Trial '6,760.07 1 56,760.07 9.93 < 0.01
L x 1 832.01 1 832.01 0.1A .S
er F Ilb,bQ4.31 12 9,724.53
er T 68t562.93 12 5,713.58
er F X T 94,L4c.99 12 4,538.08
-- ------------------------------------------- -------------
E : entry method1 - voice or keysetT : trial - I or 2en : errorN .S. :not significant
P* probability of error
SO C S9 ad f S F
-- - -- - -- ---- -- - - - -- - - -
TOTAL55r74.98 5
e rPCF A14.9 at F - o_ P
TCTA F 5Y,7 1A 4451-A
SUBJ~rTS2 9l1.03 1?
Enr 6,671.5 meho voice.5 9.5 <0.01
T. x tra 1592 1r 25.5 021 NS
er er ror 3'S69 1 b5
ft 7
AIF : ntrymethd-voce o keyetEI T tril - orX
N.S. not ignifcant
=j -c -c
I-- ____ --2
C141LLI
S CD
-JL
n IC CDj-o to -J
(SUN03IS :13WII ASN3 N1:
C-4I
IL __ 4:::c*
LLI-
C~LIC/)LLJ..J
LU~J c)
LL L.
uJ O~ f
C-) (D C
(saNO33S)3111 AHLLN3 NOWI
60
Ca
_Li
M: C/
C/)i
CD cm ij
LiA Li
(SO033S
1 1-
UJU
C)
Lu-I
I-L c, Li-I
LLJ~i -
LLIQ~ ~z.I
LiJ
10 C) a)~ C)J t-D C) i
(SUNO)JS) I3W I1I AHLN3 N3
62
Aodt ional analv;is i inc ated tba there as also a
significant 'hfterenre a-ono the sc T ects tar Sto 5
-Manacement tableau oata entry times, aithouan at o suh
difference could be found for "aviction prefiiaht tableau -
data. Si-ce each suoject had been aiven a tynino test, ANLvA
was examined for any difference between tne ti-es recorued
for the fast typists (-Qrater than 30 WPUI and the slow
tynists. No such difference was found. Data had as "een
recordeo on each suojects' warfare soecialty. The group"O2'
contained 4 officers (subjects 1,4,5 and 131 who a
Previously qualifieo as Tactical Cooruingtors. This asoect
was examined and a sionificant difference Was founo between
the times for the TACCO grouo end 'others' Group. The
statistical results are Shown in table V. nn trial two the
TACLOs' mean tima was 23 Percent 1 arter than 'ho 'other'
aroun (0 < 0.i). There wes no sionifica-t difference
between the crouns on trial one, n-ossiblyv because e-ve-ryone I
was Still learning abuout the- simulation at- --is Point "
There are some adoitional factors t- consider h n.
evaluating the entry sPeed data for the keyboard. "ote from
the reoroduction of the Stores management tableau data in
j appendix F that there is a pattern , the data. That is#
for a number of consecutive lines, the sonooouy type and
F hydrophone depth setting remain the same C as in q _
while the remaining data on the Iines runs in -mmer c..
seouence such as : 101, IlL, 12 Lt 13 L .. 17 Lietc. Some
63
41 1
IF------ -----------------------------------
TOTALt (scns]±T" 0 : 4QOII 2
---------------------------------------------------------- --------
564!
-v-I
0n t ua'v e ' -3=- and netA
a large i'-1acl of-.!i n s~eet aQCI' .
Sir-c* v=1 * DQUC h ~ta
asoects -f t- S.r~ 1 isia y was-oe
horictl fra 1 v1-3v t-e sa-e. OistaflCe as the-
ve- I- I-' b a ! I -
Arrf 47,rM V*, TI-gg nrr=='di olaces an
aodiio- lt-nri tr sin~cees ot :%ave t he
lat a -ee k e '- is field- of vzww
aadti~r~ b" - ** arje tsus reducd
{the eftact of t =- 0 ft tekyse', entrv
F that 0' reou irfl i~~au novCLlt
Sheet, It t k ey oar cde b-
data =' -- t t -- nerfar h -trv orcs Snee oroerlyi
numeriiswCe 13-rl' occur inactual p3
rnrtoe*~ cnr1o0 -tto -ewbat faster --ea.- entry
speerv t _r3 -ge W- e' - t 1 fl e oerationS. r
Wn e-iat ewtl this artual~v a f ed t he emDe rimenltl a ta is
not k nr n._
j~~I T0er is ie toii-a fatrslh Minfl 9 ave
affected- T Ie vcfyb0C;%2d otrv scoen i ti ezoerim-et. ITe
ir-0 45t tenIet di~ f ifert t act il1e teec-oacfrtan-
stendar3 keyboard Sat~h as-Is used in the --x ftftvIe
k~eti' ttaicrftrn~ira s -- P Celiib~eratC.-m orect
-ev ae-rsin Ik -.-t wo re fnt~~ij
gI:
.....
Icr
however : o4tta~~iVnr _'
a M o- Ac t a teeu o-ve
trialt -- a 'e-t- ard !'- t 1ej
1il -e f 4X-lrail that ;c-r tn
ffexoor.~t Zoe ~ - ifr e- t -er-eratuna -rr
rates S~~e t-o-S~~ tras S
r r~i~ v 0-
As~~ rs v rnct. ~ y prr rat e xas -not
wa ne!o~wr. r f 5fl~[ were for Tohis
a- 4We-y V~ '= rr
ewrastOA ac~ -=--r AM -sn t wer s o the
sttitialtrat t .~e-l' ri-ificrs=' nicfsren
btnflv the ~ rr rr ~ * h Wo1 C -- a -ee
snouC caiC_ ='l ae esca 1 -4- - - diUfferetce
feo-e toe wee -t. -- oerc0 - r ter e v - e ar u.OS)
fo -- -- ~s
| FIt E VIT
AN"JVA S 1- -7 P k ~FtqT TAR:.FAII nPFHN' JuNAL FiRPGRS
SOURLF SSF
r--I
W TOTAl E, 1
--- SUBTECIs ja2. Z7 I?
Ent5 1 2.591.?i ?..9.
Ir i 1 1 1 .54 O.4J3 .S.
i x I .. 9 .03 1.
er F ! 1.31 1? 1?.I]
er T 43.07 1? 3.r9
F : entry -t0o' - voicp or keysetT : trial - 1 or >er : errorN.S. : not sigifi
: prohability error
67.
T A RLF v T 1T
AN:OVA NAV PPl-rLTGHT TARLFAII UPLPATINAL FfPUPS
SOUP~CF F 0*F
PSIFFpwTOTAL 11 .p1 51
Lnt ry ? 41 2. 211 1 .00 V..
T r iA1 .?1 2.211 0 . 19~
E x T 0.715 I t. 3A 0.05 N .S.I
e r F 26 .0 12 2 .21j
er T ILI?.74 1? 11.90
-------------------------------------------------------------------------------------------------
F : er'"y mathod voice or keysetT : tri a] orer e erro rNJ.S. :not signficant
= o : robability of error
68
T AIALF TX x
i3AST(. L'oflS - fl. Fj OA~AGF.'FNT TAPLFAII
v LV S; 1 VOICL "qU6JFCT 1,10. Fk.DOPS) !?iP.%) tQf& RATL(%)A
3 Ui 0.6 142.4 1 0. 33.65 0 .
P ?0 .1?5 *7 1 7 ?.7 P7 11.?8 3 0 .9C 17 79 0 1 .
100000.0 31 1 15 ?.3 13 2.01
13 8 1 .3 7 1 .
MEAN: 6.0 1.? 1S.? ?.41
-----------------------------------------------------------------------------------------
RATE* numtqr of er-lors / Unumher of data items] *1001
*** see text ***I
TA!ALP X
ANOVA: I3ASTC EPROR RATFVSTOPES NIANAGEIMENT TABLEAU
SY E.NTRY METHOD)
TREATMENT SS 'if MS F
ENTRY NIETHOOJL .4.85 1 F14.85 8.,45 < 0.025error' rTTRY 2?7.59 24 9.48
4 69
-~ P!
--
TIthe oi ce unit. j 1 a ore is a rathe, i~a1n
stateqent when the Z36p rate IS P.U nerCprnt -samall Shift
in trip at'solutz raite D,1 rooure a -itspronortionetel,
larger shift in trip, eiati-e rftm.
It vas observe-' aarlv in the vnire InPUt dePvice trFairirou
seSSiOrS that tne vic~cuiry weS rroViolino a rea:l ch-allenae
to t hP recogniti-n Harw d re - hr were a nurrLer o f
= seouences Of utter-,nces Ir the vccah-uiary wlicn Y.~re very-
s iil Iar. The or-luos nf Cre-nrel numI~er/I'yrophorc, depths
were SuCh a bePIlercp. Triere was really not rouck ilitterence
-=betceer, "fH11IIE L"fG' ,"FF'r- L N-rC A~ IN"L qjxjF P-7L LUNb",
for exwmole, or iv1-I Y Tjj C!t" "I VUI!i Y Tf-Q0LE ShPHq~T' apo
"TW~t'lY f-I~F Sr-,OrU." Oic trir thrust Cf trip eyui'riment das5
to use voice entry in a n-rtir~I manner, however, there wereIno Charg4es to tne vocabtu'ary tr eccomolate this Problemr.
The hicfler input error rate recordeou fo-r the voice input was
likely a r -Sult -!f ti-is 1Ieci~zion. Table x7 show.s all of the
ftutterances for wnich an error rate ireater then two percent
I ~was recorded. vnote thAt or'eiaht Utterances -1 ecn
I of tne vocabulary -arcnunteo for 71.0 -nercent of the entry
j errors, an only three ors-5prcent of the vocabulary-
accounted for 'I1.2 Dercent of the entry errors. A cursory
examination was made of t"-e recognition accuracy frthe
troublesome utterances with the numbhers sooker as "TW_-:eTaG-"r
instead of "TnE-TY-1wOvu and "l-TAx vice ~S1ITE EkN etc.#
These preliminary 'ifVeStlQat'On Indicated that thPe[
4 7U
I A61 t (
IITTLRAI\!CFS vT Tq rk;7ATt,9 THANq 2 F? "NPtr~r,%T f Ttjj FiPUP PATE
% of TOTALI I T P IfFAS CFIRPupS u S mj
?M 2 Sm-ORT 17*.6
23 SHOR~T 12.0*
21 8 HPR T107* i
r20 SHORT
1PALS 7 71 . 60.1 x 41.2% 30.5 X
.71
recOo-nition error rat e V.t ndJedi Iower 'J i na thi s
tecnnioaje. t~cnr-rlbte 1ist of racouritior errors recordea
over t Ie course of t he ent re Pxnerinert tsopears in aoflendix
The jr~t s e Ct on ls ts t he utterances in the
vocabulary, With alljC c'- r:nCOrt-tCt Matches rP c or (Ied( fo r
INe=ch !he secorAi sector- 1istq -sch incorrert match ana all
of tI-e vncqou!Arv utteraiCe-S with wnjclh each was incorrectly
Aa consenu-nce 04 tnA oroole- pnCountered with these
few utter:ances, after the first 4ew subjects had comoleted
their first voicc inout trials, a channe Was made in the
exneri-ental nrocpd'jre to prevent this 4rom oiasing the
entry tilme oatp. Ti an -rror occurred ano the subjeCt
CaUgfit the error, he was civen an oportunity to delpte the
line &ro reenter tke dAta correctly. Tf, on the second
atte-titt anotngr recoonitinr, error occurred, and the stib 1ec t
incorrect data ana continue. These 'recognition Passes'
occurred in 'O.b Percent of the voice entries, although te
clid not occur on any trials performed by the 'Pxoerienced'
voice Pntry usorS.
It is likely that ePntrv errors affected overallI voice
entrv sneea to a greater axtent than thev affected thej
keyset entry sreear Particularly wii the Stores tManaoehment
tableau date. t.ntry errors in th. H'avioation Prefli'-ht
tableau were rather ouick to Correct with the 'BACKSPACE'
f un-t inn on either unit, since both svstems used a single
72.
inout, sinole data outnu4 -ode witi= tnat taoueau. Howeer,
corrections tok sam'ela * irrmer -Itt, the vnice svste in
the Stores Mannoelnn {trlepu. P cIl- F nat the two
correction functi-tns evai ib'e we'e PACKSPALF and rLLETL
LINE. Ihe btcwSPArE o-ietrc the ore,inus character and the
REKr DELETE LIE deletec the enti' -urr-rt .ine. Sirce t'e
troublesome utterances dere a1 1 ctenne' oumber/Snooouv life
inputs, they ere a-Yeys thp seco-d utterance tor a line.
Thusr the correction ontion with voice hCs to enter six
8A1KSPACF cow.-anos (the voice outnut contained three blanks Ibetween the data itp-c) end reenter only the incorrect
output or enter a DEl ETE LINF co-n-and and reenter both the jcorrect And incorrect ntQut on +he line. Since the later
!option was auicer - it too!- five tn sever, ser-onos on the
avera:e - it was the oreferrpo method and was encouraoed.
Corrections on the kevsat were much faster. ana were iI
aenerallv made with toe CP(KSPaCE key since it coulo be
activated very raoiOlv. with these corsiderations, it seems
reasonable to conclude that voice entry times would have||,
been considerably faster i4 the number of recoqnition errors
could nave been reduced for those eight troublesome
utterances.
It occurred to tie authors that, as a orouo, the former
TACCO's mioht have a lower inout error rate than the 'other'
aroup because of experience cained in talking on aircraft
radios. However, when this was examined usina the
73
t_
N a vio--l#ion rr~f I I ht t au Ieau ent ry error da-ta, no
sianitic~ant i'ferprce coulo t- found. W'hether this Was clue
to so'- n'f the 'nther' orouD h-:virno sim.ilar Pxneriencer with
1is a-s f2orL2 1nqt-jnter or hethpr the oremrise was not b
W ~TniS catpoorv arose 4rom tle examination of the data
After the exneri-ent was concluded. It had not been
Consio-,rs-d in tha exr'eri-ental desion nrimarily because of
the ai t 4 ut ty I n acouimini voi)unte-r subjects with voice
inout exnericonce. It ha'4 bean a Sumedl frorm the start r~aft a
oersoin fa-iliar with voic- entry would be more e'fective
Ithan z Or-e one 0;, had a total o f onl I hal f 'iour's
exnerieqce wit n the system, as Hirl twelve of the Subjects
when tke-v startel their first trial in this experiment.
Roth of the aithors haH used voice inout curinq a orevious
voice entry project. On took part in the complete
oxeri-entfsuoiect 3) and one c ornoIe t ed only the voice
entr-y trials. Sinoce two data noints do not makce for very[
Cood stqtistical inference not muich can be Said w~ith
statistical sianificance about the followina comparisons.
However, they are oresenteo because they oo orovide some
insicrnt into the capabilities of the voice input system whenI used ov reasonably eyoerienced personnel.
714
977 p-~--=.- - --
Tab], YIT summarizes tke r-s3uits fnr hotn tahleaux ky
exoerionce with voice entry. ror t1e 5to-es Manaoe-ent
tableau, tt. two exoerienc- vo1 e entry ueos demonstratea
3A oercent faqtPr mezri entry timp. Ike Oistficution -f
entry times amorn trne S'i suoiectq oroe:rs in f i ir- 6 Note
that none of the ineyp-rie-cPd qro-IO nd entry times as fast
or faster than the 2 exoerienceo users. lhe aistribution of
inout error rates for the Stores * narment tableau is shown
in figure 7. Tho oxnerienced usars had a inout error rate
of 1.t vercent, wnich is aonrnachino the overall kevset
average If 1.2 percent s'own in table TA.
Onp of the most interestino r-sults, however, is the
sDectacular Increasa in entry soeem for the "avioation
oreflinht fabloau demonstrated by the 2 -xoerianced voice
input users. Fioure A shows the distrioution of Nav
Orefliaht tableau entry times bY exoerience level. Taole
XIT, shows the mean entry time of the 2 exoerienced users to
be 48 percent faster than that of th- inewoerienced oroun.
This mean, at 394 seconas, is sliahtiy faster that the
fastest kevset time recorded for that tableau, and 36
Poercent faster than the mean kevset time (over both trials)
of 608 seconds. !his sugoests that voice input may be
Considerably faster than keyboard innut even for the leastJIadvangateous (for voice inut) circumstance n caracter
by-cbarecter data inout.
75
VuTCF FtjTRY T LL A00J( hb ST i EP tr-R R~A IF fy L P r T~ C r E
(trials I and d C-rii-ine)
MAR F At,~
n
12 1PJLVPEiRTEN-!FO
VOTCE FrfTkY IjSFRS b1 40 2.4fh ~ FxPPEjFiCEr,
VIC IETYI5kS 397-
p EOCErd CHANGE: -A 4
*ERPUP RATE (no. nf errors /(f no. mf oata iternsJ 10I-e t r
7 6
__ _ _ _
_ _ _ L
DISTRIBUTION OF ENTRY TIMES2 STORES MANAGEMENT TABLEAUEvil EXPERIENCE VS. INEXPERIENCE
WITH VOICE ENTRY
700
V IVr 60 -INEXPERIENCED EXPERIENCED_1 14
00
U,
400- -Ii
300
MIMAN IEIREN U M B E R
M MEANSIUR 6
DITIBTO GFBSI RRRRAESTORS MAAGEMNT TBLEA
ISPRBINOFBCE ERRORRAESED
uii
WITHR VO7 NR
Ii
~7 3. NXERECDERECI
:PC_ I-
t-
lilt i- :L I- Ir=WIL
LL I'S iLUS
-fl AIM
47
-6* 3W
after
Tf m<a in-- tr - e.n r v--c- t - onzt - a~t
a t -n u_ _- c_ -t i e r n e -f n n a n
nt eyent- S-r-en.semd
=-
.. a s u°r _.Pf+A. s
Tt IS ~A? re~t~n 0~~ C- ~u~ec t e
Co-Dar n - 0oC r~rvo ety~= a- t-t t el1v
witho t er S es - t9k
theorabeSt tiore a&e hel
-ucns ort f the freee thet ~
-7-
reasone three s a d I tuse oe
in-t in eey a taSnsa -- 18-4-
UR
r f they S bt s h n i+r te-e--o- .... ++ -" - 'Cid* t---+ *n i__t
t witn te fo reS " a-'- -un-ou -task by...
-ue . _on tree = .t treec the
lessru t iouev.P any - 1 e---.+s+ c"e: e + - I CO+I?+I errors.- Th
I- - m =~- I I"' qesr~~ ~' hich aske
resonss wre ~ne~=- -~=80ifte huh ' Nrday~atosoe h
1+
cn, * C1JU',S AND~F~~f
The' Pxeriment ,ptS t~jro test tnP 0' of e ntr y
speed an-i norerntior'al error ra)te oatwepn vnire t,?cinioue add
LAI keyooano~ tPChflii~ii f-r D-Pfliciht cp,'ta e-ntry rt o th P-3L
ASW 1c-t
was ni- t acain nierPeo,)roinoth- xreriance jfel of then
test suoiects. Af I1 n ft t'e s uh ec t W w.,e f arniIi a W wit h anci
had USPI KayP-oar'1 entry qyqtomq nrior to the ewcerimiant. T t
must be emothAsiz'd that the sub+jacts were very inexoprienced
w iIth voice antrv terhrinos. Even after the exoeriment was
concluieli ti-e Amount of time th.~t test subjects had
accumulateI or, the I-bOO opS one ano one-half hiours, which
incluopo the time 5o~ent trajninq the vocabulary. The- two
exneria-ce,' users were not experts i- usina voice systems,
but as mr(-innea earlier had comoleteo e Previous excoeriment
usino the f-AOO.
WhPen a e t r i n o c')nclusions o f the exoeriments two
fa ct o rs ts u st t c:)nsiaer-. ihese are:
I . The type of voice data entrv. which was eithermultiple charzcter input for the Stores tManagementt ablJeau, oil Char~ct-or-hy-character input f or therNavination Preflight tibleau. P
2. Yhe exoerier,ce cf the usp r s.
81
-ARa~ced or. t 'e risu its f rorr f h St rps Yn~oplment - I alit,
proficiencv of the users, ano stiniertivo re-arks received
from t-pe test suhiec"S c- tr. rost-evu,-rimptit oupstinnnaire,
it was conclu'jea fh~t vnice entry of n-re-fliiht cta into
Mr the P-IL wepon qvet- r~s f~istsr Ird leq fatiquinq than
Leyspt entry. Aiit ion aIIv, wth i nc rpa ed Pxexreric e us -a
the 'ioico systo-T, the ease 0' Iata entrY a-c! sneeao*0 inPUt
coii opconn m nre P ronotinced4 as ws ohserve.-i with the two
F exnerienre1 users nt the 1 -cN%~
Raqe-4 nn th rpat ~t. vination i- efiiaht tatletu
the voipce mro-e was si-.-nific~rItv nl': wr'r than~ the keyboara
rorle. 1his has been torr-e out i nrpvious literature with
the conCluson that ckAractrov-cnaracter input favors
kevooar-,? nrtry Twetho'Zs. Oowevpr th.% experienced suiojects,
USino te voic e -01' 1i t we re at- Ie t o complet a the
NaVioatinn Preioit task faster than the keyboard entry
times of any n- the i-eitperienced subjects. As a final 3
conclusion it -an, i'e stateA4 that even in a task which Hoes
no'- favo-r trne voice -ode of entrvt such as with the R
22::oatn relgt task, --n -xoeriencwd user of voice
kevboara mettods, and with an inctit error rate that is
82
III~01P ___ _ __I
q*PLC OMMF;riA T fI~
To effectively imole-ent a 'Jnire S-5tf- for a niatform fsuch as the ~ t is; r e c m-P n fr t r'At t t-e aasiore r:
1.FxAmine tflo tas In i't nic , tr& vc~icp syst'r~ is to be
kuseJ.
?. etemin tse vcab~rvtkt isuse-4 t- the ore atorswhon enuaq-d jr tfle tdsk.titin. eqinn th~e voire reoZjiIt 1,n vj.CA.v)ulrv to eouate withthe natural voc'abularv' rf crerators when nnaned inth,- task.
FTest t he vocabularv in oner at i na SCPnarios to
He te r i np t n r s et n f i rpoutj t is-recranized
5. etrain ths0 oroule- %utteran0S
6. Tf retraininQ does nt' surot~ntinily redluce therecoonition errors, tnon Tnfjifv th- utteranCe, keeoingiroHIfiCatiOnq clOSA to rhe jx-raon nt the Onerators.
7. Determine nonulation size nf the unerators for a
narticuir~r tastL. The qtr,llier *np nornul 3rIon Sizp, the'pore tailoredl thp n vCahularv can up to the ina~ividual.
Some considlerations wrien anolyinoI current voice svstems
to the P-3fl:
1. The vocabulary Cnust be traineo 1r, tho bd-ekarouno noise
in which it is irntenoeOa to bie used. The recognitionerror rate of the T-600 is low as long as it is useain the same DdA level and hackqpound freauericy
sPectrum as it was trainea in. IT the difference inthe level of hackoiround nniSe IS areater than about 7flBA from that in whicrh it was tr~inedr the recognition
error rate wil I tno- an inc-reas& tPef . inJ.2. Crewmemoers neea tn COT-unicatp with each other over
the TCS thus causing some oroule"-s in diesion of a dualcominic~tionS System.
3. Voice innut is not the Depst inout -netnird for allcaseso thus the rpauire-m,:t to maintain thecCurrentkevboard and matrices.
83
This eyoerino~nt kas shnw"- tha~t t-ir i 5i, 1m ;,or t innn ~f
thP P-5r- m i Sqi nn tri-It voice en~try ws more c0 4 iprt tnan fthe st- ,nea-r voyho.are Ont ry current I v in use. S IJLr t i Vel I Vi
test quhjpcts on~ thp wnnrlo qt~tod that voicp enlrv was -Nuch
less f~tiauinq tkan ",t nla-I "d YbOarl entry. The voi~.e -oe)
Ieau irP a f ar I-ss p-v e -ha n~ ;nil Ieao- Tnvp; ent to ente-r
1PNORdata. In fact it renuji rpo on'ly thpt thle suoiects rove their
'-yes fr oT t he invontory li st to the APU and t- k Jt Cou'o
b e arauei that the novelty of voice entry -,e-C rpsvosiole
for the test subiects rvst-onse. O-iile thisq 4 eactor was not
Itested in tmf exnetl'nentr it is the Autnr1Os oninion T hat
novelty Wias but a minor factor. Voice -,ntrv is a naturalIand comifortable innut '-ediumr to 1) conouter s-,ster,.A
Give, the Te'noth of the, P-* C cmiSSinn and-'o 'unt of it a
Iwhich Must t inQut, to the svstce- for nrocessina it is
sconarios for voice jata inout f-r the P-3C. Voice Hata
intcouild he a significant factor in c!cjA alt rtnes.-, when a-
I engt h of mission is ronsidierri. 0,1 t the n-ennina extendea a
Mission P-3C uograde, i s role coul'J be consior~pale.
i
84
29
- - ---
A t,
IT-~U L T j 'J L bI t y ~
Ol3 4z pF-z T A T
QJ ACnrU'Q~fIC 5 T A T tS
AI Cj j~j t- TP C C;-T11
I~~~ VF* iA FW;:
IK T
IIACI - p -tIFx.
851
7- -- - -~- -_ -_ on
I
2I
LI
Li2 fl >, .' OF LI
LI
a 1 .41 2 19 b
- O TipF- L( (I I
7 7 " ' 2 S 2 b
M 3 la7-4 9 04! 7 3
o! 2 ' 1 ." Pu 3I
1t 4 Q5 i L
12l4 L15 40 Q 5 A 4 L
16 07 m7 15 L
17 Pt 7 5) 05 3 L
11 a 2 P 5i 1 17 L
13ic ~ n w 2 r
IT -
-~ I
LnC ty
-y
43 5 05 -e A
5 b ) 1:1
6 7 QS* A7 S 05 -
ME 9 Cc 5;
P 60 Q5 (Z
10 6 T , L
ONE 6e Qai7112 63 (PC " 7
1. 64 7 o., 2 , i
6 4i
15 66 C '16 67 n"g7
17 68 Q ' 7,1 69 nOL7
LOG T y C 0 L
J l 75 -4-41fC% 7o V Z)
6 77 ni
7 7b 4C 9 Qif 412
rz I111 R C 053 r94 053 r
16 87 53 87
L nL T P n F
0~4 0l57 I?IJ Q5Ob ) 51
SoOa n" -Z " L
6 07 n5
7 0 8 5 o L
Q ji O '41 " 4
I i n? I l ii I ( b 5<IC101n Q, dl 2I S
1? 10$ qq!f ! i L• 13 In, l ! L
16 107 1" C 5 L17 108 nAt 10 L[ 1 9 rZ 41 1; 7
II 11, ' • =Id
N ! V 9 L F t . - II
u I ir07 T')QF: I~ HOP D AT FP Z ' 7 Q01 L A 1 37 ,a NI
LONA 10 4I
15 DpmorE A rP
06 PPI '-'A Y T SR: v
07 nor-'f I I
UP BALK4 UIP T 14i
00° , -- uP 0 "
12 IFF CnDEs1m OnE 1 : 35.
15 ,-'ONE3: 92 n o-
17 Rur,0o/SO : ,-5 -,, 9
i *** ALF .T A Qpra *I *PPOFMPT LT VF 4t*
: 88
" "J
442
I I t,
~~ ~lN( oferfflrw 'OtsSacKtT' E t 0ci- SiScreAte f ile f,r jrt r orrptoi tzabieeus* call !TIT1TAI 171!' t-- ;iti3lize tNe:,eaStrujctu-eq oH *0 set o n oa 3 t. -f% de x
c L
Sn re-Vontv Uti f eie e
oacksoace countsFON write cnnootal taonl'eus to j-jv fil s1 ~ lto e I
INDEY 1Iidisolav TN~ ala n- u h iuain
* isnlIayI IL'FX tte au 0&-d "L IJLtpopJ atrML si 'njlI t ion terotinat ion i s reusnCall PREFL~TO ;%t.d CONOcfSrO A--S!) ~ t
t ~ty the oneretor=
f FNn TN~PEx
PRFFLI I) ( nanrile v 5t'eV a nd-=iictnI"O_ 97- pcrT~ tablea3u!
ft l I TfFGFIt t bIe mu ano1 orompt lineftwhile inoUt is tan !NDEY repauest -1o
c call Uj'PJT( r -oe ss te nnutexecute 3SJ"l -0crn to sum- un i nout tineSCalI CaIECKL T --r E to etee-t re if al_ .
s required _ Iset val up for nnut 1ine Crs~or olacemefltc caI SKI MPA r, IL w r ite 3ln c anoed i ne,
EDwht-TLEr nPnt u t 0O% t ~ t'fC
IiSONOSTRSOi [ h annu d awasry and --di ficatitonIof STOWF ~aNEFT talau I
Call "l itrutA
-- - - - ---.-
II
I lou t il ' ' i-ro e
SI,f -
Oi
I IMI
I I;
4~dt-V ;ljY rj
U31 ~ E -nr FCA'iT1 V ~YTL L '
THF QZlr;L UF THE MA -
* p n P tTm ru%'s iII'Itf-
T--C - ii'si
FrP TFL~U .jAI K Tj TA -- t. t2Z N TZUIJ C I 0P l0TI
JJE THEr VrJfSp- - Pi-iC$ TNT -- ALL ELIUV' qT
.'tv 119 f SPEAKING rFrr !..jjI:DEh Tl~A 1t41N- I T r.r Tn KEEP TO&CarL-
F T~tRJ TLNI 7OIt Y7M S_ Ei rI iG0qn &EUTR
*It CEpTaTJ, T11 C f. L ,T4C A- - UT1EHAr
R umn r- ^ f NG Trz'AlNK~ 'I M!D _49I-1MS.T c T-L REENt IV E A11DY G lri A_ ~:TI L IIILLII ztrfI~t F !)-uPILTNHE'S F P!IISES
It
;nit
'ne iteciv nt t' ~ 's~' t~ & aluat t~-
use ofthe gTj un~rzrit A- an ino- Apd-ica
for oref IP-At in £ ji a' .ya C- C
ran uso t njis s i = lon v ct -a tam.I ar w~ith the
cornmands neceSSc81rw En v0--- -,~r WVIn rou'z-- rae Svste. TnAx
[ is the c-urr-OSe 0f m~~~=~n
[ ao -~r, Arotre-ei tab --- Witt- e thn
1: a e-~of A~la:vin--I. Loont h i s'i Pnr-.. Az.-,aiz~u~i vit the
dtae t-~O8S onrk -r -nj - h t F t one
vtablpa --e~f cry4 iv - r0 rtcti~ or eifti-
inoir tha rto eirt-n - E a_ J- f55n hsI
pxro t'flt 01'. - ab I -eAg - two ;% - .4 e~~ ta t -u
~rtab' C s &a4nr fceen te 5ra on t
F ~ ~ n ac 0_tualr tos~ hI i ~ se ee otels
Th. voer- at. *tr 'ta a~ v~n t thee taei-s.th aletF aIea Aa~o I. A birt will acorNee
actual- C ts - n- ar- O__rfa.r te ls
tontent Sif- she 4 -3t, s ... data so niin hich. ~
renut reS votr ateft" 1ese ale r ts e4li he -e-crWb-
store fuliv later,
Ttr-e-4iatelv 6-e'ow he err A- isteooc le."ere iSljsoiavea' t' ,in-r e l ine woich i-72
ava v-f or dai inout 'ut *r- f- in of the
tatlIeau b e0in S eit~ a ru~ "~ f %-,we.--! ano
characters. T-er edt-;whc sectio-
ts m-odifiable a s tS eCt i ~f -n sra~'nnd'es
that for -flu. Thi s is ta ino- * *n. This is where thesyste- Cuso will aooeArW tie Swntiu _gG a o--character I nn c-ink in line -- 9- a #~oro=frLat
tot It6IaSoe Ietn rt m lal
c haqraTer in t__e otorr-ut line. Eetouhthe uate in the
IS 2
iiA____ ___ -
lat.i ' =~jm "ny.
n-re~a t j n t~ n- c -w-.r~r 'i
f o ra tt u p i- hr-O uaa n z n te. a
Salwaysl e 4 e~ o Q_'. Ad W.- ot~t
'eaoino rer--== :e 01 v1e-C - . src - In ;:w mo-Cut
when efltfr1ns- ' P %;%-
rel at ive v~ tno Cfc ̂nA- t SCk as 11- 1-
suh.Qr R Dn U st i 3 eauFonta is l I C + i . O'~z _n
icf t e--~ an-.- va fA-y_
-- r_ e avv
rec e i vestr'nc filI y S-- -tra tnre vacrf t 1,*aircraft. wnerP r, S-~a arc-tseterMlflo, t4 the
I-sounds a re t cs e of r i n P
IW 4
= - -- 'F -
=:q-i &:Pii-- ---- -- - - T- - - --- - - - - -
S-T
- - r. , 7 er
era C..s _-_ -=
I L
08cel b . oAt
1 -_--- -- -
Ia - -ai QI-s
I__
-aD -_ i-. - I.--=I fan -I== ",E ,~a~~i s-'=avi
I --~l
__ '- - * = - '
I
W I~A PY (F V U-T CF T PJT q~F OMj~
DESIPRD ACTIflI4 'iPU'<E" I?"P1U
ENTEP nATA "FNTEQ1
DISPLAY LINE n FOK ,IiOT!ATu "I-jNL <n>"
I3ACKSPACF "IAACkRPACF"f(backsrace one ciaractor)
DELETE OTNE "nELETt. LTNF"
(erasp entire iflcot lire)
DISPLAY NEYT PAGF nf 14'0 LAYj "NEXT PAGF" 1
(SIPES fArAGF[MFi4T nn! y)j
DISPLAY TWDLY TJARLEAU ofT Nf)f&KX
DISPLAY STORES MANAGEFui1T TARLPAMI "STORFS MANAGEMENT"(acnplieable onl y wher, T -91EX i sdi spl ayed)
DISPLAY NAV PRFFLIGHT TABLEAUj "NAV PREFLIGHT"
(aoplicable only when YnDEX isLdi sp! aed)
L
'AN
A , -tk --' -'
P116 PCIII
INVALID LT N F t,1 kFu-'it~v LTINF DoUF Ib
NO' tll1j.I TRY AGAIN~
Nrh-M0DIFYARLF I i'It. is~i~ RO
SF L Ff-T A kDi *YASIL
EN~D QF PACE C1I'Af1 PQuM'PT LIEJS3 THF LASf LTNF OF
THE L*,IRUILY IOISPLAYFU PAGF /NONjE
96[
- -
Orior to runningj the expari''nt you will Ve given timeto become fa-jllar with the nata entry into thne rorpter by
Of atat 0t,, enere ot _ cotrol fndnotitne Simulatio
nvevie setio. t c ommand Will beutlzdi th
famiiarzaton xce~iewhichi follows.
V 0C r)A A I Y FA AT L T AP17 AT 1 M
3. nislav Snres anagemnent tab-leau: use cori-ana "STORES""MAAGFFNT; t-A 4ISIJVWill t'~en show the first page of
the Stores Manaaement tableau.
4. Advance through the 9 cacies Of the stores manaaementtableau usinai the conmnH "NFXT PAQCE". The last line of each
oa e SYS mor-#indicatina another aoe follows. Thefina Pae ds~as -nd-in it's last line indicating thatno urter age evst.Use the Commarid "iNFXT PAGE" to
return you to the first naoo of the tableau.
9. Retujrn to the index tableau bv usina the command"INjDEX". The -index may be Called uo at any time other thanwhen a line is in the Process of being modified.
6. fl~splay Nay Orefljght tableau: W4ith Index Ci~olayed usethe command *NAV PREFLIGHT". The disolay will show the NayPrefljgih( tableau.
7. Data entry!a. Mav Preflioht displayed
enter time"2 2 0 U O "0""0 "0" "ETIER"
line 1 220000
CL
I 97'
= - -
line 2 ready
ente" date
line 2 09 01 o1 *
line 3 ready
enter latitude" "7n "211 "4f .. ..o" "3 . .'tTH
ine 3 7 2 4 L34
I ine L! reaHy ,
n t ar 1 0o n i t U O ei"I "2 "t" " It "0 " 2 11 4 1# " vNF S T "
line 4 122 n3 2T
lime 5 ready: line h nows "non-modifiable
line" cue. Go to line 11 to enter mode I for
IFF rodeo- -
enter -o-e 1)" f"3" "5" "' IFR"
line 13 3351in- 1I reaov
enter ole 2 i"b" "5 "" "2" "ENIER"
line l0 6SU?line i reaov
enter riode 3"7" -7" "7" "7" "ENTFR"
line 15 7777
line 16 ready: line 16 shows "non-modifiableline" cue. Go to line 17 by using either the
command
"LINE)?", or Th-EYT LINE"line 17 ready 'Ienter bureau number of a/c and snuadron number
"I" "93" "9" "2" "0" "4" "1" "qm "97NTER"
line 17 159?OU 19
line 18 ready
enter call si-"MIKE" "MIKE" "1" "2" "3" "ENTER"
line 18 1Wi23line IQ realy
enter crew ano- event number
"Tau "0" *MIKE" "I" "I" -MTKE"
line -10 10 MIP, atso cue end of cage"
K] R.
I.- - .
CtlvI.Oh1 t n i7lri>h jpnrf:~ EMIDYe a nda re-entercorr-ctly, For axa nr n nje should hive been OC3U vice
Call up line I- -usinn th rommend "LINF 1 L4
Fnter correcti-n
line 15 ready
If the error is detect- orior to the "enter" cormand abacksoace 1unction vav to u ~ed ty usino the command
"BACKSPACE".: Exanol e:
Line 15 is oPina molified. The desired code is 7777 ano
your inouLt is 77o7 a - the command "ENTPH" has not been
uttered isp the command "bpCW6PAC E" to mive hack one space
oer utterance and then irsertinn the correct co4e 77"7" "7"
"ENIFR". Another methno of correctinq the error is to use
the "nELETE LINE" function wnich outs you back to the first
data entry point of tne line beinq modified.
E_.amole:
Lire 1 is oeina nifier- as above and the desired code
is 7777 while your innut was 7767 and the commanI "ENTER"
has not been uttereo. use the command "DELETE LINE' and you
will he returned to the first modifiable space in the Vine.
Re-enter the correct 3ata.
b. Data entry in Stores -anaoement tableau: nith Index
displaved use commanr "STOPER MANAGEMENT".
All entries into the stores inventory are accomplished
hy two utterances. The first utterance is the sonobouv tyce
and it's depth settiro? e.o. "41 DEEP". This is a SSQ41
lofar bouy usina a deep deoth setting. The second uttefance
is the sonobouv channel -u-ber and its duration (how long it
will transmitt before it deactivates)f e.o. "2$ SHORT".
This is a channel 23 with A short life setting. This secondutterance also has an entsr function asociated with it that.
will disolay the entry momentarily in the cueina area and
then enter it into the inventory while simultaneously
displaying the next seauoantial line for modification. .Observe the format of the tableau race. The cueing and
99,°FSii
data en? rv aren i s at rh- bottom o' tr- rn. The f irstnumber disnlnypr from- tho left Is rth lino rti-ber o f the
displayed CaQo. 1"e Sec _ond t wo -utbers in-1irete wh-ere theh1ouy IS ohysically stcre4 nn the aircraft.
The se--ue-c- nf Oat entry is as f0? inw,. '
Peaov for entry La W' YX V XYX ,ENTEP 6qWaIc P51 1e r chqnnel ?3 short lf-n t" sneaK-Inothe Zornmands "Uj Ori(cf '$P3 Lo~qJG" wit- -. %rnrt nausoheteveen :srtrieq.
WMod if i eo line: 3 i'- (fil P e23 S .iI aooear 'n i ne
3 abova and tl IS tUYX Y XY X nn-w apnears the
cueina area.
Enter the foilrwioo houys into the svste-Z L1, deev 10Icino, 41 shn11 04 11 1c ,no, '3 shallow iS IonG, in locations15, 16, andi If resnesrivolv.
CUPRECT IPNS
The sa-e cnrrec-tion nreocedureS a o rIv a~ oeu !f orce. For
examnie: PourV i-cat ion 1I fshoulId he a q5 Oe IS lono vice53 Shalljow ir Lonq. Correct this fly CA 11'flJ on line no. owhich is .nvqere OUV 1ocatioin 17 is held rn this nacie. Usethe com"mand1 "LINE6 line 6 is now -isnlayeo in the cueingarea and is rgaly for moaificetiotn. Enter the correct date,as betore; "5 r "1~5 LnNG"
The 'enrKSPhCF' commandi mar De uJsed her- it 8-, error isdetcte ~n0-~first utterance of teline, i.e. b~ouv type
and1 Peoth. qinc' there .1re 3 characters in the original -utterance, "QACKrhCF" would need to op uttered three timesVto put the cursor in the first ffodi f iab Ie nosition. Thecorrect data cou~d then oe entered. Enter the t-ouvs 01 theattached oo=uv status chart to become familiar with the' entryand correction functions. Another method of correction isthe coinmanA "DELETE LiNEs. 'QFL'ETF LINE' can be used w~enFmodif'ino a line which has not been been entered. As before-it will retu-rn the cur'sor to the first mrodifiable character
o f the line beiflo aodifiea.
KtY6OIAQD Q-AJA ENTRY FAMAILIARZATION4
1. hider Aisplaved
?. Display Stores Management tableau: Stores Msanagevient isline I of the tr.dex. To dispiay. any line of any di-splayed
- age the oterator -Dust enter a-'two diuilt number for- thatline. Procedure: with index di solIay-bd depress "0" "I'
100
A .1
TfO. Stores M.qoso~t~ nnw -isrlayed o- monitor.
A. dv ar-C t h ro uah t- Inc fve -qS ot qt,ras -dna,3ement b-Sy
Usino the 'next nanie kev
4. %turn to fflp T ndepx by 'is inol 1 "LJFN" (terrinetescurrent tahleau entry).
S. isl av av Pr-aflj nhtr Tah1--oau: ntPr t o Qloit linefliamoer fnzr -!PV PreflIi oht, df fl *FT=P
6. 1)lata jn fl-va. Nav Pro-flioht
Enter time? kepyst or ry 2?0000 'E-T7RFntered data ,ill r-&an in Cupinq areauntil is Jearegsed.
1 ine I ?2irviUl ine 2 remAnv
enter date N-"
l ine 2 -'191AjI1ine 3 r e a a
enter latitun-e
Si ne 3 3 7 2 !4 0314line '4 reaAv
e.-ter loncj-,itu-de
line 14 12?-- A3 24A#line 5 reaa-v
Iine 5 NONA -MO&,-TFTARLF: 00 to line 11 Hntrmod4e I
339q "FNIFR" ~line 11 -35l ine 14 reedy
S oenter mode 2-650i2 "ENTER"
li ne 15 ready
enre" mole -31£
line 115 7177
211101 jK= VM
lie If, r at
line I o -o, ,-,1o e ln to ine 17
Since 1? ic- -nIv one line o -- it "ENTEP"
enter hu-eau ,f -,ie r o i rCr -A -n H squadron nuirer15Od -9 -rTQ, -
I ine 17 jrea "- 1lie AP r e aA
enter call SiaVI?23M "E;NIE9"
line jP M12t
line l0 rea-A--
enter cre-!/evertlOMl[iM "Fv-,TE'-line 10 10 Lil1 also "EI) r 0AC-E CUE"
COPPEr ITh-c
Cell uo e. line in wiiich error occu--el and reenter
data.
xpmoi p: ,Aode ? snnuld na.ve been '653' vice '6542'
call un line 14 hy hittino 14 "FTER".
enter correct lata6534 "ENTEO"
line i4 rea'y4
A baCt snace funct;on is alsn available,, if a'. err')r isdetectea orior to- n;tting tne "%YTER" key jurino line
rModification. Each "BACWSPACE" moves the cursor one space
hac as with the "RACKSPACGE" command in the voice mode.
Proceoure: "BACKSPACE" to the error; enter correct data ano r
complete the entry for tha line then "ENTEP W it into the
system.
b. STORES MANAGFT--T ra'a e-try
FntrieS into the Stores manaaement tableau follows the
same rules as the vo~ce entrv with wo differences. 1) V
Each cheracter requires a keyset denression' e.o. Q # min
*DO N2" 07" O H"F NTED" and 2) Fach line must be .-anuslly
entered-by using the enter ko vice the automatic entry of
the voice mode.
Procedure:
,02
n _. ..
fljsplav tre iYnLy -v 'pi.Tr-1zstno ri Sr IIF" dioAy
Stores F0a n anent by eressmnq vl! li~" Fnter h~ours in
bouy iocatinns start in- wlth 1oce4t on 4i & to new t ae
by denressing IJ )Vr-' Iisnac starts with lorati-n3(Hit "i""FodEP" n~' r to~ec' 3 o f StarosL
Manaac,~ent. r. is vo-iq -tarrs. wit), roijy izton S" -ayo
are renay to ent-r -to~ei;z Fnter tno'~i~n oy
lc at~c bo)u v
57 411"
r forrectians rale With the three Petrnds uisra eforentendfl un w hen thp arrir was discove-ro i.e. either
aftr c-petig n etr oraur inoan entry aid or io r3
entering it into the inventor 1 -.
Correct loce-tion S-5- tn- ro~ 47 5 PO S
Prncpeaur P location 5is in line u of current noeI. eoress (1 FTD1ie 9-J rea'Jv
enter 'S25"FgTtR"line 4 U.7 S 1z
Enter the nUOVS on rne attached bo-,uv stA-tuS chart to
rkbecome familiar 1ith the entry -and correct ion fun-ctions. 1
= -
- - -.-- -----------
VF T .. .. ............. ...... ..
L-± 110. 8 i
Tv ................................. . 1
C tAAR5)Th................................ mu[ A ~.......................
.. ..... . ..ai A -r . .;3 j
1 FF C0 nt$l. .. .. .. .. .. .. .. .. .. . .. .~ 1.5
520
-104
-" - -;. 9". .._ , ,".'
wr wr
CA.ca
122 1
4ii j Y
RX
0
SONO TORAG RwC
LI53~~E leI1dc
24 1 6" V 41IIII77 41t- _ r
76g 416 jdr Z4t.1 A
106
awW41msa4a.
ME-
<:7 . -H
"j-
%n'In'
E1 iii o
- - - * * - -. - - --. * vi
O~ %a a
%o:zoit Itll
- I ,. -I - .. 2
it
I
. 1
SONO STORAGE RACK ISTATUS CHART
NO. SSQIoEP1iT1' lio. i L77 41 3 d 4L
7S 41 d S s a 11 l76f 4 9b f01 L]
1 - ,F1
7 1 8 24 . 109 4 1 1 L L1
-. .87 53 8d 107 4L 2s
_. -211" Tl .-S924 106 41 ~ 14 L
3 d f - .'7 I
-as 5110941
108
414 --
-~- - 5 __ __*KNEW-
-. -- -
\'VClT LF Qfg C T1 " 'VArtRLUJt APRY
T . I
h 6
R7 F71/
1 0 L V!rwxxl'lxxxLcc-r>1 'I LcIIrxxjilxxxLccr>
12 1 d L V~jG xxxl?xxxLc-cr>
1 3 1 ) Lr~ (IPxxl3xxxL<cr>I14 1 i Lfl0 fl yxxl'JxyxLccr>15 15 Lr01Nr xxxl~xxxLccr>16 10 1 fi1 : xxxlbxxxLc<cr>
17 117 L0 r',C xxxl7xxxL~cr>16 1c HOLQI xxxl~xxxScr>
20 ?G S t i DT xxx2Oxxx3cr>?I Ij b-HUPI ,xEx2lxxxS~cr>22 1'd 5t4QR xxx2?xxxS<cr>
?4 ?4 $r-HPI xxx23xxxS'cr'
26 1 -FE 4 x 2x x FLcf8 II -txxx5xD cr
31 1 SHALLOW~ S7xxxS
32 1 Nn E Y Tccr>33 MIAY ORFFLIGHT 10<cr >
34 SIPS !MA71uAGFMENT 0 1 c r>35 NOIN Nccr36 WE ST Wccr>37 R~rKqpALF CONTROL H318 ~EY1 LIN Fcr39 EN T ER <cr>ag 0NET PAGE n~c 0>41 LI'VE I O1<cr>
109
r I,
____ - -= - -= -- = - __ ____FN
1)3 . U' .s03<Cr>
'U 4tL "k71<c r>a4L I MEt 5- O$<cr>
9 L i'NE 9 09<Cr>
;vt90 16 1~' 1O<cr->91 L IN5 I 1 1 <C r>
52LI N I :' 2<C l~r>
Lir lb lt-hI6<c r>9z7 L I NE 17 17 <cr >98 L't I E I <Cr
t;9 1IN 1 9<Cr6061 DELETE LTN'F CUNTR:IL V <cr>
DATA FORrMS
S** V 0 1 t. L" P r C 0 "r T T l ' A T A H tt F F T *
.r tJdF.. .. .... DATE ......
-PUN VI/V /1$1/KP/ -1JfRt. t410UF: V/ K FILENAME...........
i
1-- t
*********** .... RT~' ... NAV PRF!h 3..*..*..*~**
- -
111 -
!-p
STOR_ _ MAN - -FtT ....... NAV PREFLIGHT ..*....
N .LIW'E DELETES . . O BACKSPACES .. .. ..
_.CONDUrIED -Y: hOLFE /TAGGART
vn it
...... ........ : .................. ..
.. ...........I* ... .. .. . ... . . . . . . . . . .
. . . . . .. . . .. . . . .. ..
....... 0 ... .. .. .. 0.. ...
. 6 0 0e.6.. 0 .. .:: ....
00 6 6 6 . 6 . . . . .. .e.. . . . . ..
****. VGTCF INPUT FAPLRPT-"l ,13LSi T0J M."AIPE *****
WARFARF SPErIALTY .........................................................
1. Tn general, d o you lik the idea of voice data input?
VERY -'L" NEIUPAL NOT AT ALL
7 4 1*1
1 2. Tr generl, wotld you likIe t- sp voice innut in every Iday tasks vourself, if it were anzIicahi ( i
K1VERY 1 LtIPA NUT Al AtLL
7 6 ?
3. Po you think that voice innut Fad an advantage over thekevspt nDut for the btores ?tanaoe-ent tableau data? If so,
what was it?
VERY vJ-!JLw NtIJTPAL NOT Al ALL
7 6 '4 7 1
... ........................... .....
............................................. ILI. Do ynu think that voice inout ha- an advantage over the
kevset for tne Nav Preflicht tab-leau data? If so, what wasit?VERY I'CH NLUTPAL NOT AT ALL {
75 4 2
~ ***********..** ...... *.....*S.
So Do you think that voice inrut has apolicatioreS in vour
military soecialty? If so, what would they be?
VERY MUCH NEUITRAL NOT AT ALL
7 6 4 2
0 113 {j
RECOGNITION ERROR SUMMARY
t r 0PW T I TU N RPUR SU Mt-By uITiERAw'C
P3 FE OF PEciCENT -F7MCI- FNC EPRP UCIWjPL.1jCFS ' TT -I VUP
lay------------------------- --------------- -------------
7EPo
nNF ti16E IA1 .
THREF O .
FIVETI
SEVEN lT0.
FIGHST TtiPEF- 31.STA .
P.41
I OG12 LON( 0.7.10 LONG; 3 1.!
12 LOlNG
13 LONG 10- LW~ ON 0.4-
17 0;.G 0 .
14 LONM 131.LONG 5 1 .A
L'1
_---l ~H OF PFRCENI OFIJTTLRANC,,F RF -rL -; p-nE CFs TOTAL FRORSI~
--
15 LONG _b LuNG 3 p.a
i[Z tU G0 1 OGAL
1 17 L LOULN G1I, ' I'G 2 0.7 :
JLUNG 0 '.7
11 LONG I3 LUNG 2 n.?i-, A L !t '4.8
18 SHORT r-2~~~ hfI9SNOI 2? StifIR 2 0.11.
20 SHOPr eK tORT 1 0.024 qhORT 0 P.7ci SHO'RT 2
• 0.7
21 SHOPT C SHORT 22t;. SHORt 22 8.
SSO 0.7
22 SHORT 21 SHORTAn ,hOT 1 1.1
23 ShORT 454 16.119 SHORT 4 1.510-
3 SHOPT 20 S-ORT 3 1.12 SHiORT 1O.3
2, SiORT il
24 SHORT 23 SHORT I O _.U21 SHORT 2 0.7
2;? SHORT I n.4 L2S SHORTt* I OA
25 SHORT 2 SHORT I 0.0
SIIHORJ 1 0.4
-I.
i -115
--- -- -- -- - ------- -- --------- - --- -- -- -- -
At=--_
tMU BFNg uV PERCENT OP,,UTTERPAN'CE L-PRPR £sCtfRE %:C rj- .TUTAL EwRURS o.o..
II
m1 4 SHALLO. 5'3 SALLu t. e -
47 VEEP ! DEFP . 0.7
147 SHALLn,
53 VFEP -,53 SHAt Lnn..
T N-EEP LiNF 3 0.11
NAV P~FLIGTSTRS MANAGFmFNT
NORIHWEST
RACKSPACF NEXT LTo- 1 0.-4-OP T H 1 0.0
SNEXT LTNE FIVE 1 0.4
ENTER SIX l O.a
TnHPEE 1 0.0F-fHT I 0.a
6 2.2TM'CX 1 0.0
NEXT PAGELINE 3LINE 2LINE 3LINE;L -1-L 5
SLINE 6|LINE 7
ci-A
-
- -
UTTEPANU -L _
LiNEL.i NL 9LI1NE j'
LINE 11r INE i?
Ii~~~~ LINE13L7Ch
S~ ~ lNE L TPJ 15 20
LINE It £L INt 16LINE ;7L INE I
LINE '
MIKL F T vF r
DELETE LONf
[ mi A~U 8CH 1
F:7
= -
1, M_)- M
k F L~~ t, M I~ TA L & DRlR b i t ) hI
iA. a t -r,r uC , i R-- E F S I T &L ERRO F S
ZE~o 1 0.4 4c 0 . 4a ti=t
0 .zl
TI. I
FU0.4=
FIVE C'Fxr LM
I! i-gi~t ZNFR !0.4
iI 9| LONG " ,g
IZLNGI L*nGr 0.7
16 L~n , p9o7 -
7 0.7
Ti LOON371 * b LI-0 L i T
11-8-" \ *
- I- -- _
o -- ==- - - -11_ . .:
M ict ,.% . . ::, • , :
17
17~ t LN SU
I-4
1XC SHF PE F1TO
22 Li'~
20 01 T.
20 sha~i 220.
21 -SHORT20.
222 SHOR 1 0 Q - u
#3 SHR1 21 3- T
24 CjiM K.1.
41 SHALORT2 :w
47 DEEP47 L0.
V,~
- i
[RR ~ ~ ~ -- --- ----. '- 0 ° -- ----r -------------------------PROR
3 FD
N .1
-° ~AV P RFFl I
-=- -Pt ,N -.-A TLTKLSP
3 PACK3pf. L
_.
NOET L t T f BACeSACEu H :
LNEE 0 F
NEY 1 PAFL T
L I E
L NE 3 c
L- I tP&
LiEi pA ,F
LI td E
L I fat 5
LINE 10,
INe i ILIVE.
L INE 11
LINE L I
SI NE IQ LINE 1
FRPUI U- 1 k ,r UfCI{!k - MCF.5 TnTAL ERRORS
~I INE .
T.- Li3t. 17FLIRFF TO.4LINE 16
LIt.i LF 13 U 0.~4EINE T0MIKE
~DELETE LTNE
* (OPer') T JU I 0.4FOL-'- I V.4 ,
;bIX 1 0.4
SETGHF 1 0."
20 SmnRT U.721 ThnRT 2 0.721 SriORT 0.4 a41 nt:P U 4
NEXT INE I 0.4i -
ENTFi 6 2.2
f J
121
W5
SIUATO LITN
0icld tsaf-h
de in S-9 -v9
:dP i n ZOUI Ir t ' ff1
tSIMULATIONMLISTIN
: deie1AOtMacline 0-14FFlYma ?gal0 -j, /.tGDV"YIPLA
"n /* oi Ouvcc? Ul 'veci) e
Macfin.e LmFVT I-. C14It 1 *
Uorfine FtuS,,1 fl*ka£g tfjnob tlL""tLP'
iacfine PIJrC
Eda f ine !DF~f I r / t j~~Juz t50
Macfine 'IS4PI n~o f"Awne 4Macfine LFI 4t'~ 2n r* CNtrfl of lie*/ on
racf ine Lf,1jt~~y;
Mdefine F LE r.IN PNa-fine IDUF3 1A
Odefin £FNUflO FIMFI I ?AL41
M in e tLraeufivA1 a
M~fn 1FN2 * fubta ie nasl~
Woefin.~ Jamtd~~i j
ELIn FfeujPit 3 f ig ooit dhytel notiodin d-IA~ I i
Itructbaa-Awhrso F,0P 1L~F'1 I
MAI
ift nchr rrnqr,nu: A~ DI -3mi1U)
VALE~ ~ !apn E-41 urd l)# ~4
2rrt(TnY nn2 o D
printf*TE0? V' A t ,j Ln 2 ;" '%i ~ ttW10)rItfeluut 9U0i)
v anf*NnITE1 L1 DU ChrecLr,fl1 r)
2 tet t -; tv?*:1**
putci a viFA?0:140tpnnf~fl~t 'S2 t ~f*~siel.tOCf~~lUajtdtunI-1V
:oot ri tff/w adldipla and L02:2;Ctn Ofu$tit S wQt~f tuflftaleau
0e~tI 2 teonesrnimlie2 h#3lS~i0GL
wr f pusttoro2a IftSONG!~)M moc a Ll);V~leo ZFLE
t*tA a* in;n *1LNF LMSM
eoftotrsrI 1' ~anda 4Inlay nd ahiflctl~f of tunsUA-un tbeu I*- 7abl-- c';>ONOL
-i Q. 74* ~ ~ -J* , I
10v-- r w r _
b=~arr A-wr i t-b ~ .t ,o w i .n~ a 0t a j ,L fS vA )while F-n tor
ftlir~l nel indet!
i t iWf~tONOO-Creoe A.t
else Pr~ : r~j;
wriu i j / tboAe'lS t rb4norn infton ,LhotJA
linehva't a line
nchar A~lt,*0l0et arinvt tchriniou; 11tPOxf
Siteholdcer lnecas 0: I$ s Aa
swswitc (Mce)
case 0:tcs Its /4at w55nE cn-3 t
tweak:k
Cas *t'tcase t'1: f# nex re us I
term a:
-Ca fnu *6*eno to44ln? nmer*
re kS
tS V Aa DAR
l'C ~ 'o' ft1 * I I I. the . a it v #li = In - q [
l1-e A C
*rrl INYVAL~fl LINtE ktIPERI;
Iffraaieeu MAVJ 1* pneeft noflSEOlfirbl#ljnom from O*iftQ sodifie4 0F~~c~eGCS sstirin::cg*cMi. litoet :aie 161
I odl lnetnrs)
bbreak;
return!IFFt Sotb~ckSt ~ &ese just eit#4 prawo' line We
outcbarOEtEII
genutl oi 15Iftfbteta lA)
s OMli fatindll? n alfftU*
suitdrchinJ
ftect k4 I1:ewritebroaot
-aeIndmmlento 16;
imftn 16 42~
135 ~ ;km
jR~~~R 2;j' 5-,- -
-,2-AA' -*, .V-
case 24case tet1c~se Is:eas' 17!
a Innent =- IS;breakS
case 3*vaplnith% Iin
4ent 14
case 4
cas r. ~ ack llcs 1*tc.As. lb*
cult.. c
I /Z lftt1u A: Iy)a
*pod :FAL3O!;
writerPrort)5
irwrt :,.tSes oe o4 " On-ftio * 0 ;M s-
- , *ki~~~Dat tof laie cn ~le
outcuor(b esetl 4cScdoe)
ME m
J-4'
____ 44 4 ~OF ~Za-
Char bbutw*0ut:1In- i;
fI
wn* I t a
L 1I/- for.. A/
r fla~~Chr *qtnut~iriil.ilfOft apr.oess 1-nDUt ,It it 5 aot a S~ekar 'p1 Tina. naal? cane, or linte no. a~h~ t *
START I
.hflli(.n = etcnrll 4Cal 4
42t-cam enarcount 3 t o tee #S#tar-mcina Prior to-
- famine of struc? Of
wis* - -
- Luau. f fiUshiS out C of
tuwtvet- 1Oti -
* *f li-e CFWST~lL~4*14fleufRl
1UI
Ae~euiP
- 0~3 - - CAL
retueto)$ Is to uIput I
I tnetinput *1
Checktiunetl 1 1* flctermine 4f Alert is teantred foe requmgted lin*/*
switchchtsbleeu)
r b~hlhSiNiWA z
es *-age Oz~
IT-Fg = 305 -A-res &s'Fu OF ParA.
I rnv-sftUtWLI LAML IM. *1-breolf.Cas Oltwtclne Ueas 4.C-s- IV*Cs*a)5
Iftwoul
e*'p O.Cm %Cs 12ae usIq-as,2.128 q& FDOFP I
rtm1Q
Cole 1%IWFA:swittn june11
cocaal 0*cq P~ae1
line 16;brpaok)
default:iftline '191 k
line : 7; .
& defaulft
r * I. isln £witchjtnhleav) S/
urlioraDej I e~-ilta Alert if reftef'as1, 'lear it if it IS no lonaecF ruzui-el. up %k. to% tin.k if neither of thewi. a/.~
Case HLh~
lStimetut t:
cittepo #1al 1,00; 4 Inirigiz r n to dasf~e ta!bsfutin sma
11 X @.BLAF-Litf"uMAT file
I' MEl.~
printfR IMIZL1 WE
fpt cnL on~-a~129
1.3 Ufaae(~refiiih, r)trio ~ c Prare~71ps
*c lo'te fpa) .*/
~uv yst4. to buffrf inaut made 4/
odh~iI f aji~, 16 n&Out tew b~t IV
Lx a~o~4) 16/ -e? 'r'-t~ o 4*9- Inrjt wode 0/
ot t I
in! varrgt;
:::2: Ol ?t. awc$-LAtk1 aq :#*) to UAI4PtA4. as 14"e oc a
An *1law 4 ltisty ot Sfll "a "AV teblnn" atin* -,rucLl
IsW WnmIrI
I - *'llie :fin
z j~NNWr(~sttn~
'L
tt Atntipl) 01 /A inNi,? is ialig lineal
can If
ISP break;
defaultfbrpekI
Yas ari-cwit, .'m.N.y terifetS t)a 5/a Ina-*IPJEI
oedefault
DfitfI' I~to; L t~h)
whltw I'em Ias)'[ reitfl: ta4;~sI~ al ofifct in f '4aV 4MPI4Tte5auDfm 4# via-a mrieup v nd vel* th1
Ye?.ifife I.
COrrfrselbls14
Ie~wg-gtaat wasc
wtn41tfic~aavaieq9 13 /4a"9 le4f1r aibe *nhler~l Tsr.) I
tt t.
IUS
miq~cs ~n 4c~ S~a 7 .
inden I i
in-fo.-t Isi.nen Vet no ti-
~t~=Mr
Ft
r nI
.Final Ta6tk Reprr, 'v.,1 IAi r Uovosl oment Center c*,nt ruc~t
number Mb72A9-7P-P!-17O, Critif!A Insules in Airborne
Aonnilctlons of Spe-ech PCoqminn, Wayne A. Lea. (no
Maote given)
P. Fjnil Report, (romtract NqOuOh'J-77-C-O'JUI, Uffice of Navni
Resemr'ch Taske ?i1-IbA, Tnterrtpd Apn1iCntlons _of
Automateri Speech Technolor~v Final Peaort,, R.L.Feuge and
C..rer 114 Fehroary 19-7g.
3. Mcrormiclep' E. J., Human FpACtors in Fnomineprina and
4. Final Per'ort, nffice of Naval Peset~reh Contract Number
NOOO1'4-77-C-0570, Review of 'the ARPA SUJR Project and
Survey-of urntTerrnolopy in -Speech Unrderstandina,
Lee, W. A., qr Shoun, J. F., January 1979.
5. '.ea, W. A., Trend~s in Speech Recoanition, Prentice i1~ll,
1 9PIO .
6. Threshold Technoloay Inc., rhroshold 600 Uqer s Mfnua1
June 197A.
7. Oefensp Advancod Risearch Aa ny R-l3Rb-APPA, The Use
of Speech for Man Computer CommunicAtion, R . lurn,
Jlanuary 1974. AID 71706e.
A. Rome Air Daevelopment Center, RAO)C-.R-77-30b, AutomaticP~ate -Entry Analyin, Threshold Technology Inc.,
September 197i.
9. Fedrml Aviation Administratimn Report Number, FAA-NA-
79-20, Contract Number ?lQ-151-100, Voice Data-Entrv in
Air Traffic Control, D. W. ronnollvy, July 11979.-
10. Navel Postqraduate 3chool Report NPS53-80-0Ib,
Fxcerlmerits With Voice Tnout for Command And Control;
*Usling Voice Input to Opernt *Distributed ComputerNtwor-k-, G. K. Poock, April 1.9F;..
I1I Naval Postgraduate School ' Repor't NPS'-dI800
Fl fects Certain Background Noises on the Performancesof,
a Voice Recognition 5Systemv, R., S.. Elster, Spembe r
19I800
Best AvalbeCp
INITIAL DISTRYBUTTON LIST
Na. Copies
1.Defen 'se Technicel Inf'Ormation Center 2Carderon Stat ionAlexandria, VirGinia 22314
2. Library,p Code 0142 2Naval Postgraduate SchoolMonterey, California 93940
3. Library, Code 55 1Navel Postgraduate SchoolMonterey, Callformia 9390
4. Office of Research Administration ICode 01?ANavel Postgraduate SchoolMonterey, California 93940
S. N avel Postgraduate SchoolMonterey, California 9390ATTN: J. Arirna, Code 54AA I
R. ElIstor# Code 5*4EA 1W. Moroney, Code 55MP ID. Neilp Code 55NI 2G. Poock, Codle 5SPX 20G. Rahe, Code 52RA 1
6. Thomas Brendgord IAmerican Sterilizer Company2424 West,23rd StreetErie, Pennsylvania 161S2
7. Donald Le Parks1Crew Systems Technology.Boing Commercial Airplane CompanyP. 0.0 Box 3707MS 07-08Seattle, Washington 98124
8,0 Diple-Inge-Hartmut, Mutochler coviWisseancheft'Le MltaeboitirFraunho?*eq'!nstftUte- fUp"In jo tmat Ion-und1,
Rintemr"' 'trobe, 19D-7SOQ girllsruhe IGerMany
*134
9. J. Mike ByrdGeneral Dynamics
Mail Zone 8227-1P. 0. Box 85106San Diepo, California 92138
10. Robert L. StarkeyNuclear Power Generation DivisionBabcox and WilcoxP. 0. Box 1260Lvnchburg, Virginia 24505
11. Berry Drake IHuman FactorsITTGreet Eastern HouseEdinburgh WayHarlow EssexEngland
12. Kenneth C. Bite ITexas InstumentsP. 0. Box 2909
MS 2201Austin, Texas 78769
13. Walt GoedeConsultant31051 Hawksmoor DriveRancho Palos Verdes, California 90274
14. H. Rudy RamseyITT1000 Oronoque LaneStratford, Connecticut 06497
15. Ivan BelyeaLear Sieglerp Inc,,4141 Eastern Avenue S. E.
Grand Rapids, Miehigan 40508
16. Co E. (Ned) WilkinsMTSetManmMa~hine InterfaceSystem Dsitgn DepartmentTRWOne 8 pece Pork
Reo•o e rClt-i 92078 FIN :-
---- .- " " -U
--
~zoi- -9k
II
17. Matthew F. CarrolllRwSystems Analysis Department A
MS 75-1900One Space Park -
Redondo Beach, Califoenia 42078
18. R. H. CochraneEng Mgr - Human FactorsAT&T Long Lires IRoom 4C154i~Redminstea, New Jersey 07921
19. Roger L. Kuhn 1Director - ErgonomicsHealth ServicesIndustpial Relations StaffVGenera) Motors Corporation3044 West Grand Boulevard =
IJDetroit, Michigan 84202
20. Jeffrey E. Miller oNorthfop CorporationElectronics Division23CI West 120th Street
Hawthorne, California 9?050
21. Michael L. SchneiderSperry UnivacComputer Scientist
P. 0. Box 500Blue Bell, Pennsylvania 19424
22. Richard N. ArmstrongU. S. Army Human Eng LabSax 476Ft. Rucker# Alabama 3636?
23. Gayle L, Berry 1Industrial and Systemt EngOhio State University
Olt1 Nell AvenueColumbus, Ohio 43210
24. David J, Chron IIndustrial EnOneeringuoivei'sfty of Nebraska - LincolnLincoim Nebecaska 6658i
1_6+
t - P
25. Chris HoleSRL - Human Factors Eng.
2800 Indian Ripple RoadP yton, Ohio 454410
2b. Aaron Marcus 1Como Sci and Apol Math DeptLawrence Berkeley LabUniv of CaliforniaBlde 50B Rm 2238Berkeley, California 94720
27. Larry C. LambHarris Coro
MS 22/2-419P.O.. Box 37Melbourne, r!oride 32901
28. Rodney EldenMomt Consultant
=5 Middle RoadBronxville, Naw York 10708
29. Ing. L. Van Breda 1Defence and Civil Inst.
of Environ. MedicineP. 0. Box 2000 Ws1133 Sheppard Avenue WestDownview, OntarioCanals M3M 39V 30. Carl RosengrantICode 8141NO$C-San Diego, California 9215
31. Pency woo1~~R 84-17
Merck and Company
sou 2000Rahwey, New Jersey 07065=V
-2. fet wiener C o a 3i2333NSAMoffett Field, California 9403S 9ii
13 -WE 1i7v4 4 5 -'10zfl
I
Ii
' 33* Anthony BessaeinCode 3522
~~NUSC-|CNewoot, Rhode Tsland 02840 Of0oNeooo.t,
34. Bruno Beck 1ARADC/IRAA
S Griffiss AFBRmep New York 13441
35. John F. BoehmDIRNSA ATTN: P542F!2 Meade, Maryland 20755
36. R. Breauxr4 Code N-711
NAVTRAEOUTPCEN4 Orlando, Florida 32813
k3
37. CDR Peul Chateler =U' U0US RZE
Re Roo 3D129
Wasiteon , D. C 20301
1 36. ClA- otr =Mail Step 2390?
r NASAMoffett Feid, talifurnia 94103S
34. Diane Davis If--
I Coce $Co5 %'%oort, Rhode raland 02840
40. Edward De Gregerio I
Code 3Sa2Newoort, Rhode Island 02840
41. Tice Os Young.I-U.S. Army Engineer Tooograpic I1- Lob Research. Instftute I
Ft. Selvoirs Virginia 22060
42. Joe Dickenson 1*U. S.Army Ap6l-ed T*ch Lab
-Ft. Etstiia Virginia 21662
* r
__ t i 4 q _
-r3 - .~- ~ - $ 4 X
43. HArold C. Glass
U. S. Postal Lab11711 Perklawn Dr.Rockv4llet Maryland 29852
*4. Henry HeiffCode 45q
UNRArlin3ton, Virginia 22217
45. LCDR Steve HarIs6021
~NAD(- Wa:minster, Pennsylvania 189714
'b6. warren G. Lewis~NOSe
Code 8231San Diego, California 1215?
07. John T. Mastersonr U. S. Postal Lab
Rockville, Maryland P0852
08. Don McKechniet AFAMRL
WPioht Patterson AFOOhio 45433
49. Thomas J. MooreAFAMRL/iBAWrioht Patterson IFSOhio 45433I 't
'2. CAPT Vince MortimerAFAMRLIB8Mi P~Wight Patterson AF8 <.Ohio 4531
51. IJames HoskoAcoustical -Sciences DivBE1
Pensacola? Florida 3250852, CArT Leslie_ Ko, Scofield
U S. Army Signal Ctr.IFort Gordonr Georia 3090S
i-139
53. C. Skriver6021
NADCWarminster? Pennsylvania i8974
54 S. 4is StraatveitNUSCCode 317New London, Connecticut 06320
55. Leahmond TyreFLTMATSUPPOFFICECode Q333Mechanicsburg# Pennsylvania 1705S5
_56. Eric WerkowitrF- AFFDL/FGR
Wright Patterson AFBF Ohio 4S433
57. T. Weiner Code 4043
NADFCNerminster, Pennsylvania I8974
58. LT Jeff WoodardI RADC/JRAA
I Griffiss AFORome, New York 13441
59. COR Chuck Hutchinsi
|- NAVAIPS-YSCOM i
AIR-34O-F
Jefferson Davis HighwayArlinoton, Virginia 20360
60. Major W 11iam Mac~arrie OfficArmy Communicative Tech* Ofiiee
Box 4337Ft. Eustisr Viroinia ?3604I 61. Charles WayneRS4NS AFt. Meade, Maryland 2075S
A2. Lockwood AnndAvionics R&I-DAVAA-EPort Monmouth, Mew Jersey 07703
140 I-1 0 B
03. j. N. McConnellARI
(PERI-OU)5001 Eisenhower AvenueAlexandria, Virginia 22313
64. Richard McKinleyAFAMRL B6A
Wrioht Patterson AFBOhio 45433
65. George Doddington 1Texas instrumentsBox 225936MX 37!Dallas, Texas 75243
66. N. Rex DixonIBM Research CtrBox 218Yorktown Heights, New York 10598
67. Victor Zue I
MITCambridge, Massachusetts 02139
68. Jared Woif
50 Moulton StreetCaembridge, Massachusetts 02139
69. Norm Warner -
Code 6021Warminster# Pennsylvania 18974
70. Robert LyncharE-Tech316S McCrory PlaceOrlando, Florida 32803
71. CUR James Goodson ;NAMRLhASPensacola, Florida 32508
72. H, E. Brown -Aremment Div/XRC
Egiin AF, Florida 32S42
_1___
73. Carl WilliamsAcoustical SciencesNAMRL
Pensacola, Florida 32508
74* Andrew Cruce
Systems Eng Test Directorate57030
Patuxent River, Maryland 70470l
75. Thomas Cullen I
1201 F. St., NwWashington, 0. C. 20220
76. Klaus Brosius =
E. St..NWashington, D. C. 20224
77. Arnold Craft iUSPS R&O Labs1I11 Parklawn CriveROcievilp Maryland 20742
76. Irv AlderAan I
ARIS001 fisenhower AveiueAlexandria# Virginia 22333
79. John Phillios I
Code 7232
San Dieao, Colifornia 92152
W0 ayne LeeB89 Sanford CourtSante Barbara. Caliornia 93111
8 ran Deeklmn
Code 330MAVFLEX_2S11 Jefferson Davis HighwayAruinatent Virginia 20380
= r=142a
A2. Bruno WitteCode 8302NoseSan Diego, California 9215?
8-I3~ wiis. DeikeCode 8302Nose
Sen !:~; cifornia925
84. LCDR J. DietzlerARPAsYPTO1400 Wilson Blvd-Arlinaton, Virginia 22209
85. Richard Pew -
88N
50 Moultonl St.Cambridge, Massachusetts 20138
1- 86. Merlin Thomas1
1. E. Dept.i13 Electrical Eno. Bldgj IUniversity of Mi ssou r i-ColIusbieaColumbia, Missoiri1 64211
87. Me. Tolcott1QNR
Code 455= 00 North Quincy_ Street
Arlinoton, Virginia 22217
AS. B.elc3 QNR
Code 455S
800 North Quincy Streetz
Ari1tn Virginia 22217 >
S oulton-StreetA-CamriderMassachusetts 02138
p information Sciences Inst.4676 Admiralty Way- ---
Man Del Rev, California 908911 :113
01. R. KolbNOSCCode Cd6San Dieco Cal ifornia 9215?
LIeCPACFLT, Code 64Box 6
Pearl Hebort Hawaii 96860
93* Danici SaoalowiCZSRIAT Center
33 Pavenswood AvenueMenlo Park, California 94025
ca. Russ Hammond
1911 North Fort Hver Drive
Suite 1200Arlinoton, Virginia 22209
G5. Stu ParsonsIIQ7O Via Escuela DriveSaratoga, California 95070
'5. Don ChaffinIndustrial Eng. Dept.UniverSitv of Michic"nAnn Arbor, Michigan 38104
07. wait Hancockindustrial Eno. Dept.University of FichiganAnn Arbo-# Michigan 08104
98. Dennis McCall i
NOSC i-Code 8242San Diego, California 9215
99. Marvin DenicoffONR
Code 437SOON. Quiney StreetArlington, Virginia 22217
4I'
144
--:) ; i. ' ° ° -oO
100. John SchilINOSCCode 8i23San Diego, California 92152
101. H. MoroanWharton SchoolUniversity of PennsylvaniaRoom W-83
Dietrich HallPhiladelchia, Pennsylvania 19*04
102. Oan c'wtzerNAVELEI)
PME to2511 Jefferson Davis Highway
Washinoton, 0. C. 20360
103. R. Kahn
ARPA-IPTO1400 Wilson Blvd.Arlingtri, Virqinia 22209
104. Tom Martin?TTT'
1829 Underwood Blvd.Delpan, New Jersey 08075
105. Craig FieldsARPA-CTO1400 Wilson Blvd.Arlington, Virainia 22209
106. A. L. Slafkosky
Scientific AdvisorCommandant of the MarinesCode R- R1Washinqton, 0. C. 20380
107. Jesse OrlanskyInst. for Oefense Anelysis400 'ay-Navy DriveArlington, Virginia 22202
105. Glen AllgalerCode 8242NOStSan Diego California 92152
145
, )(
h39. Dan Poami iIerAV#MPL/HEPWright PattersonAFB
7Z I
2511 Jefferson Davis HighwayArlinoton, Viroinia 20360
111. J. machado'code 310NA VAtE2511 Jefferson Da3vis HighwayArlington, Vircinia t!0360
112. CAPT J. W. Armstrong6485 Sugar Creek AayOrleans, OntarioCan-ada Kit IYI
113. LICL J. A. Wallinoton,SWIM OAS ENG. 4Department oA National Defence101 Colonel by DriveOttawag OntarioCanada KIA OK2
114. R. Vonusa
GrIffiss AR;Rome. New York 13441
US5. AI- --CU ark H. Smith
9500 Braddock RD.Fairfax, Viroinie 2203
13.Chria Harlot
515 Tecbnpology OtwasreCambDrifter Masachusetts 13
II?. Pat-l Thordarsion
DEC146 "amr StreetHL3-2E41Maynard, MassachusettsOi3
II i46
112. joh-n Gould
TIhornas J. Wet-son Research Ce-ttarRox?1Yorktown Maiohts, NRet Vort 09
119. Leon Ler-man -4
nldq. A10
Lockheed M 'SWe afd Spate
Sunnyvalar Cal f -r i1a 94 oeb6
120. "-aro t a- PriceR1intachnologv. Ilac.3 02?" Rosemi-rv LaneFalls Church, Vir-'inia 22042
121. maj'oe Warrent Watkins1 SRADO?2Vandenbeo AreCalifornia 93437
12?. OIi n Caomobe--1WICAT1160 Scut h State Street
Suite %01Drem#"tb855
123. Georroe Harr-isTRI! Field OfficeCCPACFL Staff
*/ ('W-34Pearl "&-arr Marali Qb'06
1243. Letw Hann
Wrig't Patterson Afl
SOn Io, 415433le
It2- RobletL.ShLewineso m -assacnse-ts -0?73
VPTI-it- akGoe rv
Sfl ~ir aetu
Pn runo, Cal*Ifornia 44066
IZ.LCDRCLf--Ies Wolf:e 21So 3 Camsnenil1e way
ra ig#Cifri 21