1999 - evaluating the use of efa in psychological research
TRANSCRIPT
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 1/28
P s y c h o l o g i c a l M e t h o d s1 9 9 9 , V o l . 4 . N o . 3.272-299
C o p y r i g h t 1999 by (h e A m e r i c a n P s y c h o l o g i c a l A s s o c i a t i o n , I n c .1082-989X/99/S3.00
Evaluat ing the Use of Explora to ry Factor An a ly s i s in
Psycholog ica l Research
Leandre R . FabrigarQ u e e n ' s U n i v e r s i t y
Du ane T. WegenerPurdue U n i v e r s i t y
Rober t C . M a c C a l l u mOhio S ta te Un ive rs i ty
Erin J. StrahanQueen's U n i v e r s i t y
Despi t e th e widespread use of e x p l o r a t o r y f a c t o r an a l y s i s in p s y ch o l o g i c a l r e s e a r ch ,
re searchers of ten ma ke ques t ion ab le dec i s ion s when con duct ing these ana lyses .
This ar t i c le rev iews the major des ign an d ana ly t i ca l dec i s ions th a t m us t be made
w h e n co ndu ct in g a fac to r an a lys i s and note s tha t each of these dec i s ions h as
imp or t an t consequences fo r t he ob ta ined re su l t s . Reco m m endat io ns tha t have been
m ad e i n t h e m e t h o d o l o g i c a l l i t e r a t u r e a r e d i s cus s e d . A n a l y s e s o f 3 e x i s t i n g e m -
p i r i c a l data sets a re used to i l lu s t ra te h o w q u e s t i o n ab l e d e c i s i o n s in c o n d u c t i n g
f ac to r analyses can y ie ld p rob lemat ic re su l t s . The a r t i c le p re sen t s a su rvey of 2
p r o m i n e n t j o u r n a l s t h a t s u g g e s ts t h a t r e s e a rch e r s r o u t i n e l y co n d u c t an a l y s e s u s i n g
such ques t iona b le me thods . The im pl i c a t ion s of these p rac t i ce s fo r psych olog ica l
re search a re di s cus sed, and the reasons fo r cu r ren t p rac t i ce s a re rev iewed .
Since its initial development nearly a century ago
(Spearman, 1904, 1927), exploratory factor analysis
( E F A ) has been one of the most widely used statistical
procedures in psychological research. Despite t h i s
long history and wide application, the use of factor
analysis in psychological research has often been
criticized. Some critics have raised concerns aboutfundamental limitations of factor analysis for contrib-
u t i n g to theory development (e.g., Gould, 1981; Hills,
1977; Overall, 1964). For instance, Armstrong (1967),
in an article entitled "Derivation of theory by means
of factor analysis or Tom Swift and his electric factor
analysis machine," argued that factor analysis had
l i m i t e d u t i l i t y for aiding in the development of theory,
because it could not be relied on to provide meaning-
fu l insights into data.1
He attempted to demonstrate
this point by creating ar t i f i c i a l data with a known
structure and then ostensibly showing that EFA failedto accurately represent the structure.
2Other critics
have not challenged the fundamental u t i l i t y of EFA
but have instead criticized the manner in which it is
Leandre R . Fab r igar a n d E r i n J. S t r ah an , D e pa r t m e n t o f
P s y c h o l o g y , Queen's U n i v e r s i t y , K i n g s t o n , O n t a r i o ,
C an ad a ; D u an e T . W e g e n e r , D e pa r t m e n t o f P s y ch o l o g y ,
P u r d u e U n i v e r s i t y ; R o b e r t C . M ac C a l l u m , D e pa r t m e n t o f
P s y ch o l o g y , O h i o S ta t e U n i v e r s i t y .
Er in J . St r ah an i s n o w a t D e pa r t m e n t o f P s y ch o l o g y , U n i -
ver s i t y o f W a t e r lo o , W a t e r l o o , O n t a r i o , C an ad a .
Thi s re search w a s suppor ted b y a g r an t f r o m th e SocialS c i en ce s an d H u m an i t i e s R es e a r ch C o u n c i l o f C an ad a an d
G r a n t P O 1- M H / D A 5 6 826 from th e Nat ional In s t i tu te s o f
Hea l t h . W e t h an k S t eph e n G . W e s t f o r h is co m m e n t s o n an
ea r l i e r v e r s i o n o f t h i s a r t i c l e .
C o r r e s p o n d e n c e c o n c e r n i n g th e ar t i c le shou ld b e ad -
dressed to L e an d r e R . Fab r igar , Depar tmen t o f P s y c h o l o g y ,
Q u e e n ' s U n i v e r s i t y , K i n g s t o n , O n t a r i o , K 7 L 3N6, Canada .
E l e c t r o n i c m a i l m a y b e sen t to f a b r i g a r @ p s y c . q u e e n s u . c a .
1The n a m e Tom Swif t re fe r s to a ch a r ac t e r in a p o p u l a r
series o f juven i le s c ience f i c t ion nove l s pub l i shed i n t he
1960s. In e ach n o v e l , To m Swi f t m a k e s use o f fu tu r i s t i c
d e v ice s w i t h n e a r - m i r a cu l o u s po w e rs . A r m s t r o n g ' s r e fe r -
ence to th i s charac te r in the t i t l e of h i s a r t i c le h ig h l ig h ted
w h a t h e r e g a rd e d as the na ive be l ie f by re searche rs in fun-
d a m e n t a l ut i l i t y o f EFA.2
It is i m p o r t a n t to n o t e t h a t A r m s t r o n g ( 196 7 ) w as n o t
th e f i rs t pe rson to examine the e f fec t ivenes s of EFA proce-
dures u s ing data se t s w i th a k n o w n u n d e r l y i n g s t r u c t u r e
(e.g., se e T h u r s t o n e , 1947 ; C a t t e l l & D i c k m a n , 1962; Cat te l l
& S u l l i v a n , 1962; C at te l l & Jaspers , 1967). Inte res t ing ly , in
these o the r c a s e s , th e au thors concluded tha t appropr i a te
E FA procedures were reasonab ly e f fec t ive in r e v e a l i n g th e
k n o w n u n d e r l y i n g s t r u c t u r e of t he data.
27 2
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 2/28
USE O F F AC T O R A N A L Y S I S 27 3
somet imes appl ied (e .g . , C o m r e y , 1978; Ford, Mac-
C a l l u m , & Tail , 1986; Gor such, 1983; Mc Ne m ar,
1951 ; Skinner , 1980). In th is a r t ic le , w e p r i m a r i l y
address th e latter issue. That is , we explore the m a n -
ne r in which f a c to r ana ly s i s is a p p l i e d in p s y c h o l o g i -
ca l re sea rch and eva lua te t he soundness o f cur ren t
p ra c t i c e s . Howev er , we con tend tha t t hese two i s sues
a r e i n t e r t w i n e d . Th e u t i l i t y o f f a c t o r a n a l y s i s fo r
t heo ry deve lopment is d e p e n d e n t on t he m a n n e r in
which i t i s imp lemented ( see Ca t t e l l , 1978; Comrey ,
1978). Furthermore , we suggest tha t some c r i t ics who
h a v e q u e s t i o n e d th e f u n d a m e n t a l v a l u e o f f a c to r
a n a l y s i s h a v e n o t been suf f ic ien t ly sens i t ive to th is
r e l a t i o n s h i p .
We beg in our d i scuss ion by rev iew ing some o f the
m a j o r methodo log ic a l dec i s ions t ha t re sea rche rs mus t
make when conduc t ing a f a c to r ana ly s i s . Next , we
i l lus t r a te w i t h pub l i she d da t a se ts h o w poor choices
when m akin g these dec i s ions c an sub s t an t i a l l y d i s to r tth e r e su l t s . W e then turn o ur a t t en t ion to the e x t e n t to
w h i c h c u r r e n t use of f a c to r an a ly s i s re f l ec ts sound
p r a c t i c e - . W e c o n c l u d e w i t h d i s c u s s i o n s of the i m p l i -
c a t ions o f cur ren t f a c to r an a ly t i c p ra c t ic e s fo r p s y c h o -
log ical theory and reasons for the p reva lence of cer-
ta in p r a c t i c e s .
Methodo log ic a l I s sues i n the Im p lem en ta t ion o fFactor A n a l y s i s
Perhaps m o r e t h an any o the r commonly used s t a -
t i s t ical method , EFA requi re s a re sea rche r t o make an u m b e r o f imp o r t an t dec i s ions wi th re spec t t o how t he
a n a l y s i s is performed (see Finch & West . 1997) . Spe-
c i f i c a l l y , t he re are a t least five m a j o r m e t h o d o l o g i ca l
issues th a t a re sea rche r should cons ide r when con-
duct ing a fac tor ana lysis . Fi rst , he or she must dec ide
w h a t v a r i a b l e s to i n c l u d e in the s t u d y and t he size a n d
na ture of the samp le o n w h i c h th e s t u d y wil l be based .
Second, a researcher must determine i f EFA is the
mos t a pp rop r i a t e fo rm o f a n a l y s i s g i v e n th e goa l s o f
th e re sea rch p ro jec t . Th i rd , a ssuming tha t EFA i s ap-
p rop r i a t e , a spec i f i c p rocedure to fi t the m o d e l to the
data mu st be se lec ted. Four th , the researcher m ustdecide ho w m a n y factors should be inc luded in the
m o d e l . F i n a l l y , it is u s u a l l y necessa ry for a researcher
to selec t a method fo r r o t a t i n g th e i n i t i a l f a c to r ana -
l y t i c so lu t ion to a f ina l so lu t ion t ha t can be m o r e
readi ly interpreted. Each of these dec isions can have
i m p o r t a n t consequences fo r t he re su l t s ob t a ined ( see
A r m s t r o n g & Soelberg , 1968; Cat te l l , 1978; Comrey,
1978; Ford et al . , 1986; MacCal lum, 1983; MacCal-
l u m , Widaman , Zhang , & Hong , 1999 ; Ve l i c e r &
Fava, 1998; Weiss, 1976). To the extent tha t a re-
searcher makes p o o r dec i s ions , th e a n a l y s i s is m o r e
likely to p rovide mis lead ing results . H o w ev e r , re-
searchers of ten appear to be unaware of the issues
i n v o l v e d in these dec i s ions .
Decisions in Conducting an EFA
Study design. As with any sta t i s t ica l p rocedure ,
th e ut i l i ty of the resul ts obta ined in EFA is in la rge
pa r t de te rmined by the soundness of the design of the
s tudy f r o m w h i c h th e data a re col lec ted. With in th e
context of EFA, one design issue tha t i s espec ia l ly
i m p o r t a n t is wha t mea sured va r i ab le s to i n c l u d e in the
study (Cat te l l , 1978). If a re sea rche r i nadequa te ly
samp les mea sured va r i ab le s f rom th e d o m a i n of i n -
terest , he or she may fail t o uncove r impo r t an t com-
m o n f a c to r s . Conve rse ly , if measured va r i ab le s i r re l -
evan t to the d o m a i n o f i n t e re s t a re i nc luded , t hen
spur ious common f a c to r s m igh t emerge o r t rue com-
m on fac tors m igh t be obscur ed. Therefore , research-
er s should c a re fu l ly de f ine t he i r doma in o f i n t e re s t
an d spec i fy sound gu ide l i nes for the selec t ion o f mea-
sured variables.
Resea rch sugges t s t ha t EFA p rocedures p rov ide
more a c cura te re su l t s when each com mo n f a c to r is
rep re sen ted by m u l t i p l e m e a s u r e d v a r i a b l es i n t he
a n a l y s i s ( i .e . , when common f a c to r s a re "overdeter-
m i n e d " ; M a c C a l l u m e t a l . , 1999; see also Velicer &
Fava , 1998) . Methodo log i s t s have recommended tha t
at least three to five measured va r i ab le s rep re sen t ingeach common f a c to r be i n c l u d e d in a s t u d y ( M a c C a l -
lu m et al . , 1999; Velicer & Fava , 1998). Thus, when
d e s i g n i n g studies fo r w h i c h EFA i s l i ke ly to be used ,
a re sea rche r should cons ide r t he na tu re and num ber o f
common f a c to r s he o r she expec t s m igh t em e r g e . Th e
to t a l number o f measured va r i ab le s inc luded shou ld
be at least 3 to 5 t imes th e n u m b e r o f expected com-
m o n fac tors , and t he se lec ted va r i ab le s sho uld i nc lude
m u l t i p l e va r i ab le s l ike ly to be i n f luenced by each o f
th e c o m m o n f a c t o r s . A l t e r n a t i v e l y , in cases in w h i c h
there is l i t t le or no basis to an t i c i pa te th e n u m b e r a n d
na tu re of com m on f a c to r s , a resea rcher should a t t em p tto delineate as comprehens ive ly as possible the p o p u-
la t ion o f measured va r i ab le s for the d o m a i n o f inter-
est . He or she should then i nc lude in the s tudy a
sample of these measured variables tha t i s as la rge as
feas ib le (see Cattell , 1978).
Sound selec t ion o f measured variables a lso requires
cons ide ra t ion o f p sychomet r i c p rope r t i e s o f m e a s u r e s .
When EFA i s conduc ted on measured va r i ab le s wi th
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 3/28
274 FABRIGAR, WEGENER, MAcCALLUM, AND STRAHAN
low communali t ies ( i .e . , var iables for which the com-
m on factors exp la in l i t tle var iance) , substant ia l d is tor-
tion in results can occur (MacCallum et al., 1999;
Vel ice r & Fava, 1998). There are a n u m b e r of reasons
why communa l i t i es fo r measu red va r i ab les m igh t be
low. One obvious reason is low rel iabi l i ty . As ex -pla ined la ter , var iance due to random er ror cannot , by
def ini t ion, be expla ined by common factors . Because
of this , var iables with low rel iabi l i ty wil l have low
com m una l i ti es an d thus shou ld be avo ided . A second
reason why a va r i ab le m igh t have a low com m una l i ty
is that the var iable is unrela ted to the domain of in-
teres t and thus shares l i t t le in common with other
measured variables in that domain . Therefore, to the
ex ten t such in fo rma t ion i s ava i l ab le , a r esea r cher
should cons ider the val id i ty (e.g., face val id i ty , con-
vergent val id i ty ) of m easured var iables wh en select-
in g i t ems to i n c lude in the ana lys i s .
A second impor tant des ign decis ion is the select ionof the sample. A researcher must determine how large
the sample should be and how that sample will be
selected from the populat ion of in teres t . Methodolo-
gis ts have proposed a h o s t o f rough gu ide l ines fo r
es t imat ing an adequate sample s ize for an EFA. Most
of these guidel ines invo lve determining samp le s ize
based on the number of measured var iables included
in the ana lys i s—with m ore m easu red va r iab les r equ ir -
in g la rger sample s izes . Sometimes such guidel ines
a l so sp ec i fy a m in im um necessa ry s ample s ize r ega rd-
less of the number of measured var iables .
Unfo r tuna te ly , there are ser ious drawbacks to suchguidelines. One problem is that these recommenda-
t ion s va ry d r am a t ica l ly . Fo r ins tance, Gorsuch (1983)
sugges ted a r a t io o f 5 pa r t i c ipan t s pe r m easu red va r i-
able and tha t th e sample s ize never be less than 100.
In contrast, N u n n a l l y (1978) and E v e r i t t (1975)
prop osed ra t ios of 10 to 1. More im por tan t , recent
research has suggested that such guidel ines are not
sufficiently sens i t ive to a var iety of impor tan t cha r -
ac te r i s t i c s o f the da ta (M acC a l lum e t a l . , 1999;
Velicer & Fava, 1998). The p r im ary l im i ta t ion of such
guidel ines is that adequate sample s ize is not a func -
tion of the n u m b e r of measured variables per se but is
ins tead inf luen ced by the extent to whic h factors areoverdete rm ined and the leve l o f the com m una l i t ies o f
the measu red va r iab les . W hen each com m on fac to r is
overdetermined (i.e., at least three or four measured
va r iab les r ep resen t each com m on fac to r ) and the com-
muna l i t i e s are high ( i .e . , an average of .70 or higher) ,
accurate es t imates of popu la t ion pa r ameter s can be
obtained with samples a s sma l l a s 100 ( M a c C a l lu m e t
al. , 1999). However , under more moderate condit ions
a sample s ize of at leas t 20 0 m i g h t be needed; when
these conditions are poor it is possible that samples as
la rge as 400 to 800 m i g h t not be sufficient .
It is wor th not ing that obta in ing parameter es t i-
ma tes tha t c lose ly app rox ima te popu la t ion va lues i s
on ly one criterion a researcher might consider when
determining sample s ize. In some s i tuat ions , addi-
t iona l concern s m igh t a l so p lay a r o le . Mos t no tab ly ,
w h e n EFA involves the tes t ing of formal hypotheses
regarding model f i t or parameter es t imates (as is
somet imes done in max im um l ike lihood [ML] EFA) ,
s t a ti s ti ca l po wer m igh t a l so be cons idered . A r e-
searcher could specify a hypothesis of interest, a de-
s i red level of power , and an assumed populat ion value
fo r m o d e l fit. The sample s ize necessary to achieve
these objectives can then be calculated (see MacCal-
l u m , Browne, & Sugawara , 1996).
Researchers should a lso cons ider the nature of thesample on which the s tudy is based. Psychologis ts
often select samples based on convenience. In m a n y
cases , this pract ice w il l not pose a problem. How ever ,
if th e sample is cons ider ab ly more homogeneous than
th e populat ion on the common factors , this can lead to
restriction of r a n g e in the measures , thereby at tenuat-
in g cor rela t ions among var iables . This a t tenuat ion can
result in fa lsely low es t imates of factor loadings and
cor rela t ions among factors (see Comrey & Lee, 1992;
Gor such , 1983 ; Tucker & MacCa l lum , 1997) . Add i -
t iona l ly , select ion biases rela ted to a s ingle measured
var iable in the analy s is can a lso dis tor t resul ts (Tucker& MacCa l lum, 1997). For these reasons, researchers
should cons ider the nature of the measured var iables
they a re inves tiga t ing and the mann er in wh ich the i r
s ample i s s e lec ted . Over ly hom ogeneous s amp les and
samples whose select ion is related to measured var i-
ables in the ana lys i s shou ld be avo ided . Th us , whe n
there is a substant ia l bas is to expect that convenience
samples wi l l not be appropr ia te, a researcher should
cons ider ob ta in ing a s ample r ep resen ta t ive of the
popu la t ion of in te r es t . Al te rna t ive ly , a r esea r cher
m i g h t wish to s e lec t a s ample to max imize va r i ance
on measured variables relevant to the constructs of
in teres t and m i n i m i z e v a r i an c e on measured var iablesi r relevant to the constructs of in teres t (see Cattel l ,
1978).
Determining whether EFA is appropriate. Th e
pr imary pu rpose of EFA i s to a r r ive a t a more pa r s i -
mon ious concep tua l under s tand ing of a s e t o f mea-
sured var iables by dete rm in ing th e n u m b e r an d na tu re
of common factors needed to account for the pat tern
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 4/28
USE O F F AC T O R A N A L Y S I S 275
o f corre la t ions among th e measured var iables . That is ,
EFA is used when a researcher wishes to ident i fy a se t
o f l a t en t cons t ruc t s unde r l y i ng a bat te ry o f measu red
va r i a b l e s . Be fo re u s i n g EFA. a re sea rche r shou ld
ca re f u i l y cons ide r if t h i s is a goal of the research
projec.
In r e ach ing t h i s dec i s i on , it is i m p o r t a n t to recog-
n i ze t ha t th e g o a l o f i d en t i f y i n g l a t en t cons t ruc t s ( i . e . ,
u n d e r s t a n d i n g t he s t ruc tu re o f co r re l a t i on s among
measu red va r i ab l e s ) i s dif fe rent from that of data re-
d u c t i o n . Data r educ t ion i n vo lve s t ak in g scores o n a
large se t of measured var iables and reducing them to
scores o n a s m a l l e r set of com pos i t e va r i ab l e s t ha t
retain a s much i n fo rma t i on f rom th e or iginal var iables
as pos s ib l e . Da t a r educ t i on does n o t a t t e m p t to m o d e l
th e s t ruc tu r e of co r re l a t ion s am ong t he o r i g i na l va r i -
ab l e s . Th i s d i s t i n c t i on is impor t an t , because dif fe rent
methods have been de s i gned to ach i eve t he se tw o
object ives . If the goa l is to a r r i ve a t a p a r s i m o n i o u s
rep re sen t a t i on of the as soc i a t i on s among measu red
va r iab le s , EFA can be an app rop r i a t e fo rm of an a ly s i s .
If th e goa l is data r e d u c t i o n , p r i n c i p a l c o m p o n e n t s
a n a l y s i s ( P C A ) is m o r e app rop r i a t e . Ma ny re sea rche r s
m i s t a k e n l y be l i eve t ha t P C A i s a t ype of EFA w h e n in
fac t these procedures a re di ffe rent s ta t i s t ica l methods
designed to achieve di ffe r ent object ives ( for a d i scus -
sion of the dis t inct ion , se e Bentler & K a n o , 1990;
Books t e i n , 1990 ; G o r s u c h , 1990: L o e h l i n , 1990;
M cA rd ie , 1990; M ula ik , 1990 ; Rozeboo m . 1990;
Schonemann , 1990 ; S t e i ge r , 1990; Vel i ce r & J a c k s o n ,
1990a, 1990b; Widaman, 1990) .EFA i s based on t he com mo n fac to r m ode l (Thu r -
s tone , 1947). Thi s mode l p os tu l a t e s t ha t e ach mea-
sured var iable in a bat te ry of measured var iables i s a
l i n e a r f u n c t i o n of one o r more common fac t o r s and
one un iqu e fac t o r . Co m mo n fac t o r s a re unobse r vab l e
l a ten t va r i ab l e s t ha t i n f l uen ce more t h an one mea-
su red va r i ab l e in a bat te ry and a re p re sumed to ac -
coun t fo r t he co r re l a t i on s ( cova r i ance s ) among t he
m easu red va r i ab l e s ( i .e . , two m easu red va r i ab l e s a re
assum ed to be corre la ted, because th ey are influ enc ed
by one ;> r m o r e of the s a m e c o m m o n f a c t o r s ). U n i q u e
factors a r e l a t en t va r i ab l e s t ha t i n f l uenc e on ly o n e
measu red var iable in a bat te ry and do no t a c c o u n t fo r
co r re l a t i on s amon g m easu red va r i ab l e s . Un ique fac -
tors a re a s s u m e d to have tw o c o m p o n e n t s : a speci f ic
fac t o r componen t ( i . e . , sys t emat i c l a t en t fac t o r s t ha t
i n f l u e n c e on ly one measu red v a r i ab l e ) and an e r ro r o f
measu remen t componen t ( i . e . , un r e l i ab i l i t y i n a mea-
su red va r i a b l e ) . The goa l o f t he com mo n fac t o r mo de l
is t o unde r s t an d t he s t ruc tu re o f co r re l a t ion s am ong
measu red va r i ab l e s by e s t ima t i ng th e pattern o f rela-
t i o n s between th e c o m m o n f a c t o r ( s ) a n d each of the
measured var iables ( i . e . , as indexed by factor load-
i n g s ) .
In con t r a s t , PCA does not d i ffe rent ia te be tween
c o m m o n a n d u n i q u e v a r i a n c e. R a t h e r , t h i s a p p r o a ch
def ines each measu red va r i ab l e as a l i n e a r f u n c t i on o f
p r i n c i p a l c o m p o n e n t s , wi th no separate representat ion
o f u n i q u e v a r i a n c e . M a t h e m a t i c a l l y , t h e s e p r i n c i p a l
com po nen t s can be de fi ned a s l i ne a r com pos i t e s o f the
o r i g i n a l measu red va r i ab l e s and t hus con t a i n bo th
c o m m o n a n d u n i q u e v a r i a n c e . T h e re fo r e , p r i n c i p a l
c o m p o n e n t s a re no t la tent var iables , a n d because o f
this i t i s not conceptual ly correct to equate them with
com m on fac t o r s ( a l t ho ugh in p r ac t i ce re se a rcher s o f -
te n do so) . Fu r t he rmore , whe reas t he goa l o f common
fac to r ana lys i s i s t o exp l a i n co r re l a t i on s am ong mea-
su red va r i ab l e s , th e goa l of PCA i s t o a c c o u n t fo r
v a r i a n c e in the measu red va r i ab l e s . Tha t i s , the ob-
j e c t i ve o f PC A i s t o de t e rm ine the l i ne a r com bina t i on s
of t he measu red va r i ab l e s t ha t r e t a i n a s much i n fo r -
m a t i on f rom t he o r i g i na l measu red va r i ab l es a s pos -
s ible . Thus , a l t hough PCA i s o f t en r e fe r red t o and
used as a method of factor analys i s , i t i s not factor
a n a l y s i s a t a l l .
Neve r t he l e s s , some me thodo log i s t s have a rgued
that PCA i s a r easonable substi tute fo r ana lyses o f
com m on fac t o r s and mig h t even be supe r i o r ( e . g . , s e e
V e l i c e r & Jackso n , 1990a, 1990b). They no ted that
P C A i s c o m p u t a t i o n a l l y s i m p l e r t h a n c o m m o n f a c to r
a n a l y s i s and the re fo re r equ i res l e s s com pu te r m emoryand process ing t ime (e .g. , Vel ice r & Jackson , 1990a) .
They a l so a rgued t ha t t he two app roache s gene ra l l y
p roduce ve ry s im i l a r r e su l t s ( e. g .. A r r i n de l l & van de r
Ende , 1985; Vel ice r , 1977; Vel ice r & Jackson , 1990a;
V el ice r , Peacock , & Jackson , 1982) . Also, they noted
th a t com m on fac t o r ana lys i s p rocedure s som e t imes
p roduce "Heywood cases" (e .g . , Vel ice r & Jackson ,
1 9 9 0 a ) — s i t u a t i o n s i n w h i c h a c o m m u n a l i t y fo r a
measured var iable ( i . e . , the propor t ion of var iance in
t he measu red va r i ab l e accoun t ed fo r by t he c o m m o n
fac tors ) is est imated to be at 1 or greate r than 1 . Be -
cause i t i s imposs ib le to account for more than 100%
of the var iance in a var iable , such an es t imate i s po-
t e n t i a l l y prob l emat i c . F ina l l y , advoca t e s o f P C A note
t ha t it is de t e rmina t e , whe reas th e c o m m o n f a c t o r
m o d e l i s not (e.g. , Steiger , 1979, 1990; Velicer &
Jackso n , 1990a). That i s , i t i s poss ib le to com pute a n
i n d i v i d u a l p e r s o n ' s s c o r e on a p r i n c i p a l c o m p o n e n t ,
whe reas i t i s no t pos s ib l e t o do so fo r a common
factor .
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 5/28
27 6 F A B R I G A R . W E G E N E R , M A c C A L L U M , A N D S TR A H A N
There are , however, reasons to ques t ion t hese a r-
gument s . Advances i n t he speed and memory c apa -
bi l i t i e s of compute rs have made the advan tage o f t he
computa t iona l s imp l i c i t y o f PCA t r ivia l . A ls o , a l-
t h o u g h PC A and EFA do o f ten p roduce s im i l a r re -
sul t s , t he re a re some contexts in which th i s i s not thec a s e (e .g . , see B e n t l e r & Kano , 1990; Bo rga t t a ,
Kerche r , & Stull , 1986; Gorsuch, 1988, 1990; Hub-
bard & A l l e n , 1987; M c A r d l e , 1990; Snook & Gor-
s u c h , 1989 ; Tucke r , Koopman , & L i n n , 1969; Wida-
m a n , 1990, 1993). Differences in r e s u l t s a re m o s t
l ike ly w h e n c o m m u n a l i t i e s are low (e.g., .40) an d
the r e a re a modes t number o f mea sured va r i ab le s
[e.g., th ree) per fac tor (Widaman , 1993) . Fur the rmore ,
w h e n t he da ta co r respond to a ssum p t ion s o f the com -
mon f a c to r mode l , EFA p roduces more a c cura te re -
sul t s t h an PCA (e .g . , McArdle , 1990; Snook & Gor-
such, 1989; Tucker e t a l . , 1969; Widaman, 1990,
1993). In cont rast , when the da ta a re re la t ively con-
s i s t e n t w i t h th e a s s u m p t i o n s o f P C A (e .g . , l i t t l e
u n i q u e va r i ance p re sen t in measured va r i ab le s ) , ex-
t ract ion of common f a c to r s does as wel l as ext rac t ion
of p r i n c i p a l c o m p o n e n t s ( e .g . , see Gorsuch, 1990;
McArdle , 1990; Vel icer et a!., 1982).
T h e o c c a s i o n a l o c c u r r e n c e o f H e y w o o d c a s e s
shou ld also not be regarded as a f law o f c o m m o n
factor a n a l y s i s . H e y w o o d cases of ten indica te tha t a
mi s spec i f i ed m o d e l h as been fi t to the data o r t h a t th e
da ta v io l a t e a ssump t ions of the c o m m o n f a c t o r m o d e l
( v a n Drie l , 1978). Thus, Heywood cases c a n h a v e
d i agnos t i c va lue (Ve l i c e r & Jackson , 1990a ). In con-t ras t , because such cases do no t occur i n PCA, such
p r o b l e m s a r e n o t s o l v ed b u t s i m p l y g o u n n o t i c e d
; M c A r d l e , 1990) .3
I n d e t e r m i n a c y o f i n d i v i d u a l factor scores in the
common f a c to r mode l need no t be a p rob lem. In mos t
app l i ca t i on s o f EFA, th is i s sue is i r re l evan t in t h a t th e
object ive i s to ident i fy common f a c to r s t ha t a c coun t
ro r the st ruc ture of the corre la t ions a m o n g t he mea -
sured variables. This goa l does no t requi re t he com-
pu t a t i on o f fac tor scores but r a the r o n l y fac tor load-
i n g s an d f a c to r i n t e rco r re l a t i ons (McA rdle , 1990) . In
t h o s e s i tua t ions where f a c to r scores m i g h t be of in-terest, researchers usua l ly obtain scores for the pur-
pose of a ssess ing co r re l a t i ons o f f a c to r s w i th o the r
va r i ab l e s , o r us ing fa c to r s a s i ndepen den t va r i ab le s o r
d e p e n d e n t v a r i a b l e s in reg re ss ion mode l s . However ,
th e d e v e l o p m e n t o f s t r u c t u r a l e q u a t io n m o d e l i n g
makes i t unnecessa ry t o e s t ima te f a c to r scores to ob-
ta in s u c h i n f o r m a t i o n .One can u se s t ruc tu r a l equa t ion
m o d e l i n g t o spec i fy a mode l w ith fac tors as corre-
la tes , p redic tors , o r consequences of other variables
and obta in e s t ima tes o f t he re l evan t p a ram ete rs w i th -
o ut eve r e s t im a t ing f a c to r scores . A d d i t i o n a l l y , r e c en t
d e v e l o p m e n t s h a v e p r o v ide d u s e f u l n o n s t r u c t u r a l
equa t i on mode l ing p rocedures fo r e s t i m a t i n g th e co r-
r e l a t i on s be tween f a c to r s a n d o t h e r v a r i a b l e s w i t h o u t
th e need to compute f a c to r scores (Go rsuch , 1997) .
F i n a l l y , advocates o f c o m m o n f a ct o r a n a l y s i s n o t e
tha t it h a s c e r t a in advan tages ove r P CA when the goa l
is to ident i fy l a t en t cons t ruc t s . They a rgue tha t mos t
m easures used in p sycho log ic a l research con ta in s o m e
r andom e r ro r . Because EFA procedures ref lec t a rec-
o g n i t i o n of t h i s fa c t , whe rea s PC A does no t , the com -
m o n fac to r mode l is a more rea l i s t i c mode l of the
s t ructure o r co r re l a t i ons ( e . g . , see B e n t l e r & K a n o ,
1990; Go rsuch , 1973; Loeh l in , 1990) . A ddi t i o na l ly ,
t he common f a c to r mode l i s t e s t ab le , whe rea s t he
PCA model i s not (e .g . , see Bent ler & Kano, 1990;
M c A r d l e , 1990). The common f a c to r mode l spec i f i e scer ta in hypo theses about th e da ta . Thus , i t can be fi t to
data and the model rejected if the fit is poor. In con-
t ras t , because PCA does n o t i n v o l v e a spec if ic hy-
pothesis to be tested, i t does no t p rov ide i n fo rma t ion
on w h i c h o n e could base a decis ion to reject th e
"mode l ."
Therefore , there a re c lea r concep tua l dis t inc t ion s
be tween PCA an d EFA. A l th oug h these app roaches
often p roduce s im i l a r re su l t s , t h i s i s no t t rue in ce r t a in
con text s . When th e goa l of the a n a l y s i s is to ident i fy
la tent const ruc ts u n d e r l y i n g measured variables, it is
more sens ib le t o use EFA than PCA ( see Ca t t e l l ,1 9 7 8; G o r s u c h , 1 9 83 ; M c D o n a l d , 1 9 85 ; M u l a i k ,
1972) .
A s s u m i n g t h a t iden t i fy ing la tent variables tha t ac-
c o u n t fo r t he co r re l a t i ons among measured va r i ab le s
is the goa l of the research projec t , a researcher must
then dec ide i f a n exp lo ra to ry o r conf i rma to ry ap -
p r o a c h wi l l be used. Both E F A a n d c o n f i r m a t o r y f a c-
to r ana ly s i s (CFA ) a re ba sed on the com mo n f a c to r
mode l , an d both seek to r e p r e s e n t th e s t ruc tu re o f
co r re l a t i ons amon g m easured va r i ab le s us i ng a re la -
1F u r the r m o r e , t h e r e m ig h t be s o m e cases in w h i c h a
He y wo o d case wo u ld no t r e p re s e n t a m i s s p e c i f i e d mo d e l
a nd m ig h t no t b e p ro b l e m a t i c . F o r e x a mp le , c i r c u ms t a nc e s
in wh ic h p o p u l a t i o n p a r a me t e r s a r e c l o s e t o l o g i c a l b o u nd -
a r ies (e .g . , if t r u e c o m m u n a l i t i e s a r e c l o s e to 1.0) c o u ld
p roduce Heywood cases s im p ly because o f expec ted v a r i -
ab i l i ty in p a r a me t e r e s t ima t e s r esu l t i ng f rom s a mp l i ng e r r o r
( v a n D r i e l , 1978).
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 6/28
USE OF FA CT O R A NA LY SI S 277
l ively small set of la tent var iables . However , EFA is
pr imar i ly a data-dr iven approach. N o a pr io r i number
of common factors is specif ied and few res t r ic t ions
are placed on the patterns of relations between th e
common fac to r s and the measured var iables ( i .e . , the
factor loadings) . EFA provides procedures fo r deter-
m i n i n g an appropr ia te number of factors and the pat-
tern of factor loadings primarily from th e data . In
contras t , CFA requires a researcher to specify a spe-
cific number of factors as well as to specify the pat-
tern of zero and nonzero loadings of the measured
var iables on the common fac to r s . Al te rna t ive ly , a re-
searcher might specify a pr ior i a sma l l set of compet -
ing models postulating differ ing numbers of factors,
different patterns of factor loadings , or both.
In s i tuat ions in which a researcher has rela t ively
little theoretical o r empir ica l bas is to make s t r ong
as sump t ions abou t how man y comm on fac to r s ex i st o r
wha t spec i f i c measu red va r i ab les these common fac -tors are l ikely to inf luence, EFA is probab ly a m o r e
sens ib le app roach than CFA. EFA is l ikely to be m o r e
des irable in these s i tuat ions , because the number of
p laus ib le a l terna t ive mo dels m igh t be so l a rge tha t i t
wou ld be impract ica l to speci fy and tes t each one in
CFA . Add i t iona l ly , when a s t rong bas is does n o t exist
fo r iden t i fy ing a s ing le model o r a few spec i f i c com -
pet ing models , it is quite poss ible that a researcher
m i g h t fail to identify a n u m b e r of plaus ible models .
Therefore, in these contexts , th e da ta -d r iven ap p roach
of EFA seems adv is ab le .
However, when there is sufficient theoretical andempir ica l bas is for a researcher to specify the model
or small subset of models that is the most plaus ible,
CFA is l ikely to be a bet ter approach. This is because
CFA al lows for focused tes t ing of specif ic hypotheses
abou t th e data (e.g. , see Finch & West, 1997; Wege-
ner & Fabrigar, in press). Also, the a priori nature of
CFA makes i t less l ikely that a researcher wil l capi-
ta l ize on chance character is t ics in the data .
It is also often useful to u se EFA and CFA in c o n -
junc t ion w i th on e a n o t h e r . A n EF A can be conducted
in an in i t ia l s tudy to provide a bas is for specifying a
C FA m o d e l in a subsequent s tudy. Alternat ively, if
th e sample s ize in a s ingle s tudy is sufficiently la rge,the s ample cou ld be r andomly sp l i t i n ha l f . An EFA
could then be conducted on one half of the data pro-
vid ing the bas i s fo r spec i fy ing a CFA model tha t can
be f i t to the other half of the data .
Choice of model-fitting procedure. If EFA is the
m os t app rop r ia te form of analy s is , it is then necessary
to dec ide wha t p rocedure will be used to f i t the com-
mon fac to r model to the da ta . A number o f model -
fitt ing m ethods ( i .e ., factor-extract ion procedures) are
avai lable. Most widely used among these are ML,
pr incip al factors with pr ior es t imat ion of co mmun a l i -
ties, an d i tera tive pr incip al factors . These are diffe rent
methods fo r est imating th e parameters ( factor load-
ings an d unique var iances) of the same model , th e
c o m m o n f a c t o r model.4
A lthough these p rocedures fit the same model , each
method does have cer ta in advantages an d disadvan-
tages. The p r im ary advan tage of ML i s tha t i t a l lows
fo r the computat ion of a wide range of indexes of the
goodness of f i t of the model . ML also permits s ta t is-
tical significance testing of factor loadings and corre-
la t ions among fac to r s and the c o m p u t a t i o n o f conf i-
dence in te rva l s fo r t h e s e p a r a m e t e r s ( Cu d ec k &
O'Dell , 1994) . The pr imary l im i ta t ion of ML est ima-
t ion i s i ts a s sum pt ion of m u l t iva r i a te no rm a l i ty . When
th i s a s sumpt ion is severely viola ted, this procedurecan produce dis tor ted results (Curran , West , & Finch ,
1996; Hu, Bentler , & Kano, 1992) . On the other hand ,
pr incipal factors methods (both i tera ted and noniter-
ated) have the advantag e of enta i l ing no dis t r ibutional
a s sump t ions . P r inc ipa l f ac to rs are also less l ikely than
ML to produce improper so lu t ion s (i.e., a solut ion
with a H ey w o o d case or a so lu t ion tha t fai ls to con -
verge on a f inal set of parameter es t imates ; Finch &
West, 1997). Th e major d r awback of the pr incipal
factor methods i s tha t they p rov ide a m uch more l im-
i ted range o f goo dness-of-f it indexes and gen eral ly do
not allow for computation of confidence intervals ands ignif icance tes ts . Regardless of these differences ,
w h e n the comm on fac to r mo del ho lds rea sonab ly wel l
in the populat ion and severe viola t ions of d is t r ibu-
t iona l a s s u m p t i o n s are no t present , solut ions provided
by these methods are usua l ly very s im i la r .
Selecting the number of factors. Determin ing how
m a n y fac tors to inc lude in the model requires th e
researcher to balance the need for pars imony ( i .e . , a
model w i th r e la t ive ly fe w common fac to r s ) aga in s t
the need for pla us ibi l i ty ( i .e . , a model w ith a suff ic ient
num ber o f comm on fac to r s to adequa te ly accoun t fo r
4A l t h o ug h th e common fac to r model makes a further
conceptual dis t inct ion by decompos ing unique va r iance in to
specif ic variance and error variance, methods of fi t t ing the
common fac to r model a l low fo r estimates of the a m o u n t of
un ique variance only and do not provide separate est imates
of specif ic var iance an d error variance.
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 7/28
278 F A B R I G A R , W E G E N E R , M A c C A L L U M , A N D S T R A H A N
t he co r re l a ti on s amo ng measu red va r i ab l e s ) . I n o t he r
words , the goal of the researcher i s to de te rmine the
n u m b e r o f "majo r" fac t o r s unde r l y i ng a ba t t e ry o f
measu res . Impor t an t l y , errors in selection of the n u m -
ber of factors in a model ca n h ave a substa nt ia l e ffect
on th e resul t s obta ined (e .g., C o m r e y . 1978; Fava &
V e l i c e r , 1992; Levon i an & C o m r e y , 1966; Wood , Ta-
t a r y n , & G o r s u c h , 1996).
T r a d i t i o n a l l y , m ethodolo gis t s have regarded speci -
f y ing too few factors in a mo del ( i . e . , und erfa ctor ing )
a s a much more seve re e r ro r t han spec i fy i ng to o m a n y
fac tors ( i . e . , overfactor ing; see Cat te l l , 1978; Rum-
m e l , 1970; Thur s ton e , 1 947) . Em pi r ic al research h a s
g e n e r a l l y suppor t ed t h i s no t i on . When t oo few fac t o r s
a re i n c l u d e d in a mode l , subs t an t i a l er ro r is l i ke ly
(Fava & Vel ice r , 1992; W o o d et a l . , 1996) . Measured
v a r i a b l e s t ha t l oad o n factors n o t i n c l u d e d i n the
mode l can f a l se ly load on factors included in the
mode l , an d p o o r e s t ima t e s of the fac t o r l oad ings can
he ob t a i ned fo r measu red va r i ab l e s tha t do ac tua l l y
load on t he fac t o r s i n c luded in the mode l (Wood et a l . ,
1996) . Such dis tor t ions can r e su l t in ro t a ted so lu t i on s
i n wh ich two comm on fac to r s a re com bined i n t o a
s ingle c o m m o n factor ( thereby obscu r ing the true fac-
i.or s t r u c t u r e ) and in s o l u t i o n s wi th c o m p l e x p a t t e r n s
o f fac t o r l oad ings t ha t a re dif f icu l t to in te rpre t ( see
Comrey. 1978) .
Empi r i ca l r e se a rch sugge s t s t ha t ove r fac t o r i ng i n -
t roduce s much l e s s e r ro r to fac t o r l oad ing e s t ima t e s
i h an unde r fac t o r i ng (Fava & Vel ice r . 1992; W o o d et
. . ; ! . , 1996) . Such models often resul t in rotated s o l u -i i o n s in w h i c h th e major fac t o r s are accurate ly repre-
sen t ed and t he add i t i ona l fac t o r s have no measu red
va r i ab l e s t ha t load su bs t an t i a l l y on t hem o r ha ve on ly
a s i ng l e m easu red va r i ab l e tha t l oads sub s t an t i a l l y on
each add i t i ona l fac t o r . Non e the l e s s , ove r fac t o r i ng
s h o u l d be avo ided ( see Comrey , 1978 ; Comrey &
Lee, 1992). So lu t i o n s wi t h too m any fac t o r s m igh t
prompt a researcher to postulate the exis tence of con-
s t ract s w i t h l i t t le t heo re t i ca l va lue an d the reby de-
v e l o p u n n e c e s s a r i l y c o m p l e x t h e o r i e s . A d d i t i o n a l l y ,
ove r fac t o r i ng can accen tua t e poor dec i s i on s made a t
o t h e r s teps i n a fac to r an a ly s i s . For examp le , PC Atends to p roduce load ings t ha t a re larger than factor
l oad ings ( see Snook & G o r s u c h , 1 9 8 9 ; W i d a m a n .
1993). Thus , so lu t i on s u s i ng t h i s app roach can some-
t i m e s m a k e m i n o r c o m p o n e n t s a p p ea r to be m a j o r
c o m p o n e n t s ( W o o d et a l . , 1996).
G i v e n these consequences , i t is not su rp r i s i ng t ha t
an ex t ens ive me thodo log i ca l l i t e r a tu re h a s developed
e x p l o r i n g t he i s sue of de t e rm in ing t he op t im a l num be r
o f factors . A n u m b e r o f procedures fo r a n s w e r i n g t h i s
que s t i on have been p roposed . Perhaps th e bes t known
of these procedures i s t he Ka i se r c r i te r i on o f com pu t -
in g the e igenva lues fo r the corre lat ion mat r ix to de-
t e r m i n e h o w m a n y of these e igenvalues are grea te r
th an 1 ( fo r d i s cus s i on of th e na tu re o f e igenva lue s , se eGorsuch , 1983) . Th i s num be r i s t hen u sed a s t he num -
be r o f fac t o r s . A l t hough t h i s p rocedu re i s appea l i ng
fo r i t s s im p l i c i t y and ob j e c t i v i t y , t he app roach has
s i g n i f i c a n t prob l ems . F i r s t , it is of t en mi sapp l i ed by
re fe r r ing t o t he e i genva lue s o f t he co r re l a ti on m a t r i x
w ith c o m m u n a l i t y e s t i m a t e s i n the diagonal ( i . e . , th e
r educed c o r re l a t ion m a t r i x ) r a t he r t han e i genva lue s o f
th e cor re l a t i on ma t r i x wi t h un i t i e s i n the d i a g o n a l
( i .e . , t he un reduced co r re l a t i on ma t r i x ; see Gu t tman .
1954; K aise r , 1960) . Ap pl ic at io n of thi s ru le to the
e i g e n v a l u e s of the reduced co rre la t ion m at r ix i s an
erroneous procedure (Gorsuch, 1980; Horn , 1969) .
Second , as wi t h any mechan i ca l ru l e , t he p rocedu re
can to some extent be arbi t rary. For ins tance , i t i s not
r e a l l y m ean ing fu l t o c l a im t ha t a com m on fac t o r wi t h
an e i g e n v a l u e of 1.01 is a "majo r" factor whereas a
common fac t o r wi t h an e i genva lue of 0 . 99 i s no t .
F ina l l y , in numerous s tud ies i nvo lv i ng both p r i n c i p a l
c o m p o n e n t s a n d co m m o n fac tors , t h i s p rocedu re has
been demonst ra ted to lead to subs t an t i a l ove r fac t o r i ng
an d occas i ona l l y to unde r fac t o r i ng (Ca t t e l l & Jaspers ,
1967; Cattel l & V o g e l m a n n , 1 9 77 ; H a k s t i a n , Roger s .
& Cat te l l , 1982; Linn , 1968; Tucker et al . , 1969;
Z w i c k & Vel ice r , 1982, 1986). In fac t , we know of no
s tudy of thi s ru le that shows i t to work wel l .A n o t h e r w i d e l y k n o w n a p p r o a c h f o r d e t e r m i n i n g
the numbe r of factors is the "scree test" (Cattel l , 1966;
Ca t t e l l & Jaspers , 1967) . In thi s procedure , the e ig-
enva lue s of the cor re l a t i on ma t r i x (o r the reduced cor-
re l a ti on m a t r i x ) a re compu ted and t hen p l o t t ed i n o r -
de r o f de scend ing va lue s . This g r a p h i s t h e n e x a m i n e d
to i den t i fy t he l a s t subs t an t i a l d rop i n t he m agn i tude
of t he e i genva lue s . A mode l wi t h t he s a m e n u m b e r o f
c o m m o n f a c t o r s as the n u m b e r o f e igenva lue s p r i o r to
th i s l a s t subs t an t i a l d rop is then fit to the data. This
proc edure i s often used wi th e igenva lues from the
u n r e d u c e d c o r r e l a t i o n m a t r i x . H o w e v e r , w h e n t h e
goal is to ident i fy c o m m o n factors , it is m o r e concep-
t ua l l y sen s ib l e t o examine t he p l o t o f e i genva lue s
f rom th e reduced corre la t ion m at r ix , because thi s m a-
t r ix more d i r e c t l y c o r r e s p o n d s t o t he com mo n fac to r
model . Regardless of w h i c h m a t r i x i s used, thi s pro-
cedure h a s been cr i t i c ized (e .g. . Kaise r . 1970) because
of i t s subject iv i ty ( i . e . , the re i s no c lear object ive defi -
n i t ion o f wha t cons t i t u te s a "substant ia l" d r o p in m a g -
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 8/28
U SE O F F A C T O R A N A L Y S I S 279
n i t u d e ) . A d d i t i o n a l l y , s o m e t i m e s th e ob t a i n ed pa t t e rn
o f e i g e n v a l u e s i s a m b i g u o u s i n t h a t n o c l e a r s u b s t a n -
t i a l d rop m a y b e p r e s e n t . H o w e v e r , w h e n s t r o n g c o m -
m o n f a c i o r s a re p re sen t i n d a t a , s t u d i e s i n d i c a t e t h a t
t h i s p roced u re f u n c t i on s r ea son ab ly we l l ( C a t t e l l &
V o g e l m a n n .1977; Hakst ian et a l . , 1982: Tucker e t
a l . ,
1969) .
A t h i r d f a c t o r - n u m b e r p r o c e d u r e t h a t h a s been i n -
v e s ti g a t e d i n t h e m e t h o d o l o g i c a l l i t e r a t u r e i s p a r a l l e l
a n a l y s i s ( H o r n , 1 9 6 5 ; H u m p h r e y s & I l g e n , 1969;
H u m p h r e y s & M o n t a n e l l i , 1 9 75 ; M o n t a n e l l i & H u m -
p h r e y s , 1 9 7 6 ) . T h i s a p p r o a c h is based o n a c o m p a r i -
s o n o f e i g e n v a l u e s ob t a i n ed f rom s am p le d a t a to e ig -
e n v a l u e s one w o u l d expect to obtain f rom completely
r a n d o m d a t a ( i . e ., t h e p r e d ic t e d m e a n s o f e i g e n v a l u e s
producec by repeated set s of r a n d o m d a t a ) . S u p p o s e a
se t o f m easu red v a r i ab l e s ob se rv ed in a g i v e n s a m p l e
d e p e n d s o n m m a j o r c o m m o n f a c t o r s . P a r a l l e l a n a l y -
s i s i s b ased o n t h e n o t i o n t h a t th e m l a r g e s t s a m p l e
e i g e n v a l u e s o f t h e r e du c e d c o r r e l a t io n m a t r i x s h o u l d
b e l a r g e r t h a n th e m l a rges t ex pec t ed v a lu es o f e i g e n -
v a l u e s o b t a i n e d fr o m r e p e a te d c o r r e s p o n d i n g sets o f
r an d om d a t a ( b a sed o n t h e same s a m p l e s i z e a n d n u m -
be r o f v a r i a b l e s ) . Th e e i g e n v a l u e s t h a t w o u l d be e x-
pected f r o m r a n d o m d a t a a r e t h e n c o m p a r e d w i t h th e
e i g e n v a l u e s a c t u a l l y p r o d u c e d b y t h e d a ta , a n d a
m o d e l i s s p e c i fi e d w i t h th e sa m e n u m b e r o f c o m m o n
f ac t o r s a s r e a l e i g e n v a l u e s t h a t a r e g rea t e r t h an th e
e i g e n v a l u e s e x p e c t e d f r o m r a n d o m d a t a . L i k e o t h e r
o b j e c t i ve m e c h a n i c a l r u l e s , t h i s p r o c e d u r e c a n s o m e -
t i m e s b e a r b i t r a r y i n t h a t a f a c to r j u s t m e e t i n g t h ec r i t e r i on i s r e t a i n ed , whe rea s a fa c t o r f a l l i n g j u s t b e -
l ow t he c r i t e r i on i s i gn o red . Th i s p roced u r e i s a l s o n o t
a v a i l a b l e i n m a j o r s t a t is t i c a l p r o g r a m s . N o n e t h e l e s s ,
s i m u l a t i o n r e s e ar c h s u g g e s t s p a r a l l e l a n a l y s i s f u n c -
t i o n s f a i r l y w e l l ( H u m p h r e y s & M o n t a n e l l i , 1 9 7 5 ) .
P a r a l l e l a n a l y s i s m e t h o d s h a v e a ls o been d e v e l o p e d
fo r u s e i n c o m p o n e n t s a n a l y s i s a n d fo u n d t o f u n c t i o n
w e l l in ;h is con t ex t ( A l l en & Hu b b a rd . 1986: Lau t en -
s c h l a g e r , 1 9 8 9 ; L o n g m a n , Cota, H o l d e n , & F e k k e n ,
1989; Z w i c k & V e l i c e r , 1 9 8 6 ) .
T h e m e t h o d s d e s c r i b ed to t h i s p o i n t fo r d e t e r m i n i n g
t h e n u m b e r o f f a ct o r s t o r e t a in i n v o l v e a n a l y s i s o fe i g e n v a l u e s o b t a in e d i n p r i n c i p a l f a c to r s o r P C A . A l -
t h o u g h > u c h m e t h o d s o f f a c t o r i n g a r e w i d e l y u s e d, th e
M L m e t h o d o f f a c t o r ex t r a c t i on is b e c o m i n g i n c r e a s -
i n g l y p o p u l a r . T h e M L m e t h o d h a s a more f o r m a l
s t a t i s t i c a l f o u n d a t i o n t h a n t h e p r i n c i p a l f a c t o r s m e t h -
o d s a n d t h u s p r o v i d e s more capab i l i t i e s f o r s t a t i s t i c a l
i n f e ren ce , su ch a s s i g n i f i c a n c e t e s ti n g a n d d e t e r m i n a -
t i o n o f c o n f i d e n c e i n t e r v a l s . These c a p a b i l i t i e s a l l o w
a researcher to adopt a s o m e w h a t d i f f e r e n t approach
to d e t e r m i n i n g th e o p t i m a l n u m b e r o f f a c t o r s .
O n e c a n c o n c e p t u a l i z e t h e n u m b e r - o f - f a c t o r s i s s u e
as c h o o s i n g the most a p p r o p r i a t e m o d e l f r o m a series
o f a l t e r n a t i v e fa c t o r a n a l y s i s m o d e l s t h a t d i f fe r i n t h e i r
c o m p l e x i t y ( i . e . , t h e n u m b e r o f f a c t o r s ). T h e o b j e c t i v e
is to selec t a m o d e l t h a t e x p l a i n s th e data s u b s t a n t i a l l y
b e t t e r t h an s imp le r a l t e rn a t i v e mod e l s ( i . e . , models
w i t h f ewer f a c t o r s ) b u t does a s w e l l o r n e a r l y a s w e l l
a s more c o m p l e x a l t e r n a t i ve m o d e l s ( i . e . , m o d e l s w i t h
m ore f a c t o r s ) . B ecau se f a c t o r an a l y s i s is a s pec i a l
case o f s t r u c t u r a l e q u a t i o n m o d e l in g , m a n y of t he p ro -
cedures u sed in s t r u c t u r a l e q u a t i o n m o d e l i n g fo r
model selection can be applied to EF A. That is, the
use o f M L e s t i m a t i o n f o r EFA i n t r o d u c e s a v as t a r r ay
o f goo d n es s -o f - fi t i n f o r m a t i o n t h a t c an b e u sed t o
d e t e r m i n e th e a p p r o p r i a t e n u m b e r o f f a c t o r s ( s ee
B r o w n e & C u d eck , 1992 ; Hu & B e n t l e r , 1998; M a r s h ,
B a l l a , & M c D o n a l d , 1 9 8 8; M u l a i k et al., 1989) . These
fit measures, w h i c h a r e i n t en d ed to assess th e degree
to w h i c h a g i v e n m o d e l p r o v i d e s a n a p p r o x i m a t i o n o f
observed co r r e l a t i on s or c o v a r i a n c e s , can be a p p l i e d
to the n u m b e r - o f - f a c t o r s p r o b l e m . The g e n e r a l proce-
d u re i s t o f i t m od e l s w i t h a r an ge o f n u m b er s o f f a c -
t o rs , b e g i n n i n g w i t h zero, a n d i n c r e a s i n g t h r o u g h
some m a x i m a l l y i n t e r e s t in g n u m b e r . F i t measures fo r
e a c h m o d e l can t hen be e v a l u a t e d , and a d ec i s i on can
be made as to the a p p r o p r i a t e n u m b e r of f a c t o r s to
r e t a i n . The desired m o d e l i s t h a t w h i c h c o n s t i t ut e s a
s u b s t a n t i a l i m p r o v e m e n t i n f i t o v e r a m o d e l w i t h o n e
f e w e r f a c t o r b u t f o r w h i c h a m o d e l w i t h o n e moref a c t o r p r o v i d e s l i t t l e i f a ny i m p r o v e m e n t i n f i t .
5
On e co m m on s t a t i s t i c f o r a s s e s s i n g f i t i n M L f ac t o r
a n a l y s i s s o l u t i o n s i s t h e l i k e l i h o o d r a t i o s t a t i s t i c
( Lawley , 1940) . I f N i s su f f i c i e n t l y l a rge an d t he d i s -
t r i b u t i o n a l a s s u m p t i o n s u n d e r l y i n g M L e s ti m a t i o n a r e
ad eq u a t e l y s a t i s f i ed , t he l i k e l i h oo d r a t i o s t a t i s t i c a p -
p r o x i m a t e l y f o l l o w s a c h i - s q u a r e d i s t r i b u t i o n i f t he
s p e c i f ie d n u m b e r o f f a c to r s i s correct i n t h e p o p u l a -
sIdea l ly , th e p refe r red m od e l should n o t j u s t f i t the data
subs tan t i a l ly better t han s imp l e r m o d e l s and as wel l a s m o r e
c o m p l e x m o d e l s . The p refe r red model should a l so f it the
data r e a s o na b ly well in an absolu te sense . W h e n th i s i s no t
th e case , a r e searche r s h o u l d exerc ise s o m e cau t i o n in in-
t e rp re t ing the results . A preferred model that f i ts the data
p o o r l y m i g h t do so , because the data d o n o t c o r r e s p o n d to
a s s u m p t i o n s o f t h e c o m m o n factor mo d e l . Alte rnat ive ly , i t
m i g h t suggest the ex is tence o f numerous m i n o r c o m m o n
factors .
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 9/28
280 F A B R I G A R , W E G E N E R , M A c C A L L U M , A N D S T R A H A N
t i o n . Thus, th is s ta t i s t ic can be used to test the n u l l
h y p o t h e s i s t h a t th e model holds exac t ly in the p o p u -
la t ion wi th a g i v e n n u m b e r o f c o m m o n f a c t o r s . This
test can be app l ied to a ser ies of num ber s of fac tors ,
b e g i n n i n g with zero a n d c o n t i n u i n g u n t i l a n o n s i g n i f -
i c a n t test s ta t i s t ic is obta ined , i nd i c a t i ng t h a t th e c o m -m o n f a c to r mode l w ith th e c o r r e s p o n d i n g n u m b e r o f
fac tors i s not re jec ted as a correc t model in the popu-
l a t ion . A l t h o u g h t h i s p r o c e d u r e is i n t u i t i v e l y appea l -
ing in tha t i t is based on a c lea r s t a t i s t ic a l r a t i ona le , i t
is suscep t ib le to s e r io u s p r o b l e m s . M o s t i m p o r t a n t l y ,
it is h i g h l y i n f luenced by samp le s i ze . When N is
la rge , even t r iv i a l disc repanc ies between th e m o d e l
and the data are l ikely to g ive r ise to rejection of the
mode l w i t h a n y r e a s o n a b l e n u m b e r o f f a c to r s (Haks-
t ian et a l . , 1982; M. L . Harr i s & Harr i s , 1 9 71 ; H u m -
ph reys & Montane l l i , 1975; MacCa l lum, 1990) . In
s i t ua t i on s w h e r e N is s m a l l , even l a rge d i sc repanc ie s
be tween t he m o d e l and t he data m a y n o t b e sta t i s t i -
ca l ly s ign i f i c an t , t he reby l ead ing to u n d e r f a c t o r i n g
( H u m p h r e y s & M o n t a n e l l i , 1975). In a d d i t i o n , the use
of the l i ke l ihood ra t i o t e s t is p rob lema t i c , because th e
n u l l h y p o t h e s i s of perfec t fit is an u n r e a l i s t i c s t a n d a rd
in t h a t a l l m o d e l s a r e a p p r o x i m a t i o n s o f r e a l i t y
( B r o w n e & Cudeck, 1992; Cudeck & H enly , 1991 ;
M a c C a l l u m , 1990). Th e rea l i s t i c goa l in f a c to r ana ly -
si s is to obtain a pa r s i nomious so lut ion tha t p rovides a
good app rox ima t ion to the rea l world; thus , th e hypo th -
esis of perfect fit is not gene ra l l y of em pir ica l interest .
Because o f t hese p r o b l e m s , m e t h o d o l o g i s t s h a v e
developed an a rray of a l terna t ive "descrip t ive" m ea-sures of f i t . These d e v e l o p m e n t s b e ga n w i t h th e w o r k
o f Tu c k e r an d L e w i s ( 1973) , who proposed a "reli-
ab i l i t y coeff ic ient" fo r ML f a c to r a n a l y s i s s o l u t io n s ,
an d h a v e c o n t i n u e d t h r o u g h th e p resen t day . O ur view
i s t h a t d e v e l o p m e n t s r e v i e w e d a n d i l l u s t r a t e d by
l i rowne and Cudeck (1992) p rov ide a p romis ing ap -
n roach fo r a ssess ing fi t of t hese mode l s . Browne an d
Cudeck focused on the Roo t Mean Squa re Er ro r o f
A p p r o x i m a t i o n ( R M S E A ) fi t i n d e x (S te ige r & L i n d ,
1980) a n d t h e E x p e c t e d C r o s s - V a l i d a t i o n I n d e x
i E C V I ; B r o w n e & Cudeck , 1989) and i l l us t ra t ed the i r
u s e fo r d e t e r m i n i n g th e n u m b e r o f fac tors in EFA.R M S E A i s an es t ima te of the di sc repa ncy be tween th e
mode l and the data p er degree o f f reedom for the
m ode l . I t ha s been su gges ted tha t va lues less than 0.05
cons t i tu te g o o d f i t , va lues in the 0.05 to 0.08 range
acceptable f i t , va l ues in the 0.08 to 0.10 r ange ma r-
g i n a l fit , an d va lues g rea te r t han 0 .10 poor fi t (see
B r o w n e & Cudeck, 1992; Steiger , 1989).6E C V I , o n
th e o the r hand , is an es t ima te of how wel l th e so lu t ion
obta ined f rom o n e samp le w i l l gene ra l i ze to other
samp les . A l though n o g u i d e l i n e s e x i s t fo r i n t e r p r e t i n g
E C V I in abso lu te t e rms , it is useful fo r re l a t ive com-
pa r i sons am ong a l t e rna t ive mo de l s . The sm a l l e r t he
v a l u e o f E C V I , t h e b e t t e r t h e e x p e c t e d c r o s s -
va l ida t ion of t he mode l . An impo r t an t p rope r ty o f
E C V I di scussed by C u d e c k a n d H e n l y ( 1 9 9 1 ) a n d
i l l u s t r a t ed by B r o w n e an d C u d e c k ( 1 9 9 2 ) is t h a t it is
sen s i t i ve to samp le s i ze . ECVI wi l l t end to s u p p o r t th e
r e ten t ion o f s imp le r mode l s ( f ewer f a c to r s ) when N is
s m a l l a n d m o r e c o m p l e x m o d e ls ( m o r e fa c t o r s ) w h e n
N is l a rge . One can t h i n k o f E C V I as address ing th e
f o l l o w i n g ques t ion ; Based on t he ava i l ab le da t a , fo r
how m a n y factors can we obta in accura te an d gener-
a l i z ab le pa ramete r e s t ima tes?
A majo r advan tage o f both these indexes i s the
av a i l ab i l i t y o f c o n f i d e n c e i n t e r v a l s . Th u s , a researcher
ca n compa re t he po in t e s t im a tes and co r re spo nding
con f idence i n t e r v a l s o f these fi t i n d e x e s for a series o fm o d e l s w ith v a r y i n g n u m b e r s o f fac tors . A m o d e l c an
be selec ted tha t shows fi t t h a t is subs tan t i a l ly better
th an s i m p l e r m o d e l s and f i t t h a t is c o m p a r a b l e to t h a t
of more complex models . Of course , the logic of the
app roach i l lus t r a ted by B r o w n e a n d Cudeck (1992) o f
u s i n g R M S E A a n d E C V I to d e t e r m i n e th e n u m b e r o f
factors in EFA can be extended to o the r desc r i p t ive fi t
i ndexe s . Thus , a re sea rche r migh t choose to e x a m i n e
a d d i t i o n a l i n d e x e s o f mode l fi t w h e n d e t e r m i n i n g th e
n u m b e r of fac tors ( for a recen t eva lua t ion of fi t in-
dexes, see Hu & Bent ler , 1998).
A l t h o u g h t he use o f RMSEA, ECVI , and o the r de-sc r i p t i ve m e a s u r e s of m o d e l fi t has yet to be exten-
s ive ly tested w i t h i n th e c o n t e x t o f d e t e r m i n i n g th e
n u m b e r o f fac tors in EFA, there is a c o m p e l l i n g l o g ic
to t h i s app roach . Fur the rmore , many o f t hese i ndexes
have been tested w i t h i n th e c o n t e x t o f m o r e gene ra l
c o v a r i a n c e s t ruc tu re mode l s . Thus , use rs o f ML fac to r
a n a l y s i s w o u l d do wel l to cons ide r the use of these fi t
i ndexe s w h e n d e t e r m i n i n g th e n u m b e r o f fac tors to
r e t a in .
In s u m m a r y , a n u m b e r o f p rocedures ex i s t to de-
t e r m i n e th e a p p r o p r i a t e n u m b e r o f c o m m o n f a c t o r s .7
6A l t h o u g h t h e s e g u id e l i ne s fo r R M S E A a r e g e n e r a l l y
accep ted , i t is of course poss ib le tha t subsequent resea rch
m i g h t s u g g e s t m o d i f i c a t i o n s .7
One me t h o d t h a t has been found to perfo rm wel l in
d e t e r m i n i n g t h e nu m b e r o f p r i n c i p a l c o mp o ne n t s t o r e t a i n is
th e m i n i m u m a v e r a g e p a r t i a l p rocedure (Vel ice r , 1976;
Zwick & Vel ice r , 1982 , 1986) . We do no t d iscuss t h i s p ro-
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 10/28
USE O F FA CT O R A N A L Y S I S 28 1
So m e of these procedures a re h i g h l y prob l emat i c ( i . e .,
e i genva lue s greate r than 1 , th e l i ke l i hood r a t i o s t a t is -
t ic) , whereas others are l i ke ly t o pe r fo rm re asonab ly
w el l s'. leas t under a range of condi t ions (e .g . , scree
t es t , pa r a l l e l an a lys i s , de sc r i p t i ve i ndexe s o f m o d e l fi t
such a s RMSEA) . Howeve r , even th e best procedures
a r e no t i n f a l l i b l e . Fur the rmore , it is i m p o r t a n t to re-
membe r t ha t th e decis ion of how many fac t o r s to
i n c l u d e in a model i s a substant ive i ssue as wel l as a
s ta t is t ica l i ssue . A mode l t ha t fa i ls to produce a ro-
tated -o lu t ion t ha t i s in te rpre table and theore t i ca l l y
s e n s i b l e h a s l i t t l e va lue . The re fo re , a r e se a rche r
shou ld a lway s cons ider r e l evan t t heo ry and p rev ious
research when de te rmining th e app rop r ia te n u m b e r o f
factors to re ta in . I t should a l so be noted that because
an y i n d i v i d u a l data set is l i ke ly to have i t s own id io-
s y n c r a s i e s , dec i s i on s r ega rd ing t he app rop r i a t e num-
be r o f fac t o r s can be fu r t he r improved by examin ing
th e r e p l i cab i l i t y of the decis ion over m u l t i p l e data sets(Ca t t e i l , 1978). When a g iven numbe r o f fac t o r s fo r a
bat te ry of measu red va r i ab l e s is s h o w n to be a p p r o -
pr ia te in more than one data se t (e .g . , sens ib le ru les
fo r de t e rm in in g t he num be r o f fac to r s g ive s i m i l a r
resul t s , ro t a ted s o lu t i on s p roduce s im i l a r i n t e rp re t ab l e
pa t t e rn s of fac t o r l oad ings ) , a researcher can be m o r e
c o n f i d e n t t ha t t he op t ima l n um be r o f fac t o r s has been
ex t r ac l ed .
Factor rotation. For any g iven so lu t i on wi t h tw o
or more fac t o r s ( o r p r i n c i pa l com pon en t s ) , the re ex is t s
an i n f i n i t e numbe r o f a l t e rna t i ve o r i en t a t i on s o f t he
factors in mul t i d imens iona l space that wil l explain th eda t a equa l l y we l l . Th i s means t ha t EFA mo de l s wi t h
more t han one fac t o r do no t have a un iqu e so lu t i on .
Therefore , a researcher must se lect a s i ng l e so lu t i on
f rom a m o n g t h e i n f i n i t e n u m b e r o f e q u a l l y f i t t ing so -
l u t i o n s .
Th e c r i te r ion mos t c o m m o n l y used fo r selecting
am ong so lu t i on s in EFA i s t he p rope r t y o f s imp le
cedure, because i t is a method for use wi th p r i n c i p a l c o m -
ponen t s and has no t been deve loped for u se wi th common
f ac to r s . A n o t h e r app r o ach t o d e t e r m i n i n g t h e n u m b e r o f
co m po n e n t s i s to e x am i n e t h e co m pa r ab i l i t y o f co m p o n e n tscores ac r o s s s p l i t h a l v e s o f a sample (Eve re t t , 1983) . Un -
fo r tuna t e ly , f o r m a l app r o ach e s f o r d e t e r m i n i n g t h e n u m b e r
o f co m m o n f a c t o r s b as ed on the s tab i l i ty of co m m o n f a c t o r s
h av e n o r b e e n e x t e n s i v e l y d e v e l o pe d a n d te s ted . None the-
less , approaches based on this logic seem like a p r o m i s i n g
d i rec t ion fo r future re search . Cat t e i l ( 1978) sugges ted tha t
t rue fac to r s shou ld rep l i ca te acros s s amples whe reas spu r i -
o u s f a c t o r s s h o u l d b e u n s t a b l e o v e r s am p l e s .
s t ructure (Thurs tone , 1947) . Thurs tone proposed t ha t
fo r any g iven se t o f ma themat i ca l l y equ iva l en t so lu -
t ions , the solut ion wi th the best "s imple s t ructure"
w o u l d g e n e r a l l y be the mos t e as i l y i n t e rp re t ab l e ,
psy cho log i ca l l y m ean ing fu l , and rep l i cab le . Thu r s t -
o n e used th e term simple structure to refer to solu-
t i on s in whi ch e ach fac t o r w as defined by a subse t
of measured var iables that had large loadings rela-
t ive to the other measured var iables ( i . e . , h igh wi th-
i n - f a c to r va r i ab i l i t y in l o a d i n g s ) and in which e ach
measu red va r i ab l e loaded h igh ly on on ly a subse t
of the common fac t o r s ( i . e . , lo w fac to r i a l complex-
it y in defin ing var iables) . Therefore , Thurs ton e sug -
gested that factors be rota ted in m u l t i d i m e n s i o n a l
space to ar r ive at the so lu t i on w i t h th e be s t s imp le
st ructure .
A num be r o f ana ly t i c ro t a t ion me thods have been
deve loped to seek s imple s t ructure , a n d n u m e r o u s a r -
t ic les have been pub l i shed compar i ng t he ut i l i ty o f
these var ious rotat ion procedures (e .g . , Crawford &
Ferguson, 1970; Die lm an , C at te i l , & Wagner , 1972;
Gorsuch , 1970 ; Haks t i an , 1971 ; Haks t i an & Boyd ,
1 9 7 2 ; H o f m a n n , 1 9 7 8 ) . A l t h o u g h t h e s e r o t a t i o n
m e t h o d s differ in a n u m b e r o f respects , p e r h a p s th e
m o s t fundamen t a l dis t inct ion that can be m a d e is be-
tween o r thogona l and ob l ique ro t a t ion s . Or t hogona l
ro t a t i on s cons t r a i n fac t o r s to be unco r re l a t ed . Though
a n u m b e r h a v e b ee n d e v e lo p e d , v a r i m a x ( K a i s er ,
1958) ha s general ly been r ega rded as the best o r-
t hogona l ro t a t i on and i s o v e r w h e l m i n g l y th e m o s t
wide ly used or thogonal rota t ion in psycho log ica l re-se a rch .
In cont ras t to or thogonal rotat ions , obl ique rota-
t i on s pe rmi t co r re l a t i on s among fac t o r s . O n e c o m m o n
mi sconcep t i on among re sea rche r s is that obl ique ro -
t a t i o n s requi re factors to be correlated. This i s not the
case . I f the solut ion wi th the best s imp le s t ruc tu re
i n v o l v e s or t hogona l fac t o r s , a successful obl ique ro -
t a t i o n w i l l p r o v i d e e s t im a t e s o f t h e c o r r e l a t io n s
among fac t o r s t ha t a re close to zero an d p r o d u c e a
so lu t ion t ha t i s qu i t e s im i l a r t o t ha t p roduced by a
successful or t hogona l ro t a t i on ( H a r m a n , 1976) . How-
ever , in s i tuat ion s in whic h the best s im ple s t ructure i s
a solut ion wi th corre la ted factors , suc cessful obl i que
ro t a t i on s w i l l produce so lu t i on s wi t h co r re l a ted fac -
tors . Un l ik e or thogo nal rotat ion , the re i s no s ing le
me thod of ob l i que ro ta t i on t ha t i s c l e a r l y dom inan t i n
p s y c h o l o g i c a l research. Several oblique ro tat ion pro-
cedures a re c o m m o n l y u s e d an d have been found to
gene ra l l y p roduce sa t i s fac t o ry so lu t i on s . These in -
c lude d i r e c t qua r t im in ro t a t ion ( Jenn r i ch & Sampson ,
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 11/28
282 F A B R I G A R , W E G E N E R , M A c C A L L U M , A N D S T R A H A N
1966), p r o m a x ro t a t i on (Hend r i ckson & W h i t e , 1964),
an d Har r i s -Ka i se r o r t ho b l ique ro t a t i on (Har r i s & Kai -
ser, 1964) .8
Some researchers h a v e indicated a preference fo r
or t hogon a l ro t a t i on because of i ts s im p l i c i t y and con -
ceptual c lar i ty (e .g . , N u n n a l l y , 1978) . However , the re
are a n u m b e r of r e asons to ques t i on th e wisdom of t h i s
v i ew. F i r s t , fo r many cons t ruc t s examined i n psycho l -
ogy ( e . g . , men t a l ab i l i t i e s , pe r son a l i t y t r a i t s , a t t i -
t udes ) , t he re i s subs t an t i a l t heo re t i ca l and em pi r i ca l
bas i s fo r expect ing these const ructs (o r d i m e n s i o n s of
t he se cons t ruc t s ) to be corre la ted wi th o n e a n o t h e r .
The re fo re , ob l i que ro t a t i on s p rov ide a more accu ra t e
and re a l i s t i c r e p re sen t a t i on of how c o n s t r u c t s a re
l ikely to be re la ted to one another . Thus , f rom a sub-
stant ive pe r spec t i ve , t he r e s t r i c t i on o f uncor r e l a t ed
fac t o r s imposed by v a r i m a x an d other o r t h o g o n a l ro -
t a t i on s is of t en unwar ran t ed and can y i e l d m i s l e a d i n g
r e su l t s . Second , because o r t hogona l ro t a t i on s r equ i refac tors to be or iented at 90° angles from o n e ano the r
in m ul t i d im ens io na l space ( i . e ., uncor re l a t ed fac to r s )
whe reas ob l i que ro t a ti on s a l l o w fo r o r i en t a t i on s o f
less t h a n 9 0° ( i . e . , corre la ted factors) , or thogonal ro -
t a t i on s a re l i ke ly to produce so lu t i on s wi t h p o o r e r
s imp le s t ruc tu re when c lu s t e r s of va r i ab l e s a re less
th an 9 0 ° f r o m o n e a n o t h e r i n m u l t i d i m e n s i o n a l space
( i . e . , w h e n t h e t r u e u n d e r l y i n g f a c to r s t r u c t u r e is
based on cor rela ted factors) . F i n a l l y , ob l ique so lu t i on s
p r o v i d e more i n fo r m a t i on t han o r t hogona l ro t a t i on s .
O b l i q u e ro t a t i on s p roduce e s t ima t e s o f t he co r re l a -
t i o n s a m o n g c o m m o n f a c to r s . K n o w i n g th e e xt e n t t ov v h i c h factors are corre la ted wi th one ano the r can of -
ren be useful i n i n t e rp re t i ng t he concep tua l n a tu re o f
i he common fac t o r s . I ndeed , th e ex i s t ence of s u b s t a n -
l i a l cor re l a t i on s am ong fac t o r s sugge s t s t ha t h i g he r
o rde r fac t o r s may ex i s t . Cor re l a t i on ma t r i ce s o f fac -
tors can in t u r n be a n a l y z e d to ga in i n s i gh t i n t o th e
n u m b e r a n d n a t u r e o f these higher order factors an d
the r eby fu r t he r r e fi ne a r e se a rche r ' s und e r s t a nd in g of
th e data ( see Go rsu ch , 1983) . Because or thog ona l ro-
t a t i o n s do no t p rov ide co r re l a t i on s am ong fac t o r s , it i s
i m p o s s i b l e t o de t e rmine i f one o r more h i ghe r o rde r
factors are p r e s e n t in the data .
Summary and Recommendations
Th e i m p l e m e n t a t i o n of EFA requires a r e se a rche r
to address f ive major t ype s o f me thodo log i ca l dec i -
s i on s . There are a n u m b e r o f o p t i o n s a v a i l a b l e fo r
each dec i s i on , and t he i s sue s i nvo lved in se lect ing
among t he se op t i on s a re s o m e t i m e s c o m p l e x . N o n e -
t h e l e s s , t h e s e d e c i s i o n s a r e n o t a r b i t r a r y i n t h a t
s o m e o p t i o n s ar e clear ly m o r e op t ima l t han o t he r s .
T h u s , th e ut i l i ty of an EFA i s l i ke ly to be a func t ion
of the decis ions made in the des ign of the s tudy and
the imp lem en ta t ion of the ana lys i s . Indeed, it is inter-
e s t i ng t ha t some no t ab l e example s o f t he supposed
f a i lu r e of EFA to p rov ide va l i d i n s i gh t s i n t o da t a i n -
v o l v e d p o o r f a c to r a n a l y t i c m e t h o d o l o g y . For i n -
s t ance , Arms t rong ' s ( 1967) c l a s s i c demons t r a t i on o f
t he a l l eged l imi t a t i on s of EFA used a P C A , th e e ig-
enva lue s -g re a t e r - t han -1 ru l e , and va r im ax ro t a t ion . I n
l i g h t of the ques t i onab l e na tu re the se cho i ce s , i t is not
su rp r i s i ng the an a ly s i s fa i l ed t o uncove r t he t rue s t ruc-
tu re of the da ta .9
Given these fact s , some clear rec-
o m m e n d a t i o n s c a n b e m a d e r e g a r d i n g h o w E F A
s h o u l d be conduc t ed .
/. Study design. Because E FA r e su l t s a re l i ke ly
to be m o r e accu ra te if sensib le decis ions are m a d e in
se l e c ti ng m easu red va r i ab l e s and samp le s , i t i s es sen -
t i a l t ha t r e se a rche r s ca re fu l l y cons ider bo th o f thesei s sue s . Obv ious ly , because EFA i s used i n s i t ua t i on s
where there i s re la t ive ly l i t t le pr i o r t heo ry and empi r i -
cal evidence , va r iable se lect ion can be dif f icu l t . N o n e -
the less , to the extent i t i s poss ib le , researchers should
tr y t o an t i c i pa t e t he numbe r and na tu re o f t he fac t o r s
they expect to obtain and use thi s as a guide for se-
l e c t i ng va r i ab l e s . W e sugge s t r esea r cher s i n c l u d e a t
l e a s t fou r measu red va r i ab l e s fo r e ach common fac t o r
they expect to em e r g e an d p e r h a p s a s m a n y as s ix
g i v e n t ha t the re i s u sua l l y cons ide rab l e unc e r t a i n t y
a b o u t th e na tu re of the c o m m o n f a c t o r s an d t he i r re-
l a t i on s to the measu red va r i ab l e s . Fu r t he rmore , a l-t h o u g h EFA s h o u l d be based o n c o m p r e h e n s i v e s a m -
8U n f o r t u n a t e l y , th e selection o f obl ique ro ta t ions o f fe red
in ma jo r s ta t i s t ica l packages is q u i t e l i m i t e d . SPSS offers
p r o m a x and Harr i s -Ka ise r o r thobl ique ro ta t ions . Di rec t ob l i -
m in ro ta t ion is a f a m i l y o f ro ta t ions def ined by d i f f e r en t
values of the d e l t a p a r a me t e r , wh i c h g o v e rn s th e o b l i q u e -
ness of the s o lu t i o n . Th e defaul t va lue fo r t h i s p a r a me t e r in
SPSS is 0. wh i c h c o r r e sp o nd s to a d i r e c t q u a r t im in r o t a t i o n .
A ne w EF A p ro g r a m . C E F A ( c o mp re h e n s iv e e x p lo r a t o ry
fac to r ana lys i s ; Browne. Cudeck , Ta teneni . & Mels , 1998)
offers a much wider range o f ro ta t ions .9 A d d i t i o n a l l y , b e c a us e th e data created by A r m s t r o n g
h av e a n u m b e r o f p roper t ies tha t v io la te a ssumpt ions of the
com m on f ac to r model (e .g . , non l in ea r re la t ion s be tween f ac-
to rs and measured va r iab les ) , h i s da ta a re no t rea l ly app ro-
p r i a t e fo r EFA. Nonethe less , w e f o u nd t h a t i f one uses more
o p t i m a l EFA p r ocedures , the ana ly s i s p roduces a so lu t ion
t h a t p ro v id e s a good r e p re s e n ta t i o n o f t h e u n d e r l y i n g s t ru c -
t u re of the d a t a , t h u s i nv a l i d a t i ng A rm s t ro ng ' s a rg u m e n t s
ag a i n s t the use of f a c to r a n a l y s i s .
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 12/28
U SE O F F A C T O R A N A L Y S I S 283
p l i n g of measured var iables in the domain of in te res t ,
we re commend t ha t r e se a rche r s ca r e fu l ly consider the
p s y c h o m e t r i c p r o p e r ti es o f va r i ab l e s . Va r i ab l e s wi t h
lo w r e l i ab i l i t i e s (e .g ., be low .70) sho uld be avoided,
and when val id i ty informat ion i s avai lable , i t should
be used as a bas i s fo r se lect ing i tems. With respect tod e t e r m i n i n g adequate sample s ize , the proper t ies of
t he measu red va r i ab l e s shou ld be t aken i n t o accoun t .
U n d e r g o o d c o n d i t i o n s ( c o m m u n a l i t i e s of .70 or
h ighe r , fou r to f ive va r i ab l e s fo r each factor) , a s a m p l e
size of 100 m i g h t w e l l be adequa t e ( a l t hough it is
always best to have larger sample s izes i f poss ib le) .
U n d e r c o n d i t i o n s o f mode ra t e communa l i t i e s ( e . g . ,
.40 to .70) and mode ra t e ove rde t e rmina t i on of factors ,
a s a m p l e of 200 or more seems adv i sab l e . F ina l l y ,
u n d e r poor cond i t i on s , no s ample s i ze may be suffi-
c i en t t o p roduce accu ra t e e s t ima t e s o f t he popu l a t i on
pa r ameter s . However , it seems l ike ly that a sample
less than 4 00 wi l l lead to dis tor ted resul t s .
2. Appropriateness of EFA. We urge researchers
t o ca re fu l l y cons ide r i f EFA i s t he mos t app rop r i a t e
form of analy s i s to meet the i r research object ives .
EFA sho u ld be u sed w hen t he p r im ary goa l i s t o i den -
t i f y l a tent const ructs an d there is i n su f f i c i e n t basis to
spec ify an a p r i o r i mode l ( o r sm a l l subse t o f m ode l s ) .
CFA should be used when the goal i s to ident i fy l a t en t
cons t ruc t s and a substantial basis exists to speci fy an
a p r i o r i mode l o r sm a l l subset of mode l s . P C A shou ld
no t be used as a subst i tu te for EFA.
3. M,idel-fitting procedures. With re spec t to se-
l e c t ing one of t he ma jo r me thods o f f i t t ing t he com-m o n f ac to r model in EFA ( i .e . , pr incipal factors , i te r-
a te d p r i n c i p a l f a c to r s , m a x i m u m l i ke l i hood) , a l l three
a re r e asonab l e app roach e s wi t h ce r t a i n advan t age s
and disadvantages . No nethe less , the wide rang e of f i t
indexes avai lable fo r ML EFA p rov ides some bas is
fo r p r e f e r r i n g t h i s a p p r o a c h . H o w e v e r , researchers
shou ld r s c o g n i z e that thi s procedure c a n produce mi s -
leading resul ts w h e n a s s u m p t i o n s o f m u l t i v a r i a t e n o r -
m a l i t y are severe ly v iolated ( see Curran e t al . , 1996;
H u et a!. , 1992) . Therefore , w e recom m end that the
d i s t r i b u t i o n s of measu red va r i ab l e s be examined p r i o r
t o conduc t i ng ML EFA. I f n o n n o r m a l i t y is severe
(e.g. , skew > 2; kur t os i s > 7; West , F inch , & C u r r a n ,
1995), one of several r emed ies m i g h t be emp loyed
(see West e t a l . , 1995) . Mea sured v ar ia bles cou ld be
t r an s fo rmed t o no rm a l i ze t he i r d i s t r i bu t i on s . Cor rec-
t ions to f i t indexes and s tandard er ro r s could be per-
fo rmed (Ben t l e r & Dudg eon, 1996; Brow ne, 1984;
Satorra & Ben t l e r , 1994) . A l t e rna t i ve ly , o n e m i g h t
w ish to use a pr i nc i pa l fac t o r s p r o c e d u r e .1 0
4. Determining th e number of factors. W e sug-
gest that researchers re ly on mu l t ip le cr i ter ia w hen
deciding on t he app rop r i a t e numbe r o f factors to in-
c l u d e in a model . In the use of pr incipal factors meth-
ods, w e r e c o m m en d t h e scree test and paral le l analy-
s is us ing e i genva lue s f rom t he r educed co r re l a ti on
m a t r i x . In ML factor analys i s , we encourage the use
of de sc r i p t i ve f i t i ndexe s such a s RMSEA and E C V I
as di s cussed by Bro wne and Cudeck ( 1992) a l ong
w ith m o r e t r ad i ti ona l app roaches such as the scree test
an d p a r a l l e l a n a l y s i s . A sens ib l e s t r a t egy in m o s t
case s wo u ld be t o u se m u l t i p l e me thods t o make t h i s
dec i s i on and t hen ca r e fu l ly examine the rotated solu-
tion for the suggested mode l to confi rm that i t is in-
te rpre table an d t heo re t i ca l l y p l aus ib l e . In s i t ua t i on s in
w h i c h the sample s ize i s su f f i c i en t ly l a rge , a re-
se a rche r migh t a l so wi sh to r a n d o m l y s p l i t th e data
and examine t he s t ab i l i t y o f t he so lu t i on ac ros s th e
tw o ha lve s ( fo r a d i s cus s i on of a s se s si ng fac t o r com-pa r ab i l i ty ac ros s s ample s , see Gorsuch , 1983). In c o n -
texts i n wh ich p rocedu re s sugge s t d i f fe ren t num be r s
of factors or in which the procedures produce s o m e-
what ambiguous resul t s , th e researcher shou ld e x a m -
in e th e subse t o f m odels that these proc edures suggest
a re mos t p l a us ib l e . The ro t a t ed so lu t i on s fo r t he se
m o d e l s can then be e x a m i n e d to see w h i c h m o d e l
p roduce s th e mos t r e ad i l y i n t e rp re t ab l e a n d theore t i -
ca l ly sensib le pat te rn of resul t s (Com rey, 1978; Ford
et al . , 1986; Hakst ian & Mul le r , 1973; Hakst ian e t a l . ,
1982; C . W . Harris, 1967) an d when pos s ib l e whi ch
of these solut ions i s most s table over d i ffe rent data
sets o r spl i t halves of data sets.
5. Rotation. G i v e n th e advantages of ob l ique ro -
ta t ion ove r o r t hogona l ro t a t i on , we see l i t tl e j u s t i f i ca -
t ion fo r u s i ng o rt hogona l ro t a t ion a s a gene ra l ap-
p roach t o ach i ev ing so lu t i on s wi t h s imp le s t ruc tu re
(Gorsuch, 1983) . Ins tead, i t i s most sens ib le to f i rs t
e x a m i n e th e so lu t ion s p roduced by one o r m o r e of the
c o m m o n m e t h o d s of obl iqu e rotat ion (e .g ., prom ax,
or thobl ique , or d i rect q u a r t i m i n ) . I f thi s solut ion in-
10A n o t h e r app r o ach to addres s ing v io la t ions o f n o r m a l -
ity is to create "i tem pa r ce l s " ( i . e . , compos i t e s of seve ra lmeasu red var i ab le s tha t t ap on the s am e co m m o n f a c t o r ) .
C reat ion of such i t em parce l s of ten re su l t s in measu red va r i -
ab le s w i t h m o r e n o r m a l d i s t r i b u t i o n s t h an t h e i n d i v i d u a l
i t ems (Wes t e t al . , 1995) . However , such an approach wi l l
often not be feas ible in EFA, because l i t t le i s k n o w n r e -
g a r d i n g w h i ch m e as u r e d v a r i ab l e s a r e i n f l u e n ce d b y t h e
same common fac to r s , and thus i t wi l l be diff icul t t o fo rm
i tem parce l s .
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 13/28
284 F A B R I G A R , W E G E N E R , M A c C A L L U M , A N D S TRA HA N
dicates that the factors are unco r re l a t ed , then i t is
r e asonab l e for the researcher to c o n d u c t a v a r i m a x
rotat ion and use t h i s as the basis fo r i n t e rp re t a t i on
( t hough t h i s so lu t ion wi l l l ike ly be ve ry s im i l a r t o t he
obl ique solut ion) . On the other hand, i f a t leas t s o m e
of the fac t o r s are f o u n d to be corre la ted wi th on e
another , i t i s most defensible to use the obl ique solu-
t ion as the bas i s for in te rpre tat ion .
I l lus t r a t ion o f Con sequen ces of Cho icesin A n a l y s i s
A s noted ear l ie r , some cr i t i cs of EFA have been
i n su f f i c i en t ly sen s i t i ve to the ex t en t to which pa r t i cu -
la r dec i s i on s abou t ho w t he ana lys i s i s conduc t ed can
i n f luence the resu l t s . In order t o i l l u s t r a t e some of t he
effects t ha t t he se dec i s i on s can have , we re ana lyzed
three data se t s from a wel l -deve loped psycho log i ca l
l i te ra ture on the t r i pa r t i t e mode l of a t t i t ude s t ruc tu re .
A c c o r d i n g to the t r i pa r t i t e mo de l (Rosenbe rg &
H o v l a n d , 1960; Sm i th , 1947), a t t i t ude s have affect ive ,
cogn i t i ve , and behav io ra l componen t s . Tha t i s , fe e l -
i n g s expe r i enced when in the p re sence of an at t i tude
object , be l ie fs about th e a t t r i bu t e s of the object , a n d
pas t o r pre sen t behav io r s r e l evan t to the ob jec t make
u p t h e s t r u c tu r e u n d e r l y i n g o v e r a l l s u m m a r y e v a l u a -
t i o n s ( see Eagly & Chaiken , 1998; Pe t ty , Pr ies te r , &
Wegene r , 1994 ; W e g e n e r & Gregg , in press , fo r m o r e
re cen t d i s cus s i on s ) . Numerous s t ud i e s have i nve s t i -
ga t ed t he hyp o the s i zed t r i p a r t i t e na tu re o f a t t i t ude s
( e . g . , Breck le r , 1984; Kothandapan i , 1971 ; O s t r o m ,•969) , and i n pa r t i cu l a r , t he affect ive a n d c o g n i t i v e
c o m p o n e n t s have rece ived a great deal o f a t t en t i on a s
-.eparable aspec t s of a t t i t ude s t ruc tu re . For example ,
a s se s smen t s o f t he a f fe c t and cogn i t i on a s soc i a t ed
with pa r t i cu l a r a t t i tude ob j ec t s h ave i ndep enden t l y
predicted at t i tudes in a v a r i e t y o f se t t i ngs (e.g., A b e l -
•on . Kinder , Pe te rs , & Fiske, 1982; Cr i tes , Fabr i ga r ,
& Pe t t y , 1994) , and con f i rma to ry ana lyse s have sup-
por t ed m u l t i fac t o r ( tr i pa r t i t e ) r a t he r t han s i ng l e - fac t o r
m ode l s o f t he se a t t i t ude s t ruc tu re s (B reck l e r , 1984).
Moreove r , a t t i t ude s p r im ar i l y based on a f fe c t ve r sus
c o g n i t i o n p red i c t dif fe rent classes of behaviors (e .g . ,M i l l a r & Tesser , 1986, 1989) and a re dif fe rent ia l ly
i n f luenced by a f fe c t i ve ve r sus cogn i t i ve pe r suas ive
appeals (e .g . , Edwards , 1990; Fabr igar & Pet ty, 1999;
M i l l a r & Mil lar , 1990) . Therefore , the re are c o m p e l -
l i n g t heo re t i ca l a n d empi r i ca l r a t i ona l e s fo r sepa ra t i ng
affect and cogn i t i on i n a t t i t ude s t ruc tu re . Because o f
t h i s , the re i s a s t rong bas i s for expect ing that EFA
s h o u l d i dea l l y r ecove r sepa rab le a f fe c t , cog n i t i on , and
( pe rhaps ) behav io r fac t o r s when examin ing re l evan t
data sets.
W e addressed t h i s que s t i on by r e ana lyz i ng t h ree
data se t s from this l i te rature . Fi rs t , we ana lyzed two
9- i t em mat r i ce s f rom Breck l e r ( 1984) . In these mat r i -
ces , three i tems each had been designed to assessaffec t ive , cogn i t i ve , and behav io ra l aspec t s of att i-
tudes , respect ive ly ( see Breckle r , 1984, for de ta i l on
t he measu re s ) . W e took th e thi rd data set f rom Cr i t e s
et a l . ( 1994) , i n whi ch gene ra l measu re s we re deve l -
oped to assess th e a f fe c t i ve an d cogn i t i ve base s o f
a t t i tudes ( three types of measures for each) . In o rde r
to t ake advan t age of the ex i s t ence of an add i t i ona l
measure of affect and an addit ional me as u r e of cog-
n i t i o n spec i f ic to one of the at t i tude objects ( sna kes;
Breckle r , 1984) , we an aly zed 8 i tems from Study 1 of
the Cr i tes et a l . (1994) ar t ic le , in w h i c h p eo p l e re-
s p o n d ed to the a t t i t ude ob j e c t "snakes" ( see Breckle r ,
1984; Crites et al., 1994, for addi t ional de ta i l on the
m e a s u r e s ) .
W e wished to use these data sets to i l l u s t r a t e h o w
d i f f e r e n t p r o c e d u r e s i n c o n d u c t i n g E FA a n a l y s e s
could lead one to e i ther accurate ly o r i n a c c u r a t e l y
ident i fy t he nu m be r and na tu re o f the com m on fac to r s
u n d e r l y i n g these data sets. W e s u b m i t t e d th e matr ices
to a P C A , e x a m i n i n g b o t h a v a r i m a x ( o r th o g o n a l ) an d
a di rect q u a r t i m i n ( ob l i que ) ro t a ti on . W e a l so submi t -
ted the s a m e mat r i ce s to a ML fac t o r ana lys i s , aga i n
e x a m i n i n g both t he va r imax and d i re c t qua r t imin ro-
ta t ions . In order t o de t e rmine t he numbe r o f factors ,
w e e x a m i n e d th e e igenva lue s f rom th e unreduced cor-r e l a ti o n m a t r ic e s a p p l y i n g t h e e i g e n v a l u e s -g r e a t e r -
th an-1 r u l e . For the ML fac to r a na lys i s m ode l s , w e
a l s o e x a m i n e d th e R M S E A an d E C V I i n d e x e s o f
model f i t , as wel l as the scree test an d p a r a l l e l a n a l y s i s
( M o n t a n e l l i & Hum ph reys , 1976) fo r the e i gen va lue s
f rom t he r educed co r re l a t i on ma t r i x .
Th e sample s i ze s w er e 138, 105, an d 164, fo r
Breck le r ( 1984) S tud i e s 1 and 2 and C r i t e s et al.
( 199 4) S tudy 1 , r e spec t i ve ly . Though t he s am ple s i ze s
a r e a b i t s m a l l e r t h a n o n e m i g h t w a n t , t h e s a m p l i n g
e r ro r t ha t migh t occu r i n sma l l s ample s wou ld on ly
work aga i n s t t he obse rva t i on of cons i s t en t r e su l t sac ros s data se t s . Therefore , consis tency ac ros s th e
sample s wou ld i n c re ase con f idence i n t he ob t a i ned
r e su l t s , desp i t e any conce rn s abou t sma l l s ample s .
Th e i n i t i a l c o m m u n a l i t y e s ti m a t es ( s q ua r e d m u l t i p l e
co r re l a t i on s ) a re som ewha t va r i ab l e in e ach s t udy ( see
Table 1) . For Breckle r , Study I , th e e s t ima t e s r anged
f rom .61 to .25 wi th M = .42. Fo r Breckle r , Study 2.
th e e s t ima t e s r anged f rom .81 to .37 wi th M = .62.
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 14/28
U SE O F F AC T O R A N A L Y S I S 285
Table 1
Squared Multiple Correlations (SMCs) for Items in
Breckler (1984; Studies I and 2) and Crites, Fabrigar,
an d Petn (1994; Studv I)
S MC s
Item Study 1Breckle r
Study
Affec t
Th u r s t o ne affect
Mo o d C h e c k l i s t ( + )
Mo o d C h e c k l i s t (-)
Behavio r
A ct i o n sequence
Dis tance
Thurs tone behavio r
C o g n i t i o n
Thurs tone cogni t ion
S e ma n t i c di f fe rent i a l
Lis ted though ts
Cr i tes e t a l .
Affec t
M u l t i r e s po n s e C h e c k l i s t
D i c h c t o m o u s C h e c k l i st
S e m an t i c di f fe rent i a l
Thurs tone a f fec t
C o g n i t i o n
Mu l t i r e s p o n s e C h e c k l i s t
D i c h o t o mo u s C h e c k l i s t
S e ma n t i c different ial
Thurs tone cogni t ion
0.43
0.25
0.33
0.53
0.37
0.56
0.38
0.61
0.35
0.82
0.78
0.78
0.34
0.85
0.79
0.85
0.56
0.54
0.37
0.51
0.73
0.81
0.77
0.50
0.76
0.58
For Cr i t e s e t a l . , Study 1, the es t imated ra nged from
.85 to 34 w ith M = .72. However , these average
c o m m u n a l i t i e s , e spec i a l l y fo r S tudy 2 of B reck l e r
(1984) an d Study 1 of Cr i tes e t a l. ( 1994 ) , a re ac tua l l y
h i g h e r m an th e i n i t i a l communa l i t i e s t ha t o f t en occu r
in appl ied research (see l a te r d i scuss ion) . O f course ,
m o s t v a r i a b l e s in real data w i l l h a v e s u b s t a n t i a l
u n i q u e va r i ance , an d such cond i t i on s shou ld be espe-
c i a l l y l i ke ly to lead to diffe rences be tween EFA
( w h i c h s e p a r a t e l y r e p r e s e n t s c o m m o n a n d u n i q u e
v a r i a n c e in the m o d e l ) an d PC A ( w h i c h does n o t dif-
fe rent ia te between c o m m o n a n d u n i q u e v a r i a n c e ) .
U n f o r t u n a t e l y , i n f o r m a t i o n a b o u t th e d i s t r i b u t i o n a l
p rope r t i e s of the i t ems in the Breckle r (1984) data sets
w as u n a v a i l a b l e . For the Cri tes et al. (1994) data ,
h o w e v e r , th e skew (-0.77 to 0.73, l A f l = 0 .41) and
kur t os i s (-1.02 to 3.28. I A / 1 = 0.79) of the i t ems we re
f a r s m a l l e r t h a n th e r e c o m m e n d e d t h r e s h o l d s fo r
ques t i on i ng th e adequacy of ML e s t ima t i on me thods
( skew > 2, kur t os i s > 7; West et a l . , 1995) . Therefore ,
ac ros s th e data sets w e ana lyzed , co ns i s tency in so lu -
t i on s cou ld p rov ide a compe l l i ng i l l u s t r a t i on of how
t he va r i ous dec i s i on s can i n f luenc e t he r e su l t s fo r r ea l
data .
Number of Factors
Table 2 prov ide s th e e igenva lue s for the reduced
an d unreduced corre la t ion mat r ices fo r each data set.
As can be seen from th e e i g e n v a l u e s for the un re -
d u c e d c o r r e l a t i o n m a t r i x , th e e igenva lue s -g re a t e r -
th an-1 ru le suggested two-factor an d one-factor mod-
e ls for the Breckle r ( 1984) data sets (Studies 1 and 2 ,
respect ive ly) . For the Cr i tes e t a l . ( 1 9 9 4 ) data , the ru le
sugge s t ed a one - fac t o r mode l (see Table 1). Scree
p lo t s o f t he se va lue s , thoug h a bi t a m b i g u o u s , w o u l d
pe rhaps sugge s t one - fac t o r mode l s for all three stud-
i e s . Howeve r , g iven t ha t th e goa l is to ident i fy com-
m on factors , it is more sen s ib l e to e x a m i n e th e scree
p lo t s of the e igenva lue s f rom th e reduced corre la t ion
mat r i ce s . The se p l o t s wou ld o n c e aga in pe rhaps sug-
Table 2
Eigenvalues fo r Breckler (1984; Studies 1 and 2) and Crites, Fabrigar, an d Petty (1994;
Studv I), From th e Unreduced an d Reduced Correlation Matrices
F a c t o r nu mb e r
C o r r e l a t i o n ma t r i c e s
B r e ck l e r Study 1Unre d u c e d
Reduced
B r e ck l e r Study 2
U n r e d u ce d
Reduced
C r i t e s et al. Study 1
Unre d u c e d
Reduced
3
3
5
5
5
5
.84
.30
.59
.24
.72
.48
1.20
0.60
0.91
0.40
0.88
0.50
0.
0,
0,
0,
0,
.98
.39
.70
.34
.46
0.07
0.85
0.20
0.50
0.05
0.38
0.01
0.65
0.02
0.42
-0.04
0.19
-0.05
0.47
-0.10
0.34
-0.07
0.17
-0.06
0.41
-0.12
0.23
-0.09
0.12
-0.08
0.35
-0.21
0.19
-0.13
-0.09
-0.09
0.25
-0.27
0.13
-0.14
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 15/28
286 F A B R I G A R , W E G E N ER , M A c C A L L U M , A N D S T R A H A N
ges t a one-fac tor model for the th ree da ta sets. How-
ever , on t he bas i s o f these scree p l o t s , o n e m i g h t a l s o
argue for a four-fac tor model in the Breckler Study 1
data set, a th r ee - fa c to r m ode l in the Breck le r S tudy 2
data set, an d tw o- fac to r m ode l in the Crites et a l . da ta
set.
W h e n o n e e x a m i n e s th e pa r a l le l a na ly s i s pe r fo rm ed
o n t h e r e d u c e d c o r r e l a t i o n m a t r i x ( M o n t a n e l l i &
H um phreys , 1976) , a one-fac tor so lut io n appears less
reasonable . Fo r Breckler (1984) Study 1 , th e f i r s t four
e igenva lues expec ted fo r r andom da ta (0 .51 , 0.34,
0.25, 0.17) fall below th e obse rved e igenva lues f r om
th e r educed m a t r ix (3.30, 0.60, 0.39,0.20). Fo r Breck-
le r ( 1 9 8 4 ) Study 2, th ree of the f i r s t four e igenvalues
expected fo r r andom da ta (0.60, 0.40, 0.29, 0.20) f a l l
at or be low th e obse rved e igen va lues f rom the re-
duced cor rela t ion m at r ix (5.24. 0.40, 0.34, 0.05) w ith
Tab le 3Selected Fit Indexes for Analyses of Breckler (1984;
Studies I and 2) and Crites, Fabrigar, an d Petty (1994;
Study 1) : RMSEAs and ECVls From ML and PACE
Factor Analyses
Model - f i t t i ng procedure
Breck le r S tudy 1 (n =
RMSEA
M L
P A C E
E C V I
M LP A C E
1
138)
0.15
0.13
1.040.93
N u m b e r
2
0.12"
0.14
0.790.87
of factors
3
0.03"
0.08
0.580.65
4
0.00"
0.25
0.590.97
Breckler Study 2 (n = 105)
RMSEA
M L
P A C E
E C V I
M L
P A C E
Cr i t e s et al. Study 1 (n
R M S E A
M L
P A C E
E C V I
M LP A C E
0.14
0.14
1.16
1 . 1 1
= 164)
0.23
0.23
1.411.38
0.09
0.09
0.85
0.85
0.06
0.06
0.420.41
0.00
0.00
0.68
0.69
0.02
0.04
0.400.41
0.00
0.00
0.76
0.76
h'ote. N on i t e r a t e d p r i n c i p a l f a c t o r i n g a n d P A C E f a c t o r i ng pro-
cjce s i m i l a r s o l u t i o n s w i t h n o b ou n d a ry e s t im a t e s . (See Footnote
1 2 f o r a d e s c r i p t io n o f t h i s a n a ly s i s . ) RM S E A = roo t m e a n sq u a re
e i r o r o f a p p r o x i m a t i o n ; E C V I = e x pe c te d c ro s s - v a l id a t i on i n d e x ;
M L = m a x i m u m l i k e l i h o o d ; P A C E = pa r t i t i on e d c ov a r i a n c e es -t i m a t o r .
"The so lu t i on s n o t e d i n c l u d e d on e o r t w o b ou n d a r y e s t im a t e s ( 0 ) f o r
u n i q u e v a r i a n c e s .
the four th obse rved e igenva lue f a l l i n g fa r below the
four th v a l u e fo r r andom da ta . Fo r Cr i te s et a l . (1994)
Study 1 , tw o o f the four e ige nva lues expec ted fo r
r a n d o m data (0.42, 0.27, 0.19. 0 . 1 1 ) fal l be low th e
obse rved e igen va lues (5 .48. 0.50, 0.07, 0 . 0 1 ) . ' ' T h u s ,
the pa r a l le l a na ly ses ques t ion th e one-fac tor dec is ion
t h a t m i g h t c o m e f r om the e igenva lues -g r ea te r - than-1
ru le . They sug ges t a th r ee - fa c to r s o lu t ion in one of the
Breck le r da ta sets and a tw o- fac to r s o lu t ion in the
Cr i tes et al. data set (both a s expec ted g iven pa s t da ta
and theo ry ) , bu t they sugges t a four - f a c to r s o l u t i o n fo r
S tudy 1 of the Breck le r ( 1 9 8 4 ) da ta .
T h e good nes s -o f - fi t i nd exes , how ever , s t r ong ly
sugges t th e theo re t i c a l ly expec ted f a c to r s t r uc tu r e s
(see Table 3). For the Breck le r (1984 ) da ta s e t s .
R M S E A s h o w s p o o r fi t wi th th e one- fa c to r m ode l a n d
presents s u b s t a n t i a l i m p r o v e m e n t w i t h a th ree-fac tor
m ode l . Moreove r , ove r a l l f i t becom es qu i te good (see
B r o w n e & C u d e c k , 1992)w h e n th e th i rd f a c to r isadded. There i s a l s o ve ry l i t t l e ove r lap in the 90%
conf idence in te rva l s ( C I ) for the tw o- fac to r (RMSEA
= 0.12, C I = 0.09-0.16 fo r Study 1 ; R M S E A =
0.09, C I = 0.04-0.14 fo r Study 2) and th ree-fac tor
models (RMSEA = 0.03, CI = 0.00-0.10 for Study
1 ; R M S E A = 0.00, C I = 0.00-0.00 fo r Study 2) but
com p le te ove r lap be tw een th e th ree- a n d four - f a c to r
m ode l s (RMSEA = 0.00, C I = 0.00-0.07 fo r Study
1 : R M S E A = 0.00,C I = 0.00-0.00 fo r Study 2). The
ECV I ha s i t low es t va lue ( i .e . , the sm a l le s t po in t e s -
t i m a t e fo r a p r ed ic ted d i s c r epancy in a new s am p le )
fo r th e three-factor model . This pat tern c lear ly sug-
gests th e th r ee - fa c to r m ode l a s supe r io r to the one-o r
tw o- fac to r m ode l s . For the Crites et al . (1994 ) da ta ,
th e expec ted tw o- fac to r s t r uc tu r e is s t r o n g l y sug-
ges ted. Th e m ode l h as q u i t e p o o r fi t w i t h o n e fac tor
1' A s noted ear l i e r , t he re have a l so been para l l e l ana lyses
deve loped for de te rm in in g the num ber of com pon en t s to
r e t a i n ( e .g . , Longman e t al. , 1989) . G iven ou r in te re s t of
d e t e r m i n i n g th e n u m b e r o f f a c t o r s u n d e r l y i n g th e data , h o w -
eve r , i t s eems m os t reasonab le to u se the para l l e l an a ly s i s
m e t h o d d e s i g n e d f o r d e t e r m i n i n g t h e n u m b e r o f co m m o n
factors ( i . e. , p a r a l l e l an a l y s i s w i t h s q u a r e d m u l t i p l e cor re -lat ions in the d iagonal of the cor re l a t i on mat r ix ) . Us ing
p a r a l l e l a n a l y s e s for the un reduced mat r ix sugges t s ex t rac-
t i on o f a s i n g le p r i n c i p l e co m po n e n t ( t h o u g h s u ch a co n c l u -
s ion i s ques t ioned by the para l l e l ana lys i s on the reduced
mat r ix and by the indexes of EFA m od e l fi t ) . Mor e ov e r , on e
w o u l d want to be cau t ious abou t accept ing a s ing le fac to r
m o d e l in t h i s co n t e x t g i v e n t h a t u n d e r f a c t o r i n g i s of ten
t h o u g h t to be a more severe e r ror t h an o v e r f a c t o r i n g .
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 16/28
USE OF F A C T O R A N A L Y S I S 287
and acceptable f i t wi th two factors . Moreover , the re i s
n o o v e r l a p in the 90% C Is for the one-factor (RMSEA
= 0.23, C I = 0.20-0.26) an d two- fac t o r mode l s
( R M S E A = 0.06, C I = 0.00-0.11) but n e a r l y com-
ple te over lap be tween th e two- an d three-factor mod-
els ( R M S E A = 0.02, C I = 0.00-0.10). A g a i n , E C V I
fa i ls t o improve beyond t he level obtained wi th th e
t heore t i ca l l y expec t ed numbe r of factors .
When taken toge ther , these ana lyse s p rov ide a use-
f u l i l l u s t r a t i on of how nonop t ima l p rocedu re s can lead
a researcher to m i s l e a d i n g c o n c l u s i o n s r e g a r d in g th e
a p p r o p r i a t e n u m b e r o f f a c t o r s . Th e e i g e n v a l u e s -
grea ter-i ban- 1 ru le consis tent ly suggested fewer fac-
to rs than pas t research an d theory would indicate was
m o s t p l a u s i b l e fo r each data set. The scree test pro-
v ided som ewha t am b iguou s i n fo rm a t i on . I n con t r a s t ,
pa ra l l e l ana lys i s sugge s t ed th e m o s t p l a u s i b l e n u m b e r
of factors for two of the three data sets, and m o d e l fi t
suggested the mo st plau sib le num ber of factors in a l lthree data se t s . Thus , consis tent wi th th e m e t h o d o l o g i -
ca l l i t e r a tu re , a researcher c lea r ly would have been
be tt e r se rved re l y i ng on p a ra l l e l ana lys i s and m ode l f i t
th an t he e i genva lue s -g re a t e r -t han -1 ru l e when de te r -
m i n i n g th e n u m b e r of factors fo r these data.
Orthogonal Versus Oblique Rotations
Resea rche r s are often tempted to seek "concep tu-
a l l y d i s t i n c t " fac t o r s by conduc t i ng va r im ax ( o r t hogo-
n a l ) ro t a t i on s i n fac t o r an a lys e s . It i s som e t imes
t h o u g h t that thi s re tent ion o f s t a t i s t i ca l l y i ndependen t
factors "c leans up" and c l a r i f i e s s o l u t i o n s , m a k i n gthem ea s ie r to i n t e rp re t . Unfo r tuna t e l y , t h i s i n tu i t i on
is exact.ly th e oppos i te of w h a t th e methodo log i ca l
l i te rature suggests , and the present resul t s bear out the
methodo logy-based conc lus i on s . Tables 4, 5 , and 6
pre sen t PC A and ML fac t o r ana lys i s r e su l t s (the left
an d r i g h t c o l u m n s ) u s i n g v a r i m a x an d di rect quar t i -
m i n r o t a t i o n s (the t op and bot t om por t i on s of the
t ables) . Fo r ease of e x a m i n a t i o n , l o a d i n g s a b o ve 0.30
are presented in bold face. W e have ordered factors
s i m i l a r l y for each analys i s ( for the Breckle r data se t s ,
w ith th e most "affective" factors first , m o s t "behav-
iora l" factors second, an d mos t " cogn i t ive" fac t o r st h i rd ; for the Cr i tes e t a l. data , wi th the m ost "affec-
t ive" factor first , an d m o s t "cogn i t ive" factor second) .
Fo r each of the s tud i e s , it would have been un fo r -
t u n a t e for a researcher to re ly sole ly on a v a r i m a x
ro t a t i on . Examin ing on ly t hose l oad ings above 0.30,
the re are m any m ore c ros s -fac to r l oad ings ( i . e . , i t ems
th a t load above 0.30 fo r more t han on e fac t o r ) wi t h
the or thogonal rotat ion . A cr o s s the s ix va r imax ro t a -
t ions repor ted in Tables 4, 5, and 6, there are 28 t imes
tha t an i tem is found to load on m o r e t han on e factor
( o r componen t ) . Howeve r , the s ix d i re c t qua r t imin
rotat ions repor ted in Tables 4, 5, and 6 p r o d u c e o n l y
e igh t c ros s -fac to r l oad ings . Exa m in in g th e l o a d i n g s
be low 0.30, th e va r imax ro t a t i on p roduced on ly 1 3%
with m a g n i t u d e s ( i g n o r i n g s i g n ) of less than 0.10;
42.6% h a d values be tween 0.10 and 0.20, an d 44.4%
had va lu e s g re a te r t han 0.20. U s i n g th e di rect quar t i -
m in r o t a t i o n , 60.8% of the l oad ings be low 0.30 h ad
m a g n i t u d e s e q ua l o r less than 0.10; 25.3%h ad va lue s
between 0.10 an d 0.20, an d o n l y 13.9% had va lue s
greate r than 0.20 ( de sp i t e i n c lud ing the 25 l oad ings
that fell below 0.30 using direct qua r t imin but were
above 0.30 us ing va r imax) . The re fo re , i t seems qu i t e
clear that d i rect quar t imin (theob l ique ro t a t i on ) pro-
vided super ior s imple s t ructure .
Besides th e "c leane r" so lu t i on s p rov ided by the ob-
l ique ro t a t i on , a r e se a rche r r e l y i ng on an o r t h o g o n a lrotat ion would a l so forfeit an y k n o w l e d g e of the ex-
i s t i ng co r re l a t ion s am ong fac to r s . A l t ho ugh some o f
t he va r imax so lu t i on s fo r t he cu r ren t da t a ( e . g . , t he
M L fac t o r ana lys i s so lu ti on fo r Breckle r , 1984, Study
1 ) m i g h t h a v e led the researcher to t h i n k in t e rms o f
"affect , behavior , an d cogn i t i on ," he or she m i g h t
have t h ough t tha t t here w as l i t t l e reason to t h i n k of the
three factors a s cor rela ted ( g iven th e or t hogona l rota-
t i on ) . Yet, w h e n th e d i re c t qua r t im in ro ta t i on w a s
used on the same data , i t not on ly p roduced better
s i m p l e st ructure c lear ly breaking a long affect ive , be-
havioral , and cogni t ive l ines , but i t a l so revealed thatthe factors were corre la ted in the .4-.6 r a n g e (see
Tables 4 , 5, and 6) .
Factor Analysis Versus Principal Components
C o m p a r i n g the PCA and EFA c o l u m n s a l s o pro-
v ide s s o m e use fu l i n f o r m a t i o n . A s no t ed e a r l i e r ,
W i d a m a n ( 1 9 9 3 ) used s imu l a t i on da t a to show t ha t
P C A i n f l a t e s l oad ings when co mp a r e d with factor
a n a l y s i s . W i d a m a n f o u n d t h a t "salient" loadings ( i . e . ,
th e h ighe s t l oad ings on a g iven fac t o r ) a re h i g h e r in
PC A than i n fac t o r ana lys i s and t ha t such i n f l a t ion isg re a t e r when th e sal ient loadings a re mo r e mode ra t e
in value (e .g. , 0.40 i n t he popu l a t i on ) r a t he r t han h i gh
(e.g. , 0.80 in the p o p u l a t i o n ) . Because factor an d com-
ponen t ana lyse s l e ad to some di ffe rences in the pat-
te rns o f l oad ings acro ss factors in the current data ,
d i r e c t compar i sons o f l o a d i n g s m i g h t n o t a l w a y s be
m e a n i n g f u l . Yet, an ove ra l l pa t t e rn cons i s t en t wi t h
Widaman ' s ( 1993) ana lyse s seems to be pre sen t .
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 17/28
288 F A B R I G A R , W E G E N E R , I V Uc C A L L U M , A N D S T R A H A N
Table 4
Loadings fo r Principal Components an d Common Factors Using Varimax and Direct
Quartimin Rotations: Breckler (1984: Study I)
R o t a t i o n
I tem
P r i n c i p a l c o m p o n e n t s
a n a l y s i s ( c o m p o n e n t s )
1 2 3
M a x i m u m l i k e l i h o o d
fac to r ana ly s i s ( f ac t o r s )
1 2 3V a r i m a x
Affec t
Thurs t one a f fec t 0.83 0.29 0.09 0.99 0.10 0.11
M o o d C h e c k l i s t (+) 0.47 0.57 -0.19 0.43 0.1 5 0.1 3
M o o d C h e c k l i s t (-) 0.77 -0.05 0.34 0.46 0.23 0.16
B e h a v i o r
A c t i o n se qu en ce 0.25 0.66 0.37 0.24 0.86 0.20
Dis tan ce -0.05 0.80 0.25 0.1 5 0.49 0.34
Thurs t one behavio r 0 .19 0.66 0.46 0.28 0.60 0.40
Cognition
Thurs t on e cog ni t i o n 0 .03 0.11 0.78 0.10 0.17 0.58
Sem an t ic diffe ren t ial 0 .12 0.39 0.77 0.17 0.26 0.95
Lis ted th ou gh ts 0.26 0.1 7 0.68 0.23 0.27 0.47
D i r e c t q u a r t i m i n
Affec t
Thurs t one a f fec t
M o o d C h e c k l i s t ( + )
M o o d C h e c k l i s t (-)
B e h a v i o r
A c t i o n s e q u e n c e
D i s t a n c e
T h u r s t o n e b e h a v i o r
C o g n i t i o n
T h u r s t o n e c o g n i t i o n
S e m a n t i c d i ff e r e n t i a l
L i s t ed t hough t s
0.82
0.40
0.81
0 .14
-0.20
0.08
0.00
0.04
0.23
C o r r e l a t i o n sj _
2
3
.32
.1 8
0.18
0.57
-0.20
0.64
0.84
0.64
0.04
0.34
0.08
a m o n g f a c t o r s
.28
-0.06
-0.35
0.26
0.23
0.12
0.33
0.78
0.71
0.63
1.08
0.43
0.45
0.03
-0.01
0.10
-0.01
-0.01
0 .12
-0.14
0.04
0.13
0.97
0.47
0.56
-0.01
-0.04
0 .13
-0.05
0.03
0.03
-0.12
0.20
0.21
0.62
1.02
0.43
o r c o m p o n e n t s
—
.51
.42 .60 —
Note. Loa d i n gs in bold a re va lue s above 0.30.
If one takes a l l the loadings tha t a re above 0.30 for
at least one of the ana ly ses (PCA or ML fac to r ana ly -
s i s ) an d compa res th e m a g n i t u d e of those load ings
ac ro ss me thods , t he PCA load ings tend to be h igh e r .
Fo r examp le , the sa l i en t l o ad ings fo r Com pon en t 2 o f
th e va r imax ro ta t ion in Study 1 ( in bold on Table 4)
have va lues of 0.57, 0.66, 0.80, 0.66, and 0.39 (M =
0.62). Th e co r re sponding load ings for the ML factor
ana lys i s (Fac tor 2) are 0.15, 0.86, 0.49, 0.60, an d 0.26
(M = 0.47). There a re 16 such com pa r i sons a c ro ss
th e ana ly ses p re sen ted , and 12 of the c o m p a r i s o n s
s h o w h igh e r sa l i en t lo ad ings fo r c o m p o n e n t s t h a n fo r
fac t o r s . A l t h o u g h e x i s t in g w o r k h a s g e n e r a l l y e x a m -
i ned poss ib le inf la t ion of sa l i en t lo ad ings , som e of the
i n f l a t ions in the current da ta a re "nonsa l ien t" l o ad ings
f rom f a c to r ana ly ses t ha t become l a rge enough fo r
some re sea rchers t o cons ide r t hem sa l i en t i n de f in ing
a c o m p o n e n t . Su c h i n f l a ti o n s w o u ld pose a po ten t i a l l y
ma jo r p roblem, because they could change th e pre-
s u m e d n a t u r e an d i n t e rp re t a t i on of the cons t ruc t s un -
der i n v e s t i g a t i o n . O n e poss ib le i ns t ance o f such inf la-
t ion i s the c rea t ion o f a s i zeab le l oad ing of the Affec t
Dicho tom ous Ch eckl i s t (0 .57) i n the PC A s o l u t i o n fo r
Cr i t e s et a l . (1994) Study 1 in w h i c h th e direc t quar-
t i m i n ro ta t ion was used (see Table 4) . The same load-
in g ( o f an "a f fec t " i t em on a p r ima r i l y "cogn i t ive"
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 18/28
U S E O F F A C T O R A N A L Y S I S 289
Table 5
Loadings fo r Principal Components an d Common Factors Using Varimax an d Direct
Quartimin Rotations: Breckler (1984; Study 2)
R o t a t i o n
ItemV a r i m a x
Affec t
T h u r s t o n e affect
Mo o d C h e c k l i s t ( + )
Mo o d C h e c k l i s t (-)
B e h a v io r
A ct i o n sequence
Dis tance
Thurs tone behavio r
C o g n i t i o n
Th u r s t o ne c o g n i t i o n
S e ma n t i c different ial
Lis ted though ts
Direc t Quar t imin
Affec t
Th u r s t o ne affect
Mo o d C h e c k l i s t ( + )
Mo o d C h e c k l i s t (-)
B e h a v io r
Ac t ion sequence
Dis tance
Thurs tone behavio r
C o g n i t i o n
Th u r s t o ne c o g n i t i o n
S e ma n t i c di f fe rent i a l
Lis ted though ts
P r i n c i p a l c o mp o ne n t s
an a l y s i s ( c o m p o n e n t s )
1
0.72
0.89
0.31
0.27
0.25
0.24
0.08
0.36
0.53
0.68
0.98
0 . 1 1
0.01
-0.05
-0.04
-0.05
0.18
0.42
2
0.43
0.18
0.69
0.81
0.89
0.84
0.22
0.55
0.49
0.24
-0.11
0.72
0.87
1.01
0.90
-0.07
0.36
0.32
3
0.18
0.07
0.19
0.27
0.19
0.29
0.94
0.65
0.39
0.03
-0.04
-0.01
0.04
-0.07
0.07
1.02
0.56
0.26
M a x i m u m l ik e l i h o o d
fac to r ana lys i s ( f ac to rs )
1
0.75
0.63
0.40
0.39
0.32
0.36
0.13
0.43
0.57
0.81
0.71
0.22
0.10
-0.09
0.04
-0.06
0.24
0.51
2
0.32
0.24
0.53
0.69
0.90
0.73
0.22
0.44
0.38
0.02
-0.01
0.49
0.72
1.10
0.79
-0.01
0.19
0 .14
3
0.20
0.12
0.28
0.34
0.24
0.36
0.76
0.70
0.39
0.01
-0.05
0.08
0.10
-0.10
0.11
0.84
0.63
0.25
Corre la t ions among f ac to rs o r c o mp o ne n t s
.59
.35 .56
.73
.52 .64
Note. Lo ad i ng s in bold ar e valu es above 0.30.
component) was 0.09 in the fac tor ana lysis . I t i s c lea r
to see th a t th e di rec t q u a r t i m i n M L so lu t ions a re sub-
s t an t i a l ly "cleaner" t h an th e same ro ta t ion o f the PC A
so lu t i on s .
A n o t h e r notable dif ference between the PCA and
M L s o l u t i o n s c o n c e r n s t h e i d e n t i fi e d c o r r e l a t i o n s
among f a c to r s . Cons i s t en t w i th W i d a m a n ' s (1993)
s i m u l a t i o n s , the corre la t ions ident i f ied by obl ique ro-
ta t ion of t he PCA so lu t ion were subs tan t i a l ly l ower
th an th e co r re l a t i ons iden t i f ied by the same ro ta t ion o f
th e ML fac to r an a ly s i s . I t makes sense t ha t PCA s
should gen e ra l l y unde res t im a te re l a ti ons amon g the
const ruc ts , because random error i s i nc luded in t he
com ponen t s . Because f a c to r ana ly ses remove random
error f rom the fac tors , the re la t ions among fac tors a re
m o r e l ike ly to app roach th e popula t ion va lues . Such
d i f f e r e n c e s a r e e s p e c i a l l y e v i d e n t i n a n a l y s e s o f
Breck le r ( 1984) S tudy 1 . The co r re l a t ions among
components ( i .e . , .32, .18, and .28) were roughly ha lf
the m ag ni tu de of the corre la t ions am ong fac tors ( i .e . ,
.51 , .42, an d .60). If a researcher had used a P C A , h e
or she would have been tempted to conc lude tha t the
componen t s were l a rge ly i ndependen t . However , us-
in g an EFA, th e same researcher would have rea l ized
t ha t the smal lest of the interfac tor corre la t ions was
ac tua l ly greater than 0.4. These would ce r t a in ly be
ra ther dif ferent conc lusions. Simila r def la t ions of cor-
re la t ions occur for the P C A s o f Breckler (1984) Study
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 19/28
290 F A B R I G A R , W E G E N E R , M A c C A L L U M , A N D S T R A H A N
Table 6
Loadings for Principal Components an d Common Factors Using Varimax an d Direct
Quartimin Rotations: Criles, Fabrigar, and Petty (1994; Study 1)
P r i n c i p a l c o m p o n e n t s M a x i m u m l i k e l i h o o d
D t t - a u d i ^ M * ^ u i i i p u i i c H U V i d t- i ui a n a l y s i s uacioisj
I temV a r i m a x
Affec t
M u l t i r e s p o n s e C h e c k l i s t
D i c h o t o m o u s C h e c k l i s t
S e m a n t i c di f fe re n t i a l
Thurs t one a f fec t
C o g n i t i o n
M u l t i r e s p o n s e C h e c k l i s t
D i c h o t o m o u s C h e c k l i s t
S e m a n t i c d i f f e r en t i a l
T h u r s t o n e c o g n i t i o n
Direct Q u ar t i m i n
Affec t
M u l t i r e s p o n s e C h e c k l i s t
D i c h o to m o u s C h e c k l i s t
S e m a n t i c differentia l
Thurs t one a f fec t
C o g n i t i o n
M u l t i r e s p o n s e C h e c k l i s t
D i c h o t o m o u s C h e c k l i s t
S e m a n t i c di f fe re n t i a l
T h u r s t o n e c o g n i t i o n
Cor re l a t i ons
1
2
1
0.63
0.67
0.57
0.91
0.27
0.31
0.28
0.15
0.42
0.49
0.35
0.94
-0.04
0.01
-0.04
-0.15
a m o n g
—
.46
i
0.66
0.61
0.70
0.09
0.89
0.86
0.90
0.83
0.64
0.57
0.69
-0.04
0.95
0.90
0.95
0.90
factors o r c o m p o n e n t s
—
1
0.81
0.80
0.74
0.56
0.38
0.40
0.41
0.38
0.82
0.84
0.70
0.66
-0.04
0.02
0.01
0.11
—
.77
2
0.48
0.44
0.52
0.20
0.87
0.81
0.85
0.64
0.15
0.09
0.24
-0.09
0.98
0.89
0.94
0.66
—
Note. L o a d i n g s in bold a re v a lu e s abo ve 0.30.
2 (see Table 5) and Crites et al. (1994) Study 1 (see
Table 6) .l 2
The a n a l y s e s of the Breckler (1984) and Crites et
a l . (1994) data provide e x a m p l e s o f h o w q u e s t i o n a b l e
12It is w o r t h n o t i n g t h a t s o m e p a r a m e t e r e s ti m a t i o n p ro b -
k m s were encounte red i n the ML a n a l y s e s of the Breckle r
(1 984 ) Study 1 data set . H e y w o o d cases we re e n c o u n t e r e d
f . i r th e two- , t h ree - , and four - fac to r model s . I t i s pe rhaps no t
s u r p r i s i n g t h a t di f f i cu l t i e s were encounte red fo r one o f the
f lur-factor model s g iven t ha t th i s model i s a lmos t c e r t a i n l y
i n a p p ro p r i a t e for the present data ( i .e. , the model i s over-
f ac to red) . O n e c o m m o n reason fo r e n c o u n t e r i n g s u c h e s t i -
ma t ion p rob lems i s wh en a mi sspec i f i ed mo del i s f i t t o the
da ta . I n th e ca se of the th ree- fac to r model fo r S tudy 1 , th e
theo re t i ca l p l a u s i b i l i t y of t he so lu t i on and t he comparab i l i t y
o f t h i s s o l u t i o n w i t h t he t h ree- fac to r model so lu t i on fo r
Study 2 and the two- fac to r so lu t i on from the Cr i t es e t a l .
(!9 9 4 ) da ta sugges t t ha t th e exi s t ence o f H e y w o o d c a s e s
d. i es n o t cons t i t u t e a se r ious p r o b l e m . N o n e t h e l e s s , to ex-
am ine i f t he r esu l t s o f the ML an a lyses ha d p roduced un-
u - u a l r e s u l t s a s a f u n c t i o n o f severe n o n n o r m a l i t y i n the da t a
( w h i c h could no t be tested for the Breckler data sets), w e
conduc ted n o n i t e r a t e d p r i n c i p a l f a c t o r a n a l y s e s fo r these
da t a . These a n a l y s e s produced r esu l t s very s imi l a r to t hose
of the ML a n a l y s e s . A d d i t i o n a l l y , th e noni t e r a t ed p r i nc ipa l
f ac to r so lu t i ons fo r t he four - fac to r model s conf i rmed t ha t a
four - fac to r model was in f ac t i napp rop r i a t e fo r these da ta .
Th e four - fac to r model s ( a s was the ca se fo r the ML a n a l y -
ses) fa i led to p roduce r ead i l y i n t e rp re t ab le o r p l a u s i b l e so -
l u t i o n s . N o e s t i m a t i o n p r o b l e m s were encounte red i n any of
t h e a n a l y s e s of the Cr i t es et al . (1994 ) da t a se t , an d n o t
s u r p r i s i n g l y th e noni t e r a t ed p r i nc ipa l f ac t o r ana ly ses o f
these data p ro d u c e d so lu t i ons very s imi l a r t o the ML a n a l y -
ses. Final ly , to fur ther test th e stabi l i ty of the ML so lu t ions
across a ll three data sets , w e c o nd u c t e d ana lyses us ing Pa r -
t i t i o n e d C o v a r i a n c e M a t r i x E s t i m a t o r F a c t o r A n a l y s i s
( P A C E ; C u d e ck . 1991 ) . Th i s p ro c e d u re is a v a i l a b l e i n the
p rog ram C E F A ( B r o w n e et al.. 1998). It is a noni t e r a t ed
c o m m o n f a c to r m o d e l - f it t i n g p r o c e d u r e t h a t p e r m i t s th e
c o m p u t a t i o n o f t h e s a m e f i t i ndexes ava i l ab le i n ML. The
P A C E a n a l y s e s p r o d u c e d p a t t e r n s of fi t i n d e x e s a c ro s s th e
m o d e l s t h a t were c o m p a r a b l e to those of the ML a n a l y s e s .
Th e so lu t i ons obt a ined f rom th e P A C E ana lyses were a l so
q u i t e s i m i l a r to t hose of the ML analyses .
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 20/28
U SE O F F AC T O R A N A L Y S I S 29 1
procedu re s can p roduce resul t s that a re r a t he r con fus -
in g an d m i s l e a d i n g . For all three studies, an EFA w i t h
an ob l i que ro t a ti on p ro v ide s m uch be t te r s imp le s t ruc-
ture , more in te rpre table resul t s , an d more t heore t i ca l l y
p l a u s i b l e r e p re sen t a t i on s of the data than a P C A w i t h
an or t hogona l ro t a t i on . Moreove r , th e ob l ique ro t a t i on
( e s p e c i a l l y when pa i r ed w i t h EFA ra t he r t han PCA)
p r o v i d e s i m p o r t a n t i n f o r m a t i o n c o n c e r n i n g th e r e l a -
t ions am ong ext racted factors . A cr o s s th e e x a m p l e
data sets, we see that d i ffe rent procedures fo r dete r-
m i n i n g t he app rop r i a t e numbe r o f fac t o r s , d i f fe ren t
a n a l y t i c m e t h o d s (PCAvs . EFA),an d dif fe rent rota-
t ion pro cedures a l l have an effect on resu l t s and in-
te rpretat ions.
The Use o f Factor A n a l y s i s in C u r r e n t
Psycho log i ca l Resea rch
O n e obv ious que s t i on t ha t a r i se s f rom o ur review
a n d i l l u s t r a t i on i s the i ssue of the extent to which
r e s e a r c h e r s a c t u a l l y use the p r o c e d u r e s w e h a v e
s h o w n to produce m i s l e ad in g re su l t s . A n a n s w e r to
t h i s ques t ion i s no t r e a d i l y a v a i l a b le . A l t h o u g h m e t h -
odologis t s have often commented on the use of factor
a n a l y s i s in psycho logy ( e . g . , C o m r e y , 1978;Ford et
a l . , 1986;M c N e m a r , 1 9 5 1 ; S k i n n e r , 1980; see a l so
G o r s u c h . 1983) , most of t he se c r i t i c i sm s have been
based on sub j e c t i ve imp re s s i on s r a t he r t han sys t em-
at ic r e v i e w s of pub l i s hed app l i ca t i on s . One excep t i on
is a r ev i ew of EFA pract ices repor ted byFord
et al.
( 1986) . T h e y s y s t e m a t i c a l l y e x a m i n e d a p p l i c a t i o n s of
EFA p u b l i s h e d b e t w e en 1975an d 1984in the area of
i n d u s t r i a l - o r g a n i z a t i o n a l p s y c h o l o g y . T h e y con-
c luded t ha t fac t o r an a ly t i c p r ac t ice s w i t h i n thi s area
were gene ra l l y i n con s i s t en t wi t h the m e thodo log i ca l
l i t e r a tu r e . H o w e v e r , t h e i r r e v i ew did no t f u l l y address
s tudy des ign i s sue s , was con f i ned to a s i ng l e a rea of
p s y c h o l o g y , and cove red app l i ca t i on s pub l i shed 14 o r
m o r e y;:ars ago.
Assessing Current Factor Analytic Practices
To e x p l o r e th e ques t i on of how fac t o r ana lys i s is
c u r r e n t l y used in psycho log i ca l r e se a rch , w e con-
ducted a sys t emat i c r ev i ew of a r t i c l e s pub l i shed f rom
1991 t h rough 1995 in the Journal of Personality an d
Social Psychology (JPSP) and the Journal of Applied
Psychology (JAP). W e se lected these journals , be-
cause they represent tw o areas of p s y c h o l o g y ( p e r s o n -
a l i t y - soc i a l p sycho logy a n d i ndus t r i a l -o rgan i za t i ona l
p s y c h o l o g y ) in w h i c h EFA ha s been wide ly used. W e
also chose these par t icular j o u r n a l s , because both a re
a m o n g th e mos t p re s t i g i ous j ou rna l s in t he i r r e spec-
t ive a re as , so t he a r t i c l e s found i n t he se j ou rna l s
s h o u l d p re sumab ly r e f l e c t me thodo log i ca l l y r i go rous
w o r k .
I n ou r r ev i ew, we examined eve ry a r t ic l e pub l i shed
in t he se j ou rna l s du r i ng th e spec i f i ed t ime per iod to
dete rmine i f any of the s ta t i s t ica l analyses repor ted in
t he a r t i c l e add re ssed an exp lo ra t o ry fac t o r an a ly t i c
que s t i on . If one or more ana lyse s of t h i s t ype w as
conducted, w e t h e n e x a m i n e d th e desc r i p t i on of each
a n a l y s i s . Studies were coded for the ra t io o f m e a s u r e d
var iables to factors , ave rage re l iabi l i ty (o r c o m m u n a l -
i t y ) of the measu red va r i ab l e s , s amp le s ize , examin a-
t ion o f c o m m o n f a c to r s v e r s u s p r i n c i p a l c o m p o n e n t s ,
mo de l - fi t ti ng p rocedu re , m e thod fo r de t e rm in ing t he
n u m b e r o f fac t o r s , an d ro t a t i on p rocedu re. The r e su l t s
of t h i s r ev i ew are presented in Table 7. The f i r s t tw o
c o l u m n s of the t able indicate th e n u m b e r of a r t i c l e s
and co r re spond ing pe rcen t age of t o t a l numbe r of a r-
t i c les f a l l i ng in to each category fo r JPSP. The t h i rd
and fou r t h co lumns p re sen t t he s ame i n fo rma t i on fo r
JAP.
There are several aspects o f these resul t s that mer i t
c o m m e n t a r y . F i r s t , o ur r ev i ew i nd i ca t e s t ha t E FA
c o n t i n u e s to be an ex t reme ly popu l a r s t a t i s t i ca l pro-
cedure in psycho log i ca l r e se a rch . A tota l of 159 of the
88 3 a r t i c l e s pub l i shed in 60 i ssues of JPSP ove r a
5-year pe r iod repor ted EFAs. A tota l of 58 of 455
a r t i c l e s pub l i shed in 30 i s sue s of JAP over th e s a m e5-year pe r iod repor ted EFAs. Thus, th e t yp i ca l i s sue
of t he se j ou rna l s con t a i ned two o r three ar t ic les us ing
EFA.
The f i r s t sect ion of Table 7 s h o w s th e d i s t r i bu t i on
of v a r i a b l e to fac t o r r a t i os . These r e su l t s i nd i ca t e t ha t
th e grea t ma jo r i t y o f ana lyse s we re based on ra t ios of
at least 4; 1 . Thus , i n mos t ana lyse s , fac to r s we re p rob-
ab ly adequa t e l y ove rde t e rmined . Howeve r , t he re w a s
a n on t r i v i a l num be r o f a r t i c l e s ( i. e ., abou t one i n f ive)
w ith ra t ios be low 4 :1 . Thi s f i n d i n g i s n o t e w o r t h y ,
because o n e c o n d i t i o n in w h i c h P C A s p r o d u c e sub-
s t an t i a l l y inf la ted e s t ima t e s o f fac to r l o ad ings i s whenth e r a t i o is 3: 1 o r l e s s (Widaman , 1993) .
The nex t se c t i on of Table 7 s h o w s th e d i s t r i bu t i on
of the a v e r a g e r e l i ab i l i t y of measu red va r i ab l e s in
a n a l y s e s . These r e su l t s show t ha t when re sea rche r s
repor ted th e r e l i ab i l i t y of t he i r measu red va r i ab l e s , th e
va lue s we re gene ra l l y h i gh ( i . e . . .70 or greate r) . O n e
m i g h t conc lude f rom t h i s f i nd i ng t ha t th e p s y c h o m e t -
r ic proper t ies of va r i ab l e s ana lyzed in EFA are t y p i -
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 21/28
29 2 F A B R IG A R , W E G E N E R , M A c C A L L U M , A N D S T R A H A N
Table 7
Summary Information of Current Practices in the Use of
Factor Analysis
Journal of
Personality
an d Social
Psychology
Va r i a b l e
Rat io o f variable to fac to rs
Less than 3: 1
3:1
4 :1
5: 1
6: 1
More than 6: 1
U n k n o w n
N
1
28
26
14
13
742
%
0.6
17.6
16.4
8.8
8.2
46.5
1. 3
Journal of
Applied
Psychology
N
1
9
10
10
6
18
4
%
1. 7
15.5
17.2
17.2
10.3
31.0
6.9
Avera ge re l iab i l i ty o f va r iab les
Less than .6 0
.60-.69.70-79
.80-.89
.90-1.00
U n k n o w n
Sample s ize
100 or less
101-200
201-300
301^00
More than 4 00
Type o f ana lys i s
P r i n c i p a l c o m p o n e n t s
C o mmo n f a c t o r s
M u l t i p l e methodsOther
U n k n o w n
F ac to r - com pon e n t n u m b e r
E i g e n v a l u e > 1 .0
Scree Test
Para l le l a na l y s i s
Model fi t
Theory
In te rpre t ab i l i t y
M u l t i p l e me t h o d s
Other
U n k n o w n
F a c t o r - c o m p o n e n t ro ta t ion
V a r i m a x
Harr i s -Ka ise r
P ro ma x
Di re c t q u a r t im in
No ro ta t ion
M u l t i p l e me t h o d s
Other
U n k n o w n
3
6
33
33
14
70
30
44
25
13
47
84
31
81
35
p rocedure
25
24
1
0
2
4
35
2
66
87
1
2
21
23
3
1
21
1. 9
3.820.8
20.8
8.8
44.0
18.9
27.7
15.7
8.2
29.6
52.8
19.5
5.00.6
22.0
15.7
15.1
0.6
0.0
1. 3
2.5
22.0
1.3
4 1 . 5
54.7
0.6
1.3
13.2
14.5
1. 9
0.6
13.2
2
5
9
1 1
9
22
8
14
9
2
25
28
13
20
15
1 1
9
0
0
4
0
12
0
22
28
1
2
9
4
2
0
12
3.4
8.6
15.5
19.0
15.5
37.9
13.8
24.1
15.5
3.4
43.1
48.3
22.4
3.40.0
25.9
19.0
15.5
0.0
0.0
6.9
0.0
20.7
0.0
37.9
48.3
1.7
3.4
15.5
6. 9
3. 4
0.0
20.7
cal ly qui te g o o d . Howeve r , in both j o u r n a l s about
40% of ana lyse s did not include repor t s of the re l i -
ab i l i ty of the measu red va r i ab l e s . A l a r g e n u m b e r of
th e ana lyse s i n whi c h r e l i ab i l i t ie s we re no t reported
i n v o l v e d s i ng l e - i t em measu re s , whe reas t h o s e fo r
w h i c h re l i ab i l i t i e s were r e po r t ed i nvo lved m u l t i - i t em
measu re s . Because s i ng l e - i t em va r i ab l e s a re l i ke ly to
be cons ide rab ly l e ss r e l i ab l e t han m u l t i - i t em va r i -
ab l e s , it seems probab le t ha t many of the ana lyse s
repor ted in these j o u r n a l s w e r e based o n va r i ab l e s
w ith l e s s t han op t ima l p sychom e t r ic p rope r t i es . A l so
o f in te res t i s the fact that w e f o u n d v i r tua l l y n o cases
in which au thor s r epo r t ed t he communa l i t i e s o f t he i r
measured var iables . This p rac t ice is unfor tunate given
th a t , i n some ways , t he communa l i t i e s a re more i n -
fo rma t ive than th e r e l i ab i l i t i e s r ega rd ing th e sound-
ness of the EFA resul t s . However , fo r 18 data sets we
were able to o b t a i n th e cor re l a t i on ma t r i ce s o n w h i c h
th e au thor s ' f ac t o r ana lyse s we re based . Thi s a l l owed
us t o i n d e x t h e c o m m u n a l i t i e s b y e x a m i n i n g t h e
squa red m u l t i p l e co r re l a t ion s a s soc i a ted wi t h e ach
data set. Th e ave rage com m una l i t y a s soc i a ted w i t h
each data set r anged f rom .1 2 to .65 w ith th e m e d i a n
of these averages be ing .425.
The thi rd sect ion of Table 7 pre sen t s th e dis t r ibu-
t ion of sample s izes across ar t ic les . More than a t h i rd
o f th e ar t ic les across the two j ou rna l s conduc t ed EFA
based on modes t - to -sma l l sample s izes ( i . e . , samples
o f 200 or less). A s o m e w h a t s m a l l e r n u m b e r of ar-
t i c les used moderate sample s izes ( i . e . , 201 to 400),
an d abou t a t h i r d o r more used large samples ( i .e . ,grea te r t han 400). Thus, the re was a s u b s t a n t i a l n u m -
ber of ar t ic les based on sample s izes suff ic ient ly s m a l l
t ha t resul t s could have been dis tor ted i f the measured
va r i ab l e s i n c luded i n the an a ly s i s we re l e s s t han op-
t i m a l or t he fac t o r s we re unde rde t e rmined .
Th e next sect ion o f Table 7 i nd i ca t e s th e grea t e r
p o p u l a r i t y of PCA r e l a t i ve to EFA. A p p r o x i m a t e l y
ha l f of t he pu b l i sh ed app l i ca t i on s r epor t ed us i n g the
P C A method . Th i s me thod w as used despi te th e fact
that in the vast major i ty of these ar t ic les , the pr imary
goa l was t o ident i fy l a ten t cons t ruc t s unde r l y i ng mea-
sured var iables ra ther than data reduct ion per se . In
con t r a s t , on ly abou t 20% of ana lyse s u sed s o me fo rm
of EFA ( w i t h some t ype of p r i n c i pa l fac t o r s ana lys i s
a c c o u n t i n g f o r three out of every four ar t ic les us ing
common fac t o r ana lys i s ) . I n app rox ima te l y a four th o f
the ar t ic les in both journals , i t was imposs ib le to de-
t e rmine wha t me thod w as used.
Th e next sect ion o f Table 7 r epor t s th e d i s t r i bu t i on
of ar t ic les across d i ffe rent proc edures for de te rm inin g
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 22/28
U SE O F FA CT O R A N A L Y S I S 293
th e n u m b e r of factors . The e igen va lue-g rea te r - than-1
ru le was the mos t popu l a r s i ng l e p rocedu re in both
jou rna l s , fo l l owed c l ose ly by the scree test . Use of
othe r m e thods o f de t e rmin ing t he num be r o f fac t o r s
was r e l a t i v e ly r a re. A fa i r ly s i zab l e num be r o f a r t i c l es
( i . e ., about 20%) repor ted us in g m ul t ip le methods. Int he ove rwhe lming ma jo r i t y o f t he se case s , mu l t i p l e
m e thods i nvo lved some com bina t i on of the e i g e n v a l -
ue s -g re a i e r - t han -1 r u le , scree test , o r factor in te rpre t -
ab i l i t y -a pr i o r i t heo ry . Howeve r , i t was ex t reme ly
common ( i . e . , abou t 40% of the t i m e ) fo r a u t h o r s to
fail t o c l e a r l y i nd i ca t e how t hey a r r i ved a t t he i r dec i-
s i on s as to the n u m b e r of factors to i n c l u d e .
The f inal section o f Table 7 provides the dis t r ibu-
t ion of a r t i c l e s ac ros s d i f fe ren t me thods of ro t a t i on .
V a r i m a x r o t a t i o n w a s c l e a r l y t h e m o s t c o m m o n l y
used ro t a t i on wi t h app rox ima te l y ha l f o f a l l f ac t o r
ana lyse s i n bo th j ou rna l s u s i ng t h i s p rocedu re . The
second mos t popu l a r me thod o f rotat ion w as di rect
q u a r t i m i n a l t hough t h i s ro t a t i on was u sed i n on ly
abou t a t h i rd t o a fou r t h a s many a r t i c l e s a s va r imax
ro t a t i on . A no n t r i v i a l num be r o f a r ti c l e s ( i .e . , 13% to
2 1 % ) fa i led to indicate the rotat ion used.
When viewed in the i r en t i re ty, the resul t s repor ted
in Tab le 7 a re d i s cou rag in g . A fa i r num be r o f ana lyse s
were based o n studies in w h i c h a t least o n e de s ign
fea tu re was marg ina l ( i . e . , l ow measu red va r i ab l e t o
factor ra t ios , modes t s ample s i ze s , o r both) . A s izable
numbe r o f ana lyse s p rov ided no i n fo rma t i on r ega rd -
in g t he psy chom e t r i c p rope r t i es o f t he measu red va r i -
ables . Trie m o s t p o p u l a r t y p e s o f a n a l y s i s a n d ro t a t i on( i .e ., PC A and va r im ax ro t a t i on ) we re no t o p t im a l o r
even ne ; ;. r -opt ima l choices . In the case of d e t e r m i n i n g
the num be r o f fac t o r s , t he l a rge s t p rop or t i on o f pub-
l i shed a r t i c l e s i nd i ca t ed t ha t mu l t i p l e m e thods we re
used. Such an approach seems sensib le in l i g h t of the
m e thodo log i ca l l i t e r a tu re . Howeve r , exc lus ive use of
th e l a r g e l y d i sc red i t ed e i genva lue s -g re a t e r - t han -1 ru l e
was the se cond mos t po pu l a r cho i ce . Thus , it appear s
t ha t the s ame poor cho i ce s fou nd t o be p rob l em at i c in
t h e m e t h o d o l o g i c a l l i t e r a t u r e a n d d e m o n s t r a t e d t o
p roduce t he m i s l e ad in g re su l t s i n ou r exam ple s a re
p o p u l a r am ong re sea rche r s . Eq ua l l y d i s conce r t i ng , t her e s u l t s in Table 7 indicated that researchers often
fa i led t o p rov ide adequa t e i n fo rm a t i on abou t t he p ro-
cedures used. In 15.7% of JPSP fac t o r ana lyse s and
22.4% of JA P fac t o r ana lyse s i t was imposs ib l e t o
dete rmine what procedures were used for a t leas t two
of the t h ree ma jo r ana ly t i c dec i s i on s . In m o r e t h a n
ha l f of a l l f ac t o r ana lyse s r ev i ewed , i n fo rma t i on was
no t p rov ided conce rn i ng a t l e a s t one of t he dec i s i on s .
Implications of Current Practices forPsychological Research
G i v e n th e preva l ence of poor dec i s i on mak ing by
researchers in the use of E F A , m a n y readers m i g h t
w o n d e r w h a t th e i m p l i c a t i o n s of such p rac t i ces are for
t he in t e rp re t a t i on s and conc lus i on s r e ached i n thesea r t i c le s . A prec i se an swe r to thi s quest ion i s no t pos-
s ib l e. A l t ho ugh t he me thodo log i ca l l i t e r a tu re sugge s t s
( and the exam ples p resented in thi s ar tic le i l lus t ra te )
th a t diffe re nt cho ices in des ig nin g s tudies and se lect -
i ng fac t o r ana ly t i c p rocedu re s ca n p roduce subs t an t i a l
di f fe r ences i n r e su l t s , t he re a re c l e a r l y many cases in
w h i c h t h i s doe s no t occu r . The me thodo log i ca l l i te r a -
tu r e h a s de l i nea t ed some of the c o n d i t i o n s u n d e r
whi ch d i f fe rence s in procedures wi l l produce subs t an -
t i a l d i f f e r e n c e s in r e su l t s . Howeve r , unde r s t and ing o f
t he se i s sue s is far f rom comple t e . Fu r t he rmore , in
many case s , it is i m p o s s i b l e to k n o w h o w often thesecon d i t i on s ex i s t i n ac tua l da t a . One m e thod fo r an -
swe r i ng t h i s que s t i on wou ld be t o conduc t compre -
hens ive r e ana lyse s o f pub l i shed da t a sets. U n f o r t u -
na t e l y , such an app roach i s no t p r ac t i ca l . Beyond t he
fac t t ha t such a s t udy wou ld requ i re t he r e ana lys i s o f
h u n d r e d s of data sets, access to data sets is very di f-
f icu l t . I t i s re la t ive ly rare for researchers to repor t the
co r re l a t i on ma t r i x o n which t he i r fac t o r ana lyse s a re
based, an d r eque s t i ng acce s s to data is o f t e n u n s u c -
ce s s fu l .1 3
None the l e s s , w e were able to address thi s quest ion
in a s o m e w h a t i n f o r m a l m a n n e r by reana lyz i ng t hose
data sets fo r w h i c h we had access to the corre la t ion
mat r i ce s (a tota l of 18 data se t s) . These analyses re-
vea l ed a numbe r o f cases i n whi ch ex t r ac t i ng fac t o r s
ve r sus componen t s , u s i ng d i f fe ren t p rocedu re s to de-
t e rmine t he numbe r o f fac t o r s , o r u s i ng d i f fe ren t ro -
t a t i on me thods p roduced change s in r e s u l t s suf f i -
c i e n t l y s u b s t a n t i a l to have a l te red th e conc lus i on s a
11I n t e r e s t i ng l y , wh e n w e contac ted autho rs to reques t
t he i r da ta , we found tha t a re la t ive l y sma l l p rop o r t ion o f
t h e m agreed to our reques t . In the majo r i ty o f cases , au tho rs
di d no t a n s we r o ur reques t even a f te r reminder le t te rs were
sent . In o ther cases , au tho rs ind ica ted tha t the da ta were no
l o n g e r a v a i l a b l e . F i na l l y , in a few cases , au tho rs ind ica ted
t h a t they would send th e data but did not or di rec t ly refused
to send th e da ta a t a l l . Th is la s t s i t ua t i on is p a r t i c u l a r l y
i n t e res t i ng g iven tha t cur rent A P A eth ica l gu ide l in es spec i fy
t ha t a u t h o rs p u b l i s h i n g i n A P A j o u rna l s mu s t ma k e t h e i r
da ta ava i lab le to th i r d pa r t ies fo r a pe r iod o f 5 yea rs fo l -
l o w i n g p u b l i c a t i o n .
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 23/28
29 4 F A B R I G A R , W E G E N E R . M A c C A L L U M , A N D S T R A H A N
r e se a rche r migh t have r eached conce rn i ng th e da ta .
Fo r e x a m p l e , w e c o m p a r e d th e solut ions produced by
ML fac to r ana lys i s and PCA fo r mode l s wi t h the s ame
num be r o f fac to r s r e t a i ned by t he au tho r s and us i ng a
r o ta t ion c o m p a r a b l e to that used by t he au thor s . W e
f ound t ha t t he re we re d i f fe rence s be tween PCA and
M L s u f f i c i e n t l y subs t an t i a l t ha t a r esea r cher cou ld
have reached a d i f f e ren t i n t e rp re t a t i on of the fac t o r s in
5 of the 18 data sets. That is, for 5 of these data sets,
one o r more measu red va r i ab l e s changed th e fac t o r s
o n w h i c h t h e y h a d t h e i r p r i m a r y l o a d i n g s ac ros s th e
tw o type s o f a n a l y s i s . I n t e r e s t i n g l y , for 4 of the data
sets, i t was i m p o s s i b l e to c o m p a r e t he PCA and ML
solut ions . Th e solut ions could not be co mp a r e d , be-
cause t he au tho r s i n t he i r o r i g i na l ana lyse s r e t a i ned so
m a n y com pon en t s r e l a t i ve t o t he num be r o f m easu red
va r i ab l e s t ha t t he co r re spond ing ML fac t o r an a ly s i s
mode l s wou ld have had nega t i ve degrees of f r e edom.
U s i n g th e s a m e mode l s ( i . e . , common fac t o r o r
p r i n c i p a l c o m p o n e n t ) a n d f i t t ing procedures used by
:h e a u t h o r s and the s a m e n u m b e r of factors re ta ined
by t he au tho r s , we a l so compared v a r i m a x ro t a t i on
and d i re c t qua r t im in ro t a t i on . We foun d tha t d i r e c t
q u a r t i m i n r o t a t i o n s o f t e n p r o d u c e d s l i g h t l y bet te r
s i m p l e s t r u c tu r e th a n v a r i m a x r o t a t i o n w h e n th e fac-
l o r s were corre la ted, but the pa t t e rn o f l o a d i n g s w a s
subs tan t i a l ly diffe rent ( i . e . , the re were changes i n the
fac tors o n w h i c h one o r m o r e of the measu red va r i -
ab le s had t h e i r p r i m a r y l o a d i n g s ) in o n l y 1 of the data
sets.
Fina l ly , u s i n g th e e igenva lue s -g re a t e r - t han -1 r u le ,-c ree tes t , and model f i t ( as indexed by RMSEA), we
a l so examined t he i s sue of t he app rop r i a t e numbe r o f
f a c t o r s . In 7 of the 18 data sets, the scree tes t , modelT
i t , o r b o t h c o n t r a d i c t e d t h e e i g e n v a l u e s - g r e a t e r -
i .han-1 ru l e . I n t e re s t i ng ly , when w e e x a m i n e d the re-
su l t s of the scree test and model fi t ( two of the better
p rocedu re s fo r de t e rm in in g t he num be r o f fac to r s ) , we
f o u n d t h a t th e r e su l t s o f t en con t r ad i c t ed th e dec i s i on s
ma de by the au thor s in the or ig ina l ar t ic les . In 3 of the
data sets , both model fi t and the scree tes t c lear ly
suggested a d i ffe rent number of factors than that re-
t a i n e d by the authors. In 5 of the data sets, model fi t
c lea r ly suggested a d i f fe ren t numbe r of factors . In 1
data se t , the scree tes t c lear ly suggested an a l te rn at iv e
n u m b e r of fac t o r s .1 4
A l t h o u g h t h i s s m a l l s a m p l e o f data sets c a n n o t be
regarded as f u l l y representat ive of the ent i re appl ied
EFA l i t e r a tu re , it does suggest that d i ffe rences in re-
su l t s due to change s in EFA p r o c e d u r e s m i g h t be
mo re com mo n t ha n m an y re sea rche r s r e a l i ze . A dd i -
t i o n a l l y , ou r su rvey i nd i ca t ed t ha t many r esea r cher s
m a d e m o r e than o n e p o o r dec i s i on . Th e combina t i on
o f several p o o r dec i s i on s is l i ke ly to produce even
more se r ious d is tor t ions . For exam ple , i t was re la-
t i ve ly c o m m o n fo r researchers to conduc t a P C A , re-
t a i n as many fac t o r s a s e i genva lue s g re a t e r t han 1 , and
c o n d u c t a va r imax ro t a t i on . Th i s pa r t i cu l a r "package"
of decis ions i s especia l ly l i ke ly to resul t in p o o r r e-
c o v er y o f t h e u n d e r l y i n g f a c t o r s .IS
Gene r a l D i s cu s s i on
W e began o u r ar t ic le by no t i ng t ha t r e sea rche r s
m us t cons ide r f i ve m a jo r me thodo log i ca l i s sues wh en
c o n d u c t i n g a f a c to r a n a l y s i s . W e a r g u e d t h a t th e
m ethodolo gical l i te rature suggests that not a l l op t ions
ava i l ab l e to researchers fo r each o f these decis ions are
e q u a l l y sound and t ha t poo r cho i ce s i n de s i gn ing t he
s tudy and conduc t i ng t he fac t o r ana lys i s can p roduce
poo r resul t s . To fu r t he r i l l u s t r a t e t h i s po i n t , w e r e ana-
lyzed prev ious ly pub l i shed da t a sets and showed t ha t
th e ( m i s ) u s e of EFA can produce mi s l e ad ing re su l t s .
W e demonst ra ted that th e mi s l e ad ing re su l t s ob t a i ned
in t hese an a lyse s d id no t r e a l l y r e fl e c t a funda m en t a l
weakne ss i n EFA bu t i n s t e ad demons t r a ted the con-
sequence s o f u s i n g que s t i onab l e ana ly t i c p rocedu res .
W e t hen wen t on to establ i sh that th e s a m e ques t i on -
able procedures used in our examples are in fact qui te
p reva l en t i n cu r ren t empi r i ca l research us ing fac t o r
a n a l y s i s .
W e bel ieve that o ur r e v i e w h i g h l i g h t s tw o i m p o r -t an t po i n t s t ha t sho u ld be brought t o t he a t t en t i on of
re sea rche r s u s i ng EFA and to readers of art icles in
w h i c h E F A s a r e r e po r t ed . F i r s t , con t r a ry to w h a t
m a n y r e se a rche r s p robab ly be l i eve , t he dec i s i on s i n
the des ign of s tudies and in se lect ing factor analyt ic
p r o c ed u r e s a r e n o t a r b i t r a r y a n d i n c o n s e q u e n t i a l .
There is reason to cons ide r s o m e design features an d
14In those cases i n whic h mode l f i t c lear ly con t rad ic ted
e i the r th e e igenvalues -greate r - than-1 ru le or th e o r i g i n a l de-
c i s ions made by the au thors bu t the scree tes t d id not , i t was
a l m o s t n e v e r th e ca se t h a t th e scree tes t supported th e e ig-
e n v a l u e s - g r e a t e r - t h an - 1 r u l e o r t h e o r i g i n a l d e c i s i o n . I n -
s tead, in these cases , the scree tes t was su f f i c i en t l y a m b i g u -
o us that i t was diff icul t to a r g u e t h a t it c l e a r l y i n d i c a t e d an
app r o p r i a t e n u m b e r o f f a c t o rs .1 ?
I t i s pe rhap s n ot su rpr i s ing tha t t h i s par t i cu la r cho ice o f
o p t i o n s is so po pu l a r . T h i s set of deci s ions are the defau l t
o p t i o n s f o r t h e f a c t o r an a l y s i s p r oce d u r e in SPSS.
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 24/28
USE O F F A C T O R A N A L Y S I S 29 5
E FA procedures to be markedly be t te r than others .
Second , thi s ar t ic le suggests that th e q u a l i t y o f EFAs
reported in psyc holog ical research i s rou t ine ly qui te
poor . Researchers som et imes base the i r analyses on
s tud i e s wi t h l e s s t han op t ima l fe a tu re s , common ly
m ake que s t i onab l e cho i ce s w hen se l e c t i ng ana ly t i c
p rocedu re s , and do no t p rov ide suff ic ient i n f o r m a t i o n
fo r r e ade r s to m a k e i n f o r m e d j u d g e m e n t s of t he
s o u n d n e s s of the EFA being repor ted.
One o bv ious que s t i on t h a t a r i ses f rom these obser -
va t i on s i s why fac t o r a na ly s i s is so poor l y u sed. There
a re several poss ib le reasons . One is that researchers
are i l l - i n fo rmed rega rd ing the use of E F A . A l t h o u g h
there is a substant ia l m et h o d o l o g i c a l l i terature o n
EFA, m uch of t h i s l i te r a tu re i s r e l a t i ve ly com plex and
p u b l i s h e d i n quan t i t a t i ve ly o r i en t ed j ou rn a l s t ha t m os t
p s y c h o l o g i s t s a re u n l i k e l y to read on a r egu l a r bas i s .
With a few except ions (e .g . , Finch & W es t , 1997) ,
nontechnical , concise , and up-to-date reviews of thi s
l i t e r a tu r e have gen e ra l l y no t been ava i l ab l e t o r e -
searchers . Furthermore , most researchers probably re-
ce ive l i t t l e f o r m a l t r a i n i n g in EFA. Al t hough i t is
c o m m o n fo r g radua t e p rog rams to requi re the i r s tu-
dents to take courses on the use of a n a l y s i s o f v a r i a n c e
(ANOVA) , i t i s much r a re r fo r t h i s t o be t he case fo r
EFA (-,ee A iken , West , Sechrest , & Reno , 1990) .
Many g radua t e p rog rams do no t o f fe r cou r ses t ha t
cove r fac t o r ana lys i s o r devote o n l y 1 week or 2 to
this topic as pa r t o f a b road su rvey cou r se cove r i ng
dif fe rent m ul t i va r i a t e s t a t i s ti ca l p rocedu re s . The re-
fore, it is not su rp r i s i ng t ha t many re sea rche r s a rer e l a t ive ly u n i n f o r m e d r e g a r d i n g th e i m p l i c a t i o n s o f
s tudy des ign fe a tu re s and choos i ng d i f f e ren t fac t o r
ana ly t i c procedu re s .
A second major reason w h y fac to r ana lyse s a re
poor l y conduc t ed i s s im p le t r ad i t i on . The re i s a s trong
t endency fo r r e se a rche r s t o conduc t ana lyse s i n a
m an ne r t ha t is s imi l a r to wha t has been done be fo re .
Researchers do so because (a) they wish for the i r re-
su l t s to be di rect ly com par able to past s tudies , (b) they
na ive ly bel ieve that procedures must be reasonable i f
s o m a n y p eo p l e have used them in the past , or ( c ) they
feel (pe rhaps correct ly) that the surest way to avoiddif f icu l t ies in the peer review p r o c e s s i s t o do wha t
h a s been d o n e before.
F i n a l l y , ano the r r eason fo r t he p o o r use of EFA has
to do w ith the s t a t i s t ica l so f tware cu r ren t l y pop u l a r in
psycho log i ca l r e se a rch . Such p rog rams are l i ke ly to
exe r t a t r emendous i n f luenc e on t he way ana lyse s a re
conduc t ed . Fo r exam ple , m any re sea rche r s p robab ly
fo l low t he de fau l t op t i on s o f the i r p rog rams , because
they bel ieve that these opt ions would not be the de-
f au l t s un le s s t hey were th e mo st acceptable m ethods
c u r r e n t l y ava i l ab l e . Add i t i ona l l y , i f a pa r t i cu l a r p ro-
cedu re i s no t offered in t he se p rog rams , it is u n l i k e l y
th a t a researcher w i l l o r c an even be expec ted to use
it . U n f o r t u n a t e l y , th e fac t o r ana ly t i c p rocedu re s o f-
fe red in the major s ta t i s t ica l programs are far from
ideal (e.g. , see MacCa l lum, 1983 ; W o o d et al., 1996).
Giv en the inad equa cies of these progra ms, i t i s not
s u r p r i s i n g t h a t fac t o r ana lyse s conduc t ed in p s y c h o -
l og ic a l r e se a rch a re o f t en fa r f rom op t ima l .
A l t h o u g h it is re la t ive ly easy to u n d e r s t a n d w h y
EFA i s of t en mi sused , it is m o r e di ff i cu l t to f o r m u l a t e
how such prac t i ces m i g h t be ch an g e d . It seems un -
l ike ly t ha t p sycho logy depa r tmen t s wil l be able or
w i l l i n g to invest the resources necessary to substan-
t i a l l y upgra de t he i r s t a t i s t ic s cou r se s . How eve r , m e th-
odologis t s could accept a grea t e r r e spons ib i l i t y fo r
educa t i ng t he r e se a rch commun i t y r ega rd ing t he u seo f E F A a n d other s ta t i s t ic a l proc edures . This wou ld
r equ i r e t hem n o t on ly t o wr i t e h i g h ly te chn i ca l pape r s
t a rge t ed a t t he quan t i t a t i ve m e thodo logy com m un i t y
( w h i c h a re unden i ab ly impor t an t ) bu t a l so t o wr i t e
l e s s t e chn i ca l pape r s c l e a r l y exp l a i n i ng t he p rac t i ca l
i m p l i c a t i o n s o f t h i s methodological research. Further-
more , ed i t o r s mus t be w i l l i n g t o pu b l i s h t he se a r t i c l e s
in n o n q u a n t i t a t i v e j o u r n a l s t h a t a r e l i k e l y to be read
by researchers . The use of EFA m i g h t also be im-
proved by ed i t o r s o f j ou r na l s adop t i ng h i g he r s t an -
da rds fo r t he manne r i n whi ch fac t o r ana lyse s are
conduc t ed an d r epor ted . At the very leas t , researchersshou ld be r equ i red t o r epor t wha t p rocedu re s t hey
u s e d w h e n c o n d u c t i n g a n EFA. Researchers should
a l so be expected to offe r a br ief ra t ionale fo r t he i r
de s i gn dec i s i on s an d cho i ce s of EFA procedures . Fi -
n a l l y , deve lope r s a n d users of EFA s h o u l d m o r e ac -
t ive ly pre s su re t he manufac tu re r s o f t he ma jo r s t a t i s -
t i c a l p r o g r a m s t o i m p r o v e th e i r p r o d u c t s . T a k e n
together , these i n i t i a t i v es would be a good s tar t to-
w a r d i m p r o v i n g the use of EFA in p s y c h o l o g i c a l r e-
se a rch .
References
A b e l s o n . R. P. , K i n d e r , D. R., Peters , M . D., & Fiske. S. T.
( 1 9 8 2 ) . A f f e c t i v e an d s e m a n t i c co m po n e n t s i n po l i t i c a l
pe r s o n pe r ce p t i o n . Journal of Personality of Social Psy-
chology. 42, 619-630.
A i k e n , L. S., West , S. G. . Sechres t , L., & R e n o , R. R.
( 19 90) . Graduate t r a in in g in s t a t i s t i cs , me tho dology , and
m e as u r e m e n t i n p s y ch o l o g y : A s u r v e y o f P h D p r o g r am s
in N o r t h A m e r i c a . American Psychologist. 45, 721-734.
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 25/28
29 6 F A B R IG A R , W E G E N E R , M A c C A L L U M , A N D S T R A H A N
A l l e n , S. J., & H u b b a r d , R . (1986) . Regress ion equa t ions fo r
the la ten t roo ts o f random da ta co r re la t ion ma t r ices wi th
u n i t i e s in the d i a g o n a l . Multivariate Behavioral R e-
search, 21, 393-398.
Armst rong , J . S . (1967) . Der iva t ion o f theo ry by means o f
f ac to r ana ly s i s o r Tom Swift and h is e lec t r ic f ac to r an a ly -
s i s ma c h ine . The American Statistician, 21, 17-21.
A rms t ro ng , J. S., & Soelberg, P . (1968). On the in te rp re ta -
t ion o f f ac to r ana lys i s . Psychological Bulletin, 70 , 361-
364.
A r r i n d e l l , W. A . , & van der Ende , J . (1985) . An empi r ica l
test of the u t i l i ty of the observa t ions- to -va r iab les ra t io in
f a c t o r a nd c o mp o ne n t s a na l y s i s . Applied Psychological
Measurement, 9, 165-178.
Bent le r , P . M. , & Dudgeon, P . (1996) . Cova r iance s t ruc ture
an a l y s i s : Sta t i s t ica l p rac t ice , theo ry , and d i rec t ions . A n-
nual Review of Psychology, 47 , 563-592.
Bentler, P . M., & K a n o , Y. (1990) . On the equiva lence o f
f ac to rs a n d c o mp o ne n t s . Multivariate Behavioral Re-search, 25, 67-74.
Books te in , F . L . ( 1990 ) . Least squa res and la ten t va r iab les .
Multivariate Behavioral Research, 25, 75-80.
B o r g a t t a , E. F. , Ke rc h e r , K., & Stul l , D. E. ( 1986 ) . A c a u -
tionary no te on the use of p r i n c i p a l component s ana lys i s .
Sociological Methods an d Research, 15 , 160-168.
Breckle r , S . J . (1984) . Emp i r ica l va l id a t ion o f affect , behav-
i o r , a nd c o g n i t i o n a s d i s t i n c t c o mp o ne n t s o f a t t i t ude .
Journal of Personality an d Social Psychology, 47 , 1191-
1205.
B ro wn e , M. W. ( 1 9 8 4 ) . A s y m p t o t i c a l l y d i s t r i b u t i o n - f r e e
methods fo r the ana lys i s o f cova r iance s t ruc tures . BritishJournal of Mathematical an d Statistical Psychology, 37 ,
62-83.
B r o w n e , M. W. , & Cudeck , R. (1989) . S ing le sample c ross-
v a l i d a t i o n i nd i c e s fo r cova r iance s t ruc tures . Multivariate
Behavioral Research, 24, 445-455.
B ro wne , M. W ., & Cudeck, R. (1992) . A l te rna t ive ways o f
assess ing model f i t . Sociological Methods and Research,
21 , 230-258.
B ro wne , M . W ., C u d e c k , R ., Ta t e ne n i , K ., & Me l s , G .
( 1998 ) . C EF A : C o mp re h e n s iv e e x p lo r a t o ry f a c t o r a na l y -
s i s . Autho rs . [Computer p r o g r a m ] . To obta in t h i s p ro-
g r a m , s e e U R L http://auantrm2.psy.ohio-state.edu/
browne/.
C a t t e l l , R. B. (1966). The scree test for the number of fac-
to rs . M ultivariate B ehavioral Research, I, 245-276.
C a t t e l l , R. B. ( 1978) . The scientific use of factor analysis in
behavioral an d l i f e sciences. N e w Y o r k : P l e n u m .
Cat te l l , R. B. , & Dickman, K. (1962) . A dynamic model o f
p h y s i c a l i n f l u e nc e d e mo ns t r a t i ng th e necess i ty o f o b l i q u e
s imp le s t ruc ture . Psychological Bulletin, 59, 389-400.
C a t t e l l , R. B. , & Jaspers , J . (1967) . A genera l p la smode (N o .
30-10-5-2) for factor analytic exerc i ses and resea rch .
Multivariate Behavioral Research Monographs, No. 67-3.
Cat te l l , R. B., & Sul l ivan , W. (1962). The scientif ic nature
of f ac to rs : A demon s t ra t ion by cup s o f co ffee . Behavioral
Science, 7, 184-193.
Cat te l l , R. B. , & Vo g e lma nn , S . ( 1 9 7 7 ) . A c o mp re h e n s iv e
t r ial of the sc ree and KG c r i te r ia fo r de te rm in in g the
n u m b e r o f factors . Mu ltivariate Behavioral Research, 12,
289-325.
C o m r e y , A. L . ( 1 9 7 8 ) . C o mmo n me t h o d o lo g i c a l p ro b l e ms
in f ac to r ana ly t ic s tudies . Journal of Consulting an d
Clinical Psychology, 46 , 648-659.
C o m r e y , A. L., & Lee, H. B. (1992) . A first course in factor
analysis (2nd ed.) . H i l l s d a l e , N J : E r lb a u m.
Cra wfo rd , C . B . , & Ferguson , G . A . (1970) . A genera l ro -
t a t i on c r i te r ion and i t s use in o r thogona l ro ta t ion . Ps\-
chometrika, 35, 321-332.
Cri tes , S . L., J r . , Fabr iga r , L . R ., & Petty , R . E. (1994).
Measur ing the a f fec t ive and cogni t ive p roper t ies o f a t t i -
tudes : Concep tua l and methodo log ica l i s sues . Personality
an d Social Psychology Bulletin, 20, 619-634.
Cudeck, R. ( 1991 ) . N o n i t e r a t i v e f ac to r ana lys i s es t ima to rs
wi th a lgo r i thms fo r subset an d instrumental variable se -
l e c t ion . Journal of Educational Statistics, 16, 35-52.
Cudeck, R. , & H e n l y , S. J . (1 991 ). Model selection in co-
va r iance s t ruc tures and the "p ro b l e m " of sample size: A
c la r i f i ca t ion . Psychological Bulletin, 109, 512-519.
Cudeck, R. , & O' De l l , L. L. (1994) . App l ica t ions o f s tan-
da rd e r ro r es t ima tes in unres t r ic ted fac to r an a lys i s : S ig -
n i f i c a n c e tes t s fo r f ac to r load ings and co r re la t ions . Psy-chological Bulletin, 115, 475-487.
C u r r a n , P . J. , West , S. G ., & F inc h , J. F. (1996) . The ro-
bus tness o f tes t s ta t i s t ic s to n o n n o r m a l i t y an d specif ica-
t ion er ro r in con f i rm a to r y f ac to r ana lys i s . Psychological
Methods, 1, 16-29.
Dielm an, T. E . , Ca t te l l , R. B . , & Wagner , A . (1 972) . Evi-
d e n ce o n t h e s imp l e s t ru c t u re a n d f a c t o r i nv a r i a nc e
ach ieved by f ive ro ta t iona l methods on four types of data .
M ultivariate Behavioral Research, 7, 223-242.
E a g l y , A ., & Cha iken , S . (1998) . A t t i tude s t ruc ture . In D.
Gilbe r t , S. Fiske, & G. Lindsay (Eds . ) , Handb ook of so-
cial psychology ( Vo l . 1, 4 th ed. , p p . 269-322). N ew
York: McGraw-Hi l l .
Ed wa rd s , K . (1990) . Th e i n t e r p l a y o f affect an d c o g n i t i o n in
a t t i tude fo rmat ion and change . Journal of Personality and
Social Psychology, 59 , 202-216.
Evere t t , J. E. (1983) . Factor c o mp a ra b i l i t y as a m e a n s o f
d e t e rm in i ng th e n u m b e r o f factors an d the i r ro ta t ion . Mul-
tivariate Behavioral Research, 18 , 197-218.
Ever i t t , B. S . (1975) . Mu l t iva r ia te ana ly s i s : The need fo r
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 26/28
U S E O F FA CT O R A N A L Y S I S 297
da t a , and o ther p roblems . British Journal of Psychiatry,
126, 237-240.
Fabr iga r , L . R ., & Petty , R. E . (1999). Th e ro le of the af-
fec t ive an d cogn i t ive bases o f a t t i tudes in s u s c e p t i b i l i t y to
affect ively an d c o g n i t i v e l y b a s ed p e r s u a s i o n . Personality
an d Social Psychology Bulletin, 25, 91-109.
Fava, J. L., & Velicer, W. F. (1992). The effects of overex-
t r ac t i on o n f a c t o r a nd c o mp o ne n t a na l y s i s . Multivariate
Behavioral Research, 27, 387^15.
Finch , .1 . F., & West , S. G. ( 1 9 9 7 ) . Th e i nv e s t i g a t i o n of
pe r s o n a l i t y s t ruc ture : S ta t i s t ica l models . Journal of Re-
search in Personality, 31 , 439^1-85.
Ford , J K . , M acC a l l u m , R. C ., & Tai l , M . (1986). The ap-
p l ica t ions of exploratory factor analysis in app l ied psy-
c h o l o g y : A c r i t i c a l r e v i e w an d a na l y s i s . Personnel Psy-
chology, 39 , 291-314.
G o r s u c n , R. L. (1970) . A compar i son o f b i q u a r t i m i n , m a x -
p l an e , p r o m a x , a n d v a r i m a x . Educational and Psycho-
logical Measurement, 30, 861-872.
G or su ch , R. L. (1973) . Us ing Bar t l e t t ' s signif icance test to
d e t e r m i n e the number o f f ac to rs to ext rac t . Educational
an d Psychological Measurement, 33 , 361-364.
Gorsuch, R. L. (1980). Factor score r e l i ab i l i t i es a nd d o ma in
val id i t i e s . Educational an d Psychological Measurement,
40 , 895-897.
Gorsuch , R. L . (1983) . Factor analysis (2nd ed . ) . Hi l l sd a le ,
N J: F r l b a u m .
Go r s u c h , R. L . (1988) . Exp lo ra to ry f ac to r ana lys i s . In J .
Nessdroade & R. B. Ca t te l l (Eds . ) , Handbook of multi-
variaie experimental psychology (pp. 231-258). N ew
York: P lenum.G o r s u c h , R. L . (1990) . C o m mo n f a ct o r a na l y s i s v e r s u s p r i n -
c i p a l c o mp o ne n t a n a l y s i s : S ome we l l an d l it t le k n o w n
facts . Multivariate Behavioral Research, 25, 33-39.
Gorsuch . R. L . ( 1997 ) . N e w p ro c e d u res f o r e x te n s i o n a na l y -
sis in e x p lo r a t o ry f a c t o r a na l y s i s . Educational and Psy-
chological Measurement, 57, 725-740.
Gould , S . J . (19 81) . Th e mismeasure of man. New York:
N o r t o n .
G u t t m a n , L. (1954). Some necessa ry con di t ions fo r com -
mon cactor a na l y s i s . Psvchometrika, 19 , 149-161 .
H a k s t i a n , A. R . ( 1 9 7 1 ) . A c o mp a ra t i v e e v a lu a t i o n o f severa l
p r o m i n e n t me t h o d s o f o b l i q u e f a ct o r t r a n s f o rm a t i o n . Ps\-
chometrika, 36, 175-193.
H ak s t i an , A. R. , & Boyd, W. M. (19 72) . An emp i r ica l in-
v e s t i g a t i o n of some special cases of the general "or tho-
m a x " c r i te r ion fo r o r t h o g o na l f a c t o r t r a n s f o rma t i o n . E d-
ucational an d Psychological Measurements, 32 , 3—22.
H ak s t i an . A. R. , & Mul le r , V. J . (1973) . Some n o tes on the
n u m b e r of f ac to rs p roblem. Multivariate Behavioral Re -
search. 8, 461^75.
H ak s t i an , A. R., Rogers, W. T., & Cattell , R. B. (1982). The
b e h av i o r o f nu tnbe r-of- fac to r s ru les wi th s imula ted da ta .
Multivariate Behavioral Research, 17, 193-219.
H a r m a n , H. H. ( 1 9 7 6 ) . Modern factor analysis (3rded.) .
C h i c a g o : The U n i v e r s i t y o f Ch icago P ress .
Harr i s , C . W . (1967) . On factors an d factor sco res . Psy-
chometrika, 32, 363-379.
Harris , C . W., & Kaiser, H. F. (1964). Oblique factor ana-
l y t i c s o l u t i o n s b y o r t h o g o n a l t r a n s f o r m a t i o n s . Psy-
chometrika, 29, 347-362.
Harr i s , M. L., & Harr i s , C . W . ( 1 9 7 1 ) . A fac to r ana ly t ic
i n t e rpre t a t ion s t ra tegy . Educational an d Psychological
Measurement, 31, 589-606.
H e n d r i c k s o n , A . E ., & White , P.O. (1964) . P ro ma x : A
qu ick me t h o d fo r r o t a t i o n to obl ique s imp le s t ruc ture .
British Journal of Statistical Psychology, 17 , 65-70.
H i l l s , M . ( 1 9 7 7 ) . A r e v i e w of "An i n t r o d u c t i o n to m u l t i -
var ia te techn iques fo r soc ia l and behavio ra l sc iences ."
Applied Statistics, 26, 339-340.
H o f m a n n , R. J. ( 1 9 7 8) . C o m p l e x i t y an d s imp l i c i t y as ob-
jec t ive ind ices desc r ip t ive o f f ac to r so lu t ions . Multivari-
at e Behavioral Research, 13, 247-250.
H o r n , J. L. (1965) . A ra t i o na l e and t e c h n iq u e fo r e s t ima t i ng
th e n u m b e r o f factors in f a c t o r a na l y s i s . Psychometrika,
30, 179-185.
Horn , J . L . (1969) . On the in te rn a l con s is tency re l ia b i l i ty o f
fac to r s . Multivariate Behavioral Research, 4 , 115-125.
Hu, L., & B e n t l e r , P . M. ( 199 8). Fit i nd i c e s in cova r iance
s t r u c t u r e m o d e l i ng : S e n s i t i v i t y t o u nd e rp a r a m e t e r i ze d
mo d e l m i s s pe c i f i c a t i o n . Psychological Methods, 3 , 424-
453.
H u, L. , Bent le r , P . M ., & Kan o , Y. (1992) . Can tes t s ta t i s t ic s
in c o v a r i a nc e s t ru c t u re a na l y s i s be t rus ted? Psychological
Bulletin, 112, 351-362.
Hu b b a rd , R., & A l len , S . J . (1987). A c aut iona ry no te on the
use of p r inc ipa l c o m p o ne n t s ana lys i s : Suppor t ive empi r i -
ca l e v id e nc e . Sociological Methods an d Research, 16 ,
301-308.
H u m p h r e y s , L. G ., & I lgen , D. R. (1969) . No te o n a crite-
r i on f o r th e nu m b e r o f c o mm o n f a ct o r s . Educational an d
Psychological Measurements, 29, 571-578.
Hu mp h re y s , L . G ., & Mo n t a ne l l i , R . G ., J r . (1975) . An in-
ves t iga t ion of the pa ra l le l ana lys i s c r i te r ion fo r d e t e rm in -
in g t h e nu mb e r o f c o mmo n f ac t o rs . Multivariate Behav-
ioral Research, 10, 193-205.
J e n n r i c h , R. I . , & Sam pson , P.P. (1966) . Ro ta t ion fo r
s imp l e l o a d i ng s . Psychometrika, 31 , 313-323.
Kaise r , H. F. ( 1958) . Th e v a r im a x c r i t e r i o n fo r a na l y t i c r o-
t a t ion i n f a c t o r a na l y s i s . Psychometrika, 23 , 187-200.
Kaise r , H. F. ( 1960) . The app l ica t ion o f e lec t ron ic comput-
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 27/28
29 8 F A B R I G A R , W E G E N E R , M U c C A L L U M , A N D S TRA HA N
ers to f ac to r ana lys i s . Educational and Psychological
Measurement, 2 0, 141-151 .
Kaise r , H. F. (1970). A second generation Lit t le-Jiffy . Psy-
chomelrika, 35, 401-415.
Kothandapani , V. (1971) . Va l ida t ion o f f ee l ing , be l ie f , and
i n t en t ion to ac t a s th ree components o f a t t i tude and the i r
c o n t r i b u t i o n t o p r e d i c t i o n o f c o n t r a c e p t i v e b e h a v io r .
Journal of Personality an d Social Psychology, 19 , 321-
333.
L au t e n s ch l ag e r , G. J . (1989) . A com par i son o f a l te rna t ives
t o c o nd u c t ing mo n t e c a r lo a n a l y s e s f o r d e t e rm in i ng p a r -
a l l e l ana ly s i s c r i te r ia. Mu/tivariate Behavioral Research,
24 , 365-395.
Lawley , D. N. (1940). Th e est imat ion o f factor loadings by
t h e me t h o d o f ma x imu m l i k e l i h o o d . Proceedings of the
Royal Society of Edinborough, 60A, 64-82.
L e v o n i an , E. , & Comrey , A . L . (1966) . Fac to r ia l s tab i l i ty a s
a func t i on of the number o f o r thogona l ly - ro ta ted f ac to rs .
Behavioral Science, 11 , 400-404.
L i n n , R. L. (1968) . A Mo n t e C a r l o a p p roa c h t o t h e nu m b e r
of factors problem. Psychometrika, 33, 37-72.
L o e h l i n , J . C . ( 1 9 9 0 ) . C o m p o ne n t a na l y s i s v er s u s c o m mo n
fac to r a na l y s i s : A case of d isputed autho rsh ip . Mu/tivari-
ate Behavioral Research, 25, 29-31.
L o n g m a n , R. S., Co ta , A . A . , Ho ld e n , R. R., & F e k k e n ,
G. C . (1989) . A reg ress ion equa t ion fo r t h e p a r a l l e l a na l y -
s i s c r i te r ion in p r in c ipa l compo nents an a lys i s : Mean and
9 5 th p e r c e n t i l e e i g e nv a lu e s . Multivariate Behavioral Re-
search, 24, 59-69.
Mac Ca l lum , R. C . (1983) . A com par i son o f f ac to r ana lys i s
p rog rams in SPSS, BMDP, and SAS. Psychometrika, 48 ,223-231.
MacC al lum , R. C . (1990). Th e need fo r a l te rna t ive mea-
sures of fit in cova r iance s t ruc ture model ing . Multivariate
Behavioral Research, 25, 157-162.
M a c C a l l u m , R . C ., Brow ne, M . W. , & Sugawara , H. M.
(1996) . Power an a lys i s and de te rm ina t ion o f sam ple s ize
fo r c o v a r ia nc e s t ru c t u re mo d e l i ng . Psychological Meth-
ods, 1 , 130-149.
M a c C a l l u m , R . C ., W i d a m a n , K . F., Z h a n g , S., & Hong , S .
(1999) . Sample s ize i n f a c t o r a na l y s i s . Psychological
Methods, 4, 84-89.
Ma rs h , H . W ., B al l a , J . R. , & McD ona ld , R. P . (1988) .
Goodness -of- f i t indexes i n c o n f i rma t o ry f a c to r a na l y s i s :
Th e effect of sample s ize . Psychological Bulletin, 103,
391-410.
McA rdle , J . J . (1990) . P r i n c i p l e s v e r s u s p r i n c i p a l s o f s t ru c-
t u r a l f ac to r ana lyses . Multivariate Behavioral Research,
25 , 81-87.
M c D o n a l d , R. P . (1985) . Factor analysis an d related meth-
ods. Hi l l s d a l e , N J: E r lb a u m.
McNem ar , Q. (19 51) . The fac to rs in fac to r ing behavio r .
Psychometrika, 16, 353-359.
M i l l a r , M . G ., & Mi l l a r , K . U . ( 1990) . Att i tude change as a
func t i on o f a t t i tude type an d a rg u me n t t y p e . Journal of
Personality and Social Psychology, 59 , 217-228.
M i l l a r , M. G., & Tesser , A. (1986) . Effects o f af fec t ive an d
cogni t ive focus on the a t t i tude-behavio r re la t ion . Journal
of Personality an d Social Psychology, 51 , 270-276.
M i l l a r , M . G ., & Tesser, A. (1989). The effects of affective-
c o g n i t i v e c o n s i s t e n c y a n d t h o u g h t o n t h e a t t i t u d e -
b e h a v io r r e l a t i o n . Journal of Experimental Social Psy-
chology, 2 5, 189-202.
M o n t a n e l l i , R . G ., J r . , & Hum ph reys , L . G. (1976) . La tent
roots of r an d om data correlat ion matrices with squared
m u l t i p l e co r re la t ions on the d iag on a l : A Mon te C ar l o
s t u d y . Psychometrika, 41, 341-348.
M u l a i k , S. A. (19 72). Th e foundation of factor analysis.
N ew Yo rk : Mc Gra w-Hi l l .
M u l a i k , S. A . (1990) . B lu r r i ng th e dis t inc t ion be tween com-
p o ne n t a na l y s i s a nd c o mmo n f a c t o r a na l y s i s . Mu/tivari-
at e Behavioral Research, 25, 53-59.
M u l a i k , S. A . , J ames , L . R. , Van A ls t ine , J ., B e nne t t , N .,
L i n d , S., & St i lw el l , C . D. (1989) . Ev a lua t ion o f g o o d-
ness-of-fi t i nd i c e s fo r s t ruc tura l equa t ion models . Psycho-
logical Bulletin, 105, 430^45.
N u n n a l l y , J . C . ( 197 8) . Psychometric theory (2nd ed.) . N ew
Yo rk : Mc Gra w-Hi l l .
Os t ro m , T. M. (1969). The re la t ionsh ip be tween th e affec-
t i ve , behavio ra l , an d c o g n i t i v e c o mp o ne n t s o f a t t i tude .
Journal of Experimental Social Psvcholog\, 5, 1 2 — 3 0 .
O v e r a l l , J . E. (1964). Note on the sc ient i f ic s ta tus o f factors .
Psychological Bulletin, 61 , 270-276.
Pet ty , R. E., Priester, J. R., & Wegener , D. T. (19 94) . Cog-
n i t i v e p r oce s se s in a t t i tude change . In R. S . Wyer & T. K.
Sru l l (Eds . ) , Handbook of social cognition ( V o l . 2, 2nd
ed. , pp . 69-142). Hi l l s d a l e , N J: E r lb a u m.
Rosenberg , M. J., & H o v l a n d , C . L (1960). C o g n i t i v e , af-
fec t ive , and behavio ra l com ponen ts o f a t ti tudes . In C . I .
H o v l a n d & M. J . Rosenberg (Eds . ) , Attitude organization
an d change: An analysis of consistency among attitude
components ( p p . 1-14). N e w Ha v e n , C T: Ya l e Un iv e r s i t y
Press .
Ro z e b o o m, W . W . (1990) . Whatever happened to broad
p e r s p e c t i v e ? Multivariate Behavioral Research, 25,
1-28.
R u m m e l , R. J . (1970). Applied factor analysis. Ev a ns t o n ,
IL : N o r t h we s t e rn Un iv e r s i t y Press .
Satorra , A., & Bent le r , P . M . (1994) . Co rrec t ions to test
s t a t i s t i c s a nd s t a nd a rd e r r o r s i n c o v a r i a nc e s t ru c t u re
a na l y s i s . I n A . Vo n Ey e & C . C . Clogg (Eds .) , Analysis of
7/15/2019 1999 - Evaluating the Use of EFA in Psychological Research
http://slidepdf.com/reader/full/1999-evaluating-the-use-of-efa-in-psychological-research 28/28
U S E O F F A C T O R A N A L Y S I S 299
latent variab les in developm ental research (pp. 399-
419) . N e w b u r y Park , CA: Sage .
Scho ner ran n , P . H. (1990) . Fac ts , f ic t ions , and co mm on
sense ; ibout f a c to r s a nd c o mp o ne n t s . Multivariate Behav-
ioral Research, 25, 47-51.
Skinne r , H . A . (1980) . Factor a n a l y s i s an d s tudies o f a lco-
ho l . Journal of Studies on Alcohol, 41 , 1091- 1101 .
S mi t h , M . B . ( 1 9 4 7 ) . Th e persona l se t t ing o f p u b l i c o p i n -
i o n s : A s tudy o f a t t i tudes toward Russ ia . Public Opinion
Quarterly, 11 , 507-523.
Snook, S C . , & Gor such , R. L . ( 1989 ) . C o m p o n e n t a n a l y s i s
ve rsus com mo n f ac to r ana ly s i s : A Monte Ca r le s tudy .
Psychological Bulletin, 106, 148-154.
Sp e a rm a n , C . (1904) . Genera l intell igence, objectively de -
t e rm i r e d a nd me a s u re d . American Journal of Psychol-
ogy, 15 , 201-293.
S p e a rma n , C . ( 1927 ) . Th e abilities of man. New York: Mac-
m il I a n
Steiger, .1. H. ( 1 9 7 9 ) . F a c t o r i nd e t e rm ina c y in the 1930' s
and th e 1970's : Some in te res t ing pa ra l le l s . Psychomet-
rika. < 1 4 , 157-167.
Steiger, .1 . H. ( 1989 ) . EzPATH: A supplementary module for
SYSTAT and SYCRAPH. Evans ton , 1L: SYSTAT.
Steiger, I. H . (1990) . Some addi t iona l though ts o n c o mp o -
nen t s , f ac to rs , and f ac to r inde te rminacy . Multivariate Be -
havioral Research, 25, 41-^-5.
Steiger, .1 . H ., & L i n d , J. (1980 , May) . Statistically based
tests for the number of common factors. P ape r p resented
at the a n n u a l m e e t i n g of the Psychomet r ic Soc ie ty , Iowa
C i t y .
Thurs tone , L . L . (1947) . Multiple factor analysis. C h ic a g o :U n i v e r s i t y o f C h i c a g o Press .
Tu c k e r , L . R . , K o o p m a n , R. F., & L i n n , R. L . ( 1 9 6 9 ) .
E v a l u a t i o n o f f a c t o r a na l y t i c r e s e a rc h p ro c e d u re s by
me a ns o f s imu l a t e d c o r re l a ti o n ma t r i c e s . Psychometrika,
34 , 421^159.
Tucker , L . R ., & Lewis, C. (1973). A r e l i ab i l i ty c o e f f i c i e n t
fo r m a x im u m l ik e l i h o o d f ac t o r a na l y s i s . Psychometrika,
38 , 1-10.
Tucker , L . R ., & M a c C a l l u m , R . C . ( 1 9 9 7 ) . Exploratory
factor analysis. Unp u b l i s h e d m a nu s c r i p t , Oh io S t at e Un i -
ve rs i ty , C o l u m b u s .
van Dr ie l , O. P . ( 197 8) . On va r ious causes o f improper so -
l u t i o n s i n m a x i m u m l i k e l i h o o d f a c t o r a n a l y s i s . Psy-
chometrika, 43, 225-243.
Vel ice r , W. F . ( 197 6 ) . De t e rm in i ng t h e nu mb e r o f c o mp o -
n e n t s f r o m t h e m a t r i x o f p a r t i a l c o r r e l a t i o n s . Psy-
chometrika, 41, 321-327.
Vel ice r , W. F. ( 1 9 7 7 ) . A n e mp i r i c a l c o mp a r i s o n of the s im i -
lar i ty o f p r i n c i p a l c o mp o ne n t , ima g e , a n d f ac to r pa t te rns .
Multivariate Behavioral Research, 12, 3 — 2 2 .
V e l i ce r , W . F., & Fava, J . L. (1998). Effects of variable and
subject sampl ing on f ac to r pa t te rn recovery . Psychologi-
ca l Methods, 3, 231-251.
V e l i c e r , W . F. , & J a c k s o n , D . N . ( 1 9 9 0 a ) . C o mp o ne n t
a n a l y s i s v e r s u s c o mmo n f a ct o r a na l y s i s : S o me i s s u e s in
se lec t ing a n app rop r ia te p rocedure . Multivariate Behav-
ioral Research, 25 , 1-28.
V e l i c e r , W. F., & J a c k s o n , D . N . ( 1 9 9 0 b ) . C o m p o n e n t
an a l y s i s v e r s u s c o mmo n f a c t o r a na l y s i s : S o m e fur ther
o b s e rv a t i o n s . Multivariate Behavioral Research, 25, 9 7-
114.
Vel ice r , W . F. , Peacock , A . C ., & J a c k s o n , D. N . ( 1982) . A
c o mp a r i s o n o f c o mp o ne n t a nd f a c t o r p a t t e rn s : A Mo n t e
C ar l o app roach . Multivariate Behavioral Research, 1 7,
371-388.
Weg ener, D. T., & Fabr igar , L. R. ( in p ress ) . Ana lys i s and
des ign fo r nonexper imenta l da ta : Address ing causa l an d
n o n c a u s a l h y p o t h e s e s . In H. T. Reis & C . M. Judd (Eds . ) ,
Handbook of research methods in social psychology.N ew Yo rk : C a mb r id g e L'nivers i ty Press .
Wegener , D. T. , & Gregg , A . P . ( in p ress ) . A t t i tude s t ruc-
tu re . I n A . K az d i n (Ed .) , Encyclopedia of Psychology.
N ew Yo rk : A m e r i c a n P s y c h o lo g ic a l A s s o c i a ti o n .
Weiss, D. ( 197 6 ) . Multivariate procedures. In M. D. Dun-
nete (Ed . ) , Ha nd b o o k o f i nd u s t r i a l / o rg a n i z a t i o na l p s y -
c h o lo g y . C h i c a g o , IL : Ra nd Mc N a l l y .
West, S. G., Finch, J . F., & C u r r a n , P . J . ( 1995 ) . Struc tura l
e q u a t i o n mo d e l s wi th no n no r ma l v a r i a b l e s : P ro b le ms an d
remedies . In R. H. Hoy le (Ed. ) , Structural equation mod-
eling: Concepts, issues and applications ( p p . 56-75).
N e w b u r y Park , C A : Sage.
W i d a m a n , K . F. (1990) . Bias in pa t te rn loadin gs rep resented
by c o mm o n f a ct o r a na l y s i s a nd c o mp o ne n t a n a l y s i s . Mul-
tivariate Behavioral Research, 25, 89-95.
Wid a m a n , K . F . ( 1 9 9 3) . C o m mo n f a ct o r a na l y s i s v e r s u s
p r i n c i p a l c o mp o ne n t a na l y s i s : D i f fe r e n t i a l b i a s in rep re-
s e n t i n g mo d e l p a r a me t e r s ? Multivariate Behavioral Re -
search, 28, 263-311 .
Wo o d , J . M., T a ta r yn , D . J. , & Go rs u c h , R. L . (1996) . E f-
fects of under- and o v e r e x t r a c t i o n on p r inc ipa l ax is f ac to r
a n a l y s i s wi t h v a r ima x ro t a t i o n . Psychological Methods,
I, 354-365.
Zwick , W . R. , & Vel ice r , W. F . ( 1982) . Factors i n f l u e n c i n g
four ru l e s fo r d e t erm in i ng t h e nu m b e r o f c o mp o ne n t s t o
re t a in . Multivariate Behavioral Research, 1 7, 253-269.
Z wic k , W . R ., & Vel ice r , W. F . ( 1986 ) . C o mp a r i s o n o f f ive
ru le s fo r d e t e r m i n i n g th e n u m b e r o f c o mp o ne n t s to r e t a i n .
Psychological Bulletin, 17, 253-269.
Received September 24 , 1997
Revis ion rece ived February 3, 1999
Accepted February 10, 1999 •