item response theory analysis of the diagnostic criteria for mania: … · 2012. 2. 28. · item...

1
Bipolar disorder is a severe and recurrent condition (Stensland et al., 2007). In the general population, the lifetime prevalence of bipolar disorder is 3.9% in the U.S (Kessler et al., 2005) and 1.3% in Australia. Bipolar disorder is challenging to diagnose (Agrawal et al., 2010; Stensland et al., 2008) and consequently patients often receive inappropriate treatment (Hirschfeld, 2004). In cross-sectional epidemiological studies, researchers rely on one-time assessments of manic and depressive episodes. Differential item functioning (DIF) contd.: Target items (symptoms flagged for DIF): grandiosity flight of ideas activities with painful consequences Statistically significant DIF: Following application of the Benjamini-Hochberg procedure, a statistically significant group difference was identified in the severity parameter for the activities with painful consequences symptom: G 2 (1, n = 623) = 12.5, p < 0.001 Clinically significant DIF: This difference was also clinically significant as the DIF exceeded our 0.25 a priori cut-off: b SUD = -0.35, b no SUD = 0.38, b difference = -0.73 Item response theory analysis of the diagnostic criteria for mania: Findings from the 2007 Australian National Survey of Mental Health and Well-Being Natacha Carragher a , Lauren Weinstock b , David Strong b a National Drug and Alcohol Research Centre, University of New South Wales, Sydney b Brown University and Butler Hospital, Providence, RI To evaluate the psychometric properties of the DSM-IV mania symptoms in an epidemiologic sample Since mania frequently co-occurs with substance use disorders (SUD), to examine differences in symptom expression between those mania respondents with and without a lifetime SUD. Sample: 2007 National Survey of Mental Health and Well- Being (NSMHWB). Analyses focused on respondents who reported a distinct period of abnormally and persistently elevated, expansive or irritable mood, lasting at least 1 week and who were queried about the 14 mania symptom items (n =623). Diagnostic instrument: Modified version of the World Mental Health- Composite International Diagnostic Interview (WMH- CIDI, version 3.0). Analytic plan: One-factor model was fit to the data. Two-parameter logistic model was used to describe the relationship between responses to the DSM-IV mania symptoms and the underlying latent trait (mania severity). IRT likelihood-ratio test for differential item functioning program (IRTLRDIF) was used to assess whether the mania symptoms function equivalently for those with and without a SUD. Benjamini-Hochberg method was used to adjust p- values and reduce the risk of Type I error. Final item parameter estimates were generated. With DSM-5 pending, psychometric investigations of diagnostic symptoms are especially timely. This study confirmed that a single liability dimension underlies mania symptoms. The mania criteria performed equivalently across those mania respondents with and without a SUD, except for the activities with painful consequences symptom. These data indicate that individuals with a SUD are more likely to endorse this item at lower levels of mania severity. The findings may be aid clinical diagnostic decision- making and highlight subtle phenomenological differences between mania patients with and without SUD. Study sample characteristics: mean age of 34.7 years (S.E., 0.8), 16-80 years 50.3% (S.E. 2.7) male 55.6% (S.E. 2.9) never married 54.4% (S.E. 2.3) have a post-school qualification 70.7% (S.E. 2.3) were employed Confirmatory factor analysis (CFA): A one-factor model provided a good fit to the data. All factor loadings were salient (>0.40) and statistically significant (p < 0.05). Item response theory (IRT) analysis: Discrimination (a): The flight of ideas and distractibility symptoms had similar discrimination parameters indicating redundant psychometric information. Severity (b): Differential item functioning (DIF): Through an iterative process, anchor and target items were identified. Anchor set (symptoms free of DIF): goal-orientated activities talkativeness decreased need for sleep distractibility Fit indices for the CFA models used to assess the IRT unidimensionality assumption Dr Natacha Carragher NDARC, UNSW Randwick Campus Phone: (02) 9385 0249 Email: [email protected] 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 -3.0 -2.0 -1.0 0.0 1.0 2.0 3.0 Probability of endorsement Severity of mania (latent trait) Grandiosity Less sleep Talkativeness Flight of ideas Distractibility Goal-oriented activities Painful consequences greatest for grandiosity. lowest for the decreased need for sleep. Χ 2 (df) RMSEA CFI TLI Mania sample 40.7* (14) 0.06 0.93 0.89 (n = 623) - SUD 26.5* (14) 0.05 0.92 0.88 (n = 314) - No SUD 29.7* (14) 0.06 0.93 0.90 (n = 309) 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 -3.0 -2.0 -1.0 0.0 1.0 2.0 3.0 Probability of endorsement of activities with painful consequences Severity of mania (latent trait) Mania group with a SUD Mania group without a SUD Differences between the mania groups with and without a SUD in the probability of endorsing activities with painful consequences The activities with painful consequences symptom was endorsed at lower levels of severity (i.e., ICC is displaced to the left), and hence more frequently, by those with a SUD diagnosis than those without a SUD diagnosis. Item characteristic curves (ICCs) for the seven mania symptoms in the 2007 NSMHWB goal-oriented activities symptom tapped the mild end of the mania continuum. grandiosity symptom fell at the severe end of the continuum. It adds to a growing literature conceptualising mental disorders according to a dimensional framework (e.g., Brown & Barlow, 2005). - First investigation of its kind in Australia and only second internationally. Background Aims Method The psychometric performance of the symptoms are thus of critical importance. Results Conclusion Contact details Specific lifetime estimates for bipolar I disorder (mania) range from 3.6% in the U.S (Weinstock et al., 2009) to 0.7% in Australia.

Upload: others

Post on 25-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Item response theory analysis of the diagnostic criteria for mania: … · 2012. 2. 28. · Item response theory analysis of the diagnostic criteria for mania: Findings from the 2007

Bipolar disorder is a severe and recurrent condition (Stensland et al., 2007). In the general population, the lifetime prevalence of bipolar disorder is 3.9% in the U.S (Kessler et al., 2005) and 1.3% in Australia. Bipolar disorder is challenging to diagnose (Agrawal et al., 2010; Stensland et al., 2008) and consequently patients often receive inappropriate treatment (Hirschfeld, 2004). In cross-sectional epidemiological studies, researchers rely on one-time assessments of manic and depressive episodes.

Differential item functioning (DIF) contd.: Target items (symptoms flagged for DIF): ▪ grandiosity ▪ flight of ideas ▪ activities with painful consequences Statistically significant DIF:

Following application of the Benjamini-Hochberg procedure, a statistically significant group difference was identified in the severity parameter for the activities with painful consequences symptom: G2 (1, n = 623) = 12.5, p < 0.001 Clinically significant DIF:

This difference was also clinically significant as the DIF exceeded our 0.25 a priori cut-off: bSUD = -0.35, bno SUD = 0.38, bdifference = -0.73

Item response theory analysis of the diagnostic criteria for mania: Findings from the 2007 Australian National Survey of Mental

Health and Well-Being

Natacha Carragher a, Lauren Weinstock b, David Strong b a National Drug and Alcohol Research Centre, University of New South Wales, Sydney

b Brown University and Butler Hospital, Providence, RI

v  To evaluate the psychometric properties of the DSM-IV mania symptoms in an epidemiologic sample

v  Since mania frequently co-occurs with substance use disorders (SUD), to examine differences in symptom expression between those mania respondents with and without a lifetime SUD.

Sample: v  2007 National Survey of Mental Health and Well-

Being (NSMHWB).

v  Analyses focused on respondents who reported a distinct period of abnormally and persistently elevated, expansive or irritable mood, lasting at least 1 week and who were queried about the 14 mania symptom items (n =623).

Diagnostic instrument: v  Modified version of the World Mental Health-

Composite International Diagnostic Interview (WMH-CIDI, version 3.0).

Analytic plan: v  One-factor model was fit to the data.

v Two-parameter logistic model was used to describe the relationship between responses to the DSM-IV mania symptoms and the underlying latent trait (mania severity).

v  IRT likelihood-ratio test for differential item functioning program (IRTLRDIF) was used to assess whether the mania symptoms function equivalently for those with and without a SUD.

v  Benjamini-Hochberg method was used to adjust p-values and reduce the risk of Type I error.

v  Final item parameter estimates were generated.

With DSM-5 pending, psychometric investigations of diagnostic symptoms are especially timely.

This study confirmed that a single liability dimension underlies mania symptoms. The mania criteria performed equivalently across those mania respondents with and without a SUD, except for the activities with painful consequences symptom. These data indicate that individuals with a SUD are more likely to endorse this item at lower levels of mania severity.

The findings may be aid clinical diagnostic decision-making and highlight subtle phenomenological differences between mania patients with and without SUD.

Study sample characteristics: v  mean age of 34.7 years (S.E., 0.8), 16-80 years v  50.3% (S.E. 2.7) male v  55.6% (S.E. 2.9) never married v  54.4% (S.E. 2.3) have a post-school qualification v  70.7% (S.E. 2.3) were employed Confirmatory factor analysis (CFA): A one-factor model provided a good fit to the data. All factor loadings were salient (>0.40) and statistically significant (p < 0.05). Item response theory (IRT) analysis: Discrimination (a): The flight of ideas and distractibility symptoms had similar discrimination parameters indicating redundant psychometric information. Severity (b): Differential item functioning (DIF): Through an iterative process, anchor and target items were identified.

Anchor set (symptoms free of DIF): ▪ goal-orientated activities ▪ talkativeness ▪ decreased need for sleep ▪ distractibility

Fit indices for the CFA models used to assess the IRT unidimensionality assumption

Dr Natacha Carragher NDARC, UNSW Randwick Campus Phone: (02) 9385 0249 Email: [email protected]

0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0

-3.0 -2.0 -1.0 0.0 1.0 2.0 3.0

Pro

babi

lity

of e

ndor

sem

ent

Severity of mania (latent trait)

Grandiosity Less sleep Talkativeness Flight of ideas Distractibility Goal-oriented activities Painful consequences

v  greatest for grandiosity. v  lowest for the decreased need for sleep.

Χ 2 (df) RMSEA CFI TLI

Mania sample 40.7* (14) 0.06 0.93 0.89 (n = 623)

- SUD 26.5* (14) 0.05 0.92 0.88 (n = 314)

- No SUD 29.7* (14) 0.06 0.93 0.90 (n = 309)

0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0

-3.0 -2.0 -1.0 0.0 1.0 2.0 3.0

Prob

abili

ty o

f end

orse

men

t of

act

iviti

es w

ith p

ainf

ul

cons

eque

nces

Severity of mania (latent trait)

Mania group with a SUD Mania group without a SUD

Differences between the mania groups with and without a SUD in the probability of endorsing activities with painful consequences

The activities with painful consequences symptom was endorsed at lower levels of severity (i.e., ICC is displaced to the left), and hence more frequently, by those with a SUD diagnosis than those without a SUD diagnosis.

Item characteristic curves (ICCs) for the seven mania symptoms in the 2007 NSMHWB

v  goal-oriented activities symptom tapped the mild end of the mania continuum. v  grandiosity symptom fell at the severe end of the continuum.

v It adds to a growing literature conceptualising mental disorders according to a dimensional framework (e.g., Brown & Barlow, 2005).

- First investigation of its kind in Australia and only second internationally.

Background

Aims

Method

v  The psychometric performance of the symptoms are thus of critical importance.

Results

Conclusion

Contact details

v  Specific lifetime estimates for bipolar I disorder (mania) range from 3.6% in the U.S (Weinstock et al., 2009) to 0.7% in Australia.