‘i've lost my husband, my house and i need a new knee … why should i smile?’: action...

7
‘I’ve lost my husband, my house and I need a new knee . . . why should I smile?’: Action research evaluation of a group cognitive behavioural therapy program for older adults with depression LISA RICHARDSON & CORINNE REID School of Psychology, Murdoch University, Murdoch, Western Australia, Australia Abstract The current paper details an action research approach to developing and evaluating a group cognitive-behavioural therapy (CBT) program for older adults (65þ years) experiencing depression. This approach allowed the development of a novel program and for each component of the program to be evaluated and modified in an iterative, developmental fashion – a particularly important, ethically responsive feature when working with vulnerable populations. Formative and summative evaluations allowed the identification of beneficial, cohort-specific elements of an intervention without compromising individual wellbeing. A mixed methods data design was used to triangulate multiple and repeated quantitative and qualitative measures; in essence, a formalisation of usual clinical practice. The outcomes from the pilot study will be discussed in the context of a methodology that uniquely facilitates microanalytic research while maintaining therapeutic accountability, making replication and program accountability available to all clinicians. Keywords: Action research, CBT, evaluation, group therapy, mixed method, older adult Older adults represent a unique and vulnerable group in mental health. They are impacted upon by significant developmental changes when ageing normally and may experience highly distressing psychiatric conditions that require idiosyncratic management strategies (Brodaty, Harris, Peters, Boyce, & Hickie, 1993; Mulsant & Ganguli, 1999). The gerontological clinical literature emphasises the use of medications yet acknowledges the complica- tions of physical decline and polypharmacy (Baldwin, 2002; Salzman, 2000; Wood, 2002). There are relatively few existing studies of psychotherapeutic approaches and these are beset by issues of patient drop-out, lack of replication, relative lack of differ- ence between theoretically diverse therapies and lack of component evaluation (Dick, Gallagher-Thomp- son, & Thompson, 1999; Eyesenck, 1994; Floyd & Scogin, 1998; DeRubies et al., 1990). Moreover, existing manualised mood programs are generally written for young adults and the exercises and examples are not culturally relevant (Free, 1999; Yoshioka, 1999). Those that are specifically designed for older adults are written for individuals rather than for a group format (Gallagher & Thompson, 1982; Thompson, Gallagher-Thompson, & Dick, 1992). They are also quite long and thus likely to increase drop-out rates in clinical populations (Shapiro et al., 1994; Yost, Beutler, Corbishley, & Allender, 1986). Thus, although cognitive-behavioural therapy (CBT) is generally supported as an intervention model with individual older adults, its efficacy as a brief, group intervention is currently unresolved (Clijpers, 1998; Gatz et al., 1998; Robinson, Berman, & Neimeyer, 1990; Woods & Roth, 1996). The aims of the present study were twofold: to develop, then evaluate, a brief group therapy mood management program specifically for older adults. In searching for an existing program to serve as a framework, the authors encountered the problems outlined above and little, other than post hoc rationalisation, by way of explanation of these variable outcomes (Greenburg & Newman, 1996; Scogin & McElreath, 1994; Woods & Roth, 1996). For progress to be made it seemed clear that a new program would need to be developed and a micro- analytic approach required to answer questions regarding component effectiveness as the program progressed. Correspondence: C. Reid, School of Psychology, Murdoch University, Murdoch, WA 6150, Australia. E-mail: [email protected] Clinical Psychologist, Vol. 10, No. 2, July 2006, pp. 60 – 66. ISSN 1328-4207 print/ISSN 1742-9552 online ª The Australian Psychological Society Ltd Published by Taylor & Francis DOI: 10.1080/13284200600690453

Upload: lisa-richardson

Post on 08-Aug-2016

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ‘I've lost my husband, my house and I need a new knee … why should I smile?’: Action research evaluation of a group cognitive behavioural therapy program for older adults with

‘I’ve lost my husband, my house and I need a new knee . . . why should Ismile?’: Action research evaluation of a group cognitive behaviouraltherapy program for older adults with depression

LISA RICHARDSON & CORINNE REID

School of Psychology, Murdoch University, Murdoch, Western Australia, Australia

AbstractThe current paper details an action research approach to developing and evaluating a group cognitive-behavioural therapy(CBT) program for older adults (65þ years) experiencing depression. This approach allowed the development of a novelprogram and for each component of the program to be evaluated and modified in an iterative, developmental fashion – aparticularly important, ethically responsive feature when working with vulnerable populations. Formative and summativeevaluations allowed the identification of beneficial, cohort-specific elements of an intervention without compromisingindividual wellbeing. A mixed methods data design was used to triangulate multiple and repeated quantitative and qualitativemeasures; in essence, a formalisation of usual clinical practice. The outcomes from the pilot study will be discussed in thecontext of a methodology that uniquely facilitates microanalytic research while maintaining therapeutic accountability,making replication and program accountability available to all clinicians.

Keywords: Action research, CBT, evaluation, group therapy, mixed method, older adult

Older adults represent a unique and vulnerable group

in mental health. They are impacted upon by

significant developmental changes when ageing

normally and may experience highly distressing

psychiatric conditions that require idiosyncratic

management strategies (Brodaty, Harris, Peters,

Boyce, & Hickie, 1993; Mulsant & Ganguli, 1999).

The gerontological clinical literature emphasises the

use of medications yet acknowledges the complica-

tions of physical decline and polypharmacy (Baldwin,

2002; Salzman, 2000; Wood, 2002). There are

relatively few existing studies of psychotherapeutic

approaches and these are beset by issues of patient

drop-out, lack of replication, relative lack of differ-

ence between theoretically diverse therapies and lack

of component evaluation (Dick, Gallagher-Thomp-

son, & Thompson, 1999; Eyesenck, 1994; Floyd &

Scogin, 1998; DeRubies et al., 1990). Moreover,

existing manualised mood programs are generally

written for young adults and the exercises and

examples are not culturally relevant (Free, 1999;

Yoshioka, 1999). Those that are specifically designed

for older adults are written for individuals rather than

for a group format (Gallagher & Thompson, 1982;

Thompson, Gallagher-Thompson, & Dick, 1992).

They are also quite long and thus likely to increase

drop-out rates in clinical populations (Shapiro et al.,

1994; Yost, Beutler, Corbishley, & Allender, 1986).

Thus, although cognitive-behavioural therapy (CBT)

is generally supported as an intervention model with

individual older adults, its efficacy as a brief, group

intervention is currently unresolved (Clijpers, 1998;

Gatz et al., 1998; Robinson, Berman, & Neimeyer,

1990; Woods & Roth, 1996).

The aims of the present study were twofold: to

develop, then evaluate, a brief group therapy mood

management program specifically for older adults. In

searching for an existing program to serve as a

framework, the authors encountered the problems

outlined above and little, other than post hoc

rationalisation, by way of explanation of these

variable outcomes (Greenburg & Newman, 1996;

Scogin & McElreath, 1994; Woods & Roth, 1996).

For progress to be made it seemed clear that a new

program would need to be developed and a micro-

analytic approach required to answer questions

regarding component effectiveness as the program

progressed.

Correspondence: C. Reid, School of Psychology, Murdoch University, Murdoch, WA 6150, Australia. E-mail: [email protected]

Clinical Psychologist, Vol. 10, No. 2, July 2006, pp. 60 – 66.

ISSN 1328-4207 print/ISSN 1742-9552 online ª The Australian Psychological Society Ltd

Published by Taylor & Francis

DOI: 10.1080/13284200600690453

Page 2: ‘I've lost my husband, my house and I need a new knee … why should I smile?’: Action research evaluation of a group cognitive behavioural therapy program for older adults with

Such microanalysis required a fluid approach to

emergent problems. Action research is one such

dynamic research design offering opportunities to

evaluate components of the program as it progresses

(formative evaluation) and to evaluate the effective-

ness of the program after it is completed (summative

evaluation) (Power, Dale, & Jones 1991; Sharp &

Frechtling, 1997). It is a model that is ideally suited to

research that is formative and quasi-experimental in

nature, and incorporates a cycle of action, reflection,

hypothesis generation, data collection/action and

analysis/reflection again. Although this cycle of

‘‘research activities’’ is similar to those of conven-

tional experimental research in human sciences,

action research differs by its accommodation of

contextual information, experiential reflection, and

shared boundaries between participants and re-

searchers as valuable data reflecting ‘‘the real

world’’ rather than as contaminating variables or bias

that need to be controlled (Wadsworth, 1998). While

the participant status of the researcher potentially

compromises objectivity, it offers expert opportunity

for noting unexpected and fortuitous outcomes from

the perspectives of both the participants and facil-

itators (Collins, Murphy, & Bierman, 2004).

The case study approach used in action research in

conjunction with the real-time capture of data and the

iterative use of that data in a program development

feedback loop, makes it most suitable for use in testing

an innovative program with vulnerable client groups

(Davey, 1991). In constantly monitoring the effective-

ness of each session for each client, and being respon-

sive in weekly session planning, this approach is

ethically responsible and clinically accountable (Bar-

nett et al., 1999; Woolley, Butler, & Wampler, 2000).

Hence, this paper will focus, not on the program

alone, but on describing an innovative approach to

evaluating intervention programs that is accessible to

the ordinary practitioner. Through both formative

and summative evaluation, this approach has helped

us unpick the elements of an intervention that might

hold promise for particular groups of older parti-

cipants (aged 65 and above). The process and

outcomes of this journey will be discussed below,

and are organised thematically around clinically

relevant issues. We hope that this takes us one step

closer to fulfilling our professional responsibilities as

scientist – practitioners. The salient parameters of

this 12-week CBT group therapy program will be

illuminated as the discussion progresses.

Accountability

In applied settings, the demands of research can often

conflict with the clinical demands to ‘‘do no harm’’,

especially if the research methodology requires strict

adherence to a pre-set intervention program (Slonim-

Nevo, 1997). Action research describes a model of

evaluation that encourages multiple iterations of a

program to be evaluated as it progresses. It draws

intentional and unintentional elements, from various

perspectives, into the data set, directly contributing to

program development (Power et al., 1991; Tyson,

1992). One of the criticisms of both ‘‘fixed’’ or

manualised and ‘‘adaptive interventions’’ is that

expert-generated rules for the inclusion or removal

of components of an intervention are determined by

clinicians who are not familiar with the idiosyncratic

needs of each participant group of individuals, which

can systematically reduce the reliability of interven-

tions (Collins et al., 2004).

Each session in our program was assessed prior to,

and at the conclusion of the interaction to evaluate

successes, failures, opportunities and redundancies.

This information was then used to better target the

needs and capabilities of the participants in sub-

sequent sessions; thereby enhancing accountability.

This process revealed that, despite intensive ground-

work and preparation in the current study (in the

form of expert interviews and literature review),

many of the uniquely developed content features and

process considerations failed to adequately address

the needs of the client group. One such formative

outcome was the finding that participants failed to

comprehend the ABC model (i.e., antecedents/

activating event-belief/thought-emotional consequence

(Beck, Rush, Shaw, & Emery, 1979)), which is

central to CBT treatment programs for depression.

As a result, much of the session’s script was rewritten

and presented again during the next session using the

same exercises/examples, but with more diary-like

format (rather than the traditional columnar format)

and more cohort-relevant labels to enhance compre-

hension. Results from each subsequent assessment

showed that participants’ understanding of the con-

cepts had improved, and participants were able to

progress to the next stage of the CBT process. Had the

research design not allowed for ongoing changes to

both content and tailored evaluation surveys, the parti-

cipants’ comprehension might have been hindered by

jargon and their subsequent insight and behaviour

change masked by unfair and unrealistic assessment

item design. Thus an action research approach

increased clinical accountability through the respon-

sive modification of session content and process in a

structured, evidence-based way rather than merely

presenting ad hoc observations of client – program fit

as limitations to the study after the fact (Greenburg &

Newman, 1996; Sutton, 1989; Tyson, 1992).

Contextualisation of intervention

Action research emphasises the participatory

nature of research, and encourages fluidity between

Older adults & group CBT programs 61

Page 3: ‘I've lost my husband, my house and I need a new knee … why should I smile?’: Action research evaluation of a group cognitive behavioural therapy program for older adults with

boundaries of ‘‘participant’’ and ‘‘expert’’ through

the recording of collective processes and summative

outcomes to determine what is ‘‘. . . deemed useful by

those whose problematic situation led to the research

in the first place’’ (Wadsworth, 1998:12, also see

Power et al., 1991). Participants are service con-

sumers and service providers. In the formative aspect

of this study, both group members and group

facilitators contributed significantly to the data set.

Moreover, local experts were involved in the process

of program design to supplement the literature review

of relevant programs (Thompson, Gallagher-

Thompson, & Dick, 1992; Yost et al., 1986). A

comprehensive series of 14 interviews with local

experts identified a range of age-specific issues as well

as issues specific to their work with older adults in the

local context. A circumscribed package of CBT that

accommodated time and content limits was devel-

oped with a unique script for each session, and local

and age-specific examples.

In the first draft of the manual, expert interviews

resulted in several technical accommodations includ-

ing (a) the considerable expansion of time to socialise

participants to the unfamiliar experience of therapy,

(b) highlighting grief and loss as particularly pertinent

to the mood of older adults, (c) incorporating a flexible

approach to setting and using homework tasks, and (d)

the restriction of the program to 862-hr sessions to

prevent drop-out. Other process and content recom-

mendations for maximising the efficacy of the program

and troubleshooting were also included for facilitators,

as a separate section at the beginning of each session

script. These included modifications in environment

and presentation strategy, such as (a) using two

therapists; (b) modifying room layouts to accommo-

date tremors, involuntary movements, walking frames

and sensory impairments; (c) changing jargon to lay

terms; (d) increasing font sizes on handouts; (e)

providing age-relevant examples, suggestions and

strategies; (f) increasing break frequency; and (g)

increasing time for reviewing session material. These

modifications were aimed at enhancing and facilitating

the more standard CBT features of this program,

which included symptom psychoeducation and the

ABC model, thinking errors, self-talk, behavioural

activation and self-monitoring.

Feedback from participants about the experience of

participating in the intervention was also sought as the

intervention unfolded, to guide existing theory toward

real world practice and action, rather than evaluating

the degree to which participants deviate from expert

or professional expectation (Wadsworth, 1998).

Complex issues but small samples

Action research engages the mixed methods data

collection approach, which encourages the synthesis,

or triangulation of both qualitative and quantitative

types of data from multiple sources including

therapists and group participants. This transforms

that which is generally considered a weakness of

clinical research, namely small sample size, into a

design strength (Galassi & Gersch, 1993; Power

et al., 1991; Sharp & Frechtling, 1997). The mixed

method approach utilises single case study metho-

dology, emphasising depth and breadth of analysis

with each individual to draw contextualised, clini-

cally rich and, arguably, more valid and reliable

conclusions (Barnett et al., 1999; Davey, 1991;

Slonim-Nevo, 1997). In many ways, it formalises

what clinicians have always done: to monitor their

client from multiple perspectives and to draw out

inferences from complex data sets involving observa-

tions, inferences, reflections, failures and deviations

from expected procedures.

In our research the pilot program was completed by

five participants with a mean age of 81.3 years. Each

participant was assessed individually on 18 separate

occasions, using four standardised quantitative

assessment tools and several qualitative assessments.

Quantitative measures included the General Health

Questionnaire (GHQ-12; Goldberg & Williams,

1988), Geriatric Depression Scale (GDS; Yesavage

et al., 1983), Beck Anxiety Inventory (BAI; Beck &

Steer, 1993) and a Mood Rating Form (MRF)

designed by the researchers. These were implemen-

ted before and after intervention and at 3-month

follow-up. The qualitative measures included one

assessment of physical symptom change in addition

to measures of knowledge acquisition, concept

recognition, retention and application at the begin-

ning and end of each session, and again at follow-up.

Thus, despite having so few participants in the pilot

study, conclusions were drawn from a total of 65

separate data points, from the perspective of both

the participants and group facilitators. Results

were presented as a portfolio of information where

disparate or small pieces of data about the same

subject were combined into a richer whole before

conceptual re-sorting of data and re-analysis (Barnett

et al., 1999). Each analysis yielded important results.

The former alerted us to individual progress, the

latter to broader success of particular program

components. Thus, the systematic case study ap-

proach illuminated individual change but also shed

light on therapy/change processes (Davey, 1991;

Greenburg & Newman, 1996; Tyson, 1992).

Statistical versus clinical significance of change

The triangulation or synthesis of multiple sources of

data is a core element of action research and serves to

integrate apparently disparate sources of sometimes

gross, quantitative data with finer, qualitative data to

62 L. Richardson & C. Reid

Page 4: ‘I've lost my husband, my house and I need a new knee … why should I smile?’: Action research evaluation of a group cognitive behavioural therapy program for older adults with

titrate their combined contribution to global variable

change (Barlow, Hayes, & Nelson, 1984; Sharp &

Frechtling, 1997). Baseline and repeated measures of

clinically and functionally relevant knowledge, skills

and behaviour were undertaken in addition to

changes in mood. To assess program efficacy on a

micro level in our program, a weekly MRF was

constructed that assessed symptoms as they more

typically present in the older population. To assess

knowledge and skill development, data were gathered

about the participants’ immediate (in-session) under-

standing of information presented, and was

triangulated with delayed recall of information (the

following week) and their ability to demonstrate

comprehension through application to relevant ex-

amples and descriptions of their own behaviour

change. Items were developed to reflect key themes

from each session plan. These criteria helped us to

ascertain what degree and type of change was being

achieved when compared to preexisting levels of

knowledge, skills and behaviour measured. For

example, in the case of a client who did not apply

the ABC model correctly in their homework task, it

was important to ascertain whether there was an initial

processing problem (e.g., not hearing the material

being presented), an interpretive problem (e.g., not

understanding the concept despite being able to

repeat what had been said), a memory problem

(e.g., if they scored highly on comprehension one

week, but low on recall of the material in a subsequent

week), or a motivational problem in application for

homework tasks. Similarly, for those who scored

highly on all conceptual elements of the program it

was important to assess whether they were learning

this material in the group (which is the desired aim) or

already knew it before entering the program but had

been having problems implementing it in their daily

lives. This process allowed the program to be better

targeted to the needs and abilities of each client. The

aim of this process was also to determine what

participants believed was important. Results of the

recall data were able to be translated immediately to

modification of subsequent sessions, with the aim of

enhancing processing of information and the pro-

gram’s overall efficacy. These measures were used in

conjunction with more traditional standardised and

norm-referenced symptom measures and qualitative

feedback regarding therapeutic/change processes.

These formative assessments resulted in changes to

the duration of sessions, frequency of breaks, use of

multimedia, and presentation style due to the impact

of physical, sensory and cognitive impairment.

Drop-outs

The changing physical and medical circumstance of

older adults was recognised as an important logistical

feature of this target group, and a degree of partial

nonattendance or complete drop-out was expected.

Individuals traditionally labelled as missing data or

nonparticipants, are usually removed from final

results due to their threat to sample bias, degrees of

freedom and overall quality of the research (Sutton,

1989). However, the recognised features of ‘‘drop-

out’’ in this target group support the inclusion of the

non-missing parts of the so-called ‘‘missing data’’.

The action research approach accommodates this.

Participants who drop out provide insight into

personal or environmental hurdles to completion of

a therapy group, the adequacy of the program to

meet the needs and expectations of participants and

how they typically respond when it does not.

For our completer participants, missing data

occurred with noteworthy frequency, as expected,

due to illness-related absences, transport problems

and sensory deficits, as expected. Commencing with

seven participants but concluding with five, exit

interviews were conducted. The data obtained from

interviews with drop-outs (who remained involved

with the service but not the group) support the

observation that interventions for older persons must

accommodate the specific challenges they bring to

therapy. Through formative session reviews, facil-

itators observed that external events could mean that

participants could be physically present but not

participating in the program. Poor concentration

and a loss of confidence was one outcome for

participants’ mental state and emotions following

falls or injury. Discussing the past weeks’ key events

provided essential forewarning for facilitators to

engage with participants in ways that accommodated

variations in attention or cognition. Compared to

generic adult populations, our findings further

support the recommendation to make explicit

accommodation for lifestyle features when designing

psychological interventions for older clients.

Homework

The CBT literature strongly advocates the use of

homework as a vital component of the therapeutic

process. According to many of the experts who were

interviewed, the success in implementing homework

tasks and obtaining useful personal data on which to

build sessions is a less than automatic assumption

when working with an older participant. The choice of

descriptive label for the task, the amount of self-

directed work required, the medium in which tasks

are set, and the amount and availability of instruction,

all impact on whether the participant completes

homework tasks. The likelihood of homework com-

pletion in a short-term group setting with an older

group of participants was untested prior to this study,

but most interviewed practitioners agreed that tasks

Older adults & group CBT programs 63

Page 5: ‘I've lost my husband, my house and I need a new knee … why should I smile?’: Action research evaluation of a group cognitive behavioural therapy program for older adults with

would need to be short and simple, have clear

instructions that could be referred to out of the

session, and which were not described as ‘‘home-

work’’, but rather as ‘‘take-home tasks’’, or ‘‘help/

information for the therapist’’. Requesting too much

writing was identified as one likely reason for failure,

while setting a task that was partially undertaken

outside the session but which could be elaborated

upon in session, was considered more likely to be

successful.

In this study, homework was planned for every

session, as per CBT doctrine, and professional

recommendation. However despite multiple presen-

tations and iterations, memory prompts and

changing formats, homework tasks remorselessly

changed from formal written exercises to verbal

recollections of recent events that would be elabo-

rated on or discussed in detail the following session.

Although not formal homework tasks, these remin-

ders and prompts did seem reasonably effective in

generating examples and issues for ongoing session

work. The conclusion we drew was that despite the

well-documented value of homework to CBT pro-

gress for general adult participants, a flexible

approach to how it looks and its purpose (i.e., to

generate in-session examples for group discussion

and problem solving rather than individual insight-

oriented work) was necessary in order for our

participants to benefit from the exercise.

Personal narrative

Every professional interviewed prior to developing this

program mentioned the need for facilitators to allow

time for older participants to recount their personal

narrative, while also maintaining the group focus on

the session goals. This study’s formative observations

(in the form of behavioural observations, monitoring

of elapsed time between time on task and ‘‘story-

telling’’, and objective measures of amount of content

completed during the session compared to expected

content amount) supported the observation of this

age-related response set. While all group participants

may need to contextualise their experience of therapy

with their own life experiences, and describe signifi-

cant elements of their personal narrative, the need for

story-telling appears greater for the older therapy

participant. This apparently consistent feature of their

experience may reflect a tradition of passing on

historical fact by spoken word, as well as an

opportunistic response to having a like-minded, and

tolerant audience. ‘‘Memory meandering’’ (Thomp-

son, Gantz, Del Maestro, Bryan, & Gallagher-

Thompson, 1991), and a need to externally process

the thoughts and feelings associated with intervention-

specific factors in a verbal narrative form, are also likely

to play a part. For clinicians, however, rather than

being a hindrance, these stories can be drawn upon at a

later stage, to highlight examples of unhelpful beha-

viours, thoughts and beliefs that the client can directly

challenge in therapy, and with which the rest of the

group may identify, and verbally engage.

With regard to assessment of progress, unlike that

which is typically seen in younger adult groups,

responses were not ‘‘parroted back’’ as they had been

described during the session but were described as

personal experiences (e.g., ‘‘become less active’’, is

replaced with ‘‘stop doing the gardening’’). With the

researcher as intervention facilitator, use of open-

ended questions and the recording of significant in-

session focus points, individual responses and the

learning they reflected, were able to be interpreted.

Such responses in all likelihood would be marked

incorrect on a standardised questionnaire. However,

through triangulation of data, and multiple assess-

ments, a group participant could demonstrate an

understanding of concepts better when asked to

describe the experience in more detail, or explain the

management strategies he or she could use. The

research design allowed participants to demonstrate

applied knowledge in multiple ways. These observa-

tions suggest that failure to recall labels or technical

terms may reflect a tendency to personalise informa-

tion encoding and recall, as opposed to a failure to

comprehend or apply the information to behaviour.

It is important to accommodate this different

cohort style of processing information when asses-

sing knowledge or behaviour change. Subsequently,

participants’ responses to learning questionnaires

were sometimes assessed on the basis of personal

narrative (and therefore in terms of their application

of knowledge to their own situation) rather than

solely on their ability to restate the content of the

sessions as described in the manual.

Personal narrative can also identify, as it did in this

study, an issue that is central to therapeutic change

for a particular cohort yet which had been under-

appreciated in program design. In this case the issue

was grief and loss. The preponderance of sponta-

neous personal narrative related to the theme of loss

of loved ones or change of personal circumstances

alerted the facilitators to the centrality of this issue in

the experience of depression and anxiety in this

cohort. The relationship between loss, grief and

depression was consequently allocated a much more

significant profile in the program. For our group,

these issues were very tangible and were blocking

progress on other depression-related issues until it

was fully addressed.

Summative evaluation outcomes

Taken together, results suggest that 50 – 80% com-

prehension or application of most elements included

64 L. Richardson & C. Reid

Page 6: ‘I've lost my husband, my house and I need a new knee … why should I smile?’: Action research evaluation of a group cognitive behavioural therapy program for older adults with

in this program was sufficient to significantly reduce

the level of symptomatic distress as measured on

standardised assessments (GDS, BAI, GHQ and

MRF) at the conclusion of an 8-week intervention. It

would seem, however, that partial comprehension and

application of most elements in this program was not

sufficient to prevent resurgence in symptomatic

distress (to clinically significant levels for nearly all

participants on the GDS), measured on the same

assessment tools, when participants were no longer

engaged in a therapeutic intervention. Despite nearly

100% comprehension and application of knowledge

and skills related to relapse prevention planning, nearly

every participant recorded a partial return of depres-

sive or anxious symptoms at 12-week follow-up. The

reasons for this failure in prophylaxis may be related to

intervening health crises (noted in recording of

hospital admissions or incidences of specialist medical

treatment), but also perhaps to a need for intermittent

top-up sessions: several participants indicated that they

had wanted to contact group facilitators in the

intervening weeks but ‘‘did not want to be a burden’’

or were unsure how to approach such a contact.

It is these discrepancies between the participant’s

knowledge or behaviour, and their standardised mood

assessment results, which highlight the value of the

current study’s research design to elucidate genuine

possible causes for change, as opposed to post hoc

speculations regarding limitations of the study.

Summary

It seems that an action research approach has been

critical to the success of developing and evaluating this

novel approach to group treatment. Although the final

program that was delivered differed from the original

manual, the changes to program content and process

outlined above reflected responsiveness to accumulat-

ing evidence rather than stasis in the face of client

difficulty. The therapy manual generally retains its

content and process features, but some sections

required several iterations before the best fit of content

or practice could be determined to match the needs of

the clients. The summative results of this study point

to a positive outcome for participants both in terms of

symptom relief as measured by standardised assess-

ment tools, self-reported behaviour change, subjective

mood assessment, and participant satisfaction. Long-

term follow-up suggested the importance of top-up

sessions as relapse prevention given the variable

medical health status of this cohort group and the

negative impact that health challenges have on self-

reported depression and anxiety management.

The success of the research as both an exploratory

study of program development and outcome was

dependent on several factors: (a) the involvement of

experienced practitioners in the design process, and

an active hypothesis testing between that which the

literature proposed and that which experienced

clinicians enacted; (b) the utilisation of an action

research methodology, which accommodated forma-

tive evaluation processes and allowed the researcher/

clinicians to make modifications as the research

progressed (to some extent, and due to the particular

challenges of working with the older adult population,

our results would have been unrealistically and

unfairly unimpressive if we had not); (c) the

measurement of knowledge change, behaviour and

mood change, which allowed us to determine

whether, as a preliminary step, learning was taking

place, and whether it was being translated to action

and finally resulting in mood change (combining

quantitative and qualitative data helped to unpick

these relationships), and similarly (d) the consi-

deration given to information processing, recall and

longer term retention as unique challenges to therapy

with the older adult; finally (e) the participant –

researcher stance adopted in this study was invalu-

able in melding clinical expertise with the research

process.

The formative results highlighted the value of the

feedback loop inherent in the action research model,

which added a dimension to this study both in terms

of the quantity of data (potentially to have been

undermined by a small sample size) and the quality

of claims made about the intervention’s impact on

functionally and clinically relevant behaviour change.

These elements can be missing in psychological

research but are critical in applied contexts to ensure

that (a) component analysis occurs to reduce

unnecessary redundancies and streamlines the most

efficacious treatments for the discerning health

consumer; (b) ethical obligations to clients are met,

and (c) the dissemination of cumulative expertise

gained from clinicians’ daily work is not thwarted by

the realities of small numbers. Using such a model

means that we can formalise our usual clinical

practices in a considered way, and use the framework

as a reflective learning tool as well as a research

strategy. By drawing together multiple sources of

data to understand complex cases, we can be

inventive in finding ways to assess small, individua-

lised but important changes, and focus on possibility

for our clients rather than probability.

References

Baldwin, R. C. (2002). Depressive illness. In R. Jacoby, &

C. Oppenheimer (Eds.), Psychiatry in the elderly (3rd ed.,

pp. 536 – 573). Oxford: Oxford University Press.

Barlow, D. H., Hayes, S. C., & Nelson, R. O. (1984). The scientist

practitioner: Research and accountability in clinical and educational

settings. New York: Pergamon Press.

Older adults & group CBT programs 65

Page 7: ‘I've lost my husband, my house and I need a new knee … why should I smile?’: Action research evaluation of a group cognitive behavioural therapy program for older adults with

Barnett, D. W., Pepiton, A. E., Bell, S. H., & Gilkey, C. M.,

Smith, J. I., Stone, C. M., et al. (1999). Evaluating early

intervention: Accountability methods for service delivery

innovations. Journal of Special Education, 33, 177 – 188.

Beck, A. T., Rush, A. J., Shaw, B. F., & Emery, G. (1979).

Cognitive theory of depression. New York: Guildford Press.

Beck, A. T., & Steer, R. A. (1993). The Beck Anxiety Inventory

manual. San Antonio, TX: Psychological Corporation.

Brodaty, H., Harris, L., Peters, K., Boyce, P., & Hickie, I. (1993).

Prognosis of depression in the elderly: A comparison with

younger patients. British Journal of Psychiatry, 163, 589 – 596.

Clijpers, P. (1998). Psychological outreach programmes for the

depressed elderly: A meta-analysis of effects and dropout.

International Journal of Geriatric Psychiatry, 13, 41 – 48.

Collins, L. M., Murphy, S. A., & Bierman, K. L. (2004). A

conceptual framework for adaptive preventive interventions.

Prevention Science, 5(3), 185 – 196.

Davey, L. (1991). The application of case study evaluations.

Practical Assessment: Research and Evaluation, 2(9), 1 – 3.

DeRubeis, R. J., Evans, M. D., Hollon, S. D., Garvey, M. J.,

Grove, W. M., & Tuason, V. B. (1990). How does cognitive

therapy work? Cognitive change and symptom change in

cognitive therapy and pharmacotherapy for Depression.

Journal of Consulting and Clinical Psychology, 58, 862 – 869.

Dick, L., Gallagher-Thompson, D., & Thompson, L. (1999).

Cognitive behavioral therapy. In R. T. Woods (Ed.),

Psychological problems of ageing: Assessment, treatment and care

(pp. 253 – 291). Chichester, NY: John Wiley & Sons.

Free, M. (1999). Cognitive therapy in groups: Guidelines and resources

for practice. Chichester, NY: John Wiley & Sons.

Eyesenck, H. J. (1994). The outcome problem in psychotherapy:

What have we learned? Behaviour Research and Therapy, 32,

477 – 496.

Floyd, M., & Scogin, F. (1998). CBT for older adults: How does it

work? Psychotherapy, 35, 459 – 463.

Galassi, J. P., & Gersh, T. L. (1993). Myths, misconceptions and

missed opportunity: Single-case designs and counseling

psychology. Journal of Counseling Psychology, 40, 525 – 531.

Gallagher, D., & Thompson, L. (1982). Treatment of major

depression disorder in older adult outpatients with brief

psychotherapies. Psychotherapy: Theory, Research and Practice,

19, 42 – 49.

Gatz, M., Fiske, A., Fox, K., Kaskie, B., Kasl-Godley, J. E.,

McCallum, T. J., et al. (1998). Empirically validated treat-

ments for older adults. Journal of Mental Health & Ageing, 4,

9 – 46.

Goldberg, D., & Williams, P. (1988). A user’s guide to the General

Health Questionnaire. Windsor: NFER-Nelson.

Greenburg L., & Newman, F. (1996). An approach to therapy

change process research. Introduction to the special section.

Journal of Consulting and Clinical Psychology, 64, 435 – 438.

Mulsant, B. H., & Ganguli, M. (1999). Epidemiology and

diagnosis of depression in late life. Journal of Clinical Psychiatry,

60(20), 9 – 15.

Power, R., Dale, A., & Jones, S. (1991). Toward a process

evaluation model for community-based initiatives aimed at

preventing the spread of HIV amongst injecting drug users.

Aids Care, 3, 123 – 135.

Robinson, L. A., Berman, J. S., & Neimeyer, R. A. (1990).

Psychotherapy for the treatment of depression: A comprehen-

sive review of controlled outcome research. Psychological

Bulletin, 108, 30 – 49.

Salzman, C. (2000). Mood disorders. In C. E. Coffey, &

J. L. Cummings (Eds.), Textbook of geriatric neuropsychiatry

(2nd ed., pp. 313 – 328). Washington, DC: American

Psychiatric Press.

Scogin, F., & McElreath, L. (1994). Efficacy of psychosocial

treatments for geriatric depression: A quantitative review.

Journal of Consulting and Clinical Psychology, 62, 69 – 74.

Shapiro, D. A., Barkham, M., Rees, A., Hardy, G. E., Reynolds,

S., & Startup, M. (1994). Effects of treatment duration and

severity of depression on the effectiveness of cognitive-

behavioural and psychodynamic-interpersonal psychotherapy.

Journal of Consulting and Clinical Psychology, 62, 522 – 534.

Sharp, L., & Frechtling, J. (Eds.) (1997). User friendly handbook for

mixed method evaluations (NSF 97-153). Arlington, VA:

National Science Foundation.

Slonim-Nevo, V. (1997). Evaluating practice: The dual roles of

clinician and evaluator. Families in Society, 78, 228 – 239.

Sutton, K. (1989). Reactions of non-participants as additional

rather than missing data: Opportunities for organisational

research. Human Relations, 42, 423 – 439.

Thompson, L., Gallagher-Thompson, D., & Dick, L. (1992).

Cognitive behavioural therapy for late life depression: A therapist

manual. Palo Alto, CA: Older Adult & Family Research and

Resource Centre, Palo Alto Health Care System & Stanford

University School of Medicine.

Thompson, L., Gantz, F., Del Maestro, S., Bryan, H., &

Gallagher-Thompson, D. (1991). CBT for affective disorders

in the elderly. In W. A. Myers (Ed.), New techniques in the

psychotherapy of older patients (pp. 3 – 19). Washington, DC:

American Psychiatric Press.

Tyson, K. (1992). A new approach to relevant scientific research

for practitioners: The heuristic paradigm. Social Work, 37,

541 – 556.

Wadsworth, Y. (1998). What is Participatory Action Research? In

Action Research International retrieved 10 September 2005

from http://www.scu.edu.au/schools/gcm/ar/ari/p-ywadsworth98.

html

Wood, P. (2002). Psychopharmacology in the elderly. In R.

Jacoby, & C. Oppenheimer (Eds.), Psychiatry in the Elderly (3rd

ed., pp. 286 – 314). Oxford: Oxford University Press.

Woods, R. T., & Roth, A. (1996). Effectiveness of psychological

interventions with older people. In A. Roth, & P. Fonagy

(Eds.), What works for whom: A critical review of psychotherapy

research (pp. 321 – 378). New York: Guildford Press.

Woolley, S. R., Butler, M., & Wampler, K. (2000). Unraveling

change in therapy: 3 different process research methodologies.

American Journal of Family Therapy, 28, 311 – 327.

Yesavage, J. A., Brink, T., Rose, T., Lum, O., Huang, V., Adey,

M., et al. (1983). Development and validation of a geriatric

depression screening scale: A preliminary report. Journal of

Psychiatric Research, 17, 37 – 49.

Yoshioka, M. (1999). The use of developmental research methods

to design culturally competent intervention. Journal of Multi-

cultural Social Work, 7, 113 – 128.

Yost, E. B., Beutler, L. E., Corbishley, M. A., & Allender, J. R.

(1986). Group cognitive therapy: A treatment approach for

depressed older adults. New York: Pergamon Press.

66 L. Richardson & C. Reid