the mental health recovery star: validation study and

13
Mental-health-Recovery-Star_Chiaro del Bosco Validation study.docx 1 The Mental Health Recovery Star: Validation study and features of the Italian version Anna Placentino, Fabio Lucchi, Gianpaolo Scarsato, Giuseppe Fazzari and Gruppo Rex.it* Psychiatric Dept. no. 23 DSM, ASST Spedali Civili Brescia E-mail: [email protected] SUMMARY. Aim. The MHRS is a tool for assessing the recovery process of patients suffering from mental illness through a collaborative approach. The aim of the study is to describe the features of the tool and report the results of the Italian validation study. Methods. The study involved 117 service users assessed in two phases a month apart. In addition to the MRHS, the Health of the Nation Outcome Scales (HoNOS), World Health Organisation Quality of Life- BREF (WHOQoL-B) and Global Assessment of Functioning (GAF) were used. The acceptability of the tool by service users and keyworkers was assessed, in addition to its main psychometric properties, including assessment of readings assigned jointly using intraclass coefficients and concurrent validity using the Pearson correlation coefficient. Results. The MHRS demonstrated temporal stability in all areas. Significant correlations were found between the MHRS and the most similar areas of the scales used. Inter-rater reliability was not studied sufficiently. Overall the MHRS was deemed a satisfactory and easy tool to use. Joint evaluations were mostly completed in less than 45 minutes. Conclusions. The MHRS is deemed acceptable by service users and keyworkers, and is characterised by practical and useful visual aids. It contributes to identifying patient recovery pathways and encourages a collaborative approach between users and keyworkers. The results of the evaluation of the psychometric properties appeared promising but were not exhaustive. Although further efforts could be directed at examining these aspects, and consideration should be given to traditional methods for measuring the overall subjective/objective recovery approach, the valuable collaborative contribution of the MHRS in empowering users and supporting keyworkers in their role as case managers cannot be denied. KEY WORDS: evaluation tools, recovery, mental disorders, Mental Health Care INTRODUCTION The subject of co-production has changed the concept of welfare (1), and when it comes to health services, especially mental health services, its synergy with the recovery model (2) has acquired broad consensus. In this framework, the involvement of users in the co-production of medical interventions is an issue which is debated in numerous documents from authorised agencies and organisations (3). The National Institute for Health and Care Excellence deals with the subject using two guidelines – one specifically for mental health, with a focus on improving the experience of service users through their active participation in service delivery, and the second relating to pathways that contribute to improving the health effects of interventions jointly constructed through community engagement with direct beneficiaries (4,5). The concrete manifestation of these principles in the day-to-day provision of mental health services still seems to be inconsistent and affected by local factors, and this is also the case in Italy (6). Based on these assumptions, and with a view to reassessing models and interventions in psychiatric services, it would appear useful to provide keyworkers, who interact with users and their families every day, with easy-to-use tools that steer their activity towards methods based on co-production and recovery. In recent decades the concept of recovery (7) has gradually acquired increasing importance in mental health research and policy. As stated by Slade et al. (8), mental health services should reshape their role and facilitate the user recovery process. In particular, the recovery process provides a transformation opportunity for services, by encouraging the increased participation of service users and involving them in the definition of their own care objectives (9). The MHRS fits into this context, and is a tool which is useful to keyworkers and case managers for constructing and monitoring personalised rehabilitation and care plans, while keeping the focus on users and optimising their pathway. The MHRS was developed by Triangle Consulting in conjunction with the Mental Health Providers Forum in the UK, where it was the subject to evaluation of its psychometric properties (11) and found application in a wide range of services

Upload: others

Post on 12-Nov-2021

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The Mental Health Recovery Star: Validation study and

Mental-health-Recovery-Star_ChiarodelBoscoValidationstudy.docx 1

TheMentalHealthRecoveryStar:

ValidationstudyandfeaturesoftheItalianversion

AnnaPlacentino,FabioLucchi,GianpaoloScarsato,GiuseppeFazzariandGruppoRex.it*PsychiatricDept.no.23DSM,ASSTSpedaliCiviliBrescia

E-mail:[email protected] SUMMARY.Aim.TheMHRSisatoolforassessingtherecoveryprocessofpatientssufferingfrommentalillnessthroughacollaborativeapproach.TheaimofthestudyistodescribethefeaturesofthetoolandreporttheresultsoftheItalianvalidationstudy.Methods.Thestudyinvolved117serviceusersassessedintwophasesamonthapart.InadditiontotheMRHS,theHealthoftheNationOutcomeScales(HoNOS),WorldHealthOrganisationQualityofLife-BREF(WHOQoL-B)andGlobalAssessmentofFunctioning(GAF)wereused.Theacceptabilityofthetoolbyserviceusersandkeyworkerswasassessed,inadditiontoitsmainpsychometricproperties,includingassessmentofreadingsassignedjointlyusingintraclasscoefficientsandconcurrentvalidityusingthePearsoncorrelationcoefficient.Results.TheMHRSdemonstratedtemporalstabilityinallareas.SignificantcorrelationswerefoundbetweentheMHRSandthemostsimilarareasofthescalesused.Inter-raterreliabilitywasnotstudiedsufficiently.OveralltheMHRSwasdeemedasatisfactoryandeasytooltouse.Jointevaluationsweremostlycompletedinlessthan45minutes.Conclusions.TheMHRSisdeemedacceptablebyserviceusersandkeyworkers,andischaracterisedbypracticalandusefulvisualaids.Itcontributestoidentifyingpatientrecoverypathwaysandencouragesacollaborativeapproachbetweenusersandkeyworkers.Theresultsoftheevaluationofthepsychometricpropertiesappearedpromisingbutwerenotexhaustive.Althoughfurthereffortscouldbedirectedatexaminingtheseaspects,andconsiderationshouldbegiventotraditionalmethodsformeasuringtheoverallsubjective/objectiverecoveryapproach,thevaluablecollaborativecontributionoftheMHRSinempoweringusersandsupportingkeyworkersintheirroleascasemanagerscannotbedenied. KEYWORDS:evaluationtools,recovery,mentaldisorders,MentalHealthCare INTRODUCTIONThesubjectofco-productionhaschangedtheconceptofwelfare(1),andwhenitcomestohealthservices,especiallymentalhealthservices,itssynergywiththerecoverymodel(2)hasacquiredbroadconsensus.Inthisframework,theinvolvementofusersintheco-productionofmedicalinterventionsisanissuewhichisdebatedinnumerousdocumentsfromauthorisedagenciesandorganisations(3).TheNationalInstituteforHealthandCareExcellencedealswiththesubjectusingtwoguidelines–onespecificallyformentalhealth,withafocusonimprovingtheexperienceofserviceusersthroughtheiractiveparticipationinservicedelivery,andthesecondrelatingtopathwaysthatcontributetoimprovingthehealtheffectsofinterventionsjointlyconstructedthroughcommunityengagementwithdirectbeneficiaries(4,5).Theconcretemanifestationoftheseprinciplesintheday-to-dayprovisionofmentalhealthservicesstillseemstobeinconsistentandaffectedbylocalfactors,andthisisalsothecaseinItaly(6).Basedontheseassumptions,andwithaviewtoreassessingmodelsandinterventionsinpsychiatricservices,itwouldappearusefultoprovidekeyworkers,whointeractwithusersandtheirfamilieseveryday,witheasy-to-usetoolsthatsteertheiractivitytowardsmethodsbasedonco-productionandrecovery. Inrecentdecadestheconceptofrecovery(7)hasgraduallyacquiredincreasingimportanceinmentalhealthresearchandpolicy.AsstatedbySladeetal.(8),mentalhealthservicesshouldreshapetheirroleandfacilitatetheuserrecoveryprocess.Inparticular,therecoveryprocessprovidesatransformationopportunityforservices,byencouragingtheincreasedparticipationofserviceusersandinvolvingtheminthedefinitionoftheirowncareobjectives(9).TheMHRSfitsintothiscontext,andisatoolwhichisusefultokeyworkersandcasemanagersforconstructingandmonitoringpersonalisedrehabilitationandcareplans,whilekeepingthefocusonusersandoptimisingtheirpathway.TheMHRSwasdevelopedbyTriangleConsultinginconjunctionwiththeMentalHealthProvidersForumintheUK,whereitwasthesubjecttoevaluationofitspsychometricproperties(11)andfoundapplicationinawiderangeofservices

Page 2: The Mental Health Recovery Star: Validation study and

Mental-health-Recovery-Star_ChiarodelBoscoValidationstudy.docx 2

andprojects,tothepointofbeingconsideredfordefiningoutcomemeasureswithingovernmentPaymentsbyResultsprojects.ThetoolisbecomingwidespreadinEnglish-speakingcountriesandtwoinitiativesareinprogresstomakeitavailableinotherlanguages-French,Danishand,throughthisstudy,Italian.TheaimofourcontributionistoillustratethemainfeaturesoftheMHRSandoutlinetheresultsoftheItalianevaluation.ThestudywascarriedoutaspartofacollaborationprojectinvolvingservicesinthethirdsectorandpublichealthfacilitiesinLombardy,andwasco-fundedbyFondazioneComunitàBresciana.AssociazioneilChiarodelBosco(www.ilchiarodelbosco.it)wastheresearchcontactorganisation. METHODSThecollaborationprojectwhichledtotheItalianevaluationoftheMHRSinvolvedservicesinLombardyprovidedbyfourgovernmentmentalhealthdepartments-UOP23DSMASSTSpedaliCiviliinBrescia,DSMASSTinGarda,DSMASSTinCremaandDSMASSTinVallecamonica-andtwothirdsectororganisations(AssociazioneilChiarodelBosco,andCooperativaLiberamente).ThecollaborationwassetupthroughasharedletterofintentandworkcommencedfollowingextensivetrainingontheuseofMHRSandresearchintotheuseofadditionaltoolsincludedintheproject.ThestudyplaninvolvedthecompletionoftheMHRSwithatleast100patientsincontactwiththepsychiatricfacilitiesbelongingtotheorganisationsthatparticipatedintheproject.Thestudywassplitintotwoevaluations(T0andT1)carriedoutapproximately1monthapartusingthetoolsoutlinedbelow.Socialdemographic/clinicalcharacteristicsandtheClinicalGlobalImpression-CGI(12)weremeasuredforallindividuals,theMHRSwascompleted,andHoNOS(13,14),WHOQOL-B(15)andGAF(16)wereadministered.TheseevaluationtoolswereimplementedwhiletryingtoadheretotheclinicalassessmentroutineforthevariousservicesandenabledcomparisonwithmostoftheareasoutlinedintheMHRS.Oncompletionofthefirstevaluation(T0),theacceptabilityofthetoolbythekeyworkeranduserincompletingtheMHRSwasassessed.Twoitemsspeciallyconstructedona5-pointLikertscalewereused-thefirstratedlevelofsatisfaction(rangingfromNotatAlltoVerySatisfied)andthesecondratedlevelofdifficulty(rangingfromVeryDifficulttoVeryEasy).Finally,thetimerequiredforthejointcompletionoftheMHRSwasnoted.Aftergivingtheirinformedconsent,patientswereconsecutivelyrecruitedfromthosecasesrequiringmanagementwiththecreationofaformalcareplaninaccordancewithLombardRegioncriteria,asoutlinedinthelatestRegionalMentalHealthProject(17).Allrelevantkeyworkers(casemanagers)wereinvolvedinthestudyandtrainedintheuseoftheMHRS.

DescriptionoftheMentalHealthRecoveryStar(MHRS)characteristicsTheMHRSwasdevelopedthroughtheuseofqualitativeandquantitativemethodsinaccordancewithaparticipatoryactionresearchmodeloutlinedbytheauthorsofthetool(10),whichinvolvedresearchers,keyworkersandtheusersofresidentialfacilitiesanddayservicesintheLondonarea.Thetoolisconsideredameasureofpersonalisedholisticoutcomes,withafocusonarecovery-orientatedapproach(18).TheMHRSmeasurestheserviceuser'srecoverypaththroughdiscussionguidedbyscaledescriptionsandavisualmap,toencouragetheidentificationofthepointusersfeeltheyhavereachedintheir'journeyofrecovery'.Furthermore,itenablesindividualstotracktheirownprogressandplantheactionsrequiredtomeettheirobjectivesregardingchange(19,11,18).TherearetwomainelementsoftheMHRS.Thefirstisastar-shaped10-pointdiagramshowinglifedomainsunderlyingtherecoveryprocesswhichareallocatedareading(figure1andbox1).ThesecondistheJourneyofChange(figure2),whichoutlinesfivestagesontheroadto

Page 3: The Mental Health Recovery Star: Validation study and

Mental-health-Recovery-Star_ChiarodelBoscoValidationstudy.docx 3

recovery,eachofwhichissplitintwoanddescribedwithspecificreadingsforeacharea.Attributingareadingtoeachareainvolvesanalysisanddiscussionbetweenthecasemanagerandthepatient,inordertounderstandthecurrentsituationanddefineapersonalisedcareplantogether.Afterdecidinginitialreadingsandagreeingobjectivesforchange,theevaluationiscarriedoutagainafterasuitableperiodoftime.Thisisthereforeamethodforevaluating,agreeingandsupportingpersonalisedpathwaysforusersofpsychiatricservicesthroughtheirdirectinvolvement.Thetoolischaracterisedbyitsuseofsimplelanguagewithnoclinicalterminology,anditsinformalstylewithconcreteexamplesassistedbytheuseofgraphics.ThefullMHRStoolcontainsvariousaids-auserguidecontainingthedescriptionofthe10lifedomainsandthecorrespondingJourneyofChangestages;aguidefororganisationswithcompletioninstructionsandFAQs;TheStardiagramforrecordingreadings;aformforrecordingactionplansandinterventionsinpriorityareasforthepatient.TheMHRSwastranslatedintoItalianfollowingauthorisationfromtheauthors,andwastranslatedandadaptedaccordingtovariousrecommendationsintherelevantliterature(10).ThisprocedureinvolvedaforwardtranslationintoItalianbynativeItalianexpertsinmentalhealth,abacktranslationintoEnglishbynativeEnglishtranslatorssourcedbytheauthorsinLondon,afinalrevisionphase(21-24)anduseoftheofficialMHRSformatprovidedbyTriangleConsulting,whichholdscopyrightforthetool. Twodays'trainingisrequiredtolearnhowtousetheMHRSandenablekeyworkerstoworkdirectlywithserviceusers,asoutlinedbyitsauthors.InItalytheorganisationauthorisedbyTriangleConsultingtodistributethematerialandprovidetrainingonusingtheMHRSistheAssociazioneilChiarodelBosco(www.ilchiarodelbosco.org),whichsetupateamoftrainersconsistingofkeyworkersinmentalhealthservices,inadditiontoserviceusersandtheirrelatives. DataanalysisMeansandstandarddeviationswerecalculatedforthesocialdemographic/clinicalvariablesinthesampleandkeyworkercharacteristics.Inter-raterreliabilitywastestedinaspecialsessionusingthetooloncompletionoftraining,duringwhichthekeyworkersparticipatinginthestudygaveindependentreadingsforaclinicalcasediscussedanddescribedindetail.ReliabilitywasestimatedbycalculatingCohen'skappacoefficientandcomparingpairsofreadingsfromallparticipants.Itwasnotpossibletomeasureadditionalclinicalcases. Thetest-retestreliabilityobtainedinconjunctionwiththeMHRSserviceuserandkeyworkerwasevaluatedusingtheintraclasscorrelationcoefficient,testingthenullhypothesisr=0.70.ConcurrentvaliditywasassessedusingthePearsoncorrelationcoefficient.Finally,thefrequencyanalysiswascarriedouttoestimatelevelsofsatisfaction,difficultyinusingthetool,andadministrationtimes.AllinformationcollectedwasenteredintoadatabaseandanalysedwithSPSSversion26forWindows.RESULTSParticipantcharacteristicsAtotalof11mentalhealthdepartmentswereinvolved,whichincluded4(36%)psycho-socialrehabilitationcentres(localclinics),2(18%)daycentresand5(45%)residentialpsychiatricfacilitieswithsupportlevelsrangingfrommediumtohighintheprovinceofBrescia.42keyworkersfromthesefacilitiescollaboratedinthestudy:20(48%)professionaleducators,14(33%)qualifiednurses,5(12%)psychiatristsand1(2%)psychologist.Theaverageageofthekeyworkerswas40.71

Page 4: The Mental Health Recovery Star: Validation study and

Mental-health-Recovery-Star_ChiarodelBoscoValidationstudy.docx 4

(SD7.47)withanagerangeof26to57yearsold.Averageyearsofservicewas12.46(SD7.36)withlengthofservicerangingfrom2to37years.AllkeyworkersinvolvedintheresearchhadbeentrainedintheuseofMHRS.117serviceusersparticipatedinthestudy,whowereeachprovidedwithachronologicalpersonalisedtreatment/rehabilitationplan.Thepatientsmainlycamefrompsycho-socialrehabilitationcentres(83;70%),daycentres(16;14%)andresidentialpsychiatricfacilities(18;16%).Themainsocio-demographicandclinicalcharacteristicsofthesampleareoutlinedintables1and2respectively.ReliabilityInter-raterreliability(42participants)wasstudiedinpartwiththedataavailable.ThiswasmeasuredthroughCohen'skappacoefficientandwasgreaterthan0.7inallcombinations,withnegligibleerrorvariance.Thisshouldbeconsideredinsufficienthowever,giventheabsenceofadditionalcasestudyevaluations.MHRStest-retestreliabilitywasstudiedusingtwoconsecutivemeasurements.Asshownintable3,thecorrelationbetweenreadingsinthetwoevaluationsissignificant,indicatingtemporalstabilityforallareas.ConcurrentvalidityConcurrentvaliditywastestedusingthePearsoncorrelationcoefficient,withreferencetothejointT0evaluations.SignificantcorrelationswereobservedbetweentheMHRSandthescalesusedinthestudyinsimilar,comparableareas.TheMHRSmentalhealthareacorrelateswiththefollowingfactors:GAF(r=0.25,p<0.01),behaviouralproblems-HoNOS(r=-0.27,p<0.01),symptoms-HoNOS(r=-0.47,p<0.01),socio-environmentalarea-HoNOS(r=-0.44,p<0.01),psychology-WHOQOL-B(r=0.27,p<0.05),socialarea-WHOQOL-B(r=0.30,p<0.05),environmentalarea-WHOQOL-B(r=0.29,p<0.01),physicalarea-WHOQOL-B(r=0.29,p<0.05)andgeneralqualityoflife-WHOQOL-B(r=0.31,p<0.01).TheMHRSself-careareacorrelateswith:GAF(r=0.27,p<0.01),symptoms-HoNOS(r=-0.36,p<0.01),socio-environmentalarea-HoNOS(r=-0.56,p<0.01),psychology-WHOQOL-B(r=0.32,p<0.01),environmentalarea-WHOQOL-B(r=0.29,p<0.05),physicalarea-WHOQOL-B(r=0.26,p<0.05)andgeneralqualityoflife-WHOQOL-B(r=0.28,p<0.01).TheMHRSlifeskillsareacorrelateswith:GAF(r=0.32,p<0.01),socio-environmentalarea-HoNOS(r=-0.35,p<0.01).TheMHRSsocialnetworkareacorrelateswith:GAF(r=0.32,p<0.01),behaviouralproblems-HoNOS(r=-0.30,p<0.01),symptoms-HoNOS(r=-0.38,p<0.01),socio-environmentalarea-HoNOS(r=-0.46,p<0.01),psychology-WHOQOL-B(r=0.34,p<0.01),socialarea-WHOQOL-B(r=0.34,p<0.01),environmentalarea-WHOQOL-B(r=0.35,p<0.01),physicalarea-WHOQOL-B(r=0.33,p<0.01)andgeneralqualityoflife-WHOQOL-B(r=0.37,p<0.01).TheMHRSworkareacorrelateswith:GAF(r=0.22,p<0.05),symptoms-HoNOS(r=-0.27,p<0.05),socio-environmentalarea-HoNOS(r=-0.25,p<0.05),environmentalarea-WHOQOL-B(r=0.25,p<0.05),generalqualityoflife-WHOQOL-B(r=0.29,p<0.01).TheMHRSpersonalrelationshipsareacorrelateswith:GAF(r=0.32,p<0.01),symptoms-HoNOS(r=-0.30,p<0.01),socio-environmentalarea-HoNOS(r=-0.32,p<0.01),physicalarea-WHOQOL-B(r=0.23,p<0.05),psychology-WHOQOL-B(r=0.34,p<0.05),environmentalarea-WHOQOL-B(r=0.24,p<0.05)andgeneralqualityoflife-WHOQOL-B(r=0.81,p<0.01).TheMHRSdependenciesareacorrelateswith:behaviouralproblems-HoNOS(r=-0.38,p<0.01),symptoms-HoNOS(r=-0.29,p<0.01),socialarea-WHOQOL-B(r=0.24,p<0.05),environmentalarea-WHOQOL-B(r=0.83,p<0.05),generalqualityoflife-WHOQOL-B(r=0.30,p<0.01).TheMHRSresponsibilityareacorrelateswith:behaviouralproblems-HONOS(r=-0.42,p<0.01),socio-environmentalarea-HoNOS(r=-0.36,p<0.01).TheMHRSidentity/self-esteemareacorrelateswith:GAF(r=0.23,p<0.05),symptoms-HoNOS(r=-0.43,p<0.01),socio-environmentalarea-HoNOS(r=-0.40,p<0.01),socialarea-WHOQOL-B(r=0.51,p<0.01),generalqualityoflife-WHOQOL-B(r=0.33,p<0.05).The

Page 5: The Mental Health Recovery Star: Validation study and

Mental-health-Recovery-Star_ChiarodelBoscoValidationstudy.docx 5

MHRStrust/hopeareacorrelateswith:symptoms-HoNOS(r=-0.33,p<0.01),socio-environmentalarea-HoNOS(r=0.34,p<0.01),physicalarea-WHOQOL-B(r=0.24,p<0.05),environmentalarea-WHOQOL-B(r=0.23,p<0.05),generalqualityoflife-WHOQOL-B(r=0.31,p<0.01).TheHoNOS-DisabilityfactorwasexcludedcompletelyfromtheanalysisasithasnosimilaritiestotheMHRSareas.AcceptabilityOveralltheMHRSwasdeemedasatisfactorytoolandeasytocompleteforbothkeyworkersandserviceusers.Specifically,thetoolwasjudgedsatisfactory/verysatisfactoryby40(96%)keyworkersand99(85%)serviceusers,neithersatisfactory/unsatisfactoryby2(4%)keyworkersand16(14%)serviceusers,andnotverysatisfactory/unsatisfactorybynokeyworkersand2(1%)users.Furthermore,thetoolwasjudgedeasy/veryeasytocompleteby23(55%)keyworkersand63(54%)serviceusers,neithereasy/difficultby18(43%)keyworkersand38(32%)serviceusers,anddifficult/verydifficultby1(2%)keyworkerand16(14%)users.Thejointkeyworker/serviceuserStarreadingwascarriedoutinlessthan45minutesby101(86%)usersparticipatinginthestudyandbetween45to90minutesintherestofthesample(n=16;14%).DISCUSSIONTheaimofourstudywastoillustratethemaincharacteristicsoftheMHRSanditsacceptability,andtooutlinethepreliminaryresultsoftheItalianevaluationofthetool.Asobservedinotherstudies(11,25),theMHRSmeasurementwasdeemedacceptableformostusersandkeyworkersintermsoflevelsofsatisfactionandbeingeasytocomplete.Onlytwoserviceusersreporteddissatisfactionwiththetool,andafewserviceusersandonekeyworkerfeltitwasdifficulttocomplete.MostofthesamplecompletedthejointStarreadinginlessthan45minutes.Thisdemonstratesthatitwouldalsobesuitableforoutpatientfacilities,wheretheuseofrelativelyquicktoolsthatfitinwithconsultationtimeswouldbeconvenient.Consideringthecollaborativenatureofthetool,thestudyoftest-retestreliabilitywasassessedbyexaminingthereadingobtainedinagreementbetweenthekeyworkerandtheuser,demonstratinggoodtest-retestreliability,aswasfoundinanevaluationstudyintheUnitedKingdom(11).Inter-raterreliabilitywasnotstudiedsufficientlyandrepresentsanimportantconstraintinthisstudy.Killapsyetal.(11)studiedtheinter-raterreliabilityofthetoolsufficientlyandonlytheMHRSworkareademonstratedacceptableinter-raterreliability,demonstratinginsufficientinter-raterreliabilityoverall.TheconcurrentvalidityoftheMHRSappearsacceptable.Mostareasofthetoolcorrelatewithgeneralqualityoflifeandleveloffunctioning.Killapsyetal.(11)alsohighlightedconvergentvaliditywithameasureofsocialfunctioning.Inourstudy,inadditiontotheWHOQOL-B,manyareasoftheMHRSreportedsignificantcorrelationswiththreeofthefourHoNOSfactors.Tothiseffect,Lloydetal.(26)definetheMHRSintermsofoutcomemeasuresusefulforassessinghowanindividualchangesduringrecovery.Thetool'sbottom-upapproachhasfacilitatedatoolstructureaimedatmeetingtherequirementsofserviceusersandprovidinganimportantcollaborativetool,howeverthiscancreateproblemsinrelationtoexpectationsregardingitspsychometricproperties(27).ThereisundoubtedlyasharedneedforimprovedcomprehensionandexaminationofthepsychometriccharacteristicsoftheMHRS,andthereisstillbroaddebatecharacterisedbyopposingoutcomes(11,25,26,28,29).TheapproachusedbyKillaspyetal.(2012a)wascriticisedintermsofmethodology(10,27,30)andwithrespecttotheunderlyingphilosophy(31).Doubtswereraisedontheneedtoapplyinter-raterreliabilitycriteriatovalidateatoolmainlydesignedforjointpatient-usermeasurementratherthanstaffevaluation(29).Dickensetal.(27),thoughnotingverygoodinternalconsistency,observedlowitemredundancyand,aswithotherauthors,notedtheabsenceofasuitableevaluationofthechangescale(11,27).

Page 6: The Mental Health Recovery Star: Validation study and

Mental-health-Recovery-Star_ChiarodelBoscoValidationstudy.docx 6

Onthebasisofthesefactors,reflectionregardingacollaborativetooldesignedtomeasureaconstructwhichisascomplexandsubjectiveasrecovery(27)isrequired,andanattempttoconsidervariouschangestotheconventionalideaofthevalidityandreliabilityofameasure(25).Eynon(31)suggeststhat,whileitsusemaynotbefullyjustifiedasaroutineoutcomemeasure,dismissingtheuseoftheMHRSwouldbeagreatlossduetothetool'svalueinfacilitatingthereconstructionofnarrativeidentityaspartoftherecoveryprocess(32).Furthermore,thedistinctivecollaborativeaspectoftheMHRScouldsupportthedevelopmentofimportanttherapeuticrelationships(33)andenableserviceuserstoplayanactiveroleintheirrecovery(34).CONCLUSIONSTheMHRShasbeenshowntobeasatisfactorytoolforserviceusersandkeyworkersduetoitsuseofpracticalvisualaids.Itcontributestodevelopinguserrecoverypathwaysandencouragesacollaborativeapproachbetweenkeyworkersandusers,whichbeginswithanevaluation,whichthenleadstoplanningtreatment/rehabilitation(35).Thetoolhaslittleoverlapwithothertoolswhichhavetraditionallybeenusedinmentalhealthservices,givenitsfocusonachievingqualityobjectives(theactiveparticipationofuserstogiveself-assessmentsanddecidewhichobjectivestoworkonintheirpersonalisedplan)andquantitativeobjectives(measuringchange).Thisdualaspectisconsideredanddiscussedinexperimentalstudiescarriedoutbyvariousauthors(11,27,32),withconclusionsthatreflecttheinterestofthevariousresearchersinemphasisingonefactororanother.ThisarticlediscussesthefirstquantitativeresearchintothepsychometriccharacteristicsoftheMHRScarriedoutinItaly.Overalltheresultshavebeenencouraging,howeveroverandabovethespecificconstraintinourstudy(ineffectiveevaluationofinter-raterreliability),variousconsiderationsonthetool'spsychometricpropertiescannotbeomitted.EngaginginthetypicalcollaborativenatureoftheMHRSbetweenusersandkeyworkersanditsrecovery-orientatedapproach(27)istobeconsideredahighlyvaluableaspectand,despiteuncertaintyoverthepsychometricaspect,itscontinueduseinmentalhealthservicesisdesirable.Thehopeisthatthisstudy,alongwithinformationreportedintherelevantliterature,maycontributetoraisingawarenessandencouragingfurtherdevelopmentoftheMHRS,givenitssignificantpotentialinclinicalsettingsandtheinvolvementofpatientsintheirownrecoverypathway.Itwouldalsobehopedthatitcouldcontributetopracticesorientatedtowardsco-productioninmentalhealthservicesbecomingwidespread,toencouragetheintegrationofviewpointsfromallstakeholders,forboththewellbeingofourserviceusersandtheimplementationofpatient-focusedorganisations.

Page 7: The Mental Health Recovery Star: Validation study and

Mental-health-Recovery-Star_ChiarodelBoscoValidationstudy.docx 7

Figura1

Page 8: The Mental Health Recovery Star: Validation study and

Mental-health-Recovery-Star_ChiarodelBoscoValidationstudy.docx 8

Box1LedieciareedellaRecoveryStar

1.LagestionedellatuasalutementaleL’areafariferimentoallagestionedellapropriasalutementaleeallacapacitàdisvilupparediunavitasoddisfacenteesignificativa,ancheinpresenzadieventualisintomi.

2.SalutefisicaecuradiséL’areafariferimentoallacuradisé,inparticolaredellapropriasalutefisica,l'igienepersonale,lagestionedellostressealmantenimentodellostatogeneraledibenessere.

3.AbilitàperlavitaquotidianaL’areafariferimentoagliaspettipraticidellavitainautonomia:farelaspesa,cucinare,avereachefareconivicini,tenereinordineilpostoincuisiviveegestireilpropriodenaro.

4.RetisocialiL’areafariferimentoallaretesocialeeall’esserepartediunacomunità.Includelacapacitàdipartecipareadattivitàorganizzatedaserviziedancheadattivitànonistituzionalicomeilvolontariato,partecipareacorsi,associarsiaduncluboauncircolo,parteciparealleattivitàdellascuola,diunachiesaoppurediattivitàpropostedagruppidiamici.

5.LavoroL’areafariferimentoalrapportopersonaleconillavoro.Consideraildesideriodilavorare,l’individuazionediciòchesidesiderafare,svilupparelecompetenzeelequalificheperavereun’occupazione,trovareemantenereunlavoro.Oppure,sepreferitoomaggiormenteindicato,dedicarsiadattivitàdivolontariatoe/oaltreattivitàoccupazionali.

6.RelazionipersonaliL’areafariferimentoallerelazionipersonalisignificative.Siindividuaunarelazioneincuisivorrebbechelecosefosserodiverse(conunfamigliare,unamicostrettoouncompagno/a)esivalutailgradodivicinanzachesidesideraavere.

7.Comportamentolegatoalledipendenzeeall’usodisostanzeL’areafariferimentoaqualsiasicomportamentolegatoall’usodisostanzecomealcool,drogheoaltreformedidipendenza(giocod’azzardo,shopping,etc.).Prendeinconsiderazionelaconsapevolezzaditaliproblemieuneventualeimpegnoperridurneidanni.

8.ResponsabilitàL’areafariferimentoalleresponsabilitàriguardantiilpostoincuisivive(casaoaltrotipodistruttura).Includeilpagamentodell’affitto,andared’accordoconivicinioglialtriospitidellastrutturaeconsideralapresenzadieventualiproblemiconlalegge.

9.IdentitàeautostimaL’areafariferimentoalsensod’identitàpersonaleeall'autostima.Consideralapercezionedisé,laconsapevolezzadellerisorsepersonali,deiproprilimitiepiùingeneraledell'accettazionedisé.

10.FiduciaeaspettativepositiveL’areafariferimentoallapercezionedifiduciapersonaleealleaspettativepositiveperilfuturo.Prendeinconsiderazioneilcredereinsestessi,lafiducianeglialtriel'aspettativaditrovaredellepossibilisoluzioni.

AdattatodaMentalHealthProvidersForum(36)

Page 9: The Mental Health Recovery Star: Validation study and

Mental-health-Recovery-Star_ChiarodelBoscoValidationstudy.docx 9

Figura2LASCALADELCAMBIAMENTO

Page 10: The Mental Health Recovery Star: Validation study and

Mental-health-Recovery-Star_ChiarodelBoscoValidationstudy.docx 10

Tabella1Caratteristichesociodemografiche(n.117)

Sex MF

6651

56%44%

Età Media(ds):41,62(11,1)Min-Max:18-66

Statocivile Celibe/nubileSeparato/divorziatoConiugato/aVedova/o

9213111

79%11%9%1%

Titolodistudio MedieSuperiori/ProfElementariLaurea

5644116

48%38%9%5%

Occupazione NonoccupatoLavoroprotettoCasalingaPensionelavorativaLavorofulltimeLavoroparttimeStudente

7911116333

68%9%9%5%3%3%3%

Invaliditàcivile SiNo

8829

75%25%

Situazioneabitativa Fam.OrigineSoloFam.CostituitaStrutturaresidenzialeAltrasistemazioneabitativa

562020183

48%17%17%15%3%

Tabella2Caratteristichecliniche(n.117)

Diagnosiprincipale(criteriDSMIV) Dist.BipolareISchizofreniaDist.SchizoaffettivoBipolareDist.DepressivoMagg.Altridisturbipsicotici(Dist.Delirante/psicosiNAS)Dist.Personalità(schizotipico/borderline)

532726443

45%23%22%4%4%2%

N.diproblemiinasse4 Media(ds):1.15(1.18)Min-Max:1-5

Familiaritàpsicopatologia SiNo

5463

46%54%

Etàd'esordio Media(ds):23,41(7,71)Min-Max:6-41

Etàprimocontatto Media(ds):25,81(7,28)Min-Max:6-45

CGI Lievemente/ModeratamenteammalatoNotevolmente/gravementeammalato

7146

61%39%

Page 11: The Mental Health Recovery Star: Validation study and

Mental-health-Recovery-Star_ChiarodelBoscoValidationstudy.docx 11

Tabella3Correlazionetraduevalutazionineltempo(attendibilitàtest-retest)dellaMHRSArea Coefficientedicorrelazioneintraclasse(IC95%)

GestionedellasalutementaleCuradisèAbilitàperlavitaquotidianaRetisocialiLavoroRelazionipersonaliDipendenzeResponsabilitàIdentitàel’autostimaFiduciaelasperanza

0,76(0.58-0.88)0,71(0.49-0.83)0,79(0,60-0,87)0,71(0.49-0.84)0,89(0,84-0,92)0,71(0.49-0.84)0,84(0,79-0,90)0,84(0,79-0,90)0,78(0,59-0,85)0,78(0,59-0,85)

>0,7consideratoaccettabileGRUPPOREX.ITUOP23-ASSTSpedaliCiviliBrescia-DeCarliPaola-LussignoliMiriam-SeggioliGiuseppe-TosiDeliaRita-VillaGiovannaDSMASSTdelGarda-FerrazzoliIvanaOrsola-GavelliLaura-MarelliSara-MiglioratiSimonetta-SaviottiFrancescoDSMASSTCrema-PegoraroMarcoDSMASSTVallecamonica-SpandreVincenzo-ZindatoVincenzoAssociazioneLiberamente-LiscidiniIlaria-RadiciRuggeroAssociazioneIlchiarodelbosco-RossellaMicheliRINGRAZIAMENTISiringrazianotuttigliutentichehannopartecipatoallostudio,glioperatorieledirezioni.Lacomunitàbrescianaperilfinanziamentofornitoeunringraziamentoparticolareèrivoltoall'AssociazioneilChiarodelBoscochehafortementesostenutol'interoprogetto.

Page 12: The Mental Health Recovery Star: Validation study and

Mental-health-Recovery-Star_ChiarodelBoscoValidationstudy.docx 12

BIBLIOGRAFIA

1. SangiorgiD,PrendevilleA.DesigningforService:keyissuesandnewdirections.London:BloomsburyPublishing,2017.2. ShepherdG,BoardmanJ,BurnM.Implementingrecovery:amethodologyfororganisationalchange.London:SainsburyCentreforMentalHealth,2010.3. GannonZ,LawsonN.Coproduction:themodernisationofpublicservicesbystaffandusers.London:Compassdirectionforthedemocraticleft,2013. 4. NationalInstituteforHealthandCareExcellence(NICE).ServiceUserExperienceinadultmentalhealthservices.ImprovingtheexperienceofcareofpeopleusingtheNHSadultmentalhealthservices,2011.http//:.www.nice.org.uk/guidance/cg136. 5. NationalInstituteforHealthandCareExcellence(NICE).Communityengagement:improvinghealthandwellbeingandreducinghealthinequalities,2016.http//:www.nice.org.uk/guidance/ng44. 6. LucchiF,Recoveryecoproduzione.UnprogettopressoiservizidisalutementaledellaprovinciadiBrescia.Trento:Erickson,2017.7. AnthonyWA.Recoveryfrommentalillness:Theguidingvisionofthementalhealthservicesysteminthe1990’s.PsychosocialRehabilJ1993;16:11-23.8. SladeM,AmeringM,FarkasM,HamiltonB,O’Hagan,M,PantherG,WhitleyR.Usesandabusesofrecovery:Implementingrecovery-orientedpracticesinmentalhealthsystems.WorldPsychiatry2014;13:12–20.9. LeBoutillierC,LeamyM,BirdVJ,DavidsonL,WilliamsJ,SladeM.Whatdoesrecoverymeaninpractice?Aqualitativeanalysisofinternationalrecovery-orientedpracticeguidance.PsychiatrServ2012;62:1470–1476.10. MacKeithJ,BurnsS.Mentalhealthrecoverystar:Userguide.London:MentalHealthProvidersForumandTriangleConsulting,2011.11. KillaspyH,White,S,TaylorTL,KingM.Psychometricpropertiesofthementalhealthrecoverystar.BrJPsychiatry2012;201:65–70.12. GuyW.ClinicalGlobalImpressions.InGuyW.(ed)ECDEUAssessmentManualforPsychopharmacology-Revised.Rockville,MD:NationalInstituteofMentalHealth.1976 13. WingJK,BeevorAS,CurtisRH,ParkSB,HaddenS,BurnsA.HealthoftheNationOutcomeScales(HoNOS).Researchanddevelopment.BrJPsychiatry1998;172:11-18.14. LoraA,BaiG,BianchiS,etal.LaversioneitalianadellaHoNOS(HealthoftheNationOutcomeScales),unascalaperlavalutazionedellagravitàedell'esitoneiservizidisalutementale.EpidemiolPsichiatrSoc.2001;10:198–21215. TheWHOQOLGroup.ThedevelopmentoftheWorldHealthOrganizationqualityoflifeassessmentinstrument.InOrleyJ&KuykenW.(eds),Qualityoflifeassessment:internationalperspective.Heidelberg:SpringerVerlag1994.16. JonesSH,ThornicroftG,CoffeyM,DunnG.Abriefmentalhealthoutcomescale-reliabilityandvalidityoftheGlobalAssessmentofFunctioning(GAF).BrJPsychiatry1995;166:654–659.17. RegioneLombardia.Lapsichiatriadicomunità:PianoRegionaleperlaSaluteMentaleelesuelineediattuazioneRegioneLombardia.ApprovatodallaGiuntaregionalecondeliberan.n.7/17513del17maggio2004. 18. Onifade,Y.Thementalhealthrecoverystar.MentalHealthandSocialInclusion2011;15:78–87.19. ImonioroO.Aguidingstar.MentalHealthToday2010;3:28-2920. WHO.Processoftranslationandadaptationofinstruments.2010.http//www.who.int/substance_abuse/research_tools/traslation/en/.

Page 13: The Mental Health Recovery Star: Validation study and

Mental-health-Recovery-Star_ChiarodelBoscoValidationstudy.docx 13

21. GuilleminF,BombardierC,BeatonD.Cross-culturaladaptationofhealth-relatedqualityoflifemeasures:Literaturereviewandproposedguidelines.JClinEpidemiol1993;46:1417-1432.22. BeatonDE,BombardierC,GuilleminF,FerrazMB.Guidelinesfortheprocessofcross-culturaladaptationofself-reportmeasures.Spine2000;25:3186-91. 23. HuntSM,AlonsoJ,BucquetDetal.Cross-culturaladaptationofhealthmeasures.HealthPolicy1991;19:33-44. 24. StreinerDL&NormanGR.Healthmeasurementscales:Apracticalguidetotheirdevelopmentanduse.Oxford:OxfordUniversityPress,1996.25. TickleA,CheungN,WalkerC.Professionals'perceptionsoftheMentalHealthRecoveryStar.MentalHealthRev2013;18:194-203.26. LloydC,WilliamsPL,MachinguraT,TseS.Afocusonrecovery:usingtheMentalHealthRecoveryStarasanoutcomemeasure.AdvancesinMentalHealth2015;16:27-23.27. DickensG,WeleminskyJ,OnifadeY,SurgarmanP.RecoveryStar:validatinguserrecovery.Psychiatrist2012;36:45-5028. KillaspyH,BoardmanJ,KingM,TaylorTL,ShepherdG,WhiteS.TheMentalHeathRecoveryStar:greatforcareplanningbutnotasaroutinemeasure.Psychiatrist2012;36:194–199.29. BurgessP,PirkisJ,CoombsT,RossenA.AssessingthevalueofexistingrecoverymeasuresforroutineuseinAustralianMentalHealthServices.AustNZJpsychiatry2011;45:267-280 30. McDonaldAJ.Reliabilityisadimension,notacategory.BritishJournalofPsyc2012disponibileinhttp://bjp.rcpsych.org/content/201/1/65/full. 31. EynonTE,TheOutcomeStarTMapproach:anobjectiveoutcomemeasureoratoolforco-creatinghealth?BritishJournalofPsychiatry2012,http://bjp.rcpsych.org/content/201/1/65/e-letters#the-outcomestartm-approach-an-objective-outcome-measure-or-a-tool-for-co-creating-health 32. KerrDJR,CroweTP,OadesLG.Thereconstructionofnarrativeidentityduringmentalgealthrecovery:acomplexadaptivesystemsperspective.PsychiatrRehabilJ2013;36:108-109. 33. PribeS&McCabeR.Therapeuticrelationshipsinpsychiatry:thebasisoftherapyortherapyinitself.IntRevPsychiatry2008;20:526-532.34. PribeS,WattJ,ChaseM,MatanovA.processofdisengagementandengagementinassertiveouttreachpatients:qualitativestudy.BrJPsychiatry2005;187:438-443.35. FrostBG,TurrellM,SlyKA,etal.Implementationofarecovery-orientedmodelinasub-acuteIntermediateStayMentalHealthUnit(ISMHU).BMCHealthServRes20173:17-20. 36. MentalHealthProvidersForum.MentalHealthRecoveryStarOrganisationalGuide.MentalHealthProvidersForum,2008.