the challenges of developing composite measures - 10am, pop up uni, 2 september 2015

Masking or un-masking quality of services?

The challenges of developing composite measures

How well services are

performing and meeting our

(patients’) needs?

Is the information about services easy to find?

Stroke

Cancer

Cardiac

Dementia

MI

Diabetes

What do we know about these services?

https://www.nhs.uk/service-search/performance/search

What CSQMs will bring?

What are Clinical Services Quality Measures? • An at-a-glance indication of how well services are performing

• Developed as composite measures, i.e. based on multiple data items

• Patients, the general public, service providers, commissioners and

clinicians will all also have access to the underlying, constituent data

items, where appropriate and secure

What are the aims of the programme? • Better, more accessible information for patients

• Providing patients and commissioners with further insight into outcomes.

• Driving service improvement and reduction in unwarrented variation

• Allowing NHS staff to see how well their services are performing within the

context of their peers

How are we going to develop CSQMs?

Are we masking or un-masking

the quality of services such as

cancer, stroke, mental health?

• Offers a summary of complex, multi-dimensional issues

• Presents the ‘big picture’ to support decision makers and patients’ choice.

• Facilitates communication with general public

• Easier to interpret than attempting to analyse quickly many separate indicators

• Indicates which service represents beacons of best performance and also services needing improvements

• May stimulate better analytic methods and data quality

• May be dismissed or ignored if the construction process is not transparent, lacking sound conceptual principles.

• It may distort behaviour in undesirable ways; perverse incentives

• May lead to inappropriate decisions should statistical methodology not being robust and consistent or poor data quality.

• The selection of indicators could be a target of political challenge as well as other aspects of the methodology including weighting

Advantages Limitations

Get involved • For more information visit NHS England website:

• www.england.nhs.uk/ourwork/tds/data-info/open-data/clinical-services-

quality-measures

• Contact us on:

• ENGLAND.servicemeasures@nhs.net

• Karina.gajewska@nhs.net

• 07900715415