quarterly pulse check survey q4 2016 - nsw.gov.au€¦ · project objectives of the quarterly pulse...
TRANSCRIPT
![Page 1: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/1.jpg)
Quarterly Pulse Check Survey Q4 2016
Summary Report
December 2016
![Page 2: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/2.jpg)
Table of Contents
1
Item Page no.
1 Executive Summary 2
2 Background and Methodology 4
3 Considerations for QPCS Interpretation 10
4 Customer Satisfaction Index and other Outcome Measures 12
5 Insights on Satisfaction Drivers 16
6
Insights on Key Primary Opportunity Areas• Area 1: Efficiency and Effectiveness of Employees• Area 2: Access to Information• Area 3: Simplicity and Efficiency of Processes
21
7 Channel Usage and Preference 26
8Appendices• Demographic Profile of Respondents
28
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 2016
![Page 3: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/3.jpg)
Executive Summary
![Page 4: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/4.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 2016
Customer Satisfaction and Effort
• The Customer Satisfaction Index (CSI) as measured by the Quarterly Pulse Check Survey (QPCS) in Q4 2016 is 77.8 for consumers and 76.1 for businesses. Average satisfaction is 7.4 out of 10 for consumers and 7.2 out of 10 for businesses.
• There is a correlation between average satisfaction and the level of effort that customers have to personally put forth when dealing with NSW Government services. In general, average satisfaction is higher for customers who felt they exerted a low amount of effort compared to customers who felt they exerted a medium to high amount of effort.
• Qualitative research shows that a smooth online experience could reduce the amount of effort that customers feel they exert when dealing with Government services, suggesting opportunity to further enhance digital services to improve customer satisfaction.
Channel Usage
• Online is the most preferred channel among businesses and the second most preferred channel among consumers when dealing with NSW Government services. Customers expect call centre staff to be knowledgeable when they call up to seek further clarification on a particular issue, especially if online information is insufficient. In addition, multiple phone transfers has been cited as a frustrating process that further increases perceived level of effort.
3
Executive Summary
Customer Satisfaction Index:
Insights on Key Primary Opportunity Areas
• Attributes relating to ‘Efficiency and Effectiveness of Employees’ and ‘Access of Information’ were rated relatively high overall. ‘Employees are respectful’ was rated as the highest performing attribute, whilst ‘Accountability’ was the lowest rated employee attribute.
• Consistent with the Annual CSMS results, process related attributes were the lowest rated. The three lowest process related attributes were ‘the process is designed to reduce wait times’, ‘service feels seamless’ and ‘I can get to the right person the first time’.
![Page 5: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/5.jpg)
Project Background & Objectives
![Page 6: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/6.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 2016
Improving customer satisfaction with key government services is one of the 12 Premier’s Priorities.
The Quarterly Pulse Check Survey was developed in 2016 as part of the broader customer satisfaction program work. In conjunction with the Annual Customer Satisfaction Measurement Survey (CSMS), which was developed in 2013, outputs are used to measure progress against the Premier’s Priority 12 – ‘improve customer satisfaction with key government services every year, this term of government’.
5
2013 2014 2015 2016
Development of the Annual Customer Satisfaction Measurement Survey (CSMS) jointly developed by the Customer Service Commissioner
and the Public Service Commissioner.
Annual CSMS pilot with 6,208 customers (consumers and
businesses). Findings used to shape improvements to instrument and
implementation approach.
2015 Annual CSMS launch completed with 4,137 consumers
and 1,126 businesses.
2016 Annual CSMS completed with 4,237 consumers and 1,132
businesses.
The QPCS methodology was developed and piloted with 500
consumers and businesses.
The results of the Annual CSMS and Quarterly Pulse Check Surveys are also used to complement existing Agency level research programmes and provide important information for Agencies to continue shaping and refining their strategies.
Background
![Page 7: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/7.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 2016 6
Driver Deep Dive
Capture breadth: understand respondents’ perceptions across the
drivers of satisfaction identified in the Annual CSMS
Capture depth: deep dive into specific key primary opportunity areas identified in the Annual CSMS
Frequency
Provide a more frequent understanding on how New South
Wales Government services are performing overall, interpreted in the
context of the Premier’s Priority 12
+
Lead indicator for Premier’s Priority 12 - respondents’ perceptions of NSW
Government services overall, captured by the Customer Satisfaction Index
and its composite measures (overall satisfaction,
expectation, ideal service)
Breadth: more frequent understanding of the 8 drivers of satisfaction.
Depth: deeper understanding of key primary opportunity areas captured in
the Annual CSMS (e.g. access, efficiency and effectiveness of
employees etc.)
+
Customer Satisfaction Index & Baseline Measures
Deep Dive into Driver Performance
Project Objectives:
Research Outputs:
Fixed section Fixed + rotating variable section
Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs
Objectives and Key Outputs
![Page 8: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/8.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 2016
The QPCS Methodology is aligned to the Annual Customer Satisfaction Measurement
Survey (CSMS) approach:
• Captures feedback across 22 different NSW Government services (described
in the customers language).
• Feedback received from customers about each of the individual services is
aggregated to provide a view of the performance of NSW Government
services overall.
• Each respondent provides feedback regarding 1 or 2 services. As a result,
the total number of responses received across services is greater than the
total number of customers who completed the survey.
The survey was completed from the 27th October 2016 to 3rd November 2016 and
results are therefore reflective of experiences with services over the six months prior,
from April 2016 to October 2016.
The Q4 2016 QPCS was completed with:
• N = 1,047 consumers, and
• N = 255 businesses.
All scores reported in this document are out of 10, with the exception of the Customer
Satisfaction Index which is out of 100.
Rounding process is in place to ensure all graphs add up to 100%.
7
Research Scope and Approach
Industry• Agriculture Advice and
Funding Services• Business Advisory Services • Water Supply• TAFE Services
Justice • Police • State Emergency Services • Prisons • Courts • Fire Brigades • Art Galleries and Museums
Family & Community Services • Public Housing • Disability Services • Child Protection• Services for Older People
Transport• Public Transport • Car and Boat Registration • Major Roads
Finance, Services & Innovation
• Consumer Affairs (Fair Trading)
Planning & Environment
• Environment and Wildlife Protection
Education
• Public Schools
Health
• Public Hospitals and Ambulance Services
Multiple clusters
• Documentation Services (including certificates for births deaths and marriages; trade licenses and certificates; and drivers licenses)
In scope services:
![Page 9: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/9.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 2016 8
Linkage Between the Annual CSMS and QPCS
Key Features 2016 Annual CSMS Q4 2016 QPCS
Qualifying Criteria and Measurement Period
• Direct dealings with NSW public services within last 12 months
• 2016 CSMS results are reflective of experiences with services between May 2015 and May 2016
• Direct dealings with NSW public services within last 6 months
• Q4 2016 QPCS results are reflective of experiences with services between April 2016 and October 2016.
Customer Satisfaction Index
• Both studies measure expectations, satisfaction and comparison with an ‘ideal service’
Perceptions of services& Satisfaction Drivers
• Measures perceptions of attributes• Drivers of satisfaction are derived from measurement at an
attribute level for all drivers
• Measures perceptions of satisfaction drivers (asked directly)• Drivers of satisfaction as identified by the CSMS
Sample Size (2016) • Consumer n=4,237; Business n=1,132 • Consumer n=1,047; Business n=255
Margin of Error for Customer Satisfaction Index(95% Confidence Interval)
• Consumer is ± 0.4• Business is ± 0.8
• Consumer is ± 1.0• Business is ± 2.3
Recency of Experience
Consumers:• 0-3 months: 57%• 3-6 months: 22%• 6-12 months: 21%
Businesses:• 0-3 months: 50%• 3-6 months:25%• 6-12 months: 25%
Consumers:• 0-3 months: 63%• 3-6 months: 37%
Businesses:• 0-3 months: 66%• 3-6 months: 34%
The table below provides an overview of the differences between the Annual CSMS and QPCS:
![Page 10: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/10.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 2016
Findings and quotes from the qualitative research have been integrated throughout the report to support and supplement analysis.
Findings are indicated using this symbol:
Quotes are indicated using this symbol:
Detailed findings can be found in Appendix B.
9
Focus Group Methodology
The online survey is focused on reaching the primary research objectives by capturing feedback on satisfaction and information on the drivers of satisfaction on more regular basis. Qualitative research allows for the results of the online survey to be further understood and to provide additional context around the insights.
For the QPCS Q4 2016, three focus groups were held across two different geographical regions:
Qualitative Research Objectives
Identify opportunities that could enhance future service delivery
Understand what is driving high effort interactions and thus the relationship
between effort and satisfaction+
QPCS Q4 2016 Focus Groups
“
“
120 minfacilitated focus group
6 - 8customersper group
• Two consumer groups and one business group were held across Sydney CBD and Parramatta
• It comprised people who had direct dealings with NSW Government services in the last 6 months
• Respondents were selected to provide a mix of ages, genders, geographical locations and experiences
![Page 11: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/11.jpg)
Considerations for QPCS Interpretation
![Page 12: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/12.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 2016
General Considerations:
• The QPCS results do not replace the Annual CSMS results, but
provide a directional indication of the shift in the results.
• Although the QPCS sample characteristics are closely representative
of the NSW population, different customers have been surveyed and
as such the results are directional indicators of shifts in the Annual
CSMS results only.
• The margin of error (MoE) for the QPCS needs to be considered
when interpreting the results (see slide 3 for further detail on MoE
differences).
11
Key Considerations for Interpreting QPCS Insights
Considerations for interpreting the first QPCS data point:
• The first QPCS data point will be used as a benchmark for subsequent QPCS data points. The Annual CSMS results have been provided as
additional context for the first QPCS data point only.
• The QPCS results need to be interpreted in the context of the time of the year and in light of events in order to normalise seasonal trends in
the data. Therefore, overall caution should be taken when interpreting the QPCS findings until a minimum of a full year of results has been
collected, so that any seasonal impacts can be examined and adjusted accordingly.
• A longitudinal dataset will need to be built over time in order to identify 'real' trends in the QPCS results and to strengthen the reliability and
validity of any conclusions drawn.
0
1
2
3
4
5
Q42016
Q12017
Q22017
Q32017
1. Set a benchmark with the first data point
Interpretation Plan for Tracking Study
2. Draw insights by comparing to previous quarter
3. Form a directional trend
4. Develop a lead indicator
We are here
Time
![Page 13: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/13.jpg)
Customer Satisfaction Measures
![Page 14: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/14.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 201613
The Customer Satisfaction Index
Consumer Business
*Annual CSMS is measured based on 12 months period, whereas QPCS is based on 6 months period – the QPCS data point should not be correlated with the Annual CSMS until a full year of results are collated and adjusted for seasonality (the Annual CSMS results have been provided as additional context for the first QPCS data point only).
Cu
sto
mer
Sat
isfa
ctio
n In
dex
(o
ut
of
100)
Cu
sto
mer
Sat
isfa
ctio
n In
dex
(o
ut
of
10
0)
The Customer Satisfaction Index (CSI) as measured by the QPCS in Q4 2016 is 77.8 for consumers.
The Customer Satisfaction Index (CSI) as measured by the QPCS in Q4 2016 is 76.1 for businesses.
76.178.4
50.0
75.0
100.0
QPCS Q4 2016(n=375)
CSMS 2016(n=1,645)
77.8 78.7
50.0
75.0
100.0
QPCS Q4 2016(n=1,611)
CSMS 2016(n=6,971)
BusinessConsumer
The Customer Satisfaction Index (CSI) is a composite measure of the average satisfaction, average gap to expectation and average comparison to an ‘ideal service’ metrics.
![Page 15: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/15.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 201614
Top Line Performance – Satisfaction, Expectation and Comparison to ‘Ideal’
Consumer - Baseline Measures
% D
istr
ibu
tio
n
Business - Baseline Measures
Average satisfaction as measured by the QPCS in Q4 2016 for consumers is 7.4, which is below average expectation of 7.8. When compared to an ‘ideal’ service, consumers rated NSW Government services on average 7.1 out of 10.
Average satisfaction as measured by the QPCS in Q4 2016 for businesses is 7.2, which is below average expectation of 7.6. When compared to an ‘ideal’ service, businesses rated NSW Government services on average 7.1 out of 10.
10% 6%12% 9% 7%
12%
17%
13%
19%16%
13%
18%
73%81%
69%75% 80%
70%
0%
20%
40%
60%
80%
100%
Satisfaction(n=1,651)
Expectation(n=1,635)
Comparison toIdeal
(n=1,620)
Satisfaction(n=7,227)
Expectation(n=6,693)
Comparison toIdeal
(n=7,015)
Low (1-4) Neutral (5-6) High (7-10)
QPCS Q4 2016 Annual CSMS 2016
Average (out of 10)
7.4 7.8 7.1 7.5 7.8 7.2
% D
istr
ibu
tio
n
15%8%
15%7% 5% 9%
15%
13%
14%18%
14%
20%
70%79%
71% 75%81%
71%
0%
20%
40%
60%
80%
100%
Satisfaction(n=382)
Expectation(n=381)
Comparison toIdeal
(n=375)
Satisfaction(n=1,761)
Expectation(n=1,738)
Comparison toIdeal
(n=1,718)
Low (1-4) Neutral (5-6) High (7-10)
QPCS Q4 2016 Annual CSMS 2016
Average(out of 10)
7.2 7.6 7.1 7.5 7.9 7.3
BusinessConsumer
*Annual CSMS is measured based on 12 months period, whereas QPCS is based on 6 months period – the QPCS data point should not be correlated with the Annual CSMS until a full year of results are collated and adjusted for seasonality (the Annual CSMS results have been provided as additional context for the first QPCS data point only).
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 2016
![Page 16: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/16.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 201615
Customer Effort and Impact on Customer Satisfaction
Consumer (n=1,600)
Customer Effort Score
Business (n=378)
Customer Effort Score
Impact on Customer Satisfaction
6.0Average
6.3Average
High Effort
Medium Effort
Low Effort
Average Satisfaction (out of 10)
(1-4)
(5-6)
(7-10)
Minimal Difference
Very low effort
Very high effort
Average Satisfaction (7.4 for Consumers; 7.2 for Businesses)
8.5
8.5
7.1
6.7
6.9
6.8
Average Customer Effort Score (CES)
The results show that there is a statistically significant relationship between effort level and satisfaction. This suggests an opportunity to address the required effort placed on customers to support increased satisfaction.
They lead the conversation, told me what I needed to do- Low effort dealings, Business
“
“
Sometimes you don’t find all the information online and I will have to make the call- High effort dealings, Consumer
““
BusinessConsumer
Qualitative research suggests that ‘Time’ is a key differentiator between low versus high effort tasks. Tasks that take longer than expected to complete tend to drive up frustration levels and are perceived as higher effort.
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 2016
![Page 17: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/17.jpg)
Insights on Satisfaction Drivers
![Page 18: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/18.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 201617
Perceptions of Improvement in Satisfaction Drivers - Consumers
8% 11% 11% 13% 13%5% 10% 12% 10% 13%
32% 32% 33% 32% 37%
34%34%
38%32%
36%
60% 57% 56% 55% 50%61% 56% 50%
58%51%
0%
20%
40%
60%
80%
100%
Employees wereopen and honest
during the process
Communicationswere clear, prompt
and easy tounderstand
Employees actedefficiently and
effectively to reachthe right outcomes
The process wassimple and efficient
Employees tookinitiative and made
decisions
I felt my privacy wasupheld and my
personal informationwas protected and
respected
I had good access toinformation andcould find what I
needed
I felt the decisionmaking process wasopen & encouraging
I was provided withgood service andoutcomes I could
trust
I felt there wasaccountability forservices delivered
Worsened (1-4) Netural (5-6) Improved (7-10)
Drivers of Improvement
Employees Process Goals Values
Derived Drivers (Annual CSMS):
Honesty and Integrity of Employees
CommunicationSimplicity and Efficiency of
Processes
Efficiency and Effectiveness of
Employees
Employee Autonomy
Privacy Access to information
TransparencyService Quality
Accountability
Sensitive: NSW Government
Statement Asked in QPCS:
In comparison to prior experiences with NSW Government services, consumers feel that the greatest improvement has been with ‘Privacy’, followed by ‘Honesty and Integrity of Employees’. Consumers rated ‘Accountability’, ‘Transparency’ and ‘Employee Autonomy’ as the least improved drivers.
Consumer Business
Average(out of 10) 7.0 6.9 6.7 6.7 6.5 7.2 6.8 6.5 6.9 6.5
Consumer n=920 to 1,010
% D
istr
ibu
tio
n
![Page 19: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/19.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 201618
Perceptions of Improvement in Satisfaction Drivers - Businesses
10% 10% 15% 15% 18%6%
13% 20% 14% 17%
26%35%
32% 32%39%
35%28%
30%30%
38%
64%55% 53% 53%
43%59% 59%
50%56%
45%
0%
20%
40%
60%
80%
100%
Employees wereopen and honest
during the process
Communicationswere clear, prompt
and easy tounderstand
Employees actedefficiently and
effectively to reachthe right outcomes
The process wassimple and efficient
Employees tookinitiative and made
decisions
I felt my privacy wasupheld and my
personal informationwas protected and
respected
I had good access toinformation andcould find what I
needed
I felt the decisionmaking process wasopen & encouraging
I was provided withgood service andoutcomes I could
trust
I felt there wasaccountability forservices delivered
Worsened (1-4) Netural (5-6) Improved (7-10)
Drivers of Improvement
Employees Process Goals Values
Statement Asked in QPCS:
Average (out of 10)
Business n=229 to 254
Consumer Business
7.1 6.8 6.6 6.7 6.3 7.1 6.9 6.3 6.8 6.2
Similar to consumers, in comparison to prior experiences with NSW Government services, businesses feel that the greatest improvement has been with ‘Privacy’ and ‘Honesty and Integrity of Employees’. Businesses rated ‘Accountability’, ‘Transparency’ and ‘Employee Autonomy’ as the least improved drivers.
% D
istr
ibu
tio
n
Derived Drivers (Annual CSMS):
Honesty and Integrity of Employees
CommunicationSimplicity and Efficiency of
Processes
Efficiency and Effectiveness of
Employees
Employee Autonomy
Privacy Access to information
TransparencyService Quality
Accountability
![Page 20: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/20.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 201619
9% 7% 10% 12% 12%6% 8% 10% 12% 12%
15% 15%18% 17% 21%
18% 17%20% 16%
21%
76% 78% 72% 71% 67%76% 75% 70% 72% 67%
0%
20%
40%
60%
80%
100%
Communicationswere clear, prompt
and easy tounderstand
Employees wereopen and honest
during the process
Employees actedefficiently and
effectively to reachthe right outcomes
The process wassimple and efficient
Employees tookinitiative and made
decisions
I felt my privacy wasupheld and my
personal informationwas protected and
respected
I understood thesteps involved with
the process
I had good access toinformation andcould find what I
needed
I was provided withgood service andoutcomes I could
trust
I felt there wasaccountability forservices delivered
Disagree (1-4) Netural (5-6) Agree (7-10)
Employees Process Goals Values
Derived Drivers (Annual CSMS): Privacy Transparency Access to
information
Statement Asked in QPCS:
Consumer Business
Average (out of 10)
Consumer n=1,404 to 1,600
Performance of Satisfaction Drivers - Consumers
Drivers of Satisfaction
Among consumers, performance is the highest for ‘Honesty and Integrity of Employees’, ‘Communication’ and ‘Privacy’, while ‘Accountability’ is the lowest rated driver.
7.7 7.6 7.4 7.3 7.2 7.7 7.5 7.3 7.4 7.1
% D
istr
ibu
tio
n
Honesty and Integrity of Employees
CommunicationSimplicity and Efficiency of
Processes
Efficiency and Effectiveness of
Employees
Employee Autonomy
Service Quality
Accountability
![Page 21: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/21.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 201620
11% 11% 16% 15% 18%8% 9% 14% 16% 20%
10% 14%16% 18% 18%
17% 20% 15% 8%
19%
79% 75% 68% 67% 64%75% 71% 71% 76%
61%
0%
20%
40%
60%
80%
100%
Employees wereopen and honest
during the process
Communicationswere clear, prompt
and easy tounderstand
Employees actedefficiently and
effectively to reachthe right outcomes
The process wassimple and efficient
Employees tookinitiative and made
decisions
I understood thesteps involved with
the process
I felt my privacy wasupheld and my
personal informationwas protected and
respected
I had good access toinformation andcould find what I
needed
I was provided withgood service andoutcomes I could
trust
I felt there wasaccountability forservices delivered
Disagree (1-4) Netural (5-6) Agree (7-10)
Employees Process Goals Values
Derived Drivers (Annual CSMS): Transparency Privacy Access to
information
Statement Asked in QPCS:
Average (out of 10)
Business n=339 to 378
Performance of Satisfaction Drivers - Businesses
Drivers of Satisfaction
Similar to consumers, the highest performing drivers among businesses are ‘Honesty and Integrity of Employees’, ‘Communication’ and ‘Privacy’, while ‘Accountability’ remains the lowest rated driver.
Consumer Business
7.7 7.5 7.1 7.2 6.9 7.6 7.4 7.3 7.3 6.7
% D
istr
ibu
tio
n
Honesty and Integrity of Employees
CommunicationSimplicity and Efficiency of
Processes
Efficiency and Effectiveness of
Employees
Employee Autonomy
Service Quality
Accountability
![Page 22: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/22.jpg)
Insights on Key Primary Opportunity Areas
![Page 23: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/23.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 201622
Performance of Key Primary Opportunity Areas - Consumers
6% 11% 10% 11% 11% 13% 13% 13% 7% 9% 9% 9% 10% 10% 12% 15% 14% 16%15%
16% 17% 17% 17% 19% 19% 20%17% 18% 19% 19% 21% 21% 22%
22% 24% 22%
79% 73% 73% 72% 72% 68% 68% 67%76% 73% 72% 72% 69% 69% 66% 63% 62% 62%
0%
20%
40%
60%
80%
100%
Are respectful Deliveragainstactions
promised
Addresscustomer
needs
Good valueservices
Proactive Get thingsdone quickly
Accountable See thingsfrom my
perspective
Language thatis simple and
widelyaccessible
Easier toaccess
information
Documentsthat are easyto complete
Keepinginformationup to date
Best use ofonline
services
Processes areeasy to
understand
It is easy toknow where
to go
Designed toreduce wait
times
Service feelsseamless
I can get tothe right
person thefirst time
Agree (7-10) Neutral (5-6) Disagree (1-4)
Efficiency and Effectiveness of Employees Access to Information Simplicity and Efficiency of Processes
Consumers rated attributes relating to ‘Efficiency and Effectiveness of Employees’ and ‘Access to Information’ satisfaction drivers relatively higher across the board, with an average of 7 out of 10 or above, in particular the newly added attribute ‘Are respectful’ was rated the highest. However, process related attributes were the lowest rated, the three lowest being ‘the process is designed to reduce wait times’, ‘service feels seamless’ and ‘I can get to the right person the first time’ – this finding is consistent with the Annual CSMS.
Consumer - Key Primary Opportunity Areas
New New New NewNew New
New= New attribute added for the QPCS based on qualitative insights and currently not included in Annual CSMS
Average(out of 10) 7.9 7.5 7.5 7.4 7.4 7.2 7.1 7.1 7.5 7.4 7.3 7.3 7.3 7.2 7.1 6.8 6.8 6.8
Consumer n=1,357 to 1,571
Consumer Business
% D
istr
ibu
tio
n
![Page 24: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/24.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 201623
Contributors to Driving Satisfaction and Areas for Improvement - Consumers
Contributors to Satisfaction Improvement Areas
Statement – “Employees acted efficiently and effectively to reach the right outcomes (e.g. Didn’t waste time and got it right the first time)”
Statement –“I had good access to information and could find what I needed”
Statement – “The process was simple and efficient (i.e. no unnecessary steps or repetition)”
“Processes are designed to reduce wait times”
They need more people to answer phones. Some times I have waited in excess of 35 minutes to talk to some one only to hang up in frustration. - Consumer
“
“
“Service feels seamless ”
At times you’re not sure who to contact, and when they refer you to someone else and advise that the person will contact you - it does not happen and you have to follow up- Consumer
““
People don't seem to care that you've already gone through the process with others and there isn't clear communication between departments- Consumer
““
“I can get to the right person the first time”
There is a wait time between arrival and initial service. There is a further wait time between initial service and completion. More staff on duty at peak times would certainly reduce the first. Better processes would reduce the second. - Consumer
““
Consumer Business
Most commonly used words by Consumers:
![Page 25: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/25.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 201624
Performance of Key Primary Opportunity Areas - Businesses
8%15% 15% 14% 14% 17% 20% 20%
9% 12% 12% 14% 15% 15% 14%22% 19% 23%10%
10% 11% 13% 16% 15% 14% 20%
13%13% 17% 18% 11% 15% 18%
15% 17%16%
82%75% 74% 73% 70% 68% 66%
60%
78% 75% 71% 68% 74% 70% 68% 63% 64% 61%
0%
20%
40%
60%
80%
100%
Are respectful Deliveragainstactions
promised
Addresscustomer
needs
Good valueservices
Proactive Get thingsdone quickly
See thingsfrom my
perspective
Accountable Language thatis simple and
widelyaccessible
Easier toaccess
information
Keepinginformationup to date
Best use ofonline
services
Documentsthat are easyto complete
Processes areeasy to
understand
It is easy toknow where
to go
Designed toreduce wait
times
Service feelsseamless
I can get tothe right
person thefirst time
Agree (7-10) Neutral (5-6) Disagree (1-4)
% D
istr
ibu
tio
n
Business - Key Primary Opportunity Areas
Efficiency and Effectiveness of Employees Access to Information Simplicity and Efficiency of Processes
Businesses tend to agree that they have good access to information and can find what they need when dealing with NSW Government services. ‘Employees are respectful’ was rated as the highest performing attribute, while ‘Accountability’ was the lowest rated employee attribute. Similar to consumers, process related attributes were generally rated lower by businesses, in particular ‘service feels seamless’ and ‘I can get to the right person the first time’.
New New New NewNew New
New
Average (out of 10) 7.9 7.5 7.3 7.2 7.1 7.0 7.0 6.6 7.7 7.4 7.3 7.3 7.2 7.2 7.2 6.9 6.7 6.5
Business n=327 to 368
Consumer Business
= New attribute added for the QPCS based on qualitative insights and currently not included in Annual CSMS
![Page 26: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/26.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 201625
Contributors to Driving Satisfaction and Areas for Improvement - Businesses
“I can get to the right person the first time”
“Service feels seamless”
[I want] a single access point where someone knows the structure of the service and is available on that day to talk to you- Business
““
Allow us to instant chat, sms or email an enquiry, [then] we can describe the issue and not linger for someone to find out for us, but we can get a reply from someone suitable.- Business
““
I think my experience would have been improved if I were assigned a particular person to assist me through the whole process rather than having to explain over and over again.- Business
““
“Employee accountability”
Provide a feedback box where feedback for the employee can be provided by the customer - Business
“
“
Contributors to Satisfaction Improvement Areas
Statement – “Employees acted efficiently and effectively to reach the right outcomes (e.g. Didn’t waste time and got it right the first time)”
Statement –“I had good access to information and could find what I needed”
Statement – “The process was simple and efficient (i.e. no unnecessary steps or repetition)”
Consumer Business
Most commonly used words by Businesses:
![Page 27: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/27.jpg)
Channel Usage and Preference
![Page 28: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/28.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 2016
% used preferred
method**90% 86% 76% 51% 0% 1%
% used preferred
method**86% 68% 64% 39% 36% 17%
27
Channel Usage and Preference
Contact Methods and Preference
*Channel usage has been rebased on total number of responses for comparison to channel preference. ** Proportion of those who have used their preferred channel.
38%
20% 18%
11%7%
3%
40%
17%21%
13%
2% 2%
In person, faceto face
Telephone Online Email Mail, postedletter, fax
Third partiessuch as
Australia Post
Usage* Preferred
26%24% 22%
15%
10%
3%
24% 26% 27%
16%
3%1%
Telephone In person, faceto face
Online Email Mail, postedletter, fax
Third partiessuch as
Australia Post
Usage* Preferred
Consumer
Face-to-face is the most commonly used and preferred channel, followed by telephone and online. Only two thirds of consumers who prefer telephone and online interactions used these channels to deal with NSW Government services.
Business
Channel usage and preferences are similar for telephone, face-to-face and online methods. More businesses have been able to interact with NSW Government services using their preferred contact method compared to consumers.
BusinessConsumer
Business n=255Consumer n=1,047
![Page 29: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/29.jpg)
Appendix
![Page 30: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/30.jpg)
Source: Office of Customer Service Commissioner, Quarterly Pulse Check Survey Q4 201629
Appendix A – Demographic Profile of Respondents
Consumer Respondent Profile
49% male51%
female
Gender: Age: Region:18-34
31% 35-5434%
55-6415%
65+20%
Consumers (n=1,047)
75% Metro
19% Regional
6% Rural
Region:
Business (n=255)
97% under 20
staff3% 20+ staff
Business size:
Business Respondent Profile
74% Metro
19% Regional
7% Rural
33%
22%
10% 9% 6% 6%
14%
0%
10%
20%
30%
40%
Employed fulltime
Retired Employedpart time
Full timedomestic
duties
Student Unemployed Other
Employment Status:
13% 15%
27%
17%
10%
18%
0%
10%
20%
30%
Up to $30,000 $30,001 to$50,000
$50,001 to$100,000
$100,001 to$150,000
Over $150,001 Prefer not tosay
Annual Income:
42% male58%
female
Gender:
Industry:
15%13% 11%
9%7% 6% 5% 4% 3% 3% 3% 2% 2% 2%
15%
0%
5%
10%
15%
20%
Health care andsocial assistance
Retail Trade Professionalservices
Education andtraining
Construction Arts andrecreation
services
Administrativeand support
services
Wholesale TradeTransport, postaland
warehousing
Financial andinsuranceservices
Accommodationand foodservices
Agriculture,forestry and
fishing
Manufacturing Info media andteleco
Other
![Page 31: Quarterly Pulse Check Survey Q4 2016 - nsw.gov.au€¦ · Project objectives of the Quarterly Pulse Check Survey (QPCS) and key research outputs Objectives and Key Outputs. Source:](https://reader033.vdocument.in/reader033/viewer/2022050715/5f2ff9c04c26fc20462ea480/html5/thumbnails/31.jpg)
DRAFT