Health and social care staff experience survey 2022

Independent report by Webropol providing detailed information and analysis of staff experience in health and social care across Scotland during 2022


Appendix 6: Statistical Notes

Significance Testing

Significance testing has been carried out on the iMatter data, to assess whether year to year movements in results are likely to be ‘true’, rather than ‘chance’. Specifically, a series of t-tests have been used to examine the size of change needed to give us a very high level of confidence that a ‘true’ change has happened. The key element here is the number of responses – the larger the number of responses, the smaller the minimum change that can be deemed statistically significant (meaning that the change is highly likely to be ‘true’).

Overall Health and Social Care Level Data

  • A change of 0.3, or even 0.2 at times, is significant across Health and Social Care as a whole. This generally means any change reported from 2021 to 2022 is likely to be a ‘true’ change

Board Level Data

As noted previously, the number of respondents (the achieved sample size) is key to the level of movement year on year that is significant. Therefore, for individual Boards, significant movements are:

  • Boards with less than 800 responses per year: movements of 3 points are significant
  • Boards with between 800 and 2,800 responses per year: movements of 2 points are significant
  • Boards with over 2,800 responses per year: movements of 1 point are significant
Movements of 3pp are significant Movements of 2pp are significant Movements of 1pp are significant
Healthcare Improvement Scotland NHS Shetland NHS National Services Scotland
NHS Western Isles NHS 24 NHS Tayside
The State Hospital NHS Golden Jubilee NHS Grampian
NHS Borders NHS Lothian
Public Health Scotland NHS Greater Glasgow & Clyde
NHS Orkney Scottish Ambulance Service
NHS Education for Scotland NHS Forth Valley
NHS Dumfries & Galloway NHS Highland
NHS Fife
NHS Ayrshire & Arran
NHS Lanarkshire

As seen with the National data there are incidences where significant movements are not evident in data reported at whole integer level only. Occasionally where there appears to be a movement in scores, but this is simply a result of rounding to whole integers and the difference is in fact, not significant. The following tables illustrate where this is the case.

Component Scores 2021 2022 Reported difference Significant Difference
I am clear about my duties and responsibilities 86 87 1 Very significant
I get the information I need to do my job well 79 81 2 Very significant
I am given the time and resources to support my learning growth 70 72 2 Very significant
I have sufficient support to do my job well 76 78 2 Very significant
I am confident my ideas and suggestions are listened to 74 76 2 Very significant
I am confident my ideas and suggestion are acted upon 70 72 2 Very significant
I feel involved in decisions relating to my job 70 71 1 Very significant
I am treated with dignity and respect as an individual 83 84 1 Very significant
I am treated fairly and consistently 81 82 1 Very significant
I get enough helpful feedback on how well I do my work 73 74 1 Very significant
I feel appreciated for the work I do 73 75 2 Very significant
My work gives me a sense of achievement 79 81 2 Very significant
I feel my direct line manager cares about my health and well-being 84 86 2 Very significant
My direct line manager is sufficiently approachable 87 88 1 Very significant
I have confidence and trust in my direct line manager 84 85 1 Very significant
I feel involved in decisions relating to my team 75 76 1 Very significant
I am confident performance is managed well within my team 77 78 1 Very significant
My team works well together 82 83 1 Very significant
I would recommend my team as a good one to be a part of 83 84 1 Very significant
I understand how my role contributes to the goals of my organisation 82 83 1 Very significant
I feel my organisation cares about my health and wellbeing 70 71 1 Very significant
I feel board members who are responsible for my organisation are sufficiently visible 55 55 0 Not significant
I have confidence & trust in Board members who are responsible for my organisation 61 61 0 Not significant
I feel sufficiently involved in decisions relating to my organisation 55 55 0 Very significant*
I am confident performance is managed well within my organisation 62 63 1 Very significant
I get the help & support I need from other teams and services to do my job 70 70 0 Very significant*
I would recommend my organisation as a good place to work 73 74 1 Very significant
I would be happy for a friend or relative to access services within my organisation 77 77 0 Not Significant

* Although rounding to the same score in 2022 as 2021, both are significantly higher this year.

EEI Score 2021 2022 Significant Difference
Health and Social Care 75 76 Very Significant
NHS Golden Jubilee 72 74 Significant
Healthcare Improvement Scotland 81 82 Not Significant
NHS 24 75 76 Fairly Significant
NHS Ayrshire & Arran 75 77 Very Significant
NHS Borders 74 75 Fairly Significant
NHS Dumfries & Galloway 72 75 Very Significant
NHS Education for Scotland 84 85 Not Significant
NHS Fife 75 75 Not Significant
NHS Forth Valley 73 76 Very Significant
NHS Grampian 76 76 Very Significant*
NHS Greater Glasgow & Clyde 74 75 Very Significant
NHS Highland 73 75 Very Significant
NHS Lanarkshire 77 78 Very Significant
NHS Lothian 76 76 Fairly Significant*
NHS National Services Scotland 78 78 Not Significant
NHS Orkney 70 72 Fairly Significant
NHS Shetland 78 79 Not Significant
NHS Tayside 74 76 Very Significant
NHS Western Isles 76 74 Not Significant
Public Health Scotland 77 75 Significant
Scottish Ambulance Service 65 67 Very Significant
The State Hospital 74 75 Not Significant

* Although rounding to the same score in 2022 as 2021, both Boards scored higher this year than last year

sig ≤ 0.05 but sig≤0.01 Fairly significant

sig<0.01 but sig≥0.001 Significant

sig < 0.001 Very significant

Individual Significance of Movement 2022 – 2021 Clear about my duties and responsibilities Get the information I need to do my job well Given the time and resources to support my learning growth I have sufficient support to do my job well Confident my ideas and suggestions are listened to Confident my ideas and suggestions are acted upon Involved in decisions relating to my job Treated with dignity and respect I am treated fairly and consistently I get enough helpful feedback on how well I do I feel appreciated for the work I do My work gives me a sense of achievement
Health & Social Care 1 2 2 2 2 2 1 1 1 1 2 2
Geographic Boards
NHS Ayrshire & Arran 1 2 2 2 1 2 2 2 2 3 3 1
NHS Borders 2 2 4 3 2 2 2 2 2 1 2 1
NHS Dumfries & Galloway 2 2 3 4 3 3 3 3 3 3 3 2
NHS Fife 0 0 0 0 0 1 0 0 1 0 1 0
NHS Forth Valley 1 3 4 3 3 3 3 3 3 3 4 2
NHS Grampian 1 1 2 2 1 1 2 1 2 1 1 1
NHS Greater Glasgow & Clyde 0 2 2 2 1 1 1 2 2 2 1 1
NHS Highland 1 1 2 3 3 2 2 3 3 3 2 2
NHS Lanarkshire 1 1 2 2 1 2 2 1 1 1 2 2
NHS Lothian 0 1 1 2 1 1 0 1 1 1 1 1
NHS Orkney 3 3 3 3 3 2 2 1 1 2 1 4
NHS Shetland 0 0 2 1 2 2 2 1 1 1 2 1
NHS Tayside 1 2 3 3 2 2 2 2 2 3 3 2
NHS Western Isles 0 -2 -2 -1 0 0 -1 0 0 0 -2 -1
National Boards (Support)
Healthcare Improvement Scotland 1 2 1 0 2 2 2 1 1 2 2 2
NHS Education for Scotland 1 1 2 2 0 1 1 1 0 1 1 2
Public Health Scotland 0 -2 -2 -1 -2 -1 -4 -1 -1 -1 -2 -2
National Services Scotland 1 1 2 1 0 0 0 0 0 1 0 1
National Boards (Patient Facing)
NHS Golden Jubilee 2 3 1 2 2 2 2 3 3 2 2 2
Scottish Ambulance Service 0 2 2 4 2 2 3 2 3 2 3 1
NHS 24 1 1 4 2 1 1 1 1 2 3 1 1
The State Hospital 1 2 0 0 0 0 1 1 2 1 0 1
My Line Manager/Team Significance of Movement 2022 – 2021 My direct line manager cares about my health and well-being My direct line manager is sufficiently approachable I have confidence and trust in my direct line manager I feel involved in decisions relating to my team I am confident performance is managed well within my team My team works well together I would recommend my team as a good one to be a part of
Health & Social Care 2 1 1 1 1 1 1
Geographic Boards
NHS Ayrshire & Arran 2 2 2 2 2 2 2
NHS Borders 1 1 1 2 1 1 1
NHS Dumfries & Galloway 3 2 2 3 3 4 3
NHS Fife 0 1 0 0 0 0 1
NHS Forth Valley 3 2 3 3 3 2 2
NHS Grampian 0 0 1 2 1 1 1
NHS Greater Glasgow & Clyde 1 1 1 1 1 1 1
NHS Highland 2 1 3 2 3 1 2
NHS Lanarkshire 1 0 1 1 1 1 1
NHS Lothian 1 1 0 1 1 1 1
NHS Orkney 0 1 2 3 3 2 2
NHS Shetland 1 2 1 1 1 1 1
NHS Tayside 2 1 2 2 3 2 2
NHS Western Isles -1 -1 -1 -1 -2 -1 -1
National Boards (Support)
Healthcare Improvement Scotland 1 1 1 2 0 0 0
NHS Education for Scotland 0 1 1 1 1 1 0
Public Health Scotland -2 -3 -3 -3 -2 -1 -2
National Services Scotland 1 1 1 1 0 0 1
National Boards (Patient Facing)
NHS Golden Jubilee 3 2 3 2 2 1 2
Scottish Ambulance Service 3 2 3 3 3 3 3
NHS 24 1 1 1 1 0 1 2
The State Hospital 1 1 3 1 0 0 0
My Organisation Significance of Movement 2022 – 2021 I understand how my role contributes to the goals of my organisation I feel my organisation cares about my health and wellbeing I feel that board members who are responsible for my organisation are sufficiently visible I have confidence and trust in Board members who are responsible for my organisation I feel sufficiently involved in decisions relating to my organisation I am confident performance is managed well within my organisation Get the help and support I need from other teams and services within the organisation to do my job I would recommend my organisation as a good place to work I would be happy for a friend or relative to access services within my organisation
Health & Social Care 1 1 0 0 0 1 0 1 0
Geographic Boards
NHS Ayrshire & Arran 0 2 0 0 1 0 1 0 0
NHS Borders 0 1 -2 -1 0 1 1 1 1
NHS Dumfries & Galloway 1 2 1 1 2 2 3 2 1
NHS Fife -1 -1 -1 -1 0 0 -1 0 -1
NHS Forth Valley 1 2 1 2 2 3 2 2 1
NHS Grampian 0 0 1 -1 0 0 0 0 -1
NHS Greater Glasgow & Clyde 0 1 0 0 0 1 1 1 0
NHS Highland 1 1 3 2 2 2 1 2 0
NHS Lanarkshire 0 1 -1 0 1 1 0 1 0
NHS Lothian 0 0 -1 -1 0 -1 0 -1 -1
NHS Orkney 3 1 0 0 3 4 0 2 1
NHS Shetland 1 1 -1 0 0 -1 1 0 0
NHS Tayside 0 2 1 1 1 1 2 2 1
NHS Western Isles -1 -3 -5 -4 -3 -4 0 -2 -2
National Boards (Support)
Healthcare Improvement Scotland 2 1 0 0 3 2 1 0 0
NHS Education for Scotland 1 1 -1 -1 -1 2 1 1 1
Public Health Scotland -3 -2 0 -3 -4 -2 -1 -2 -3
National Services Scotland 0 0 0 0 -2 0 0 -1 -1
National Boards (Patient Facing)
NHS Golden Jubilee 1 2 0 0 0 1 1 1 1
Scottish Ambulance Service 0 2 2 1 1 1 1 1 1
NHS 24 1 2 0 2 1 3 2 3 2
The State Hospital 0 1 -1 0 -1 2 0 1 1

Contact

Email: Suzanne.thomas@gov.scot

Back to top