The Scottish Health Survey 2024 - Volume 2: Technical Report

This publication presents information on the methodology and fieldwork from the Scottish Health Survey 2024.


1.2   Sample design

1.2.1    Requirements

The sample specification for the 2024 SHeS was designed by the Scottish Government. The design was coordinated with the designs for the Scottish Household Survey (SHS) and the Scottish Crime and Justice Survey (SCJS) to improve survey efficiency and to allow the samples of the three surveys to be pooled for further analysis[i].

There were two elements to the SHeS sample in 2024:

  1. Main sample - to allow annual reporting of Scotland level results and results at Health Board and local authority level for adults using the 2021, 2022, 2023 and 2024 data combined. This required an annual interview target of 5,112 adults for Scotland as a whole and a minimum target of 125 for each local authority. There were additional targets of 1,000 adults to complete each biological measure and 1,026 child interviews.
  2. Child boost sample – overall there was a requirement for 2,031 child interviews for Scotland. As the main sample was only expected to yield 1,026 child interviews, a further 1,005 interviews were required from a separate boost sample.

1.2.2    Sample design and assumptions

In 2024, the sample utilised a two-stage clustered sample design, with intermediate geographies randomly selected at the first stage and address points at the second stage. With the exception of Orkney, Shetland and Na h-Eileanan Siar councils, the sample was clustered by intermediate geographies (IG) with one quarter of IGs selected for each year of fieldwork. In Orkney, Shetland and Na h-Eileanan Siar the sample was clustered by data zone.

1.2.3    Main sample

As stated above, the annual target sample size for Scotland was 5,112 adults with a minimum local authority target sample size of 125 adults. These sample sizes were the minimum required to allow effective reporting of Scotland-level results annually and Health Board and local authority results with four years of data combined. An iterative approach was taken to efficiently allocate the sample across all Health Boards and local authorities. For the first iteration, 4,000 adult interviews were allocated across local authorities in proportion to the adult population. Any local authorities allocated fewer than 125 adult interviews had their allocation increased to 125.

The remaining sample was then allocated over the remaining local authorities. Where allocations were not whole numbers the number was rounded up. This resulted in a total target of 5,112 adult interviews. The results of the allocation are shown in Table 1.

Table 1: SHeS target annual adult interviews, 2024, by Health Board

Health Board

Target Annual Adult Interviews

Ayrshire and Arran

375

Borders

125

Dumfries and Galloway

125

Fife

271

Forth Valley

375

Grampian

488

Greater Glasgow and Clyde

1,075

Highland

297

Lanarkshire

482

Lothian

749

Orkney

125

Shetland

125

Tayside

375

Western Isles

125

Total

5,112

To allow for reporting at local authority level over a four-year period (2021/2022/2023/2024) and coordination with the sample selection of the SHS and SCJS, the required sample sizes were set at local authority level. This was done by allocating the target Health Board samples to local authorities proportionate to population.

The number of addresses selected in order to provide the target number of interviews was calculated by:

  1. Estimating the number of productive adult interviews per co-operating household. Considering response data from previous years, it was estimated that there would be an average of 1.5 interviews per co-operating households in each local authority.
  2. Allocation of the target interviews and associated estimate of co-operating households to local authority strata proportionate to population.
  3. The response rate assumptions for local authorities for 2024 were then estimated based on the variation across local authorities in response to the 2018, 2019 and 2023 face-to-face surveys. 
  4. The final step was to estimate the level of ineligible addresses. As for previous survey years, the estimates were calculated at local authority level and based on the average level of ineligible addresses from previous years of SHeS, SHS and the SCJS.

Table 2 shows the number of selected addresses used for the main sample in 2024.

Table 2: Selected addresses issued by strata in 2024 – main sample

Sample strata

Addresses for main sample

Aberdeen City

267

Aberdeenshire

295

Angus

211

Argyll & Bute

228

Clackmannanshire

189

Dumfries & Galloway

205

Dundee City

240

East Ayrshire

211

East Dunbartonshire

226

East Lothian

208

East Renfrewshire

207

Edinburgh, City of

680

Eilean Siar

195

Falkirk

203

Fife

508

Glasgow City

851

Highland

309

Inverclyde

241

Midlothian

214

Moray

191

North Ayrshire

205

North Lanarkshire

479

Orkney Islands

187

Perth & Kinross

221

Renfrewshire

244

Scottish Borders

179

Shetland Islands

178

South Ayrshire

234

South Lanarkshire

431

Stirling

219

West Dunbartonshire

242

West Lothian

233

Total

8,931

1.2.4    Child boost sample

For the 2024 survey, 2,031 child interviews were required. It was estimated that the main sample would provide 1,026 child interviews, therefore, to reach the target number of child interviews, a child boost sample was required to yield a further 1,005 interviews.

The child boost sample was linked to health records via the Community Health Index (CHI) to identify households with children. This significantly improved the sample efficiency and response levels. This linkage was carried out by the CHI Linkage (CHILi) Indexing Team at Public Health Scotland.

Table 3: Target annual child interviews, 2024, by Health Board

 

Expected child interviews from main sample

Target child interviews from boost

Total target child interviews

Ayrshire and Arran

75

70

145

Borders

25

21

46

Dumfries and Galloway

25

27

52

Fife

54

71

125

Forth Valley

75

60

135

Grampian

97

110

207

Greater Glasgow and Clyde

219

216

435

Highland

60

59

119

Lanarkshire

97

131

228

Lothian

149

163

312

Orkney

25

0

25

Shetland

25

0

25

Tayside

75

77

152

Western Isles

25

0

25

Total

1,026

1,005

2,031

The process for calculating the number of addresses to select for the child boost sample was as follows:

  1. The child boost target of 1,005 child interviews was allocated proportionally to local authorities based on the child (under 16) population. If the number expected from the child boost was less than 10, then the local authority boost target was set to zero.  Table 3 shows the child interview targets for the main sample and child boost sample by Health Board.
  2. The number of co-operating households with children required in each Health Board for the child boost sample was estimated using the performance of the child boost samples in the surveys between 2013 and 2015
  3. For the child boost, CHI linkage was performed to identify addresses where health records indicated that a child was resident. It was assumed the CHI linking would identify 20% of sampled households as having a child resident. An additional assumption of 64% accuracy of the CHI records was included to allow for cases where health records may not be up-to-date or households had moved.
  4. The assumptions made on ineligible addresses for the main sample were applied to the address calculations for the child boost sample.

The total numbers of addresses issued for the child boost sample are shown in Table 4.

Table 4: Selected addresses issued by strata in 2024 – Child Boost

Sample strata

Addresses for child boost

Aberdeen City

82

Aberdeenshire

106

Angus

51

Argyll & Bute

29

Clackmannanshire

22

Dumfries & Galloway

45

Dundee City

52

East Ayrshire

52

East Dunbartonshire

51

East Lothian

45

East Renfrewshire

47

Edinburgh, City of

184

Eilean Siar

0

Falkirk

73

Fife

174

Glasgow City

268

Highland

105

Inverclyde

34

Midlothian

45

Moray

26

North Ayrshire

60

North Lanarkshire

176

Orkney Islands

0

Perth & Kinross

59

Renfrewshire

81

Scottish Borders

42

Shetland Islands

0

South Ayrshire

53

South Lanarkshire

153

Stirling

39

West Dunbartonshire

40

West Lothian

94

Total

2,288

1.2.5    Sample Selection

The Royal Mail’s small user Postcode Address File (PAF) was used as the sample frame for the address selection. The advantages of using the PAF are as follows:

  • It has previously been used as the sample frame for Scottish Government surveys so previously recorded levels of ineligible addresses can be used to inform assumptions for the 2024 sample design.
  • It has excellent coverage of addresses in Scotland.
  • The small user version excludes the majority of businesses.

The PAF does still include a number of ineligible addresses, such as small businesses, second homes, holiday rental accommodation and vacant properties. A review of the previous performance of individual surveys found that they each recorded fairly consistent levels of ineligible address for each local authority. This meant that robust assumptions could be made for the expected levels of ineligible addresses in the sample size calculations.

As the samples for the SHS, SHeS and SCJS have all been selected by the Scottish Government since 2012, addresses selected for any of the surveys are removed from the sample frame so that they cannot be re-sampled for another survey. This helps to reduce respondent burden. The addresses are removed from the sample frame for a minimum of four years.

The sample design was implemented in three stages:

  1. All primary sampling units (data zones on the islands, intermediate geographies elsewhere) were randomly allocated to one of four sets. One of these sets will be used in each year of fieldwork. This means that the sample is drawn from one quarter of PSUs each year. The sets were updated ahead of the 2021 sampling and this ensures that over four years of fieldwork (2021 to 2024) all addresses will have a non-zero probability of selection.

Table 5: Primary sampling units selected in 2024 sample

Health Board

PSUs in 2024 Sample

Total PSUs

Ayrshire and Arran

23

93

Borders

8

30

Dumfries and Galloway

10

40

Fife

26

104

Forth Valley

19

78

Grampian

33

132

Greater Glasgow and Clyde

65

257

Highland

19

79

Lanarkshire

40

160

Lothian

48

192

Orkney

8

29

Shetland

7

30

Tayside

23

92

Western Isles

9

36

Total

338

1,352

  1. The required numbers of addresses for the main and child boost samples gave an overall total of addresses to sample for each stratum (local authorities). The required number of addresses for each stratum was then sampled from the sample frame of addresses in active PSUs. Systematic random sampling was used with addresses within PSUs ordered by urban-rural classification, mean SIMD rank, SIMD rank and postcode.
  2. Once the overall sample was selected, a proportion of the main sample addresses were randomly allocated to the biological module. One quarter of the target main adult sample was required to complete the biological module. To guard against a lower response rate to the different elements of the biological module, and to correct for inaccurate response assumptions in previous years, a proportion higher than the required one quarter of the adult sample (33% in 2024) were allocated to the biological module.

1.2.6    Selecting individuals within households

For the main sample, all adults aged 16 and over in responding households were eligible for interview. To ease respondent burden, for child interviews for both the main and the child boost samples a maximum of two children were interviewed at each household. If a household contained more than two children, then two were randomly selected for interview.

1.2.7     Selecting households at addresses with multiple dwellings

A small number of addresses have only one entry in the Postcode Address File (PAF) but contain multiple dwelling units. Such addresses are identified in the PAF by the Multiple Occupancy Indicator (MOI). To ensure that households within MOI addresses had the same probability of selection as other households, the likelihood of selecting addresses was increased in proportion to the MOI. At addresses with more than one dwelling unit fieldworkers have a programme to randomly select the household at which interviews should be sought. There are generally a few cases were the MOI on the PAF is inconsistent with the actual number of dwelling units. When this occurred, the fieldworkers recorded the information and a correction was made through the survey weighting.

References and notes

[i]     Further information on the sample designs and the methodology used is available at: https://webarchive.nrscotland.gov.uk/3000/https://www.gov.scot/Topics/Statistics/About/SurveyDesigns201215 .

Contact

ScottishHealthSurvey@gov.scot

Back to top