The Scottish Health Survey 2025 - Volume 2: Technical Report

This publication presents information on the methodology and fieldwork from the Scottish Health Survey 2025.


1.7    Weighting the data

Introduction

This section presents information on the weighting procedures applied to the survey data. Since 2012, the weighting for SHeS has been undertaken by the Scottish Government. The procedures for the implementation of the weighting methodology were developed by the Scottish Government working with the Methodology Advisory Service at the Office for National Statistics[1].

To undertake the calibration weighting, the ReGenesees Package for R was used. Within this, to execute the calibration, a raking function was implemented.

Main adult weights

The main adult weight is applicable to analysis of questions asked of all adults. There were six steps to calculating the overall adult weights. These were as follows:

1. Address selection weights (w1)

The address selection weights were calculated to compensate for unequal probabilities of selection of addresses in different survey strata. For the main sample, there were 32 strata (one for each local authority).

The address selection weight is calculated by dividing the number of PAF addresses in the stratum by the number of addresses selected for the stratum.

2. Dwelling unit selection weights (w2)

The Multiple Occupancy Indicator (MOI) for the PAF was used to ensure that if there were multiple dwelling units at a single address point then they would have the same selection probability as individual addresses. However, there are likely to have been some cases where the MOI was incorrect. The following correction was applied where this was the case:

The dwelling unit selection weight is calculated by dividing the recorded dwelling units at the address by the PAF multiple occupancy indicator for the address.

W2 was trimmed to a minimum of 0.67 and a maximum of 3.

3. Household selection weights (w3)

Similarly to w2, within a very small number of dwelling units, fieldworkers usually find multiple households, of which only one is selected for participation. The following correction was applied for multiple households:

The household selection weight equals the number of households within dwelling unit.

W3 was trimmed to a maximum of 3.

4. Calibrated household weights (w4)

The three selection weights were combined (w1*w2*w3) before the household calibration stage. This combined weight was applied to the survey data to act as entry weights for the calibration. The execution of the calibration step then modified the entry weights so that the weighted total of all members of responding households matched the population totals for Health Boards, Scotland-level population totals for age/sex breakdown, and the population within each SIMD quintile. The population totals that were used were the National Records of Scotland’s (NRS) 2023 private household population estimates.

5. Adult non-response weights (w5)

All adults within selected households were eligible for interview, but within responding households not all individuals completed an interview. The profiles of household members that did not complete the interview were different from those that did. Information on all individuals within responding households was available through information gathered as part of the household interview. This allowed the differential response rates for individuals within households to be modelled using logistic regression to calculate a probability of responding based on their profiles. The logistic regression was only applicable for households containing more than one adult since households consisting of only one adult either responded to the household and individual interviews or did not respond at all.

The following variables were considered for inclusion in the model:

  • Health Board
  • Age/sex
  • Number of adults in the household
  • Employment status of household reference person
  • Presence of a smoker in the household
  • Marital status
  • Tenure
  • Urban/rural classification
  • Access to a car
  • Located within SIMD15 area
  • Frequency of eating meals together
  • SIMD quintile

Through running backwards and forwards selection procedures for the logistic regression the following variables were included in the final model:

  • Health Board
  • Age/sex
  • Number of adults in the household
  • Marital status
  • Tenure
  • Access to a car
  • Frequency of eating meals together

The final logistic regression model was then used to calculate the probability of response for all individuals that did respond. The adult non-response weight (w5) was then calculated as the reciprocal of this probability:

The adult non-response weight is calculated by dividing 1 by the probability of individual’s response.

W5 was trimmed to a maximum of 4. For households of only one adult, the non-response weight was one.

6. Individual calibration and final adult weight (int25wt)

The household (w4) and non-response (w5) were combined (w4*w5) and applied to the survey data prior to the final stage of calibration weighting which matched weighted totals for the survey data to the NRS 2023 private household population estimates for Health Boards, age/sex distribution at Scotland level and age/sex distribution for the Glasgow and Greater Clyde Health Board shown in the tables below.

Table 6: NRS 2023 Private household population estimates by Health Board

Health Board

Adults

Children

Total

Ayrshire & Arran

 304,361

 58,086

 362,447

Borders

 97,781

 17,877

 115,658

Dumfries & Galloway

 122,259

 21,826

 144,085

Fife

 303,535

 61,221

 364,756

Forth Valley

 248,014

 49,941

 297,955

Grampian

 473,415

 98,770

 572,185

Greater Glasgow & Clyde

 977,745

 194,165

1,171,910

Highland

 267,662

 49,073

 316,735

Lanarkshire

 553,338

 115,905

 669,243

Lothian

 744,075

 148,572

 892,647

Orkney

 18,371

 3,422

 21,793

Shetland

 18,910

 4,021

 22,931

Tayside

 341,825

 65,855

 407,680

Western Isles

 21,890

 3,849

 25,739

Total

4,493,181

892,583

5,385,764

Table 7: NRS 2023 Private household population estimates by SIMD Quintile

SIMD Quintile

Total population

1 – 20% most deprived data zones

1,052,396

2

1,046,793

3

1,055,959

4

1,152,570

5 – 20% least deprived data zones

1,078,046

Total

5,385,764

Table 8: NRS 2023 Mid-year population estimates for children (0-15) and NRS 2023 private household population estimates for adults (16+) by age group

Age group

Male

Female

Total

0-4

126,658

120,213

246,871

5-9

143,956

136,301

280,257

10-15

186,615

178,840

365,455

16-24

 265,724

 266,103

 531,827

25-34

 338,005

 358,251

 696,256

35-44

 339,786

 361,436

 701,222

45-54

 334,826

 358,667

 693,493

55-64

 379,499

 404,620

 784,119

65-74

 286,874

 312,507

 599,381

75+

 212,192

 274,691

 486,883

Total

2,614,135

 2,771,629

5,385,764

Biological module weights

A similar process was applied to derive the weights for the biological module. The steps are outlined below.

1. Address selection weight (bw1)

New address selection weights were calculated using the same process as described for w1.

2. Dwelling unit (w2) and household selection weights (w3)

The dwelling unit and household selection weights from the main adult weight were applied as above.

3. Calibrated household weight (bw4)

The three selection weights were combined (bw1*w2*w3) and applied to the survey data before the household calibration was run so that survey data matched the population totals for Health Boards, Scotland-level age/sex breakdowns, and the population within each SIMD Quintile.

4. Adjustment for biological module selection (bw5)

33% of the main sample was allocated to the biological module. To incorporate this probability of selection, a correction was applied to the calibrated household weight (bw4). The correction was:

The adjustment for the biological module selection is calculated by dividing the number of PAF addresses in the stratum by the stratum selected addresses for the biological module and dividing the result by the calibrated household weight.

5. Application of adult non-response (w5)

For within household non-response, the non-response weight (w5) calculated for all households was also applicable for the biological module.

6. Non-response weight for biological module interview

Not all adults who responded to the main section of the interview responded to the biological module. Information collected for

the respondent in the main interview and household interview was used to calculate the likelihood of responding to the biological module and was modelled with logistic regression.

The following variables were considered for inclusion in the model:

  • Health Board
  • Age/sex
  • Number of adults in the household
  • Employment status of household reference person
  • Presence of a smoker in the household
  • Marital status
  • Tenure
  • Urban/rural classification
  • Access to a car
  • Located within SIMD15 area
  • Frequency of eating meals together
  • Self-assessed health
  • Days in typical week done activities that develop or maintain strength in muscles
  • Whether do any vigorous-intensity sports, fitness or leisure activities (10 mins+)
  • Whether has longstanding illness
  • Highest achieved qualification
  • Economic activity (including if retired)
  • Ever had high blood pressure

  • Whether smokes cigarettes or drinks nowadays

  • Whether drinks nowadays

  • Number of natural teeth

  • Physical barriers to entry

  • Whether in employment

  • Whether retired

  • Whether unable to work

Through running backwards and forwards selection procedures for the logistic regression the following variables were included in the final model:

  • Health Board
  • Age/sex
  • Number of adults in the household
  • Located within SIMD15 area
  • Employment status of household reference person
  • Frequency of eating meals together
  • Access to a car
  • Days in typical week done activities that develop or maintain strength in muscles
  • Whether do any vigorous-intensity sports, fitness or leisure activities (10 mins+)
  • Whether drinks nowadays
  • Physical barriers to entry

  • Whether retired

The final logistic regression model was then used to calculate the probability of response for all individuals that did respond. The adult non-response weight (w5) was then calculated as the reciprocal of this probability:

The non-response weight for biological module interview is calculated by dividing 1 by the probability of individual’s response to the biological module.

The top 1% of bw6 was trimmed.

7. Final calibration for biological module (bio25wt)

The household (bw4), biological sample correction (bw5) and adult non-response (w5), and biological non-response (bw6) weights were combined (bw4*bw5*w5*bw6) and applied to the survey data.

For the final stage of biological module weighting, the weighted totals for the survey data were calibrated to match the NRS 2023 private household population estimates for Health Boards and age/sex distribution at Scotland level. However, due to the low sample size for the module several categories had to be collapsed. In terms of Health Boards, all areas except for Grampian, Greater Glasgow and Clyde, Lanarkshire and Lothian were grouped together. For the age groups, the youngest two age groups were combined.

Adult version A weights

A weight titled “Version A” was calculated for the adult respondents in the main sample that were not selected for the biological module. These weights are for analysis of questions included in the version A rotating module which are only asked of respondents in households not selected for the biological module. The following steps were followed to derive the weight:

1. Address selection weight (bw1)

As derived in the first step of the biological module weight.

2. Dwelling unit (w2) and household selection weights (w3)

The dwelling unit and household selection weights from the main adult weight were applied as above.

3. Calibrated household weight (bw4)

As derived for the biological module.

4. Adult non-response weight (w5)

For within household non-response, the non-response weight (w5) calculated for all households was also applicable for the biological module.

5. Final calibration for Version A weight (vera25wt)

The household (bw4) and adult non-response (w5) weights were combined (bw4*w5) and applied to the survey data. As was the case with the main adult weight and biological module weight, the weighted totals for the survey data were calibrated to match the NRS 2023 mid-year population estimates for private households for Health Boards, age/sex distribution at Scotland level.

Overall child weights

An overall child weight was derived for child responses from the main sample and from the child boost combined. Separate logistic regression non-response weights were not required for the child samples as the response rate for children within cooperating households was sufficiently high. The weighting steps are shown below. Steps (1) and (2) followed the same process as described in 1.7.2 above.

1. Address selection weight for main sample and child boost combined (cw1)

2. Dwelling unit (cw2) and household (cw3) selection weights

3. Selection of children within each household (cw4)

A maximum of two children were eligible for interview in each household. To ensure that children in larger households were not under-represented in the final sample the following child selection weight was calculated for households with more than two children to compensate for the probability of selection:

The  child selection weight is calculated by dividing the number of children in the household by 2.

For households with two or fewer children cw4=1.

4. Calibration for child interview weight (cint25wt)

The address selection (cw1), dwelling unit (cw2), household (cw3) and child selection weights (cw4) were combined (cw1*cw2*cw3*cw4) and applied to the survey data. The weighted totals for the survey data were calibrated to match the NRS 2023 private household population estimates for Health Boards and NRS 2023 mid-year population estimates for age/sex distribution at Scotland level.

Child version A weights

A weight was calculated for the child respondents in the main sample in households allocated to the version A sample. These weights are for analysis of questions included in the version A rotating module (cvera25wt).

Child main sample weights

Weights were also created specifically for within household analysis, comparing children’s characteristics with those of their parents. As data was only collected with respect to both children and adults in the main sample, these weights were only created for children at main sample addresses. They were created in a similar fashion to that described for the whole of the overall child weights (cmint25wt).

Weight name

Purpose of weight

int25wt

For analysis of 2025 adult data

bio25wt

For analysis of 2025 biological module data

vera25wt

For analysis of 2025 version A adult module data

cint25wt

For analysis of 2025 child data

cvera25wt

For analysis of 2025 version A child module data

cmint25wt

For analysis of 2025 combined child data core sample only (for within household analysis)

Combined weights

A number of different combinations of annual sweeps have been produced to allow the analysis of combined datasets.

Weight name

Purpose of combined weight

int22232425wt

For analysis of 2022, 2023 2024 and 2025 combined adult data

intsc22232425wt

For analysis of 2022, 2023 2024 and 2025 combined adult self-completion data due to lower response to the online self-completion surveys in 2023. See the 2023 technical report chapter 1 for more information.

cint22232425wt

For analysis of 2022, 2023 2024 and 2025 combined child data

cmint22232425wt

For analysis of 2022, 2023 2024 and 2025 combined child data core sample only (for within household analysis)

bio22232425wt

For analysis of 2022, 2023,2024 and 2025 combined depression, anxiety, suicide and self-harm data

biophy22232425wt

For analysis of 2022, 2023, 2024 and 2025 combined bio measurements (blood pressure, hypertension, waist circumference and saliva). Created to account for reduced bio samples taken in 2022 during recovery of the interviewer panel following the pandemic. See the 2022 technical report for more information.

int2325wt

 

For analysis of 2023 and 2025 combined adult data

intsc2325wt

 

For analysis of 2023 and 2025 combined adult self-completion data due to lower response to the online self-completion surveys in 2023. See the 2023 technical report chapter 1 for more information.

vera2325wt

For analysis of 2023 and 2025 combined version A adult module data

cint2325wt

 

For analysis of 2023 and 2025 combined child data

cmint2325wt

 

For analysis 2023 and 2025 combined child data core sample only (for within household analysis)

cvera2325wt

For analysis of 2023 and 2025 combined version A child module data

int2425wt

For analysis of 2024 and 2025 combined adult data

bio2425t

For analysis of 2024 and 2025 combined depression, anxiety, suicide and self-harm data

cint2425wt

For analysis of 2024 and 2025 combined child data

cmint2425wt

For analysis of 2024 and 2025 combined child data core sample only (for within household analysis)

In each case, the calculation of the weights followed the same procedure. The pre-calibration weights which had already been calculated for the individual years (which take into account selection weighting and (except for the child weights) non-response weighting) were combined and calibrated to Health Board and age/sex 2023 population totals for private households.

When combining years, the contribution of each survey year was aligned with its respective sample size. This means years with larger samples have more influence on the final multi-year weights, while years with smaller samples have less influence, rather than treating all samples as if they were the same size.

Note, for the cvera weights in the combined year datasets from 2016/2018 to 2018/2022, the contribution of each survey year was aligned with the respective sample sizes of the full child sample. From the 2021/2023 combined datasets onwards, the respective sample sizes of the child version A sample were used. 

References and notes

[1]    A report on the development of the weighting procedures is available at:  https://webarchive.nrscotland.gov.uk/public/20190712224240/https://www2.gov.scot/Resource/0038/00385941.doc  

 

Contact

scottishhealthsurvey@gov.scot

Back to top