The Scottish Health Survey 2025 - Volume 2: Technical Report
This publication presents information on the methodology and fieldwork from the Scottish Health Survey 2025.
1.7 Weighting the data
Introduction
This section presents information on the weighting procedures applied to the survey data. Since 2012, the weighting for SHeS has been undertaken by the Scottish Government. The procedures for the implementation of the weighting methodology were developed by the Scottish Government working with the Methodology Advisory Service at the Office for National Statistics[1].
To undertake the calibration weighting, the ReGenesees Package for R was used. Within this, to execute the calibration, a raking function was implemented.
Main adult weights
The main adult weight is applicable to analysis of questions asked of all adults. There were six steps to calculating the overall adult weights. These were as follows:
1. Address selection weights (w1)
The address selection weights were calculated to compensate for unequal probabilities of selection of addresses in different survey strata. For the main sample, there were 32 strata (one for each local authority).
2. Dwelling unit selection weights (w2)
The Multiple Occupancy Indicator (MOI) for the PAF was used to ensure that if there were multiple dwelling units at a single address point then they would have the same selection probability as individual addresses. However, there are likely to have been some cases where the MOI was incorrect. The following correction was applied where this was the case:
W2 was trimmed to a minimum of 0.67 and a maximum of 3.
3. Household selection weights (w3)
Similarly to w2, within a very small number of dwelling units, fieldworkers usually find multiple households, of which only one is selected for participation. The following correction was applied for multiple households:
W3 was trimmed to a maximum of 3.
4. Calibrated household weights (w4)
The three selection weights were combined (w1*w2*w3) before the household calibration stage. This combined weight was applied to the survey data to act as entry weights for the calibration. The execution of the calibration step then modified the entry weights so that the weighted total of all members of responding households matched the population totals for Health Boards, Scotland-level population totals for age/sex breakdown, and the population within each SIMD quintile. The population totals that were used were the National Records of Scotland’s (NRS) 2023 private household population estimates.
5. Adult non-response weights (w5)
All adults within selected households were eligible for interview, but within responding households not all individuals completed an interview. The profiles of household members that did not complete the interview were different from those that did. Information on all individuals within responding households was available through information gathered as part of the household interview. This allowed the differential response rates for individuals within households to be modelled using logistic regression to calculate a probability of responding based on their profiles. The logistic regression was only applicable for households containing more than one adult since households consisting of only one adult either responded to the household and individual interviews or did not respond at all.
The following variables were considered for inclusion in the model:
- Health Board
- Age/sex
- Number of adults in the household
- Employment status of household reference person
- Presence of a smoker in the household
- Marital status
- Tenure
- Urban/rural classification
- Access to a car
- Located within SIMD15 area
- Frequency of eating meals together
- SIMD quintile
Through running backwards and forwards selection procedures for the logistic regression the following variables were included in the final model:
- Health Board
- Age/sex
- Number of adults in the household
- Marital status
- Tenure
- Access to a car
- Frequency of eating meals together
The final logistic regression model was then used to calculate the probability of response for all individuals that did respond. The adult non-response weight (w5) was then calculated as the reciprocal of this probability:
W5 was trimmed to a maximum of 4. For households of only one adult, the non-response weight was one.
6. Individual calibration and final adult weight (int25wt)
The household (w4) and non-response (w5) were combined (w4*w5) and applied to the survey data prior to the final stage of calibration weighting which matched weighted totals for the survey data to the NRS 2023 private household population estimates for Health Boards, age/sex distribution at Scotland level and age/sex distribution for the Glasgow and Greater Clyde Health Board shown in the tables below.
Table 6: NRS 2023 Private household population estimates by Health Board
|
Health Board |
Adults |
Children |
Total |
|
Ayrshire & Arran |
304,361 |
58,086 |
362,447 |
|
Borders |
97,781 |
17,877 |
115,658 |
|
Dumfries & Galloway |
122,259 |
21,826 |
144,085 |
|
Fife |
303,535 |
61,221 |
364,756 |
|
Forth Valley |
248,014 |
49,941 |
297,955 |
|
Grampian |
473,415 |
98,770 |
572,185 |
|
Greater Glasgow & Clyde |
977,745 |
194,165 |
1,171,910 |
|
Highland |
267,662 |
49,073 |
316,735 |
|
Lanarkshire |
553,338 |
115,905 |
669,243 |
|
Lothian |
744,075 |
148,572 |
892,647 |
|
Orkney |
18,371 |
3,422 |
21,793 |
|
Shetland |
18,910 |
4,021 |
22,931 |
|
Tayside |
341,825 |
65,855 |
407,680 |
|
Western Isles |
21,890 |
3,849 |
25,739 |
|
Total |
4,493,181 |
892,583 |
5,385,764 |
Table 7: NRS 2023 Private household population estimates by SIMD Quintile
|
SIMD Quintile |
Total population |
|
1 – 20% most deprived data zones |
1,052,396 |
|
2 |
1,046,793 |
|
3 |
1,055,959 |
|
4 |
1,152,570 |
|
5 – 20% least deprived data zones |
1,078,046 |
|
Total |
5,385,764 |
Table 8: NRS 2023 Mid-year population estimates for children (0-15) and NRS 2023 private household population estimates for adults (16+) by age group
|
Age group |
Male |
Female |
Total |
|
0-4 |
126,658 |
120,213 |
246,871 |
|
5-9 |
143,956 |
136,301 |
280,257 |
|
10-15 |
186,615 |
178,840 |
365,455 |
|
16-24 |
265,724 |
266,103 |
531,827 |
|
25-34 |
338,005 |
358,251 |
696,256 |
|
35-44 |
339,786 |
361,436 |
701,222 |
|
45-54 |
334,826 |
358,667 |
693,493 |
|
55-64 |
379,499 |
404,620 |
784,119 |
|
65-74 |
286,874 |
312,507 |
599,381 |
|
75+ |
212,192 |
274,691 |
486,883 |
|
Total |
2,614,135 |
2,771,629 |
5,385,764 |
Biological module weights
A similar process was applied to derive the weights for the biological module. The steps are outlined below.
1. Address selection weight (bw1)
New address selection weights were calculated using the same process as described for w1.
2. Dwelling unit (w2) and household selection weights (w3)
The dwelling unit and household selection weights from the main adult weight were applied as above.
3. Calibrated household weight (bw4)
The three selection weights were combined (bw1*w2*w3) and applied to the survey data before the household calibration was run so that survey data matched the population totals for Health Boards, Scotland-level age/sex breakdowns, and the population within each SIMD Quintile.
4. Adjustment for biological module selection (bw5)
33% of the main sample was allocated to the biological module. To incorporate this probability of selection, a correction was applied to the calibrated household weight (bw4). The correction was:
5. Application of adult non-response (w5)
For within household non-response, the non-response weight (w5) calculated for all households was also applicable for the biological module.
6. Non-response weight for biological module interview
Not all adults who responded to the main section of the interview responded to the biological module. Information collected for
the respondent in the main interview and household interview was used to calculate the likelihood of responding to the biological module and was modelled with logistic regression.
The following variables were considered for inclusion in the model:
- Health Board
- Age/sex
- Number of adults in the household
- Employment status of household reference person
- Presence of a smoker in the household
- Marital status
- Tenure
- Urban/rural classification
- Access to a car
- Located within SIMD15 area
- Frequency of eating meals together
- Self-assessed health
- Days in typical week done activities that develop or maintain strength in muscles
- Whether do any vigorous-intensity sports, fitness or leisure activities (10 mins+)
- Whether has longstanding illness
- Highest achieved qualification
- Economic activity (including if retired)
-
Ever had high blood pressure
-
Whether smokes cigarettes or drinks nowadays
-
Whether drinks nowadays
-
Number of natural teeth
-
Physical barriers to entry
-
Whether in employment
-
Whether retired
-
Whether unable to work
Through running backwards and forwards selection procedures for the logistic regression the following variables were included in the final model:
- Health Board
- Age/sex
- Number of adults in the household
- Located within SIMD15 area
- Employment status of household reference person
- Frequency of eating meals together
- Access to a car
- Days in typical week done activities that develop or maintain strength in muscles
- Whether do any vigorous-intensity sports, fitness or leisure activities (10 mins+)
- Whether drinks nowadays
-
Physical barriers to entry
-
Whether retired
The final logistic regression model was then used to calculate the probability of response for all individuals that did respond. The adult non-response weight (w5) was then calculated as the reciprocal of this probability:
The top 1% of bw6 was trimmed.
7. Final calibration for biological module (bio25wt)
The household (bw4), biological sample correction (bw5) and adult non-response (w5), and biological non-response (bw6) weights were combined (bw4*bw5*w5*bw6) and applied to the survey data.
For the final stage of biological module weighting, the weighted totals for the survey data were calibrated to match the NRS 2023 private household population estimates for Health Boards and age/sex distribution at Scotland level. However, due to the low sample size for the module several categories had to be collapsed. In terms of Health Boards, all areas except for Grampian, Greater Glasgow and Clyde, Lanarkshire and Lothian were grouped together. For the age groups, the youngest two age groups were combined.
Adult version A weights
A weight titled “Version A” was calculated for the adult respondents in the main sample that were not selected for the biological module. These weights are for analysis of questions included in the version A rotating module which are only asked of respondents in households not selected for the biological module. The following steps were followed to derive the weight:
1. Address selection weight (bw1)
As derived in the first step of the biological module weight.
2. Dwelling unit (w2) and household selection weights (w3)
The dwelling unit and household selection weights from the main adult weight were applied as above.
3. Calibrated household weight (bw4)
As derived for the biological module.
4. Adult non-response weight (w5)
For within household non-response, the non-response weight (w5) calculated for all households was also applicable for the biological module.
5. Final calibration for Version A weight (vera25wt)
The household (bw4) and adult non-response (w5) weights were combined (bw4*w5) and applied to the survey data. As was the case with the main adult weight and biological module weight, the weighted totals for the survey data were calibrated to match the NRS 2023 mid-year population estimates for private households for Health Boards, age/sex distribution at Scotland level.
Overall child weights
An overall child weight was derived for child responses from the main sample and from the child boost combined. Separate logistic regression non-response weights were not required for the child samples as the response rate for children within cooperating households was sufficiently high. The weighting steps are shown below. Steps (1) and (2) followed the same process as described in 1.7.2 above.
1. Address selection weight for main sample and child boost combined (cw1)
2. Dwelling unit (cw2) and household (cw3) selection weights
3. Selection of children within each household (cw4)
A maximum of two children were eligible for interview in each household. To ensure that children in larger households were not under-represented in the final sample the following child selection weight was calculated for households with more than two children to compensate for the probability of selection:
For households with two or fewer children cw4=1.
4. Calibration for child interview weight (cint25wt)
The address selection (cw1), dwelling unit (cw2), household (cw3) and child selection weights (cw4) were combined (cw1*cw2*cw3*cw4) and applied to the survey data. The weighted totals for the survey data were calibrated to match the NRS 2023 private household population estimates for Health Boards and NRS 2023 mid-year population estimates for age/sex distribution at Scotland level.
Child version A weights
A weight was calculated for the child respondents in the main sample in households allocated to the version A sample. These weights are for analysis of questions included in the version A rotating module (cvera25wt).
Child main sample weights
Weights were also created specifically for within household analysis, comparing children’s characteristics with those of their parents. As data was only collected with respect to both children and adults in the main sample, these weights were only created for children at main sample addresses. They were created in a similar fashion to that described for the whole of the overall child weights (cmint25wt).
|
Weight name |
Purpose of weight |
|
int25wt |
For analysis of 2025 adult data |
|
bio25wt |
For analysis of 2025 biological module data |
|
vera25wt |
For analysis of 2025 version A adult module data |
|
cint25wt |
For analysis of 2025 child data |
|
cvera25wt |
For analysis of 2025 version A child module data |
|
cmint25wt |
For analysis of 2025 combined child data core sample only (for within household analysis) |
Combined weights
A number of different combinations of annual sweeps have been produced to allow the analysis of combined datasets.
|
Weight name |
Purpose of combined weight |
|
int22232425wt |
For analysis of 2022, 2023 2024 and 2025 combined adult data |
|
intsc22232425wt |
For analysis of 2022, 2023 2024 and 2025 combined adult self-completion data due to lower response to the online self-completion surveys in 2023. See the 2023 technical report chapter 1 for more information. |
|
cint22232425wt |
For analysis of 2022, 2023 2024 and 2025 combined child data |
|
cmint22232425wt |
For analysis of 2022, 2023 2024 and 2025 combined child data core sample only (for within household analysis) |
|
bio22232425wt |
For analysis of 2022, 2023,2024 and 2025 combined depression, anxiety, suicide and self-harm data |
|
biophy22232425wt |
For analysis of 2022, 2023, 2024 and 2025 combined bio measurements (blood pressure, hypertension, waist circumference and saliva). Created to account for reduced bio samples taken in 2022 during recovery of the interviewer panel following the pandemic. See the 2022 technical report for more information. |
|
int2325wt
|
For analysis of 2023 and 2025 combined adult data |
|
intsc2325wt
|
For analysis of 2023 and 2025 combined adult self-completion data due to lower response to the online self-completion surveys in 2023. See the 2023 technical report chapter 1 for more information. |
|
vera2325wt |
For analysis of 2023 and 2025 combined version A adult module data |
|
cint2325wt
|
For analysis of 2023 and 2025 combined child data |
|
cmint2325wt
|
For analysis 2023 and 2025 combined child data core sample only (for within household analysis) |
|
cvera2325wt |
For analysis of 2023 and 2025 combined version A child module data |
|
int2425wt |
For analysis of 2024 and 2025 combined adult data |
|
bio2425t |
For analysis of 2024 and 2025 combined depression, anxiety, suicide and self-harm data |
|
cint2425wt |
For analysis of 2024 and 2025 combined child data |
|
cmint2425wt |
For analysis of 2024 and 2025 combined child data core sample only (for within household analysis) |
In each case, the calculation of the weights followed the same procedure. The pre-calibration weights which had already been calculated for the individual years (which take into account selection weighting and (except for the child weights) non-response weighting) were combined and calibrated to Health Board and age/sex 2023 population totals for private households.
When combining years, the contribution of each survey year was aligned with its respective sample size. This means years with larger samples have more influence on the final multi-year weights, while years with smaller samples have less influence, rather than treating all samples as if they were the same size.
Note, for the cvera weights in the combined year datasets from 2016/2018 to 2018/2022, the contribution of each survey year was aligned with the respective sample sizes of the full child sample. From the 2021/2023 combined datasets onwards, the respective sample sizes of the child version A sample were used.
References and notes
[1] A report on the development of the weighting procedures is available at: https://webarchive.nrscotland.gov.uk/public/20190712224240/https://www2.gov.scot/Resource/0038/00385941.doc
Contact
scottishhealthsurvey@gov.scot