Publication - Statistics

Scottish Household Survey income analysis

Published: 20 Nov 2020

This report is the result of a project that assessed in detail how accurately the Scottish Household Survey (SHS) measures household income. To this end, we compared SHS data to data from the Households Below Average Income (HBAI) dataset, the “gold standard” for estimating household income data in the UK.

Published:
20 Nov 2020
Scottish Household Survey income analysis

The comparison showed that SHS-based income estimates are accurate enough to determine whether a household is in poverty (before housing costs). 
We therefore plan to include a poverty flag in the SHS dataset, enabling SHS data users to produce poverty breakdowns of any SHS-based measure of interest.

Key results

  1. The SHS income variable compares reasonably well with HBAI income, and produces very good income estimates considering the wide remit of the survey.
  2. However, benefit payments are underreported in the SHS, which affects those households most for whom benefits are the main income source. That includes most pensioner households, as the state pension is a major income source for most of them. Other economically inactive and unemployed households are also affected by benefit underreporting.
  3. Average self-employed earnings are much higher in the SHS compared to the HBAI. Further work is required to unpick the reasons for this.
  4. The SHS income variable produces reliable before housing costs (BHC) poverty estimates for children and working-age adults, although care needs to be taken when looking specifically at economically inactive or self-employed households.
  5. Pensioners’ incomes in the SHS are not reported accurately enough to provide robust poverty estimates. Work is now underway to impute state pension and thereby improve pensioners’ incomes estimates. Until this has been done we recommend to exclude pensioners from any SHS-based income and poverty analysis.
  6. SHS-based income and poverty estimates differ from Official Statistics and can therefore not be compared directly; this needs to be highlighted and differences explained in any publications using this data.
  7. Guidance is required, explaining when to use which data source. Official Statistics (which are based on HBAI data) and administrative local poverty data, where available, are a better choice than any SHS-based poverty estimates. This guidance is provided in the Guidance section of the report.
  8. It is possible to produce SHS-based regional poverty breakdowns where sample sizes allow, although these would be subject to fairly large measurement uncertainty. We instead recommend to use administrative data (see footnote) for regional poverty estimates.
  9. The members of the Quality Assurance group found that the income analysis undertaken was thorough, they considered the findings plausible, and agreed with the conclusions. They made a number of comments relating to how the SHS income data could be improved using imputation (state pension, council tax, disability benefits) and the suggestion to allow negative self-employed earnings responses in the SHS, consistent with HBAI.