Understanding survey nonresponse behaviours: evidence and practical solutions
This report summarises key findings from research to extend understanding of the challenges posed by nonresponse and nonresponse bias in the Scottish Government's general population surveys, and identifies potential solutions.
Glossary of key terms
Behavioural science: Behavioural science applies theories and techniques from a range of academic disciplines to better understand why people display particular behaviours and what interventions might be effective in changing them.
COM-B: a model of behaviour change, COM-B identifies three key components which, in combination, drive individual behaviours:
- Capability: having the knowledge, skills and ability to engage in a behaviour.
- Opportunity: the physical and social external factors that make the behaviour possible.
- Motivation: the internal processes influencing decisions.
Cross-sectional survey: A survey of a representative sample of a defined population at a specific single point in time, or from samples of the same population at repeated points in time.
General population survey: A type of survey designed to collect data from a sample that is representative of an entire population, such as the population of Scotland.
Nonresponse bias: The bias that occurs when sample units (e.g. individuals, households) who do not respond to a survey differ in meaningful ways from those who do respond. Non-response bias means that certain types of people are underrepresented and the accuracy and generalisability of findings may be negatively affected.
Postcode Address File (PAF): A database of known postcodes in the United Kingdom, managed by Royal Mail. It is used as a sample frame for some UK surveys, including the Scottish Household Survey, Scottish Crime and Justice Survey and Scottish Health Survey.
Response rate: The number of sample units (people, households, etc.) who respond to a survey compared to the total number of people who were asked to respond (and who were eligible to do so). The exact calculation for determining response rates varies, depending on how partial interviews and cases of unknown eligibility are treated (see AAPOR response rates, above).
Respondent Centred Design (RCD): A survey design approach that places respondent experience, preferences and needs at the centre. The approach considers aspects of surveys such as ease of use, relevance, and participant feedback mechanisms.
Survey mode: The way in which survey data is collected, e.g. face-to-face, telephone, web/online.
Total Survey Error (TSE) framework: The generally accepted approach for assessing survey quality used by survey methodologists. The TSE approach methodically identifies all possible errors which can arise at each stage of the survey process.
Contact
Email: surveystrategy@gov.scot