Fair Start Scotland evaluation report 2: participant phone survey - November 2019

Part of a series on the evaluation of Fair Start Scotland employability services. It presents more detailed findings from a representative telephone survey of FSS participants and explores their experiences in the first year of service delivery (Apr 18 to Mar 19).


Appendix 1

Appendix A: Methodology

The Fair Start Scotland (FSS) Wave 1 telephone survey was carried out in June 2019, on a sample drawn from all beneficiaries who took part in FSS from its commencement in March 2018 until the end of December 2018.

IFF were provided with sample consisting of all starts on the FSS service during this period. Following data cleaning, a total of 6,780 records were available, of which 6,044 had a valid telephone number and address. From those with full contact details, 3,175 pieces of sample were drawn. Sample was drawn in proportion with the distribution of participants by lot, with Lot 8 (Highlands & Islands) slightly oversampled to ensure a minimum base for subgroup analysis of this region. Table 1.1 below shows the number of records drawn and the number of surveys achieved from each lot.

Table 1.1: Sample drawn and surveys completed per Lot

Lot All sample Sample drawn Unweighted responses Weighted responses
N % N % N % N %
Lot 1 Glasgow 1289 19.0% 597 18.8% 176 17.5% 191 19.0%
Lot 2 Lanarkshire 1262 18.6% 584 18.4% 174 17.3% 187 18.6%
Lot 3 Tayside 740 10.9% 346 10.9% 99 9.9% 110 10.9%
Lot 4 Forth Valley 551 8.1% 257 8.1% 83 8.3% 81 8.1%
Lot 5 East 1102 16.3% 514 16.2% 184 18.3% 164 16.3%
Lot 6 South West 636 9.4% 295 9.3% 93 9.3% 94 9.4%
Lot 7 North East 393 5.8% 181 5.7% 55 5.5% 58 5.8%
Lot 8 Highlands and Islands 291 4.3% 159 5.0% 60 6.0% 43 4.3%
Lot 9 West 516 7.6% 241 7.6% 81 8.1% 76 7.6%
Total 6780 100% 3175 100% 1,005 100% 1,005 100%

Participants were sent an advance letter two weeks prior to fieldwork to notify them of the research and offer them the opportunity to decline to take part. Telephone fieldwork was conducted between 3rd June and 28th June, and 1,005 completed interviews were achieved. A full breakdown of sample outcomes is shown in Table 1.2.

Table 1.2: Sample outcomes

Number Proportion of starting sample (%)
Total sample 3,175 100%
Opt outs 47 1.5%
Unusable (for example, wrong number) 159 5.0%
Contact attempted, no final outcome after minimum number of attempts 1696 53.4%
Refusal 266 8.4%
Respondent stopped or screened out during survey 2 0.1%
Total surveys completed 1,005 31.7%

The survey was 20 minutes in length. The data was checked, tabulated and verbatim responses were fully coded for analysis purposes. A rim weight (based on age, gender and lot) was applied to bring the oversampled Lot 8 back in line with population proportions and to correct for any non-response bias. Tables 1.3 and 1.4 show a breakdown of the profile of respondents by Lot, after weighting had been applied.

Table 1.3: Profile of survey respondents in each Lot, by gender and age (weighted data)

Total Gender Age
  Unweighted Weighted Male Female 16-34 35-49 50+
Total 1005 1005 654 65% 351 35% 385 38% 313 31% 308 31%
Lot 1 Glasgow 176 191 118 62% 73 38% 77 41% 53 28% 61 32%
Lot 2 Lanarkshire 174 187 126 67% 61 33% 74 39% 58 31% 55 29%
Lot 3 Tayside 99 110 74 67% 36 33% 47 43% 25 23% 37 34%
Lot 4 Forth Valley 83 81 44 54% 37 46% 31 38% 24 30% 27 33%
Lot 5 East 184 164 114 69% 50 31% 49 30% 60 36% 56 34%
Lot 6 South West 93 94 58 62% 36 38% 34 36% 37 39% 24 26%
Lot 7 North East 55 58 43 73% 16 27% 23 40% 21 37% 14 24%
Lot 8 Highlands and Islands 60 43 30 69% 13 31% 15 34% 13 31% 15 35%
Lot 9 West 81 76 49 64% 27 36% 36 47% 22 28% 19 24%

Table 1.4: Profile of survey respondents in each Lot, by qualifications, employment history and health (weighted data)

Total Qualifications Employment history Health limits day-to-day activities
  Unweighted Weighted None National 1-5 or equivalent (Advanced) Highers or equivalent Degree or above Worked in the last 5 years Not worked in the last 5 years Has condition, impacts activities Has condition, no limitations No condition
Total 1005 1005 143 14% 384 38% 190 19% 131 13% 616 61% 381 38% 603 60% 129 13% 254 25%
Lot 1 Glasgow 176 191 27 14% 79 42% 27 14% 35 19% 114 60% 77 40% 82 43% 14 7% 92 48%
Lot 2 Lanarkshire 174 187 23 12% 69 37% 39 21% 20 11% 103 55% 80 43% 122 65% 22 12% 40 21%
Lot 3 Tayside 99 110 12 11% 49 44% 27 24% 8 7% 77 70% 33 30% 90 82% 9 8% 8 7%
Lot 4 Forth Valley 83 81 14 18% 32 39% 16 19% 10 12% 43 53% 38 47% 57 70% 10 12% 14 17%
Lot 5 East 184 164 28 17% 57 35% 28 17% 22 13% 106 65% 56 34% 100 61% 19 12% 42 26%
Lot 6 South West 93 94 15 16% 34 36% 19 21% 10 11% 52 55% 42 44% 55 58% 15 16% 23 25%
Lot 7 North East 55 58 9 15% 22 38% 9 16% 8 14% 42 72% 15 26% 32 55% 14 25% 12 21%
Lot 8 Highlands and Islands 60 43 8 18% 13 30% 7 17% 5 12% 29 67% 14 32% 25 57% 4 10% 14 32%
Lot 9 West 81 76 7 9% 29 38% 16 21% 13 17% 50 65% 27 35% 42 55% 22 28% 8 11%

Contact

Email: kirstie.corbett@gov.scot

Back to top