Fair Start Scotland: evaluation report 4 - participant phone survey - year 3

Part of a series of reports on the evaluation of Fair Start Scotland (FSS) employability services. The report presents more detailed findings from a representative telephone survey of FSS participants and explores their experiences in the third year of delivery


Technical Appendix

The Fair Start Scotland (FSS) Wave 3 telephone survey was carried out in April 2021. The sample was made up of two distinct groups:

New sample of participants who joined the FSS service in 2020 (between January 2020 and December 2020). IFF were provided with a sample of 10,464 participants, from which 2,364 were drawn for the survey.

Longitudinal sample, also made up of two groups: those who joined the FSS service in 2018 (between April and December 2018) and took part in the Wave 1 and Wave 2 surveys; and those who joined the FSS service in 2019 (between January and December 2019) and took part in the Wave 2 survey. All participants who took part in the Wave 2 survey and agreed to be contacted again for further research were included in the sample for Wave 3.

A total of 1,027 surveys were completed at Wave 3, made up of 663 from the new sample and 364 from the longitudinal sample, as shown in Table 1.

For the new sample, IFF were provided with data consisting of all starts on the FSS service during this period. From this, 2,364 pieces of sample were drawn. Sample was drawn in proportion with the distribution of participants by lot, with Lots 4, 7, 8 and 9 slightly oversampled to ensure a minimum base for subgroup analysis of this region.

The tables below show the number of records drawn and the number of surveys achieved from each lot.

Table 1 2020 cohort
Lot All sample Sample drawn Unweighted responses Weighted responses
  N % N % N % N %
Lot 1 Glasgow 1870 18 % 368 16 % 103 16 % 118 18 %
Lot 2 Lanarkshire 1297 12 % 254 11 % 71 11 % 82 12 %
Lot 3 Tayside 822 8 % 179 8 % 48 7 % 52 8 %
Lot 4 Forth Valley 328 3 % 179 8 % 51 8 % 21 3 %
Lot 5 East 2749 26 % 536 23 % 150 23 % 174 26 %
Lot 6 South West 1604 15 % 314 13 % 87 13 % 102 15 %
Lot 7 North East 625 6 % 179 8 % 51 8 % 40 6 %
Lot 8 Highlands and Islands 450 4 % 179 8 % 51 8 % 29 4 %
Lot 9 West 719 7 % 179 8 % 51 8 % 46 7 %
Total 10,464 100 % 2364 100 % 663 100 % 664 100 %
Table 2 2019 cohort
Lot Sample Unweighted responses Weighted responses
  N % N % N %
Lot 1 Glasgow 96 17 % 26 13 % 42 20 %
Lot 2 Lanarkshire 66 12 % 25 12 % 31 15 %
Lot 3 Tayside 44 8 % 10 5 % 20 10 %
Lot 4 Forth Valley 47 8 % 17 8 % 8 4 %
Lot 5 East 103 18 % 42 20 % 45 22 %
Lot 6 South West 68 12 % 25 12 % 29 14 %
Lot 7 North East 47 8 % 21 10 % 8 4 %
Lot 8 Highlands and Islands 47 8 % 18 9 % 9 4 %
Lot 9 West 52 9 % 21 10 % 14 7 %
Total 570 100 % 205 100 % 206 100 %

 

Table 3 2018 cohort
Lot Sample Unweighted responses Weighted responses
  N % N % N %
Lot 1 Glasgow 68 19 % 32 20 % 30 19 %
Lot 2 Lanarkshire 57 16 % 20 13 % 30 19 %
Lot 3 Tayside 29 8 % 11 7 % 17 11 %
Lot 4 Forth Valley 30 8 % 10 6 % 13 8 %
Lot 5 East 73 20 % 33 21 % 26 16 %
Lot 6 South West 36 10 % 17 11 % 15 9 %
Lot 7 North East 22 6 % 8 5 % 9 6 %
Lot 8 Highlands and Islands 20 5 % 11 7 % 7 4 %
Lot 9 West 31 8 % 17 11 % 12 8 %
Total 366 100 % 159 100 % 159 100 %

Participants were sent an advance letter two weeks prior to fieldwork to notify them of the research and offer them the opportunity to decline to take part. Telephone fieldwork was conducted between 22nd March and 16th April 2021, and 1,027 completed interviews were achieved. A full breakdown of sample outcomes are shown in Table 4 and Table 5.

Table 4 Wave 3 fresh sample outcomes (2020 cohort)
Number Proportion of starting sample ( per cent)
Total sample 2364 100 %
Opt outs 22 1 %
Unusable (for example, wrong number) 177 7 %
Contact attempted, no final outcome after minimum number of attempts 1253 53 %
Refusal 159 7 %
Respondent stopped or screened out during survey/other 90 4 %
Total surveys completed 663 28 %
Table 5 Wave 3 longitudinal sample outcomes (2018/2019 cohort)
Number Proportion of starting sample ( per cent)
Total sample 936 100 %
Opt outs 15 2 %
Unusable (for example, wrong number) 20 2 %
Contact attempted, no final outcome after minimum number of attempts 467 50 %
Refusal 53 6 %
Respondent stopped or screened out during survey/other 17 2 %
Total surveys completed 364 39 %

The survey included fewer questions for the longitudinal sample (2018 and 2019 cohorts) than the 2020 new sample. The average survey length for the 2018 and 2019 respondents was 11 minutes 32 seconds, and for the 2020 cohort respondents it was 21 minutes 30 seconds. The data was checked, tabulated and verbatim responses were fully coded for analysis purposes.

A rim weight based on age, gender and lot was applied to the 2020 cohort data to bring the oversampled Lots 4,7,8 and 9 back in line with population proportions of 2020 FSS starters, and to correct for any non-response bias.

A rim weight based on age, gender, lot and employment status was also applied to the 2018 and 2019 cohort data to correct for any non-response bias. This brought the 2018 cohort in line with the Wave 1 weighted data, which reflected population proportions of 2018 FSS starters, and brought the 2019 cohort in line with the Wave 2 weighted data which reflected the proportion of 2019 starters.

Table 6 Wave 1: 2018 cohort: Profile of respondents in each Lot, by gender and age (weighted data)
Total Gender Age
Unweighted Weighted Male Female 16-34 35-49 50+
Total 1005 1005 654 65 % 351 35 % 385 38 % 313 31 % 308 31 %
Lot 1 Glasgow 176 191 118 62 % 73 38 % 77 41 % 53 28 % 61 32 %
Lot 2 Lanarkshire 174 187 126 67 % 61 33 % 74 39 % 58 31 % 55 29 %
Lot 3 Tayside 99 110 74 67 % 36 33 % 47 43 % 25 23 % 37 34 %
Lot 4 Forth Valley 83 81 44 54 % 37 46 % 31 38 % 24 30 % 27 33 %
Lot 5 East 184 164 114 69 % 50 31 % 49 30 % 60 36 % 56 34 %
Lot 6 South West 93 94 58 62 % 36 38 % 34 36 % 37 39 % 24 26 %
Lot 7 North East 55 58 43 73 % 16 27 % 23 40 % 21 37 % 14 24 %
Lot 8 Highlands and Islands 60 43 30 69 % 13 31 % 15 34 % 13 31 % 15 35 %
Lot 9 West 81 76 49 64 % 27 36 % 36 47 % 22 28 % 19 24 %
Table 7 Wave 1: 2018 cohort: Profile of respondents in each Lot, by qualifications, employment history and health (weighted data)
Total Qualifications Employment history Health limits day-to-day activities
Unweighted Weighted None National 1-5 or equivalent (Advanced) Highers or equivalent Degree or above Worked in the last 5 years Not worked in the last 5 years Has condition, impacts activities Has condition, no limitations No condition
Total 1005 1005 143 14 % 384 38 % 190 19 % 131 13 % 616 61 % 381 38 % 603 60 % 129 13 % 254 25 %
Lot 1 Glasgow 176 191 27 14 % 79 42 % 27 14 % 35 19 % 114 60 % 77 40 % 82 43 % 14 7 % 92 48 %
Lot 2 Lanarkshire 174 187 23 12 % 69 37 % 39 21 % 20 11 % 103 55 % 80 43 % 122 65 % 22 12 % 40 21 %
Lot 3 Tayside 99 110 12 11 % 49 44 % 27 24 % 8 7 % 77 70 % 33 30 % 90 82 % 9 8 % 8 7 %
Lot 4 Forth Valley 83 81 14 18 % 32 39 % 16 19 % 10 12 % 43 53 % 38 47 % 57 70 % 10 12 % 14 17 %
Lot 5 East 184 164 28 17 % 57 35 % 28 17 % 22 13 % 106 65 % 56 34 % 100 61 % 19 12 % 42 26 %
Lot 6 South West 93 94 15 16 % 34 36 % 19 21 % 10 11 % 52 55 % 42 44 % 55 58 % 15 16 % 23 25 %
Lot 7 North East 55 58 9 15 % 22 38 % 9 16 % 8 14 % 42 72 % 15 26 % 32 55 % 14 25 % 12 21 %
Lot 8 Highlands and Islands 60 43 8 18 % 13 30 % 7 17 % 5 12 % 29 67 % 14 32 % 25 57 % 4 10 % 14 32 %
Lot 9 West 81 76 7 9 % 29 38 % 16 21 % 13 17 % 50 65 % 27 35 % 42 55 % 22 28 % 8 11 %
Table 8 Wave 2: 2019 cohort: Profile of respondents in each Lot, by gender and age (weighted data)
Total Gender Age
Unweighted Weighted Male Female 16-24 25-34 35 -49 50+
Total 607 607 389 64 % 281 36 % 128 21 % 143 24 % 173 29 % 162 27 %
Lot 1 Glasgow 101 123 81 66 % 42 34 % 28 23 % 31 25 % 38 30 % 26 21 %
Lot 2 Lanarkshire 71 93 56 60 % 37 40 % 14 15 % 18 20 % 32 34 % 29 31 %
Lot 3 Tayside 48 60 47 *78 % 13 *22 % 21 *36 % 20 33 % 8 *13 % 11 18 %
Lot 4 Forth Valley 50 23 13 57 % 10 43 % 7 31 % 2 *11 % 7 31 % 6 28 %
Lot 5 East 112 132 78 59 % 54 41 % 25 19 % 31 24 % 39 30 % 36 27 %
Lot 6 South West 71 85 51 60 % 33 39 % 12 14 % 17 20 % 29 34 % 27 32 %
Lot 7 North East 50 24 16 66 % 8 34 % 6 27 % 5 19 % 3 *14 % 9 *39 %
Lot 8 Highlands and Islands 50 27 21 76 % 6 24 % 6 22 % 9 32 % 6 22 % 6 24 %
Lot 9 West 54 41 28 68 % 13 32 % 8 19 % 11 26 % 11 27 % 12 28 %
Table 9 Wave 2: 2019 cohort: Profile of respondents in each Lot, by qualifications, employment history and health (weighted data)
Total Qualifications Employment history Health limits day-to-day activities
Unweighted Weighted None National 1-5 or equivalent (Advanced) Highers or equivalent Degree or above Worked in the last 5 years Not worked in the last 5 years Has condition, impacts activities Has condition, no limitations No condition
Total 607 607 62 10 % 229 38 % 126 21 % 110 18 % 394 65 % 204 34 % 287 47 % 97 16 % 192 32 %
Lot 1 Glasgow 101 123 11 9 % 35 *29 % 21 17 % 35 *28 % 79 65 % 41 33 % 46 *37 % 13 10 % 59 *48 %
Lot 2 Lanarkshire 71 93 5 6 % 35 38 % 20 21 % 14 16 % 53 58 % 37 40 % 47 51 % 19 20 % 19 *20 %
Lot 3 Tayside 48 60 5 8 % 25 42 % 15 26 % 9 15 % 47 *79 % 12 *21 % 24 41 % 11 18 % 23 39 %
Lot 4 Forth Valley 50 23 3 12 % 9 39 % 6 26 % 4 17 % 15 65 % 8 33 % 15 *64 % 4 16 % 2 *10 %
Lot 5 East 112 132 17 13 % 54 41 % 28 21 % 17 13 % 90 68 % 41 31 % 67 51 % 23 17 % 37 28 %
Lot 6 South West 71 85 9 10 % 35 42 % 19 22 % 15 18 % 54 64 % 30 35 % 40 47 % 12 14 % 31 36 %
Lot 7 North East 50 24 3 14 % 9 40 % 3 14 % 5 22 % 13 56 % 10 44 % 12 51 % 3 12 % 7 30 %
Lot 8 Highlands and Islands 50 27 2 6 % 9 34 % 8 30 % 4 16 % 18 66 % 9 32 % 17 *62 % 3 12 % 5 20 %
Lot 9 West 54 41 7 17 % 17 41 % 6 14 % 6 15 % 24 58 % 17 40 % 20 47 % 10 24 % 9 23 %
Table 10 Wave 3: 2020 Cohort: Profile of respondents in each Lot, by gender and age (weighted data)
Total Gender Age
Unweighted Weighted Male Female 16-24 25-34 35 -49 50+
Total 663 664 397 60 % 263 40 % 166 25 % 179 27 % 179 27 % 140 21 %
Lot 1 Glasgow 103 118 61 *15 % 57 *22 % 31 18 % 44 *25 % 26 14 % 18 13 %
Lot 2 Lanarkshire 71 82 44 11 % 39 15 % 28 *17 % 14 *8 % 26 15 % 14 10 %
Lot 3 Tayside 48 52 32 8 % 20 8 % 20 *12 % 6 *3 % 18 10 % 8 6 %
Lot 4 Forth Valley 51 21 13 3 % 8 3 % 9 5 % 1 *1 % 4 2 % 7 5 %
Lot 5 East 150 174 104 26 % 67 25 % 34 21 % 45 25 % 56 31 % 39 28 %
Lot 6 South West 87 102 70 *18 % 32 12 % 22 13 % 37 *21 % 26 15 % 16 12 %
Lot 7 North East 51 40 27 7 % 13 5 % 9 5 % 12 7 % 7 4 % 11 8 %
Lot 8 Highlands and Islands 51 29 17 4 % 11 4 % 5 3 % 8 4 % 5 3 % 11 *8 %
Lot 9 West 51 46 29 7 % 16 6 % 8 5 % 12 7 % 11 6 % 15 *11 %
Table 11 Wave 3: 2020 cohort: Profile of respondents in each Lot, by qualifications, employment history and health (weighted data)
Total Qualifications Employment history Health limits day-to-day activities
Unweighted Weighted None National 1-5 or equivalent (Advanced) Highers or equivalent Degree or above Worked in the last 5 years Not worked in the last 5 years Has condition, impacts activities Has condition, no limitations No condition
Total 663 664 83 12 % 209 32 % 128 19 % 170 26 % 513 77 % 140 21 % 257 39 % 121 18 % 257 39 %
Lot 1 Glasgow 103 118 11 10 % 37 31 % 13 *11 % 44 *37 % 80 *68 % 38 *32 % 30 *25 % 16 14 % 65 *55 %
Lot 2 Lanarkshire 71 82 10 12 % 30 36 % 17 21 % 15 18 % 63 77 % 18 22 % 37 45 % 12 14 % 33 40 %
Lot 3 Tayside 48 52 5 9 % 20 37 % 16 *30 % 8 15 % 41 79 % 11 21 % 21 41 % 10 19 % 21 41 %
Lot 4 Forth Valley 51 21 2 8 % 9 43 % 5 24 % 2 *11 % 15 70 % 6 28 % 12 *55 % 1 *6 % 6 31 %
Lot 5 East 150 174 27 16 % 44 26 % 30 17 % 54 31 % 141 81 % 29 17 % 69 40 % 38 22 % 58 33 %
Lot 6 South West 87 102 13 13 % 31 31 % 28 *27 % 19 18 % 77 76 % 22 21 % 42 42 % 25 24 % 28 *28 %
Lot 7 North East 51 40 9 *22 % 10 25 % 8 20 % 7 17 % 31 77 % 7 19 % 16 40 % 6 14 % 18 45 %
Lot 8 Highlands and Islands 51 29 3 10 % 9 31 % 6 20 % 6 21 % 25 86 % 4 14 % 12 42 % 5 18 % 11 37 %
Lot 9 West 51 46 4 8 % 20 44 % 5 11 % 15 34 % 40 88 % 5 12 % 18 39 % 9 20 % 18 40 %

Contact

Email: Arfan.iqbal@gov.scot

Back to top