Publication - Research and analysis

Fair Start Scotland: evaluation report 4 - local area case studies - year 3

Published: 14 Oct 2021
Directorate:
Chief Economist Directorate
Part of:
Equality and rights, Work and skills
ISBN:
9781802014648

Part of the Fair Start Scotland series of evaluation reports which presents detailed findings from the third wave of local area case studies in in Fife, Motherwell and Inverclyde, incorporating feedback from FSS service providers, participants, and local delivery partners in these areas.

Fair Start Scotland: evaluation report 4 - local area case studies - year 3
Appendix 1 Evaluation methodology

Appendix 1 Evaluation methodology

This evaluation focuses on providing an insight into how delivery of Fair Start Scotland is playing out in practice and seeks to inform future iterations of employability services in Scotland through understanding what works.

This evaluation report:

  • Outlines the findings from the three case studies conducted in year three
  • Details the findings from our survey and interviews across Scotland
  • Brings together the findings from years 1, 2 and 3 to summarise the overall findings for the evaluation.

This appendix breaks down the evaluation objectives and methodology.

Evaluation objectives

The key objectives of the evaluation are to:

  • Understand how Fair Start Scotland is being implemented across the different lot areas in Scotland
  • Understand the experience of Fair Start Scotland for lead providers, partner organisations, participants and employers
  • Identify what is working well and less well in the implementation of Fair Start Scotland
  • Identify the lessons learned and recommend changes to consider for the remainder of the Fair Start Scotland contract period as well as shaping what the next iteration of employment support in Scotland might look like

Evaluation methodology

This evaluation has multiple components in terms of methodology in relation to:

  • Scotland wide research – conducted primarily in Year 3
  • Nine case studies across the three years of the evaluation.

Scotland-wide methodology

We conducted the following research in Year 3 of the evaluation (2021) with staff and stakeholders across Scotland in order to understand their experiences of Fair Start over the past three years:

1. Interviews with senior stakeholders - a range of senior stakeholders from across Scottish Government, Jobcentre Plus, and Lead Providers

2. Survey of Fair Start Scotland frontline staff – an online survey of Fair Start Scotland frontline staff across all nine contract case study areas

3. Survey of Jobcentre Plus frontline staff – online survey of Jobcentre Plus Work Coaches across Scotland.

The table below outlines the details of who we interviewed as part of the senior stakeholder interviews.

Who No. Organisation/Role
Lead Providers 5 People Plus, Remploy, Fedcap Employment/Start Scotland, Falkirk Council, The Wise Group
Scottish Government 7 Head of Employability Delivery Unit, Interim Head of Employability Improvement and Design, Service Delivery Team Lead, Jobcentre Plus Partnership Leader, Fair Start Scotland Policy and Reporting Lead
Department for Work and Pensions 5 Group Director for East and North of Scotland, Service Leader x2, Senior Customer Service Leader East Scotland, Group Partnership Manager responsible for new DWP programmes, Fair Start Scotland and devolution related engagement

In 2017, as part of a previous piece of work, Rocket Science UK Ltd. had conducted a survey of Fair Start Scotland frontline staff and Jobcentre Plus work coaches to determine their early experiences of the Fair Start Scotland service. This year, we issued very similar surveys to current frontline staff and Jobcentre Plus work coaches to determine whether there had been any significant change in their experiences. The surveys were issued to all frontline staff and Jobcentre Plus work coaches via Scottish Government. In 2017, 172 responses were received from frontline staff. 147 frontline staff responded in 2021. In 2017, 90 Jobcentre Plus work coaches responded to the survey, and in 2021 96 Jobcentre Plus work coaches submitted responses. The full comparison of findings can be found in Appendix 2. Key points are drawn out in relevant sections of this report.

Case study methodology

We have carried out the following tasks in each of the case study areas:

  • Conducted desk-based area analysis of the socio-economic and employment trends in each of the localities to understand the local labour market context that Fair Start Scotland is operating in. This analysis was streamlined in Year 3 to enable a fuller analysis of the messages across Fair Start Scotland bringing together the three years of case studies
  • Analysed the management and performance data from Fair Start Scotland in each of the localities to understand the profile and numbers of participants and outcomes achieved in the area
  • Conducted interviews with participants in each locality to understand their experience of and views on Fair Start Scotland. The total number of participants in each case study area interviewed is outlined in the table overleaf.
Case study year Area Participant interviews Non participant interviews[26]
Year 1 – 2019 Alloa 7[27] 1
Irvine 3 10
Wick 8 1
Year 2 – 2020 Drumchapel 10 -
Dundee 10 -
Peterhead and Fraserburgh 10 -
Year 3 – 2021 Inverclyde 9 -
Fife 7 -
Motherwell 6 -
Total 70 12
  • Conducted interviews with employers in one locality to understand their experience of and views on Fair Start Scotland. Because of the impact of Covid-19 arranging employer interviews in years 2 and 3 of the evaluation has proved difficult as employers had staff on furlough or it was difficult to get hold of very busy staff in HR roles, so the number of employer interviews was limited.
  • Conducted interviews with service staff including managers and frontline staff delivering Fair Start Scotland locally to understand their experience of and views on the service
  • Conducted interviews with staff in partners of Fair Start Scotland providers in the locality to understand their experience of and views on Fair Start Scotland
  • Conducted interviews with relevant other stakeholders in the area to understand their experience of and views on Fair Start Scotland.

The table overleaf provides a breakdown of the Year 3 case study participant interviewees as has been provided in prior years’ reports.

Case study area[28] Number Gender Age Ethnicity Deprivation Disability
Inverclyde 9 Male 6 16-24 1 White 7 Decile 1 5 Disabled 7
Decile 2 1
25-34 5 Decile 3 1
Decile 4 0 Not disabled 2
35-49 2 Decile 5 0
Female 3 Unknown 2 Decile 6 0
50-54 0 Decile 7 2
Decile 8 0 Unknown 0
55-64 1 Decile 9 0
Decile 10 0
Fife 7 Male 5 16-24 0 White 1 Decile 1 0 Disabled 6
Decile 2 1
25-34 4 Decile 3 0
Decile 4 2 Not disabled 1
35-49 0 Decile 5 1
Female 2 Unknown 6 Decile 6 0
50-54 1 Decile 7 1
Decile 8 0 Unknown 0
55-64 2 Decile 9 1
Decile 10 1
Case study area Number Gender Age Ethnicity Deprivation Disability
Motherwell 6 Male 5 16-24 1 White 3 Decile 1 3 Disabled 2
Decile 2 2
25-34 2 Decile 3 0
Decile 4 0 Not disabled 0
35-49 0 Decile 5 1
Female 1 Unknown 3 Decile 6 0
50-54 0 Decile 7 0
Decile 8 0 Unknown 4
55-64 3 Decile 9 0
Decile 10 0
Total 22 Male 16 16-24 2 White 11 Decile 1 8 Disabled 15
Decile 2 4
25-34 11 Decile 3 1
Decile 4 2 Not disabled 3
35-49 2 Decile 5 2
Female 6 Unknown 11 Decile 6 0
50-54 1 Decile 7 3
Decile 8 0 Unknown 4
55-64 6 Decile 9 1
Decile 10 1

Contact

Email: Arfan.iqbal@gov.scot