Cash-First Programme: final evaluation report

2. Research Approach

The overall aim of this research was to assess the implementation of the Programme by the Delivery Partners, the role of the Learning Partner, and the impact of the Programme.

The evaluation addresses the following overarching research questions:

• Has the Programme been implemented and delivered as intended?
• What has been produced as a result of the Programme?
• What difference has the Programme made and for whom?

The full list of research questions and sub-questions is detailed at Appendix B.

Methodology

A mixed methodology was used. It consisted of qualitative and quantitative methods across the eight Delivery Partners. The study team engaged with a range of individuals connected to the Programme to gain a complete understanding of each perspective.

Data collection tools used in each area varied slightly to ensure the evaluation suited the approach undertaken locally. There was also some modification of methodology and tools for the second stage of the evaluation, reflecting learning and experience from the interim evaluation.

The methods undertaken for the evaluation were as follows:

• Eighteen initial scoping interviews with the Delivery Partners, the Learning Partner and local project partners
• Two sets of research interviews (in Stage 1 and Stage 2) with representatives from each Delivery Partner (23 in total); Programme local core partners and stakeholders (33 in total), Programme service users (25 in total); and the Learning Partner (2 in total)
• One set of research interviews in Stage 1 with Programme non-beneficiaries (17), defined as people that have not received Cash-First payments, due to a wide range of reasons, but that may be eligible for Cash-First payments.
• One focus group in Stage 2 with five Programme service users
• Stage 1 Programme service user quantitative survey (73 responses)
• Stage 2 Programme service user quantitative survey (61 responses)
• Quarterly desk-based review of data and monitoring reports including:
• 34 quarterly data returns from the Delivery Partners outlining key metrics;
• Eight grant management reports (one from each Delivery Partner) provided by the Scottish Government in reporting period Quarter 3 of Year 1;
• Programme summary reports from two Delivery Partners;
• Two Learning Partner learning event reports;
• Two Learning Partner update reports;
• Nourish Scotland, and Animate Learning Partner Year 1 report;
• Nourish Scotland contract update report;
• Nourish Scotland, and Animate Learning Partner draft final report;
• Cash-First Partners’ Peer Conversation minutes;
• Programme Progress Group meeting minutes

These took place over the two stages of the evaluation previously set out. A breakdown of methods undertaken in Stage 1 and Stage 2 is provided in Appendix B.