The Evaluation of the Equality Evidence Strategy 2023-2025

2. Methodology

As documented in the conclusion of the evaluation of the Inclusive Data Taskforce (ONS), this evaluation also recognises that data improvement is an ongoing process as new technologies and data needs emerge, meaning we do not expect that the Vision will have been fully met. As such, the primary aim of this evaluation was to understand what worked well and what could be improved in order to take this forward to the next programme of work (in the upcoming Equality Evidence Strategy 2027). However, conclusions about how well the Principles and overall Vision have been met will be made based on the information gathered based on the following approach.

This evaluation draws on a process driven approach, understanding what worked and what could be improved. The aims of the evaluation were to:

• provide a final update on the 45 actions;
• understand reflections from the action holders to identify action categories benefits and challenges;
• identify impact-focused examples based on the Strategy principles and overall Vision;
• identify any additional influence on improvements to the publication and use of equality evidence;
• understand reflections from EDIP Board members about their role;
• cover lessons learned which will be taken forward to the next Equality Evidence Strategy.

Drawing on previous engagement through the Interim Review and quarterly EDIP meetings, the key questions developed to guide the evaluation were:

1) Has the Strategy driven better collection of equalities data across Scottish Government (and beyond) and to what extent?

2) Are Scottish Government policy teams using the data effectively to measure improvements in outcomes for equality groups?

3) Was the Strategy structure and governance useful in supporting progress?

4) What can we do differently for the next Equality Evidence Strategy?

The evaluation process included gathering reflections and feedback from the lead analysts undertaking activities as part of the 45 actions and the EDIP Board. Lead analysts were asked to complete an excel survey to provide a final action update and status, along with questions asking them to reflect on the benefits, challenges and impacts surrounding their action as well as a general question about the structure of the Strategy in supporting them achieve their goal. The members of the EDIP Project Board were asked to complete a Microsoft Forms which asked for their views on the reporting mechanisms, the role of EDIP and the next Equality Evidence Strategy. Both questionnaires were sent, completed and analysed (anonymously where appropriate) over November 2025 to January 2026. Responses to the lead analyst survey have been used to provide insights on the action categories and Strategy Principles. Responses to the EDIP questionnaire have been analysed in one chapter. Both responses have been used to inform the transferrable lessons and conclusions.

Beyond the Strategy, information was also collected from analysts delivering other equality data improvement work to showcase the wider commitment across Scottish Government.

In addition, Collaboration Sessions were held in June 2025 with external organisations, not represented on the EDIP Board, interested in improvements to equality evidence. Insights from these sessions have also been included in this evaluation report to highlight future thinking on data improvement.