Evaluation of the Adaptation Scotland Programme
Findings from a process and impact evaluation of the Scottish Government's Adaptation Scotland Programme. The Programme supports the delivery of Scotland’s National Adaptation Plan.
Appendix A – strength of evidence rating
|
Rating |
Description |
Criteria |
|---|---|---|
|
1 |
Strong evidence |
Refers to data that are both plausible and possible to verify. This includes qualitative evidence where stakeholders strongly/consistently agree with the claim through direct experience and, where applicable, quantifiable measures corroborate. |
|
2 |
Moderate evidence |
This includes qualitative and/or quantitative evidence which may make a plausible claim but draw heavily on assumptions e.g. indirect stakeholder perceptions rather than direct experiences, or secondary data such as surveys and reports. |
|
3 |
Minimal evidence |
This includes qualitative evidence where stakeholder agreement is weaker/inconsistent and indirect, and/or where quantifiable measures/secondary analysis do not exist or are incomplete. |
Strength of evidence ratings
|
Contribution Claim |
Contribution element |
Rating |
Assessment |
|---|---|---|---|
|
Contribution Claim 1: The Adaptation Scotland Programme has contributed to the development of a growing network of leaders across Scotland who are driving effective adaptation action. |
Engaging businesses, communities and public bodies in adaptation networks |
3 – Strong evidence |
Consistent and strong evidence from interviews with multiple stakeholders and supporting evidence provided in MI. |
|
Contribution Claim 1: The Adaptation Scotland Programme has contributed to the development of a growing network of leaders across Scotland who are driving effective adaptation action. |
Increasing leaders' knowledge and understanding of adaptation |
3 – Strong evidence |
Consistent and strong evidence from interviews with multiple stakeholders. |
|
Contribution Claim 1: The Adaptation Scotland Programme has contributed to the development of a growing network of leaders across Scotland who are driving effective adaptation action. |
Supporting leaders to drive adaptation action |
2 – moderate evidence |
Strong and consistent evidence from interviews with multiple stakeholders about taking ownership and responsibility, but less consistent evidence across stakeholder interviews. No MI available. |
|
Contribution Claim 2: The Adaptation Scotland Programme has contributed to the development of effective approaches to support fair, just and sustainable adaptation. |
Engaging with specialists |
3 – Strong evidence |
Consistent and strong evidence from interviews with multiple stakeholders and supporting evidence provided in MI. |
|
Contribution Claim 2: The Adaptation Scotland Programme has contributed to the development of effective approaches to support fair, just and sustainable adaptation. |
Connecting specialists and networks to encourage cross-sector collaboration and co-develop of adaptation tools and resources |
2 – moderate evidence |
Consistent and strong evidence from interviews with multiple stakeholders for co-development of tools and resources, with supporting evidence provided in MI but lacking evidence about connecting specialists to networks. |
|
Contribution Claim 2: The Adaptation Scotland Programme has contributed to the development of effective approaches to support fair, just and sustainable adaptation. |
Use of tools and resources by public bodies, communities and businesses |
2 – moderate evidence |
Strong and consistent evidence of use of across multiple stakeholder interviews, but not of implementing adaptation action. Some MI available. |
|
Contribution Claim 2: The Adaptation Scotland Programme has contributed to the development of effective approaches to support fair, just and sustainable adaptation. |
Supporting fair, just and sustainable adaptation |
2 – moderate evidence |
Some evidence of creation of relevant tools and resources, with supporting MI. |
|
Contribution Claim 3: The Adaptation Scotland Programme has contributed to developing place-based initiatives that drive effective adaptation action across cities, regions and localities, aligned with the interests and needs of communities. |
Embedding the Place Principle |
3 – strong evidence |
Consistent and strong evidence from interviews with multiple stakeholders and supporting evidence in MI. |
|
Contribution Claim 3: The Adaptation Scotland Programme has contributed to developing place-based initiatives that drive effective adaptation action across cities, regions and localities, aligned with the interests and needs of communities. |
Establishing, supporting and expanding regional adaptation partnerships |
3 – strong evidence |
Consistent and strong evidence from multiple stakeholder interviews and supporting evidence in MI. |
|
Contribution Claim 3: The Adaptation Scotland Programme has contributed to developing place-based initiatives that drive effective adaptation action across cities, regions and localities, aligned with the interests and needs of communities. |
Enabling regional decision-making |
1 – minimal evidence |
Some evidence but not consistent across interviews. No MI available. |
|
Contribution Claim 3: The Adaptation Scotland Programme has contributed to developing place-based initiatives that drive effective adaptation action across cities, regions and localities, aligned with the interests and needs of communities. |
Driving effective adaptation action |
2 – moderate evidence |
Strong and consistent evidence of planning activity across partnerships from multiple stakeholder interviews, but not of implementing adaptation action. Some MI available. |
|
Contribution Claim 3: The Adaptation Scotland Programme has contributed to developing place-based initiatives that drive effective adaptation action across cities, regions and localities, aligned with the interests and needs of communities. |
Alignment with community needs and interests |
1 – minimal evidence |
Some evidence but not consistent across interviews. No MI available. |
|
Contribution Claim 4: The Adaptation Scotland Programme has contributed to an increase in knowledge, engagement and capacity in shaping and delivering adaptation policy and action in Scotland. |
Adaptation Scotland regularly shares the work and findings of the Programme, and insights from wider relevant adaptation work, to its stakeholders |
3 – strong evidence |
Consistent and strong evidence from interviews with multiple stakeholders and supporting evidence provided in MI. |
|
Contribution Claim 4: The Adaptation Scotland Programme has contributed to an increase in knowledge, engagement and capacity in shaping and delivering adaptation policy and action in Scotland. |
More stakeholders are engaging with the Programme to shape and deliver adaptation policy and action in Scotland |
3 – strong evidence |
Consistent and strong evidence from interviews with multiple stakeholders and supporting evidence provided in MI. |
|
Contribution Claim 4: The Adaptation Scotland Programme has contributed to an increase in knowledge, engagement and capacity in shaping and delivering adaptation policy and action in Scotland. |
Stakeholders have a greater capacity and feel more empowered to shape and deliver adaptation policy and action |
2 – moderate evidence |
Strong and consistent evidence of increased capacity from multiple stakeholder interviews, but not of delivering policy and action. |
|
Contribution Claim 5: The Adaptation Scotland Programme has contributed to bettering the value of and acting upon the views of the most vulnerable to climate change at both national and local level. |
Working with community and third sector organisations to engage groups most vulnerable to climate change |
3 – strong evidence |
Strong and consistent evidence from multiple stakeholder interviews and supporting evidence in MI. |
|
Contribution Claim 5: The Adaptation Scotland Programme has contributed to bettering the value of and acting upon the views of the most vulnerable to climate change at both national and local level. |
Connect vulnerable groups to the networks |
1 – weak evidence |
Limited evidence from stakeholder interviews with limited supporting MI. |
|
Contribution Claim 5: The Adaptation Scotland Programme has contributed to bettering the value of and acting upon the views of the most vulnerable to climate change at both national and local level. |
Groups most vulnerable to climate change are empowered to share their views and input to effective adaptation resources |
2 – moderate evidence |
Some consistent evidence from multiple stakeholder interviews, supported by limited MI. |
|
Contribution Claim 5: The Adaptation Scotland Programme has contributed to bettering the value of and acting upon the views of the most vulnerable to climate change at both national and local level. |
Their views are valued and acted upon in adaptation actions at the local and national level |
2 – moderate evidence |
Some consistent evidence from multiple stakeholder interviews that views of vulnerable groups were valued, but more limited evidence of actions. No MI available. |
How to access the background or source data
The following statement(s) indicate the availability of the data which underlie the results of this publication (tick all that apply):
☐ Anonymised microdata (individual-level) are stored externally at and availability is subject to their access procedures.
☐ Anonymised microdata (individual-level) are openly available from the Scottish Government website at
☐ Aggregate data are openly available from the Scottish Government website at
☐ Aggregate data are provided within this publication or its annexes.
☒ Data are held by Scottish Government and may be made available on request, subject to consideration of legal and ethical factors. Please contact Rachael.Punton@gov.scot for further information.
☐ Data are held by > and may be made available by them on request, subject to consideration of legal and ethical factors. Please see for further information.
☐ Data cannot be made available due to legal, ethical or security considerations.
☐ Not applicable: This publication does not present any findings directly based on data.
Contact
Email: Rachael.Punton@gov.scot