Evaluation of the Adaptation Scotland Programme

Findings from a process and impact evaluation of the Scottish Government's Adaptation Scotland Programme. The Programme supports the delivery of Scotland’s National Adaptation Plan.


D.4: Text from organisations not receiving support guide

Aims of this interview:

  • for organisations who have received not received support from the Programme: The main aim of this interview is to inform the process evaluation and to explore the reach of the Programme and any barriers in accessing and engaging with support.
  • Where possible, the interview will also explore whether organisations have engaged with other forms of support, and what impact this has had, to inform consideration of alternative explanations in the contribution analysis.

Timings for sections are indicative and will be adjusted by the researcher depending on what forms of support the organisation has received.

Contribution claims

Contribution claim 1 (CC1): The Adaptation Scotland Programme has contributed to the development of a growing network of leaders across Scotland who are driving effective adaptation action.

The Programme engages more businesses, communities and public bodies to form and grow networks in place-based approaches to climate adaptation. These growing networks support leaders to increase their knowledge and understanding of what adaptation actions are needed and how to act. This enables leaders to take more ownership and responsibility to drive adaptation action and share knowledge on adaptation.

Contribution claim 2 (CC2): The Adaptation Scotland Programme has contributed to the development of effective approaches to support fair, just and sustainable adaptation.

The Programme engages with specialists (i.e. practitioners, researchers, institutions and policy teams) to increase understanding of what effective adaptation looks like, connecting specialists and networks to encourage cross-sector collaboration and (co-) develop tools and resources. These tools and resources are used by public sector bodies, communities and businesses to develop effective approaches for tackling adaptation challenges which support a fair, just and sustainable adaptation.

Contribution claim 3 (CC3): The Adaptation Scotland Programme has contributed to developing place-based initiatives that drive effective adaptation action across cities, regions and localities, aligned with the interests and needs of communities.

Adaptation Scotland has embedded the Place Principle into the foundation of the Programme. The Programme has helped to establish, expand and support regional adaptation partnerships to enable decisions on place-based approaches. This has led to the design and delivery of initiatives that drive effective adaptation action based on the interests and needs of communities.

Contribution claim 4 (CC4): The Adaptation Scotland Programme has contributed to an increase in knowledge, engagement and capacity in shaping and delivering adaptation policy and action in Scotland.

Adaptation Scotland regularly shares the work and findings of the Programme, and insights from wider relevant adaptation work, to its stakeholders. More stakeholders are engaging with the Programme to shape and deliver adaptation policy and action in Scotland. Stakeholders have a greater capacity and feel more empowered to shape and deliver policy and action in Scotland.

Contribution claim 5 (CC5): The Adaptation Scotland Programme has contributed to bettering the value of and acting upon the views of the most vulnerable to climate change at both national and local level.

The Programme has worked with community and third sector organisations to engage groups most vulnerable to climate change and connect them to the networks. Groups most vulnerable to climate change are empowered to share their views and input to effective adaptation resources. Their views are valued and acted upon in adaptation actions at the local and national level.

Alternative explanations

Key alternative explanations for researchers to probe on if raised in the interview:

  • Other third sector, community-led initiatives (e.g. advocacy/campaign groups – Stop Climate Chaos Scotland, Friends of the Earth).
  • Participatory processes (Scotland’s Climate Assembly, Scotland’s Children’s Parliament).
  • Direct experience of climate change impacts (e.g. extreme weather events).
  • Legislative and policy drivers (e.g. climate change act, public bodies duties, Just Transition Framework, community empowerment act).
  • Other organisations/networks (e.g. ClimateXChange, Sustainable Scotland Network, Culture for Climate Scotland, Climate Action Hubs).
  • Other knowledge sharing, public awareness and/or engagement campaigns (e.g. Universities, UK Centre for Greening Finance and Investment, Scottish Cities Alliance).
  • Other funding streams (e.g. lottery funding, just transition funding, Climate Action Hubs, Sustainable Scotland Network, Climate Intelligence Service, Climate Engagement Fund).

Introduction and consent

  • Introduce self and Ipsos (independent research organisation).
  • Thank participant for taking part.
  • Check that they received and if they have read the information sheet (if they haven’t, explain that you will go through the key points now and can share another copy with them if needed).
  • Remind them of the purpose of this interview:
  • This interview is part of an evaluation of the Adaptation Scotland Programme which is funded by the Scottish Government. We’ll be speaking both with organisations that have received support from the Programme and those who have not.
  • The Programme provides advice and support to help Scotland be prepared and resilient to the effects of climate change. It works with public sector organisations, businesses and communities.
  • The aim of this interview is to find out about your organisation and what climate adaptation challenges you face; whether you’ve sought any support to help with adaptation actions; and what support, if any, your organisation could benefit from.
  • Explain anonymity and confidentiality: As a reminder - your name will not be disclosed in the reports. However, quotes and elements of reporting may be linked to individual areas. If there is anything that you do not want us to quote you on as part of our reporting, do let us know. I will check in on this at the end of the discussion today.
  • The only time that we would disclose your identity is if you told us something that indicated that you or someone else was at risk of harm, in which case we would pass your contact details over to our safeguarding lead.
  • Remind participant that there are no right or wrong answers. We are evaluating a climate adaptation programme funded by Scottish Government, not particular organisations or projects.
  • Emphasise that taking part is completely voluntary – they don’t have to answer any questions they don’t want to answer and can decide to stop the interview at any point.
  • Remind that they are free to change their mind and decide not to take part at any time before or during the interview, or after the interview until the findings have been written up.
  • This interview will last approximately 60 minutes.
  • Check if participant has any questions (offer to go through information sheet if necessary).
  • Request permission to record interview. Explain that this is for transcription and analysis purposes and that recordings will not be shared outside the research team at Ipsos.
  • If participant does not consent, please take detailed notes.
  • If participant provides consent, please start recording.
  • Start recording if consent given

Background

Firstly, could you start by briefly describing your role and your organisation?

  • Job title and main responsibilities
  • How long you’ve been in this role

What issues does your organisation expect to face as Scotland’s climate changes? Probe: National, regional issues, sectoral issues.

If needed: Adaptation is a process of on-going adjustments in response to observed and projected climate change impacts. This includes being prepared for increasing risks posed by climate change hazards, and identifying new opportunities our changing climate may bring, while considering how impacts may be felt differently across society.

Awareness and engagement with the Programme

Before you were invited to take part in this evaluation, were you or your organisation aware of the Adaptation Scotland Programme?

If no: skip to section 4 Adaptation Action.

If yes:

What do you know about the Programme?

How did you hear about it?

To what extent do you feel the Programme’s offer is relevant to your organisation’s needs?

  • Which parts feel most/least relevant? Why?
  • What would make the Programme feel more relevant?

Have you or your organisation received support from the Programme in the past?

  • If yes: What was your organisation’s involvement with the Adaptation Scotland Programme?
  • If yes: For how long was your organisation receiving support? What are the reasons why you are no longer involved with it?

Have you or your organisation asked for support from the Programme recently? (e.g. register interest/sign up to an event, contact the team delivering the Programme, applied to be part of the Public Sector Climate Adaptation Network [PSCAN])

  • If yes: what support were you looking for? What happened? (Probe fully if interviewee mentions that Adaptation Scotland didn’t have capacity to support the request).

If haven’t engaged nor attempted to engage: what are the main reasons for not seeking support from the programme? Ask openly then probe:

  • Capacity e.g. workload, budget constraints, competing priorities
  • Accessibility e.g. format, location, timings
  • Content e.g. relevance to their sector, their needs
  • Organisational factors e.g. leadership buy-in
  • Suitability/relevance of support offered
  • Scale/nature of adaptation actions required

What would have made it easier for you to engage with the programme?

Awareness of other forms of adaptation support (3 mins)

Has your organisation sought any support for climate adaptation, [if applicable - outwith the Adaptation Scotland Programme]? (e.g. expert advice, training, tools, peer networks). If needed: by climate adaptation I mean actions to address the actual or anticipated impacts of climate change.

If yes:

  • What did this look like?
  • How did you find out about this support?
  • How effective was this support?
  • What was effective about it?
  • What has your organisation done, if anything as a result of this support?
  • What were the reasons for choosing to use this support over other forms/types of support?
  • [If applicable] What were the reason why this support felt more suitable to your organisation than the support available through the Adaptation Scotland programme?

If not covered already: Through which channels, if any, do you typically hear about adaptation support/resources?

What would be the most effective way of hearing about adaptation support/resources?

Effective adaptation actions

If short on time, prioritise this section and cover as much as possible (aim: looking for alternative explanations for climate resilience not to do with the Adaptation Scotland Programme)

If not covered already: What adaptation actions, if any, are you / your organisation taking?

  • How effective has this been?

[Note for interviewers]: If participant mentions actions taken to mitigate against climate change, please refer to definition of climate adaptation and ask specifically about adaptation actions: “by climate adaptation I mean actions to address the actual or anticipated impacts of climate change”.

If needed: Adaptation is a process of on-going adjustments in response to observed and projected climate change impacts. This includes being prepared for increasing risks posed by climate change hazards, and identifying new opportunities our changing climate may bring, while considering how impacts may be felt differently across society].

Now I’d like to understand more about your views and experiences of climate adaptation. Please remember that this evaluation is about the effectiveness of the AS programme and not about individual organisations, so the next questions are just to help us get a better understanding of the context before we discuss the programme itself

To what extent do you feel you are knowledgeable and understand what adaptation actions are needed?

  • If yes - what support or resources, if any, have helped you reach this point?
  • If no - what support or resources, if any, would help you and your organisation feel more knowledgeable about the adaptation actions needed?

To what extent do you feel your organisation has the capacity to plan and deliver adaptation action?

  • If yes - what support or resources, if any, have helped you reach this point?
  • If no - what support or resources, if any, would help increase your organisation’s capacity to plan and deliver adaptation action?

To what extent do you, or anyone else in your organisation, take on a leadership role in driving adaptation action?

  • If yes - what support or resources, if any, have helped you reach this point?
  • If no - what support or resources, if any, would help you or others to take on a leadership role in driving adaptation action?

To what extent does your organisation share knowledge on adaptation with other organisations?

  • If yes – how?
  • If no - what would help with this?

If not covered already: to what extent does your organisation collaborate on adaptation action with other organisations in your sector or region?

  • If yes – how?
  • If no - what would help with this?

To what extent does your organisation consider fairness, justice or equity in your adaptation approaches? (by this we mean approaches that consider the needs of different groups and addresses existing inequalities)

  • If yes – support or resources, if any, have helped you reach this point?
  • If not mentioned: what about groups most vulnerable to climate change? To what extent are their views/needs considered?
  • If no - what would help with this?

If not covered already: what would effective adaptation support / resources look like for you and your organisation?

  • Probe for any specific knowledge gaps or things they need help with (e.g. finance, reporting, training etc).
  • If not covered already, probe for what format would be most helpful (e.g. peer networks, tools, training etc).

Adaptation Scotland tools and resources

Now, I’d like you get your views on some of the different types of support offered by the Adaptation Scotland Programme.

Are you aware of any tools or resources developed by the Programme? (e.g. Adaptation Scotland Website, social media, newsletter, Adaptation Capability Framework, Public Sector Handbook and Starter Pack, Investment training or finance resources; Climate change projections for Scotland). [cover this briefly and skip probes if short on time]

If aware: How did you come across these tools/resources?

Have you used these resources? Why/Why not?

  • If have not used: What are main the reasons why you have not utilised these resources? (CC2, CC4)
  • If have used: How did you find the experience of using these resources? (CC2)

Is there anything that you think could be improved about these resources? What would make them more useful to your organisation specifically?

If have used: To what extent, if at all, have these resources…

  • Improved your knowledge and understanding of adaptation actions needed?
  • Helped your organisation to plan and deliver actions?
  • Helped you or others in your organisation take on a leadership role?
  • Encouraged collaboration with other organisations?
  • Consider fairness, justice or equity in your adaptation approaches? (by this we mean approaches that consider the needs of different groups and addresses existing inequalities)

If not aware:

  • Would these resources be something you would be interested in using? Why/why not? What would make them useful to your organisation?
  • If not covered already: how would you want to hear about resources developed by the Programme?
  • If not covered already: what kind of resources would you find most useful?

Adaptation Scotland events

Researcher check operational plan for any events relevant to participant’s sector/industry before the interview.

Are you aware of any events organised by the Adaptation Scotland Programme? [Interviewer to select appropriate example applicable to the type of organisation being interviewed: For example, Climate Ready Regions Gathering, Public Sector Climate Adaptation Network (PSCAN) meetings, Climate Ready Infrastructure Scotland forum) [cover this briefly and skip probes if short on time]

If aware:

  • How did you come across these events?
  • Did anyone from your organisation attend? Why/Why not?
  • If have not attended: What are main the reasons why you have not attended these events? (CC2, CC4)
  • If have attended: what was the experience of attending?

If have attended: To what extent, if at all, have these events…

  • Improved your knowledge and understanding of adaptation actions needed?
  • Helped your organisation to plan and deliver actions?
  • Helped you or others in your organisation take on a leadership role?
  • Encouraged collaboration with other organisations?
  • Consider fairness, justice or equity in your adaptation approaches? (by this we mean approaches that consider the needs of different groups and addresses existing inequalities)

If not aware:

  • Would these events be something you would be interested in attending? Why/why not? What would make them useful to your organisation?
  • If not covered already: how would you want to hear about events organised by the Programme?
  • If not covered already: what kind of events would you find most useful?

Adaptation Scotland networks / cross sector collaboration

For public sector organisations, if aware of the programme: Are you aware of the Public Sector Adaptation Network (PSCAN)? The network brings public bodies to work together to benchmark their progress and identify and share learning on climate change adaptation. [cover this briefly and skip probes if short on time]

If aware:

  • What did you know about it?
  • How did you hear about it?
  • Are you a member of the partnership? Why? Why not?
  • If not a member: What are main the reasons why you have not joined the network? What would make it more appealing/helpful?
  • If a member: what difference, if any, has this made to your organisation?
  • If a member: What would make it more useful for your organisation? What changes/improvements could be made?
  • If a member: how have you contributed to the partnership?

If a member: To what extent, if at all, has being part of the network…

  • Improved your knowledge and understanding of adaptation actions needed?
  • Helped your organisation to plan and deliver actions?
  • Helped you or others in your organisation take on a leadership role?
  • Encouraged collaboration with other organisations?
  • Consider fairness, justice or equity in your adaptation approaches? (by this we mean approaches that consider the needs of different groups and addresses existing inequalities)

If not aware:

  • Is your organisation involved in any other networks?
  • Would a network like PSCAN be something you would be interested in attending?
  • Why/why not?
  • If not: what would make it useful to your organisation?

Ask all: If not covered already: are you part of any [other] networks focused on climate adaptation or sustainability?

If member of other networks:

  • How did this come about?
  • Have you seen any examples of initiatives that drive effective adaptation action as a result of this collaboration?
  • What difference, if any, has this made to your organisation?
  • How have you contributed to the collaboration?

If not a member of other networks:

  • Would that be something you would be interested in?
  • Why/why not? What, if anything, would make cross sector collaborations useful to your organisation?
  • Probe: Not relevant to your organisation, no capacity, something else?

Regional adaptation action (5 mins)

Are you aware of the Climate Ready Region or regional adaptation partnership in your area? (depending on their location mention specific partnership(s) Adaptation Scotland - Regional Partnerships web page ).

These are partnerships that bring together local authorities, public bodies, businesses, communities and the third sector from across a region to collaborate on shared climate risks and build climate resilient places, communities and economies. [Cover this briefly and skip probes if short on time]

If aware:

  • What did you know about it?
  • How did you hear about it?
  • Have you seen any examples of initiatives that drive effective adaptation action as a result of the partnership?
  • Are you a member of the partnership? Why? Why not?
  • If yes: what difference, if any, has this made to your organisation?
  • If yes: how have you contributed to the partnership?
  • If yes: probe on highlighted questions in section 5.

If not aware:

  • Would that be something you would be interested in joining?
  • Why/why not? What, if anything, would make regional partnerships useful to your organisation?
  • Probe: Not relevant to your organisation, no capacity, something else?
  • Does your organisation connect with regional partners in other ways?
  • Why/why not?
  • If yes: with who, how, how effective is this partnership, has the partnership supported adaptation action?

Summary (5 mins)

So, to sum up… [skip if captured elsewhere]

What would you highlight has having helped your organisation most in taking effective adaptation action?

What would help you take effective action going forward?

What is the most important thing the Adaptation Scotland Programme could do to offer effective support for your organisation?

Wrap up and close (3 mins)

That’s everything I wanted to ask you today. Is there anything else you’d like to add before we finish?

Thanks very much for your time. Can I please check if there is anything you would prefer us not to quote or refer to directly in our reports for the Scottish Government?

Contact

Email: Rachael.Punton@gov.scot

Back to top