Evaluation of the Adaptation Scotland Programme

D.1: Text from private sector discussion guide

Introduction

Aims of this interview:

• For organisations in the private sector who have received support from the Programme: The aim of this interview is to gather information on whether the organisation has made progress towards the intended outcomes of the Programme, as set out in the contribution claims (see below).
• We also want to understand how the Adaptation Scotland Programme has been delivered in practice, to gather insight into the activities and outputs of the Programme. Aspects of this guide will therefore focus on the interviewee’s experiences of engaging with the Programme.

Contribution claims

Contribution claim 1 (CC1): The Adaptation Scotland Programme has contributed to the development of a growing network of leaders across Scotland who are driving effective adaptation action.

The Programme engages more businesses, communities and public bodies to form and grow networks in place-based approaches to climate adaptation. These growing networks support leaders to increase their knowledge and understanding of what adaptation actions are needed and how to act. This enables leaders to take more ownership and responsibility to drive adaptation action and share knowledge on adaptation.

Contribution claim 2 (CC2): The Adaptation Scotland Programme has contributed to the development of effective approaches to support fair, just and sustainable adaptation.

The Programme engages with specialists (i.e. practitioners, researchers, institutions and policy teams) to increase understanding of what effective adaptation looks like, connecting specialists and networks to encourage cross-sector collaboration and (co-) develop tools and resources. These tools and resources are used by public sector bodies, communities and businesses to develop effective approaches for tackling adaptation challenges which support a fair, just and sustainable adaptation. 

Contribution claim 3 (CC3): The Adaptation Scotland Programme has contributed to developing place-based initiatives that drive effective adaptation action across cities, regions and localities, aligned with the interests and needs of communities.

Adaptation Scotland has embedded the Place Principle into the foundation of the Programme. The Programme has helped to establish, expand and support regional adaptation partnerships to enable decisions on place-based approaches. This has led to the design and delivery of initiatives that drive effective adaptation action based on the interests and needs of communities.

Contribution claim 4 (CC4): The Adaptation Scotland Programme has contributed to an increase in knowledge, engagement and capacity in shaping and delivering adaptation policy and action in Scotland.

Adaptation Scotland regularly shares the work and findings of the Programme, and insights from wider relevant adaptation work, to its stakeholders. More stakeholders are engaging with the Programme to shape and deliver adaptation policy and action in Scotland. Stakeholders have a greater capacity and feel more empowered to shape and deliver policy and action in Scotland.

Contribution claim 5 (CC5): The Adaptation Scotland Programme has contributed to bettering the value of and acting upon the views of the most vulnerable to climate change at both national and local level.

The Programme has worked with community and third sector organisations to engage groups most vulnerable to climate change and connect them to the networks. Groups most vulnerable to climate change are empowered to share their views and input to effective adaptation resources. Their views are valued and acted upon in adaptation actions at the local and national level.

Introduction

• Introduce self and Ipsos (independent research organisation).
• Thank participant for taking part (and for their involvement in the evaluation so far if applicable).
• Check that they received and if they have read the information sheet (if they haven’t, explain that you will go through the key points now and can share another copy with them if needed).
• Remind them of the purpose of this interview: As a reminder, the purpose of this interview is for us to understand your views on how the Adaptation Scotland Programme has been working in order to inform both a process and impact evaluation. This means I’ll be asking about your experiences of engaging with the Programme, to understand what you found worked well and what worked less well. I will also be asking about whether engaging with the Programme has led to any changes within your organisation or sector, and why.
• Explain anonymity and confidentiality: As a reminder - your name will not be disclosed in the reports. However, quotes and elements of reporting may be linked to individual areas. As a reminder - your name will not be disclosed in the reports. However, quotes and elements of reporting may be linked to individual areas. If there is anything that you do not want us to quote you on as part of our reporting, do let us know. I will check in on this at the end of the discussion today.
• The only time that we would disclose your identity is if you told us something that indicated that you or someone else was at risk of harm, in which case we would pass your contact details over to our safeguarding lead.
• Remind participant that there are no right or wrong answers. The purpose of the evaluation is learning, to inform ongoing design and delivery and to understand impacts of the Adaptation Scotland Programme as a whole, and not to evaluate the success of particular organisations or projects.
• Emphasise that taking part is completely voluntary – they don’t have to answer any questions they don’t want to answer and can decide to stop the interview at any point.
• Remind that they are free to change their mind and decide not to take part at any time before or during the interview, or after the interview until the findings have been written up.
• This interview will last approximately 60 minutes.
• Check if participant has any questions (offer to go through information sheet if necessary).
• Request permission to record interview. Explain that this is for transcription and analysis purposes and that recordings will not be shared outside the research team at Ipsos.
• If participant does not consent, please take detailed notes.
• If participant provides consent, please start recording.
• Start recording if consent given.

Their role and engagement with Adaptation Scotland Programme

I’d now like to ask you a few questions about your organisation, your role, and the type of support you may have received through the Adaptation Scotland Programme.

Could you start by briefly describing your organisation and your role?

• Role of the organisation
• Job title and main responsibilities
• How long you’ve been in this role

What issues does your organisation / sector expect to face as Scotland’s climate changes? Probe: on local issues if appropriate.

If needed: Adaptation is a process of on-going adjustments in response to observed and projected climate change impacts. This includes being prepared for increasing risks posed by climate change hazards, and identifying new opportunities our changing climate may bring, while considering how impacts may be felt differently across society.

What engagement or support have you received through the Adaptation Scotland Programme? What did this start and what did/does this look like?

• Probe: Type and extent of support (e.g. light touch or intensive, frequency, still ongoing or not, use of tools/resources, attendance at events, partnerships).
• Based on information gathered here, facilitator to establish the most prominent form of support and lead with that section (3-5). If other sections also apply, focus on gathering key info and relative impact (i.e. how it compares to other support received) using highlighted Qs for guidance and be mindful of previous answers given.

When did your organisation first engage with, or receive support through the Adaptation Scotland Programme?

• Are you still receiving support from the programme?
• [If not] For how long was your organisation been receiving support? What are the reasons why you are no longer receiving support?

Has your organisation engaged with other support for climate adaptation or resilience, outside the Adaptation Scotland Programme?

• What did this look like?

Had your organisation taken steps to adapt to climate change before Adaptation Scotland support?

As an organisation, are you seeking to build your knowledge on climate adaptation/resilience, and capacity to act on this?

• If yes: How does your organisation currently build knowledge and capacity on adaptation? (CC4)
• Do you feel like you have sufficient support and knowledge?

Tools and resources (Cluster 3 – private sector leadership, Cluster 5 – communication and engagement)

Moving on, I’d now like to ask you some questions about the resources that the Adaptation Scotland Programme produces. Are you aware of any tools or resources developed by the Adaptation Scotland Programme?

• What kind of resources were they?
• Were these resources specific to your sector? Probe for examples
• (e.g. SME resilience checklist, Climate Hazards and Resilience in the Workplace, Climate Resilience Prompts for Business Advisors, or guides on building resilience in horticulture industry/food and drink wholesale industry, whisky industry)

[If aware of Adaptation Scotland resources] probe on: How did you come across these tools/resources? (CC2)

• Probe: Adaptation Scotland website, social media, shared directly by individuals from the Programme, newsletter, shared by others.
• Did you seek out these resources, or were you made aware of them by the Adaptation Scotland Programme?

Did you use any of these resources?

• [If used resources] Which ones? What did you use these resources for?
• How did you find the experience of using these resources? (CC2)
• What were the positives?
• Was there anything that could be improved?
• To what extent would you describe the tools or resources as ‘effective’? (CC2)
• Was there a resource that you found particularly effective? What made it effective?

Were you involved in developing these resources in collaboration with the Programme? (CC2)

[If did collaborate] Which resources were you involved in developing?

• How would you describe the process of developing these resources?
• What worked well? What worked less well?

To what extent, if at all, did co-developing these resources increase…

• …your knowledge and understanding of what adaptation/resilience actions are needed?
• …your confidence to take adaptation/resilience action?
• … staff team skills and capacity to take adaptation/resilience action?
• Would you have gained this knowledge elsewhere without co-developing these resources? Where?
• What specifically did the collaboration with Adaptation Scotland provide that you couldn’t have received elsewhere?

[If did not collaborate] Were you given the opportunity to develop any of these resources in collaboration with the programme?

• [If yes] Why did you not take up this opportunity?
• What, if anything, would encourage you to take up opportunities in future?
• [If no] Is this something that you would be interested in doing in the future?

[Ask those who used resources but didn’t co-develop these] To what extent, if at all, did using these resources increase …

• …your knowledge and understanding of what adaptation/resilience actions are needed?
• …your confidence to take adaptation/resilience action?
• … staff team skills and capacity to take adaptation/resilience action?
• Would you have gained this knowledge elsewhere without these resources? Where?
• What specifically did the Adaptation Scotland resources provide that you couldn’t have received elsewhere?
• Is there anything that could be improved about these resources?

To what extent has using and/or co-developing these tools/resources helped your organisation to take effective adaptation/resilience action? (CC1, CC2)

• Probe: What does ‘effective adaptation/resilience’ look like for your organisation?
• Can you give a specific example of an adaptation/resilience action informed by these resources?
• What made it effective?
• How do you know whether your adaptation/resilience actions are effective? How is this measured?

To what extent, if at all, have using and/or co-developing these tools/resources helped your organisation consider fairness, justice or equity in your adaptation/resilience approaches? (by this we mean approaches that consider the needs of different groups and address existing inequalities) (CC2)

• Probe: Has using and/or co-developing the tools/resources helped you consider the needs of groups or communities who are most vulnerable to climate change? In what ways? [Researcher: if not clear, probe on who individual/organisation understands to be most vulnerable].
• As a result, have you changed any approaches to make them more inclusive or equitable? How effective have these approaches been?
• Are there any vulnerable groups/communities whose needs resources haven’t addressed? What would be useful for the programme to do for you to be able to support these vulnerable groups/communities?

Have these tools/resources helped you collaborate with other organisations on adaptation/resilience? (CC2)

• If not: What are the reasons why the tools/resources have not been helpful encouraging collaboration? What would make them more helpful?
• Have you shared these tools/resources with others? Who?
• Can you give an example of cross-sector collaboration that was supported by Adaptation Scotland resources?

[If did not use resources] What are main the reasons why you have not utilised these resources? (CC2)

• Probe: Not relevant to your organisation or sector, no capacity, something else?
• What kinds of resources would you find useful?
• Would you be interested in developing resources with the Adaptation Scotland programme? What would make collaborating with the programme useful to you?

[If have not seen adaptation scotland resources]: Were you aware that that Adaptation Scotland Programme develops resources for the private sector? (CC2)

• Would resources be something you would be interested in using? Why/why not? What would make them useful to you?
• How would you want to hear about resources developed by the Programme?

Events (Cluster 3 – private sector leadership, Cluster 5 – communication and engagement)

I’m now going to ask some questions on any events that your organisation may have attended as part of engaging with the Programme. As part of your engagement with the Adaptation Scotland Programme, have you, or others from your organisation, attended any events that the Adaptation Scotland programme has contributed to? (CC1)

[If yes] Probe on: Who from your organisation attended?

• [If not interviewee] What is their role?

How many different events have you/others from your organisation attended?

What was the purpose of the event(s)?

• Who hosted it?
• What did attending involve?
• Probe: were any of these events focussed on how to support implementation of the Scottish National Adaptation Plan (SNAP), or your organisation’s adaptation/resilience objectives? (CC5)

How did you hear about the event(s)? (CC1, CC4)

• Probe on whether this was before or after engaging with resources from the Programme?

What other organisations or businesses were in attendance? Where they from different sectors, or the same sector? (CC1)

Did attending the event(s) help you to connect with other businesses or organisations who are taking adaptation/resilience action? (CC1)

• Did the event(s) provide opportunities to work together or share experiences?
• Have you collaborated with any of these other businesses or organisations since the event(s)?
• Has attending the event(s) helped anyone in your organisation to take on more of a leadership role in adaptation/resilience? What does this look like?

How did you find the experience of attending the event(s)? (Process)

• What worked well?
• Was there anything that could be improved?
• Was there anything missing from the events that you would like to have seen?
• What was your main takeaway from the event(s)?

Is there anything that your organisation is doing differently as a result of attending the event(s)? (CC1) [If they say their organisation is doing anything differently]:

• Can you give a specific example of an adaptation/resilience action your organisation has taken as a result of attending?
• What was it about the event that led to this action being taken?
• Would you describe this action as ‘effective’? Why/why not? How do you know whether it’s working?
• And how would you describe the impact on your sector?

To what extent have attending the event(s) helped your organisation to consider fairness, justice or equity in your adaptation/resilience approaches? (by this we mean approaches that consider the needs of different groups and address existing inequalities) (CC2)

• Probe: Have the events helped you consider the needs of vulnerable groups or communities? Which groups/communities?
• Are there any vulnerable groups/communities that the events haven’t addressed? What would be useful for the programme to do for you to be able to support these vulnerable groups/communities?
• Have you changed any approaches as a result to make them more inclusive or equitable? How effective have these approaches been?

To what extent, if at all, did the event(s) increase your knowledge and understanding of what adaptation/resilience actions are needed? (CC1, CC2)

• Probe: In terms of skills, confidence, understanding of how to access further support?
• [If not] What would have made the events more useful to you and your organisation?

Have the event(s) led to individuals within your organisation taking on more responsibility to share knowledge and drive adaptation/resilience transformation? Probe for examples (CC1)

• What does adaptation/resilience leadership look like in your organisation? Who do you consider the leaders to be?

To what extent, if at all, did these events meet your expectations?

• Was there anything that you thought was missing from the events? What was missing? How could the events be improved in the future?

Have you attended any other events on climate adaptation/resilience outwith the Programme?

• Did you find these other events useful? What was it about these events that was useful to you?

Have you attended [other] events, outwith the Adaptation Scotland programme, that are related to climate adaptation/resilience? [If yes, researcher probe for details on what type of event and what impact this had]

• What was it that encouraged you to attend these events? What was particularly useful? What could be improved?

If haven’t attended any events: Would events be something you would be interested in attending? Why/why not?

• What would make them useful to your organisation/sector?
• How would you want to hear about events like these?

Section 5: Place-based partnerships (Cluster 6 – place-based adaptation/regional partnerships)

And lastly, I’d like to ask a few questions about regional adaptation partnerships. As part of your engagement with the Programme, have you been involved in any regional adaptation partnerships (sometimes referred to as Climate Ready regions)? E.g. Highland Adapts, Climate Ready Clyde (facilitator to check/mention most regionally relevant RAP) (CC3)

[If yes] What did this involve? (CC3)

• Have you developed any resources with regional partners?

To what extent would you say that the partnership is collaborative?

• What does this look like?
• To what extent, and in what ways, did the Adaptation Scotland Programme help with this?

How would you describe the impact of receiving support through the programme?

• Have you seen any examples of initiatives that drive effective adaptation/resilience action as a result of the partnership?
• As a result of the support your organisation received, have you seen the partnership support place-based adaptation/resilience action? PROBE for examples?

How did you find the experience of engaging with the regional adaptation partnership? (Process)

• What worked well about the partnership?
• Was there anything that could be improved?
• What was your main takeaway from the support you received?

To what extent has your involvement in the Regional Adaptation Partnership… (Probe for examples):

• Increased your knowledge and understanding of what adaptation actions are needed? (CC1)
• Increased your confidence to take adaptation action? (CC3)
• Enhanced team skills and capacity to take adaptation action? (CC3)
• Enabled your organisation to take effective adaptation action? (CC1)
• Enabled more collaboration between your organisation and others on adaptation? (CC4)
• Helped your organisation/hub consider fairness, justice or equity in your adaptation approaches? (CC2, CC5)

Would you have gained any of this without being involved in the RAP?

What specifically has the ASP provided that you couldn’t have got elsewhere?

[If no] Regional Adaptation Partnerships (sometimes referred to as Climate Ready Regions) are partnerships that bring together local authorities, public bodies, businesses, communities and the third sector from across a region to collaborate on shared climate risks and build climate resilient places, communities and economies.

Is this something that would be of interest to your organisation? Why/why not?

• How easy or difficult would it be for your organisation to be part of a regional adaptation partnership? Probe on not relevant to organisation/sector, no capacity, something else?
• What would you want to get out of being part of a Regional Adaptation Partnership? What would make it useful for your organisation?

Section 4: Overall Outcomes

So, to start summing up…Overall, how satisfied are you with the support that your organisation received from the Adaptation Scotland Programme? (Process)

• What is working well and less well in the delivery of the Programme and where could improvements be made?
• Have you requested any support which the Programme has not been able to provide?
• How have you found the responsiveness of the Programme to requests for support, e.g. response times?
• How effectively would you say that the Programme communicates information on climate risk and adaptation and best practice adaptation/resilience action?

Since engaging with the Programme, to what extent do you feel more knowledgeable about how to implement adaptation/resilience action within your organisation, and across your sector? (CC1)

To what extent, if at all, do you feel the actions your organisation has taken is supporting a fair, just and sustainable adaptation/resilience? (by this we mean adaptation that considers the impacts on different groups, addresses existing inequalities, and seeks solutions that are for the long term) (CC2)

To what extent, if at all, has your engagement with the Programme led to you/others within your organisation taking on more responsibility and ownership to share knowledge and drive adaptation/resilience transformation? (CC1)

[If has] What does this look like in practice?

• How did this come about?
• Which aspects of the Programme were most important in this regard? Probe on aspects discussed.
• Were there any other contributing factors that led you/others in your organisation to take on this responsibility and ownership? (CC1)
• Have you shared examples of effective adaptation/resilience/AS Programme resources with others? Who? (CC1)

[If has not] What barriers are there to you/others in your organisation taking on this responsibility and ownership to share knowledge and drive adaptation/resilience transformation? (CC1)

Wrap up and close

That’s everything I wanted to ask you today. Is there anything else you’d like to add before we finish?

Thanks very much for your time. Can I please check if there is anything you would prefer us not to quote or refer to directly in our reports for the Scottish Government?