Scotland House London Evaluation
The evaluation found that Scotland House London is widely considered to be a valuable strategic asset supporting Scotland’s interests in the UK and internationally, while suggesting practical improvements to increase use and refine the offering of SHL
10. Conclusions and recommendations
Scotland House London is considered by evaluation participants to be a valued and effective strategic asset in Scotland’s international network; partners, stakeholders and members value the physical presence for Scotland in London. Its high-quality offer is seen as essential in helping to advance and deliver a range of economic and diplomatic priorities objectives, as well as having wider value in its convening power and enhancing Scotland’s reputation. However, it is currently challenging to fully demonstrate this impact, in part because of a lack of consistent data
The findings of this evaluation highlight the need to sharpen and strengthen the existing model. This will require a more focused view of whether SHL’s priority is diplomatic influence, economic growth, member support, Scottish presence in London, or a clearly defined combination of these. Clarity about this purpose, which can then be presented in SMART objectives in future business plans, will help to increase engagement and use. Other areas for development include improved visibility of both SHL’s agreed mission and the work it undertakes, and a more consistent approach to evidencing impact and value over time.
Below are the key evaluation findings with recommendations to inform decision-making about SHL’s future. These recommendations should be considered in the context of SHL’s current operating model, budget and staffing levels, and the wide range of activities that are currently being delivered. SHL reporting notes that delivery at this scale has stretched staff capacity and that fiscal controls resulted in some planned events being postponed.
SHL’s purpose is understood in different ways, with no single consistent definition of its core mission
While the evaluation repeatedly shows strong support for SHL’s mission, there is a lack of a shared understanding of what that mission is among stakeholders, partners and members. There is broad alignment around three core roles for SHL – economic diplomacy, convening power and relationship-building, and providing a physical presence in London – but any detailed understanding of SHL’s role is currently driven by stakeholders’ own use and experiences.
Recommendation: SHL’s partners should agree and clearly articulate a single, shared statement of purpose, supported by a small number of defined priorities. This should align with Scotland’s International Strategy and be communicated consistently across the Scottish Government, partners and external stakeholders. Clarifying this will support more coherent decision-making about how SHL’s resources are used and how its value is communicated.
SHL facilities and staff are highly valued, but not being fully capitalised
SHL’s facilities, central and convenient location, and supportive staff are widely appreciated. However, there are some practical barriers to use and concerns that SHL is underutilised in practice. While hybrid working means demand has been lower than anticipated, variation in awareness and engagement across the Scottish Government and by partner organisations also limits how fully SHL is used.
Recommendation: SHL should maintain its high-quality facilities and service offer, and address practical barriers to use. This includes improving booking systems and reviewing access arrangements, alongside more proactive engagement to ensure stakeholders are aware of, and routinely consider, how SHL can support their objectives.
SHL delivers value and impact, but this is largely indirect, inconsistently captured, and weakened by a lack of focus and consistency over time
Stakeholders, partners and members are generally very positive about SHL. Most feel that official Scottish Government and agency representation in London is important, and believe that the absence of SHL would have an adverse impact. There is qualitative evidence of SHL’s role in supporting Scottish Government objectives, facilitating connections and enhancing Scotland’s reputation. However:
- Much of this impact is indirect and difficult to evidence.
- Objectives and reporting have not been consistent over time.
- The volume and quality of data collection have improved, but are variable.
- Value for money and the value of investment are often framed in terms of avoided costs, rather than what is gained by having SHL.
Recommendation: Strengthen SHL’s ability to demonstrate impact by defining a small set of SMART objectives, aligning activity more closely to these priorities, and implementing a more consistent approach to capturing and reporting outcomes. This could include capturing both quantitative indicators, such as engagement activity, and qualitative evidence, such as case studies and stakeholder feedback, to better demonstrate how SHL supports outcomes.
The membership model is valued, but its role within SHL’s wider purpose is not fully clear
Members are very clear that there is value in being able to access affordable, high-quality, central London facilities. However, some partners questioned the membership model, with the evaluation highlighting some uncertainty around:
- The strategic purpose of the membership model within SHL’s wider role.
- Whether providing affordable workspace should remain a core function.
- How membership consistently adds value beyond access to space.
Recommendation: While some concerns are noted, there is no evidence to suggest the membership model should end. However, there is a need to define the purpose of membership within SHL’s strategic objectives, and to explore a shift from a transactional offer to a more active membership model focused on networking and business support to maximise opportunities for growth.
SHL lacks visibility, which limits awareness, demand and impact
A consistent finding is that SHL has a relatively low profile, both within the Scottish Government and externally. This means SHL may be underused not because it lacks value, but because its offer, programme and contribution are not effectively or consistently communicated. This also affects events planning, where interviewees called for more visibility over the programme and input into how it is curated.
Recommendation: Develop and implement a more proactive, regular and targeted communications approach. This should focus on increasing awareness of SHL’s offer, improving visibility of its activities, and enabling stakeholders to engage more effectively.
There is an opportunity to sharpen SHL’s strategic focus to increase impact
Stakeholders recognise the value of SHL’s existing breadth of activity, particularly in supporting its convening role. However, stakeholders also suggest that SHL could achieve greater impact by being more deliberate in where it focuses its effort, particularly in relation to economic growth and diplomatic engagement.
Recommendation: SHL should undertake a targeted strategic review to define where it can add most value, including identifying priority sectors or areas of activity. Key issues to consider include:
- Reviewing and clarifying London’s role in achieving Scottish Government objectives, with stakeholders repeatedly noting that SHL may not yet be making full strategic use of London as both a global city and a market in its own right.
- Considering how the SHL team can be more engaged in more diplomatic activity to facilitate greater bilateral cooperation, and the extent to which SHL should have a greater role in managing liaison between the Scottish and UK Governments.
- Exploring how other agencies could be encouraged to use SHL to leverage their own objectives.
- Enhancing stakeholder management approaches, including clearer ownership of relationships and more systematic tracking of engagement.
Developing a proportionate approach to monitoring and evaluation across the international network
Challenges associated with assessing the impact of Scotland's international network include that many of the intended outcomes around influence, relationship-building and reputation can be difficult to attribute directly to the activity of individual offices. It is also likely that differences in operating models, priorities and local contexts mean that a standardised evaluation approach is inappropriate.
Recommendation: Develop a proportionate monitoring and evaluation framework for the international network that combines a set of core indicators and reporting requirements across all offices, with flexibility to capture outcomes and impacts relevant to offices’ specific objectives and operating context. This should include a logic model for the network, consistent definitions of outputs and outcomes, and guidance on setting objectives and capturing evidence of impacts.
Contact
Email: socialresearch@gov.scot