Techscaler Programme 2022-2024: early evaluation - main report

Appendix B: Study methodology

Introduction

This appendix provides detail that is not covered in the study methodology chapter. See also the Fieldwork Materials supplementary report which has been prepared as a separate document.

Inception and set-up

Following the inception meeting the evaluation team had introductory and follow-up discussions and correspondence with representatives from CodeBase on data sharing and work was undertaken to agree a Data Sharing Agreement for the purpose of this evaluation. The data sharing agreement was finalised on 30^th January 2025.

Desk review

The secondary desk research element included a wide-ranging review of existing information and data, including documentation and data provided by both the Scottish Government and CodeBase. This included:

• a review of Techscaler Programme documentation and data, including the:
• specification for the Techscaler Programme contract.
• bid document CodeBase submitted as part of the procurement exercise.
• the contract between the Scottish Government and CodeBase (and contract variations).
• mobilisation plan.
• programme theory of change.
• service blueprint overview.
• 2023 and 2024 annual reports.
• quarterly meeting packs.
• a review of published strategy and research documents, relevant Scottish Government Economy and Fair Work Committee minutes/papers, and other Scottish entrepreneurial ecosystem information (for example, Scottish entrepreneurial ecosystem guide).

Primary research

Techscaler Members

Member companies who have engaged with Techscaler activities and support — the intention was that a telephone survey would be undertaken with 200 companies identified as ‘highly engaged^[32]’ with Techscaler Programme formal activities and support.

Based on our review of information provided by CodeBase on the 978 company members who have joined the Techscaler Programme since its launch^[33], it became clear that the extent of engagement between Techscaler members has varied considerably. The total population for the telephone survey reduced from 978 to 648 contacts when members who had not yet accessed Techscaler formal support were removed from the list.

The 648 remaining contacts (66% of all company members) were used as the basis for the telephone survey sample. A total of 38 email bounce backs^[34] were received reducing the total sample to 610 contacts. This list included a cross-section of companies with varying levels of engagement with Techscaler Programme support (that is, the telephone sample was not limited to ‘highly engaged’ companies). Rather the final list reflected the varying degrees to which companies have engaged with the Techscaler Programme (from highly engaged to least engaged), and this also helped to maximise the number of telephone interviews completed.

The telephone survey, which was undertaken by our study partner Research Resource, started in late March and was extended to 14^th May 2025. A follow-up email communication was issued by CodeBase on 16^th April 2025 to those companies who have been more/highly engaged with the Techscaler Programme to help boost engagement in the survey among this cohort in the sample.

A total of 140 telephone interviews were completed.

Other online survey aimed at companies and individual Techscaler members — EKOS asked CodeBase to issue an online survey to those company founders in the telephone sample (see above) who did not take part in an interview, as well as to a sample of other individual members of the programme. This typically included employees of companies supported by the Techscaler Programme (for example, who may also have accessed an education course or attended an event, etc.) and other individuals at the ideation stage.

While this online survey did ask questions relating to benefits and impacts derived as a result of engagement with the Techscaler Programme, these were not asked to be quantified in any way, unlike the telephone survey described above.

This survey also had routing which was based on whether the person has accessed Techscaler Programme support or not.

This online survey was issued to around 870 contacts on 19^th May 2025 and the survey closed on the 6^th June 2025. A total of 34 responses were received — 33 (engaged) and one (non-engaged) members responded, and these responses have been analysed as part of the larger engaged telephone survey or through analysis on the non-engaged online survey.

Stakeholder interviews

The starting point for pulling together a long-list of potential consultees for partner and stakeholder interviews was via CodeBase and the organisation’s thoughts on potential interviewees from the Techscaler Programme’s 63 startup partners across the tech ecosystem. The list was then reviewed by the Scottish Government and the evaluators to fill gaps — for example, based on organisation type (for example, startup and scaleup investors) as well as identifying any additional individuals/organisations who could provide an informed view on startups, investment, Techscaler Programme and the programme’s fit within the tech ecosystem. The list was longer than required to complete 30 target interviews and the Scottish Government helped to prioritise these.

Techscaler mentors

CodeBase issued an online survey to 150 active Techscaler mentors on 21^st March 2025 and email reminders on 7^th and 22^nd April 2025. The survey timescale was extended to help further boost participation, and the survey closed on 2^nd May 2025. The survey also asked mentors whether they would be interested in taking part in a follow-up interview with the evaluators to provide more qualitative feedback on their experiences of engagement with the Techscaler Programme — these were followed up in June and July 2025.