Procurement Efficiencies: Monitoring and Evaluation of Devanha Phase 2

This research is a monitoring and evaluation study of the Devanha Phase 2 procurement initiative established in 2006 by five RSLs in North East Scotland: Aberdeenshire Housing Partnership, Castlehill Housing Association, Grampian Housing Association and Langstane Housing Association. The research involved a four year monitoring exercise during which data was collected annually. The research also aimed to analyse transferable lessons which could be learned from Devanha’s experience


3 Methodology

3.1 We aligned our research method to the established Devanha objectives and measures of success and have not imposed additional measures of success on Devanha. We have been guided by the Communities Scotland research brief and based our analysis around answering the questions raised by the brief. The other key document guiding our analysis has been the Offer of Grant from Scottish Ministers to Devanha Limited with the Consent of the Devanha Members (Communities Scotland, 2007) which sets out the objectives which Devanha had to meet.

3.2 The research brief stated that the purpose of the research was to:

  • Establish and implement a monitoring and evaluation framework,
  • Evaluate and report on progress and impact,
  • Set out key findings and learning points to aid sharing best practice,
  • Provide evidence on transferable procurement practices,
  • Provide evidence of outcomes against Devanha objectives,
  • Provide evidence of whether those involved - Communities Scotland, RSL sectors, Consultants, Contractors and Supply Chain sectors - have appropriate policies, guidance and systems to manage change in procurement practice.

(Communities Scotland, 2007)

3.3 Table 3.1 shows the various methods employed and the questions which each addressed. A separate technical appendix gives more detail on the research tools used in the study.

Table 3.1 Research Methods and Tools

Research Method/Tool Issues Addressed
Develop Devanha Data Capture Proforma and deliver/analyse these in three rounds. Programme management, Housing quality & standards, KPIs, Training & Employment.
Develop Scottish Government Data Capture Proforma and deliver/analyse this in four rounds. Cost and Grant.
Develop Devanha Non Project Specific Data Capture Proforma and deliver/analyse this in three rounds. Programme level data on Training & Employment; Programme level data on quality innovation and modern methods of construction.
Procurement Consultant Questionnaire Survey delivered in rounds 1 & 4. Procurement consultant issues.
Governance Questionnaire Survey delivered in rounds 1 & 4. Devanha Board and RSL roles and relationships. Governance and sub-group structures, key issues for Devanha, Devanha's future.
Board/Governance workshops in 4 rounds. Wide ranging discussion involving Board and Programme Director.
Individual Interviews with Devanha chair, individual board members and Programme Director. Strategic and programme issues.
Process workshops in 3 rounds. Wide ranging discussion with Core group members and Development Director focusing on procurement, contract and other process issues. Also addressed issues of specification and quality.
Analysis of procurement consultant reports including diagnostic reports, periodic open book process reviews, in rounds 1 and 2. Progress towards implementation of collaborative working and NEC contract.
Analysis of Board and Subgroup minutes in 4 rounds. Wide ranging issues including governance, collaboration, quality, programme, cost monitoring.
Analysis of Devanha specification Quality and standards.
Analysis of Inflation Monitoring Inflation monitoring and validation.
Interviews with Core Group members including consultants, contractors and RSL development staff in round 4. To explore quality, process, collaboration and contract issues in confidential setting.
Interviews with Devanha partners including Scottish Government and Local Authorities. Wide range of issues including systems, relationships, impact in different LA areas and the future of Devanha.

Contact

Email: Pauline Innes

Back to top