Publication - Report

Scottish National Standardised Assessments: national report for academic year 2017-2018

Published: 11 Dec 2018
Directorate:
Learning Directorate
Part of:
Education
ISBN:
9781787814554

The report by ACER UK provides a summary of outcomes at a national level on the Scottish National Standardised Assessments.

104 page PDF

2.8 MB

104 page PDF

2.8 MB

Contents
Scottish National Standardised Assessments: national report for academic year 2017-2018
Appendix 5: Statistical reliability of the SNSA for academic year 2017 to 2018

104 page PDF

2.8 MB

Appendix 5: Statistical reliability of the SNSA for academic year 2017 to 2018

To evaluate whether a set of items is psychometrically sound, it is necessary that each item discriminates effectively between learners who have the knowledge or skill that underpins the item and those who have not, and that the set of items as a whole measures a unified latent trait (for example, numeracy). One key summary statistic that is usually used to indicate whether items in an assessment are working well as a set is a reliability statistic, such as Cronbach’s Alpha. According to this metric, reliabilities above 0.75 are typically considered as satisfactory and above 0.80 as excellent.

Table 8 shows Cronbach’s Alpha reliability statistics for the 11 SNSA administered in the academic year 2017 to 2018.

Table 8: Assessments’ reliability results

Assessment Reliability
P1 numeracy 0.865
P1 literacy 0.861
P4 numeracy 0.868
P4 reading 0.899
P4 writing 0.864
P7 numeracy 0.879
P7 reading 0.872
P7 writing 0.802
S3 numeracy 0.905
S3 reading 0.888
S3 writing 0.823

The summary of the results presented in Table 8 shows that the reliabilities of all assessment forms were excellent (more than 0.80).


Contact

Email: National Improvement Framework Unit