Local Area Labour Markets in Scotland: Statistics from the Annual Population Survey, 2014

Summary publication of results from the Annual Population Survey 2014, presenting analysis on the labour market, education and training. Results are provided for Scotland and local authority areas in Scotland.


Annex D: Confidence Intervals

One of the benefits of the boosted data is more reliable estimates for local authority areas. Prior to the boost the reliability threshold in all areas was 6,000. This was to prevent unreliable data being used. Thresholds are calculated so that they are approximately equivalent to suppressing if the standard error of an estimate is greater than 20% of the estimate itself. With the boost, different areas have different thresholds as some areas have larger samples and more variability in results than others (see Table D1).

Table 7: Local authority area reliability thresholds

Local Authority Reliability Threshold
Aberdeen City 3,000
Aberdeenshire 3,000
Angus 1,000
Argyll & Bute 1,000
Clackmannanshire 1,000
Dumfries & Galloway 2,000
Dundee City 2,000
East Ayrshire 1,000
East Dunbartonshire 1,000
East Lothian 1,000
East Renfrewshire 1,000
Edinburgh, City of 5,000
Eilean Siar 1,000
Falkirk 2,000
Fife 4,000
Glasgow City 5,000
Highland 2,000
Inverclyde 1,000
Midlothian 1,000
Moray 1,000
North Ayrshire 1,000
North Lanarkshire 4,000
Orkney Islands 1,000
Perth & Kinross 2,000
Renfrewshire 2,000
Scottish Borders 1,000
Shetland Islands 1,000
South Ayrshire 1,000
South Lanarkshire 4,000
Stirling 1,000
West Dunbartonshire 1,000
West Lothian 3,000

As survey results, these are subject to a degree of error and implied changes over the years may not be significant and instead be within a given error range. Confidence limits can be used to assess the range of values that the true value lies between. The web tables include 95% confidence limits for each indicator.

What does the 95% confidence limit mean?

If, for example, we have an APS estimate and confidence limit of 63% +/- 0.27%, this means that 19 times out of 20 we would expect the true rate to lie between 62.73% and 63.27%. Only in exceptional circumstances (1 in 20 times) would we expect the true rate to be outside the confidence interval around the APS estimate. Thus the smaller the confidence limits, the more reliable the estimate.

The confidence limits use a design factor of 1, which may not be likely in some cases but given the lack of further information an average design factor of 1 is assumed to be reasonable. Further information on estimating confidence intervals can be found in the LFS manuals[9].

Using confidence intervals to assess change (statistical significance).

Confidence intervals can be used to assess whether there has been a significant change between two estimates over time. The methodology for determining if a change is statistically significant is detailed in the Methodology Glossary on the Scottish Government web-site within the Tier 2 - Confidence Intervals document, available at: http://www.scotland.gov.uk/Topics/Statistics/About/Methodology/Glossary

If the difference between two estimates is said to be statistically significant, it means that only in exception circumstances (1 in 20 times) would we expect the true difference to be not significant. It should be noted that statistical significance is a tool used to help detect real change in estimates; it does not say anything about the importance of the change, which needs to be assessed by the user of the statistics in question.

Contact

Email: Alan Winetrobe

Back to top