7. Annex 1: Methodology
7.1.1. Fishing Activity and Landings information
Fishers are legally required to provide information on their fishing activities. This includes what they caught, where they caught it, what type of fishing gear they used, and where they landed their catch. The format that fishers or their agents provide the information in to Fisheries Administrations depends on the length of the fishing vessel:
- Vessels over 10 metres are required to maintain logbooks of their fishing activity and provide landings declarations.
- For UK vessels over 12 metres, this information must be submitted electronically in an e-logbook system.
- Vessels between 10 metres and 12 metres may use paper logbooks.
- EU legislation does not require vessels 10 metres and under to keep logbooks, but in Scotland, these vessels are required to provide equivalent information on FISH1 forms.
7.1.2. Value of Landings
Legislation requires that buyers and sellers of fish have to be registered and have to supply Fisheries Administrations with sales notes. These sales notes can be in paper or electronic format and show the presentation of the fish and the price paid for it. With sales of fish into non-EU countries, it can take a long time for sales notes to be submitted. In these statistics, if a sales note for a given landing is not available, then the average price for that species of fish is used instead.
The value of landings presented in the data tables are nominal (not adjusted for inflation), except in Table 23 where they are adjusted for inflation. Throughout this publication, percentage changes in values are presented in real terms adjusted to 2020 prices. The graphs in this publication also present real terms value. These statistics use calendar year deflators published by HM Treasury for the year being reported published in June of the production year, i.e. adjustment to 2020 prices has been done using Treasury deflators published in June 2021. Due to the large increase in government funding as a result of Covid-19, the GDP deflator for 2020 has the largest increase relative to the previous year since 1991. This means that the real value of the fish catch reported may be distorted by price changes unrelated to that activity.
7.1.3. Vessel Information
Fishers have to have a licence to be allowed to fish. UK Fisheries Administrations keep a record of every vessel that has a licence. This information includes the vessel's length, engine power, gross tonnage, age of the vessel (however, in some cases this is not known and it is not recorded compulsorily in licensing documents), the port where it is registered to and its main fishing method. However, the main fishing method listed on the vessel licence is no longer used to produce the vessels by main fishing method tables in this publication. This is because the main fishing method listed on the licence is not updated. An alternative methodology determining main fishing method by calculating the gear used to catch the majority of a vessel's landings by value is used instead. More information on this can be found in section 7.6.2.
Information on employment in the Scottish fishing fleet is gathered by Marine Scotland (MS) through a fisher employment survey distributed to each of the 18 Scottish port districts. MS Compliance Fishery Officers complete the survey using their expert local knowledge of the fishers in their district. In Table 41, this information is put into context of the total employment in Scotland using data on the Scottish labour force obtained from the Annual Population Survey by the Office of National Statistics. Annual Population Survey responses for Jan-Dec 2020 have been weighted to new populations derived using growth rates from HM Revenue and Customs (HMRC) Real Time Information (RTI) to allow for different trends during the coronavirus (Covid-19) pandemic.
7.2. Data Processing
The process map Figure 8 shows how data gets from sources into this publication. Marine Scotland maintains a database called Compass that contains all of the sea fisheries data, except employment, for all Scottish vessels' landings anywhere in the world plus all foreign vessels' landings into Scotland. The information from paper logbooks and FISH1 forms is entered into the Compass database by MS Compliance Fisheries Officers. The information from e-logbooks is processed and checked electronically before being imported into Compass.
The data from the Scottish Compass database are then imported into the UK-wide data warehouse called IFISH which adds the data from all the UK Fisheries Administrations together into one database. This is where most of the data presented here in Scottish Sea Fisheries Statistics comes from. Currently, vessel information comes from the older Scottish Fisheries Information Network (FIN) database, which is being replaced by the newer database Compass. In future publications, Compass will completely replace FIN.
For producing this publication, the Marine Analytical Unit (MAU) in MS take a frozen 'cut' of data from IFISH and FIN (for vessel information only) for the previous five calendar years at the end of July. The data are then quality assured for publication (see the Quality section below).
7.3. Outputs and Publications
The Compass and IFISH databases are the sources of data for a range of different outputs and publications. As administrative data, the primary use of the data is to enforce the law on sea fisheries protection by UK Fisheries Administrations. In Scotland this is carried out by Marine Scotland Compliance. The data are also used to:
- monitor fishing quota uptake by each Fish Producer Organisation (FPO) on a weekly basis
- supply MS Science with fisheries data for marine science
- produce analysis and evidence to inform government policy and decision-making
- include the fishing industry in economic indicators
- inform the National Performance Framework indicator on sustainability of fish stocks
- assist in marine planning decisions
- answer requests for data
External data requests are often received from academics, environmental groups, the fishing industry, consultants on offshore developments, or people interested in information on their local community's fishing industry. The Marine Management Organisation and MS Science use Scottish data as part of their submissions to the EU Commission and the International Council for the Exploration of the Sea (ICES) to monitor the fishing industry and provide scientific advice on maintaining sustainable fisheries.
As National Statistics, this publication has been assessed by the UK Statistics Authority as being of the highest standards of trustworthiness, quality and value. Data quality is assured throughout the publication process from sources to final outputs.
Sea fisheries data in this publication come from administrative databases where the primary purpose of collecting the data is for sea fisheries protection. The Marine Analytical Unit (MAU) uses the data for the secondary purpose of producing this statistical publication. As administrative data gathered under legislation for law enforcement, the data form a census (a complete dataset) that records every voyage and landing by UK fishing vessels or by any vessel landing into the UK.
7.4.1. Illegal, unreported and undeclared fishing
MS Compliance assesses Illegal, Unreported and Undeclared (IUU) fishing (sometimes called "black landings") as being very low with minimal impact on the trends shown in the data.
7.4.2. Data entry validation
When a fisher, agent or Fishery Officer submits data to the database, there are automatic checks for logical inconsistencies, such as wrong combinations of ICES rectangle and sea area. When data is copied from the Scottish database Compass into the UK-wide data warehouse IFISH, there are more automatic checks to make sure the data are correct and that the data copy over correctly between the different databases. In completing the forms, fishers and agents choose from drop-down menus, which help to minimise data entry error.
7.4.3. Compliance checks
As MS Compliance use the data throughout the year for sea fisheries protection, the data are checked on an ongoing basis. If MS Compliance find errors in the data, they can request that fishers or agents supply correct data and amend the records. MS Fishery Officers are experts on data reporting and the fishers in their port district, ensuring data quality when they enter FISH1 and paper logbook data and in finding and amending any data errors.
7.4.4. Expert user checks
The MAU also use the data throughout the year for producing reports on landings of quota fish for the Fish Producer Organisations (FPOs), for scientists in MS Science, and for internal and external queries. Expert users of the data, like the FPOs, give regular feedback on consistency between MAU's reports and their own internal records, providing a robust external check on data accuracy, at least for quota species that are the majority of fish landings. The Marine Management Organisation (MMO) use the UK data warehouse IFISH for their own work throughout the year, providing another expert check on data quality. Additionally the fishers and agents will check their own data to ensure they are fairly and accurately represented.
7.4.5. Statistical checks
The MAU undertakes multiple checks on the data before publication. The data are checked against the provisional publication for the same year and against the final statistics for the previous year and large changes or inconsistencies are investigated further. The same programs to query the database are run each year for consistency. Data between the Scottish database and UK-wide database are compared to ensure the data have been copied over correctly. High tonnage or high value landings are investigated for accuracy and very high or low prices for sales involving one tonne or more of fish are investigated further. When errors are identified, they are sent to MS Compliance Fisheries Officers in the relevant port district for correction. MAU quality assures the results before MS policy colleagues provide further sense checks based on their expert knowledge of the industry.
7.4.6. Program to identify issues in source fishing data (IFISH)
MAU has recently developed code which is used to identify issues in the IFISH datasets. The program looks for and identifies the following issues in the data:
- Non-Scottish vessels with a Scottish licence – this may be because they have recently moved and all the relevant datasets have not yet been updated.
- Duplicate voyages
- Duplicate sales
- Inactive vessels with landings
- Multiple RSS numbers for the same vessel - the RSS number is supposed to be a unique identifier assigned to vessels registered with the Registry of Shipping and Seamen.
- Price check - the program identifies records with sales price for sales > 1000kg which are 'outliers', that is the price is deemed too high if it is greater than the average price per Kg plus 3 times the price standard deviation or is too low if it is less than the average price per Kg minus 3 times the price standard deviation.
- Large landings by under 10 metre vessels
- Large landings with no value
- Scottish under 10 metre vessels landing into foreign ports
- Foreign vessels landing abroad - data about foreign vessels landings abroad should not be included in IFISH, this program extracts those records.
- Species by presentation – the program extracts species and presentation combinations to allow for checking of invalid combinations.
Any identified inconsistencies are sent to compliance or Fisheries Offices for investigation and resolution.
7.5. Limitations of the data
Due to the legal basis for collecting sea fisheries data, the quality of the data is high and forms a census, or complete record. Some limitations of the data include timeliness, lack of data on foreign vessels in UK waters or Scottish vessels operating far from Europe and limits on the precision of marine geography.
Information on landings of fish species not subject to quota, or fish landed by UK vessels abroad, can often take months for the information to be supplied. This is why provisional statistics are not published until 4-5 months after each year end and the final statistics are published in September. The MAU assessed that approximately 0.2 per cent of landings (by value) of Scottish vessels' landings are omitted from the final published statistics each year due to delays in receipt of information on landings out with the UK. However, this small incompleteness does not affect the overall trends shown by the statistics.
The data in the UK data warehouse IFISH are a complete record of all UK vessels' voyages and landings and of all foreign vessels' landings into the UK, but the UK does not have a system for recording foreign vessels' catches from UK waters if they land their catch abroad. That is because the legal responsibility for recording details of that vessel and its activities lies with its own country. Similarly, sales notes are generally not supplied by a small number of Scottish-registered vessels operating far from Europe (sometimes called the far-water/distant-water fleet). As there are little data on prices of exotic species landed outside of Europe, prices are estimates only. This only affects a very small amount of the overall tonnage and value of landings.
A small number of records will be identified as erroneous but will not be amended immediately. This is because they serve as a legal record of what fishers and agents supplied to MS Compliance under sea fisheries protection law. If MS Compliance takes enforcement action, then known errors may not be able to be amended until the case is resolved. This affects a very small number of records so the impact on published figures and trends is minimal.
Some data presented in this publication by a specified geography – such as by local authority or ICES Area of fish capture – are limited by the complexity of marine geography. Data on area of capture are not available below the level of an ICES rectangle, a 30 nautical mile by 30 nautical mile area, and the data do not report whether fishing occurred in inshore or offshore areas. When considering terrestrial geographies such as local authorities or port districts, there is often a mismatch between these and marine geographies such as Scottish Marine Regions or ICES Rectangles.
7.5.1. Change in recorded landings by Scottish vessels since provisional statistics
The time lag between sales and the provision of sales notes can cause changes between provisional and final statistics for a given year. Value of landings information is derived from sales notes, which are submitted by Registered Buyers and Sellers. This information is matched up with the landing declaration submitted by the vessel to obtain values for each landing. If there is no sales note, for example when a UK vessel lands into a non-EU country, the value of the landing is estimated. The most accurate estimation is based on the average price for the same species in the same quarter of the previous year. If that method is not available, the database uses the next most accurate method based on the price for the same species in the previous quarter, and then opens up to the same species type, and so on. When a sales note is supplied for that landing, the estimates are replaced by the true figure from the sales note.
7.5.2. Revisions to provisional statistics
Compared to the provisional 2020 edition, the main statistics for 2020 have changed very little. However, pelagic tonnage and value have seen an increase due to a manual addition of a few large mackerel landings that were missing from the IFISH database as a result of the vessels landing into more than one port on one voyage. The value of these landings was estimated using the average price for the same species into the same country of landing in 2020. Vessel numbers decreased by five, with all reductions being 10 metres and under vessels. Fisher numbers remained consistent with the provisional statistics.
Changes in statistics for 2020 Scottish vessels landings between Provisional and Final Scottish Sea Fisheries Statistics 2020:
7.5.3. Revisions to previous years' final statistics
The landings tables present data for the past five years. Previous years' data are updated to ensure users have access to the latest data available. Revisions are typically small and affect landings information where data comes from logbooks, landing declarations and sales notes that can be amended for small changes (usually in the order of 0.2 per cent) due to late data entry or rectification of errors. As these do not affect the main trends presented, they are not highlighted and not footnoted. Data older than five years is not updated.
The list of the main species displayed in the landings tables may change each year as the criterion for a species being a 'main species' is that the total value landed into the UK or by UK vessels is £2 million or more.
On the rare occasions that revisions are required in the previously published figures that do affect the main trends presented, the revised figures are marked "(r)" and suitably footnoted to explain the reason for the revision. The statistics are routinely revised between the provisional statistics and final statistics – see above. However, provisional statistics are always explicitly identified as such. Vessel numbers and employment remained unchanged as these data are collected once for the final version of each edition of the publication.
Changes in statistics for 2019 Scottish vessels landings between Final Scottish Sea Fisheries Statistics 2019 and 2020 editions:
In the 2019 edition of the Scottish Sea Fisheries statistics, the 2019 values for Cod landings by non-Scottish UK vessels were lower than expected. It has since been discovered that this was a result of incorrect information on landing declarations preventing the system from linking them automatically with sales notes. There were also incomplete or missing sales notes for English vessels. The Marine Management Organisation has put processes in place to impute these values for all years where necessary and as a result the 2019 data has been updated.
7.5.4. Comparability with other countries' statistics
EU legislation covers information requirements for vessels over 10 metres and for all buyers and sellers, which means that data are comparable for all countries within the UK and for all EU countries. The main difference between information collated in Scotland and that collated in the rest of the UK is that, through the FISH1 returns, Scotland obtains equivalent information on a full coverage basis for vessels of 10 metres and under. In the rest of the UK, this information is provided on a sample basis only. However, the vast majority of fish are caught by vessels over 10 metres, so the information is effectively comparable for all UK countries for most species.
The method for counting Scottish registered vessels is by totalling the number of active vessels registered in Scottish ports on 31st December of each year. In comparison, in the rest of the UK vessels are counted if they are registered (regardless of whether they are classed as active or not). This can lead to slight discrepancies between figures published at the Scottish level and those published at the UK level. Eurostat figures for vessel numbers come from the European Community Fleet Register vessel database rather than Marine Scotland's own vessel database. This can result in discrepancies for UK vessel numbers between UK and Eurostat publications. For 2019, this discrepancy was six more vessels (less than one per cent) in UK Sea Fisheries Statistics than in Eurostat.
7.6. Reintroduction of vessels by main fishing method tables
7.6.1. Removal of vessels by main fishing method tables in 2019 Scottish sea fisheries statistics
During the production of the 2019 Scottish Sea Fisheries statistics, concerns were raised regarding the reliability of the main fishing method for active vessels due to the discontinuation of a data source.
Previous publications used fishing method as declared on a vessel's licence, which is updated when a new licence is applied for. However, this data source is no longer regularly kept up to date between licence applications. Further investigation found differences between the number of vessels using different fishing methods from the discontinued licence data source and those estimated from up to date data sources such as the declared gear by fishers used on a particular vessel voyage.
That meant that for the 2019 report, all tables containing information on main fishing method were removed from the publication.
7.6.2. Development of new methodology and reintroduction of tables to 2020 publication
Since the publication of the 2019 statistics, MAU have developed a new methodology for robustly estimating the main fishing method of a vessel. This involves calculating which gear is used to catch the majority of the vessel's landings. This is based on value of landings. Therefore, a vessel's main fishing method is now determined as the fishing gear used to catch the majority of its landings by value as opposed to the fishing method declared on its licence.
This new methodology as well as examples of the tables produced using it were shared with our Scottish sea fisheries statistics user group in a user engagement exercise where we received positive feedback on the methodology and resulting tables.
The one other change that was made following the user engagement was to include Scallop dredging (scallop and queen scallop dredges) as a separate category in Table 40. Non-Scallop dredging has been moved into the Shellfish – Other category.