Scottish Business Sentiment Index

Provides an overview of the development of the Scottish Business Sentiment Index, including the evolution of the index in response to global, UK and Scottish events.


Appendix A

A.1 Topic Modelling Results

Summary of Topic-Level Sentiment Index Calculation

1. Identify relevant topics from topic modelling (e.g., LDA).

2. Multiply each article's sentiment score by its relevance share for the topic.

3. Aggregate the weighted sentiments and topic shares monthly.

4. Normalize by dividing the total weighted sentiment by the total topic share to get the average sentiment index per month.

Model output (50 topics)

0 0.02033 island ferry highland service isle port vessel community inverness calmac shetland western ship route orkney ferguson transport marine yard hie

1 0.04959 director chief executive board chairman role year group appointed business appointment company member team senior head experience management time post

2 0.03372 police investigation claim case court complaint found crime officer allegation report company fraud month action firm claimed inquiry tribunal evidence

3 0.04336 city centre building site development project plan space office property street facility park million work area year construction council open

4 0.05198 government change issue industry policy uk rule report regulation system concern minister commission legislation scheme public proposal risk law review

5 0.02868 planning plan council development application site councillor local area proposal committee community land permission home trump highland decision scheme proposed

6 0.03003 award event business conference winner show year industry category exhibition annual prize international city entry competition held organiser place director

7 0.02033 energy wind power project offshore farm renewable turbine renewables uk electricity green sse government investment port development job nuclear grid

8 0.02366 school university student college education training teacher skill child young pupil apprenticeship apprentice parent career work learning programme graduate primary

9 0.02511 food restaurant pub product drink bar shop business customer local chef coffee brand chain open range produce cafe owner hospitality

10 0.01379 car vehicle engine model motor diesel electric wheel driver range litre mph road drive seat driving petrol bhp system speed

11 0.04661 uk month figure sector number market increase growth business rate level price report quarter survey demand average economy economic show

12 0.01699 whisky distillery brand drink scotch export market company beer spirit sale industry malt product diageo bottle world gin year alcohol

13 0.01716 bbc news medium advertising tv channel radio newspaper programme television stv itv press show broadcaster advert sky digital ad campaign

14 0.01654 cancer drug research treatment disease health patient trial people university study test cell vaccine dr life uk medical medicine product

15 0.05212 company business firm service group contract director million engineering market operation year deal growth industry construction uk management customer product

16 0.02044 investment fund asset trust life management standard investor financial company pension market manager insurance equity group income capital return year

17 0.03967 government snp minister labour party uk leader sturgeon vote independence tory election mp secretary salmond political conservative parliament westminster holyrood

18 0.03999 job company staff business loss closure firm worker cut redundancy plant close plan employee site factory administration future administrator union

19 0.01845 price energy cost customer bill fuel increase gas charge consumer company supplier gbp market pay average electricity cut power pound

20 0.02747 oil gas north sea production energy field offshore company bp industry shell uk drilling exploration barrel development million project asset

21 0.02256 home property house room housing garden bedroom area family price buyer kitchen sale estate offer building flat development market gbp

22 0.01451 share market stock ftse price index point group dollar bank investor rose fell biggest higher company page analyst lower trading

23 0.03358 government council public cost million contract service project funding minister budget money report authority local police year private cut snp

24 0.08475 time people dont make year back thing big long im problem world bit work point money life put find fact

25 0.03778 council local road community city town people area street councillor centre aberdeenshire service moray work northeast resident bridge park authority

26 0.01827 farmer farm kg farming beef cattle meat price dairy lamb milk agricultural sold food crop sheep production animal rural producer

27 0.02881 customer service company online technology mobile mail phone data system digital internet product royal user website information people software bt

28 0.02249 safety fire accident incident death police health worker road died injury work night family man risk investigation rescue people service

29 0.00922 fish fishing fishery fisherman salmon sea industry boat quota stock catch cod seafood marine vessel north european fleet eu mackerel

30 0.0214 union strike pay action worker member staff offer dispute industrial unite government deal council talk ballot service secretary trade increase

31 0.0161 airport flight passenger airline air service route travel aircraft baa aviation ba heathrow number airway ryanair million british plane uk

32 0.05312 company share deal group shareholder business bid million stake takeover offer gbp sale market firm investor price executive sell interest

33 0.05463 profit group company million sale gbp market revenue business growth share gbpm result month pretax cost trading strong loss chief

34 0.02576 club game ranger football player manager team season league celtic sport cup fan time rugby match back side win supporter

35 0.01937 rail train service bus transport passenger scotrail fare network railway line operator driver travel station route ticket journey franchise stagecoach

36 0.02347 pay gbp bonus woman pension salary staff worker paid employee wage scheme executive employer company annual payment work report benefit

37 0.00963 golf beat class championship woman open cup league men division st final world round tour bt england smith gb senior

38 0.03869 industry sector technology business economy world innovation support opportunity scotland future development uk investment economic project data global government change

39 0.03254 store sale retailer retail shop supermarket tesco street chain christmas customer high shopping brand shopper online centre food asda sainsburys

40 0.02251 court legal law case claim firm lawyer lord action appeal solicitor judge company decision ruling society justice session hearing tribunal

41 0.01555 service london community england ireland lab british royal john south west wale northern chief director mar executive central north east

42 0.04441 business people work support working charity community organisation staff team company opportunity make social time job employee service experience family

43 0.02659 bank banking rb lloyd financial customer royal branch loan business hbos credit group mortgage barclays lending money lender account gbp

44 0.03098 business tax government small rate scheme cost uk firm pay budget income support money cut increase economy million debt finance

45 0.04034 year art festival family music show world work life theatre time film book museum artist child royal home history event

46 0.02225 hotel offer holiday visitor travel park room night tourism visit loch castle including highland tour trip guest tourist booking resort

47 0.01942 water gas energy plant climate waste carbon emission fuel fracking green environmental government grangemouth ineos uk supply oil site coal

48 0.03707 firm business company investment partner client growth team market service office uk funding deal technology sector investor financial capital startup

49 0.01892 health nh care service hospital patient staff people nurse board doctor home medical social covid time work dr healthcare nursing

A.2 Manual aggregation of 50-topic model to 20 broad topics

1. Business

1.1. Topic 1: Corporate Leadership

Words: director, chief, executive, board, chairman, role, year, group, appointed, business, appointment, company, member, team, senior, head, experience, management, time, post

1.2. Topic 6: Business Awards and Events

Words: award, event, business, conference, winner, show, year, industry, category, exhibition, annual, prize, international, city, entry, competition, held, organiser, place, director

1.3. Topic 15: Engineering Services and Business Operations

Words: company, business, firm, service, group, contract, director, million, engineering, market, operation, year, deal, growth, industry, construction, uk, management, customer, product

1.4. Topic 44: Business Taxes and Government Schemes

Words: business, tax, government, small, rate, scheme, cost, uk, firm, pay, budget, income, support, money, cut, increase, economy, million, debt, finance

1.5. Topic 48: Business Investments and Startups

Words: firm, business, company, investment, partner, client, growth, team, market, service, office, uk, funding, deal, technology, sector, investor, financial, capital, startup

2. Finance

2.1. Topic 11: Economic Indicators and Market Trends

Words: uk, month, figure, sector, number, market, increase, growth, business, rate, level, price, report, quarter, survey, demand, average, economy, economic, show

2.2. Topic 16: Investment Funds and Asset Management

Words: investment, fund, asset, trust, life, management, standard, investor, financial, company, pension, market, manager, insurance, equity, group, income, capital, return, year

2.3. Topic 22: Stock Market and Investment Trends

Words: share, market, stock, ftse, price, index, point, group, dollar, bank, investor, rose, fell, biggest, higher, company, page, analyst, lower, trading

2.4. Topic 32: Company Shares and Business Deals

Words: company, share, deal, group, shareholder, business, bid, million, stake, takeover, offer, gbp, sale, market, firm, investor, price, executive, sell, interest

2.5. Topic 33: Company Profits and Financial Results

Words: profit, group, company, million, sale, gbp, market, revenue, business, growth, share, gbpm, result, month, pretax, cost, trading, strong, loss, chief

2.6. Topic 38: Industry Innovation and Economic Development

Words: industry, sector, technology, business, economy, world, innovation, support, opportunity, scotland, future, development, uk, investment, economic, project, data, global, government, change

2.7. Topic 43: Banking and Financial Services

Words: bank, banking, rb, lloyd, financial, customer, royal, branch, loan, business, hbos, credit, group, mortgage, barclays, lending, money, lender, account, gbp

3. Government and Politics

3.1. Topic 4: Government Policies and Regulations

Words: government, change, issue, industry, policy, uk, rule, report, regulation, system, concern, minister, commission, legislation, scheme, public, proposal, risk, law, review

3.2. Topic 17: Scottish Politics and Independence

Words: government, snp, minister, labour, party, uk, leader, sturgeon, vote, independence, tory, election, mp, secretary, salmond, political, conservative, parliament, westminster, holyrood

3.3. Topic 23: Government Spending and Public Services

Words: government, council, public, cost, million, contract, service, project, funding, minister, budget, money, report, authority, local, police, year, private, cut, snp

4. Transportation

4.1. Topic 0: Maritime Services

Words: island, ferry, highland, service, isle, port, vessel, community, inverness, calmac, shetland, western, ship, route, orkney, ferguson, transport, marine, yard, hie

4.2. Topic 31: Air Travel

Words: airport, flight, passenger, airline, air, service, route, travel, aircraft, baa, aviation, ba, heathrow, number, airway, ryanair, million, british, plane, uk

4.3. Topic 35: Public Transport

Words: rail, train, service, bus, transport, passenger, scotrail, fare, network, railway, line, operator, driver, travel, station, route, ticket, journey, franchise, stagecoach

5. Energy and Environment

5.1. Topic 7:Renewable Energy

Words: energy, wind, power, project, offshore, farm, renewable, turbine, renewables, uk, electricity, green, sse, government, investment, port, development, job, nuclear, grid

5.2. Topic 19: Energy Prices

Words: price, energy, cost, customer, bill, fuel, increase, gas, charge, consumer, company, supplier, gbp, market, pay, average, electricity, cut, power, pound

5.3. Topic 20: Oil and Gas Industry

Words: oil, gas, north, sea, production, energy, field, offshore, company, bp, industry, shell, uk, drilling, exploration, barrel, development, million, project, asset

5.4. Topic 47 Climate Change

Words: water, gas, energy, plant, climate, waste, carbon, emission, fuel, fracking, green, environmental, government, grangemouth, ineos, uk, supply, oil, site, coal

6. Healthcare and Public Services

6.1. Topic 14: Medical Research and Healthcare

Words: cancer, drug, research, treatment, disease, health, patient, trial, people, university, study, test, cell, vaccine, dr, life, uk, medical, medicine, product

6.2. Topic 49: Healthcare Services and NHS

Words: health, nh, care, service, hospital, patient, staff, nurse, board, doctor, home, medical, social, covid, time, work, dr, healthcare, nursing

7. Hospitality and Tourism

7.1. Topic 9: Food and Beverage Industry

Words: food, restaurant, pub, product, drink, bar, shop, business, customer, local, chef, coffee, brand, chain, open, range, produce, cafe, owner, hospitality

7.2. Topic 46: Tourism and Travel

Words: hotel, offer, holiday, visitor, travel, park, room, night, tourism, visit, loch, castle, including, highland, tour, trip, guest, tourist, booking, resort

8. Legal and Judicial Services

8.1. Topic 2: Legal Investigations and Fraud Cases

Words: police, investigation, claim, case, court, complaint, found, crime, officer, allegation, report, company, fraud, month, action, firm, claimed, inquiry, tribunal, evidence

8.2. Topic 40: Legal Cases and Law Firms

Words: court, legal, law, case, claim, firm, lawyer, lord, action, appeal, solicitor, judge, company, decision, ruling, society, justice, session, hearing, tribunal

9. Real Estate and Property

9.1. Topic 3: Urban Development and Construction Projects

Words: city, centre, building, site, development, project, plan, space, office, property, street, facility, park, million, work, area, year, construction, council, open

9.2. Topic 5: Local Planning and Development Applications

Words: planning, plan, council, development, application, site, councillor, local, area, proposal, committee, community, land, permission, home, trump, highland, decision, scheme, proposed

9.3. Topic 21: Residential Property and Housing Market

Words: home, property, house, room, housing, garden, bedroom, area, family, price, buyer, kitchen, sale, estate, offer, building, flat, development, market, gbp

10. Sports

10.1. Topic 34: Football Clubs and Sports Matches

Words: club, game, ranger, football, player, manager, team, season, league, celtic, sport, cup, fan, time, rugby, match, back, side, win, supporter

10.2. Topic 37: Sports Championships and Competitions

Words: golf, beat, class, championship, woman, open, cup, league, men, division, st, final, world, round, tour, bt, england, smith, gb, senior

11. Technology and Media

11.1. Topic 13: Media and Broadcasting

Words: bbc, news, medium, advertising, tv, channel, radio, newspaper, programme, television, stv, itv, press, show, broadcaster, advert, sky, digital, ad, campaign

11.2. Topic 27: Technology Services and Digital Communications

Words: customer, service, company, online, technology, mobile, mail, phone, data, system, digital, internet, product, royal, user, website, information, people, software, bt

12. Retail and Consumer Goods

12.1. Topic 12: Whisky and Alcohol Industry

Words: whisky, distillery, brand, drink, scotch, export, market, company, beer, spirit, sale, industry, malt, product, diageo, bottle, world, gin, year, alcohol

12.2. Topic 39: Retail Industry and Shopping

Words: store, sale, retailer, retail, shop, supermarket, tesco, street, chain, christmas, customer, high, shopping, brand, shopper, online, centre, food, asda, sainsburys

13. Education and Training

13.1. Topic 8: Education and Training

Words: school, university, student, college, education, training, teacher, skill, child, young, pupil, apprenticeship, apprentice, parent, career, work, learning, programme, graduate, primary

14. Agriculture and Fishing Industry

14.1. Topic 26: Agriculture and Farming

Words: farmer, farm, kg, farming, beef, cattle, meat, price, dairy, lamb, milk, agricultural, sold, food, crop, sheep, production, animal, rural, producer

14.2. Topic 29: Fishing Industry and Fisheries

Words: fish, fishing, fishery, fisherman, salmon, sea, industry, boat, quota, stock, catch, cod, seafood, marine, vessel, north, european, fleet, eu, mackerel

15. Labor and Employment

15.1. Topic 18: Job Losses and Company Closures

Words: job, company, staff, business, loss, closure, firm, worker, cut, redundancy, plant, close, plan, employee, site, factory, administration, future, administrator, union

15.2. Topic 30: Labor Unions and Industrial Actions

Words: union, strike, pay, action, worker, member, staff, offer, dispute, industrial, unite, government, deal, council, talk, ballot, service, secretary, trade, increase

15.3. Topic 36: Salaries, Bonuses, and Pay Equality

Words: pay, gbp, bonus, woman, pension, salary, staff, worker, paid, employee, wage, scheme, executive, employer, company, annual, payment, work, report, benefit

16. Safety and Public Incidents

16.1. Topic 28: Safety Incidents and Accidents

Words: safety, fire, accident, incident, death, police, health, worker, road, died, injury, work, night, family, man, risk, investigation, rescue, people, service

17. Community and Local Projects

17.1. Topic 25: Local Communities and Infrastructure

Words: council, local, road, community, city, town, people, area, street, councillor, centre, aberdeenshire, service, moray, work, northeast, resident, bridge, park, authority

17.2. Topic 41: Community Services and National Organizations

Words: service, london, community, england, ireland, lab, british, royal, john, south, west, wale, northern, chief, director, mar, executive, central, north, east

17.3. Topic 42: Community Support and Charities

Words: business, people, work, support, working, charity, community, organisation, staff, team, company, opportunity, make, social, time, job, employee, service, experience, family

18. Automobiles and Vehicles

18.1. Topic 10: Automotive Industry and Vehicles

Words: car, vehicle, engine, model, motor, diesel, electric, wheel, driver, range, litre, mph, road, drive, seat, driving, petrol, bhp, system, speed

19. Arts and Culture

19.1. Topic 45: Arts, Culture, and Festivals

Words: year, art, festival, family, music, show, world, work, life, theatre, time, film, book, museum, artist, child, royal, home, history, event

20. Other

20.1. Topic 24: Other

Words: time, people, dont, make, year, back, thing, big, long, im, problem, world, bit, work, point, money, life, put, find, fac

A.3 Additional Figures

Figure A.1: Shares of topic coverage for 50 topics, yearly average (%)
Yearly topic coverage for 50 topics (2013–2024), stable with minor fluctuations.

Notes: The figure plots the % share of topic coverage, yearly average, for each of the 50 topics produced by the LDA topic modelling using Factiva data. Note, that the topic “Other” refers to topic 24 in the 50-topic model, which is meaningless and uninformative in the context of Scottish business news, and thus not relevant to use for topic-specific sentiment analysis.

Figure A.2: Shares of topic coverage for 20 aggregated topics, yearly average (%)
Yearly coverage for 20 aggregated topics, confirming 'Business' and 'Finance' dominance.

Notes: The figure plots the % share of topic coverage, yearly average, for each of the 20 aggregated topics produced by the LDA topic modelling using Factiva data. Note that the aggregation to 20 broad topics is done manually and a detailed list of the exact topics used from the 50-topic model is provided in the Appendix. Note, that the topic “Other” refers to topic 24 in the 50-topic model, which is meaningless and uninformative in the context of Scottish business news, and thus not relevant to use for topic-specific sentiment analysis.

Figure A.3: Scottish Business Sentiment Index (BSI) ppt changes from the previous quarter vs. Nominal GDP growth
BSI and GDP in constant prices (2019), showing correlation persists after inflation adjustment.

Notes: The figure plots the quarterly (average of monthly) frequency of the percentage point changes from the previous quarter in the Scottish Business Sentiment Index (BSI - left axis) constructed by the authors using Factiva data and the quarterly series for the Scottish Nominal GDP (£ billion, current prices, seasonally adjusted) which can be found at the Scotland's Economic and Fiscal Forecasts (Scottish Fiscal Commission).

Figure A.4: Scottish Business Sentiment Index (BSI) vs. GDP in constant prices 2019

Notes: The figure plots the quarterly (average of monthly) frequency of the Scottish Business Sentiment Index (BSI - left axis) constructed by the authors using Factiva data and the quarterly series for the Scottish GDP (£ billion 2019, constant prices, seasonally adjusted) which can be found at the Scotland's Economic and Fiscal Forecasts (Scottish Fiscal Commission).

Contact

Email: economic.statistics@gov.scot

Back to top