Family Nurse Partnership evaluation: methods and process

This paper presents the methods of using routinely collected health, education and social care data to evaluate the Family Nurse Partnership (FNP) in Scotland using a natural experiment methodology.


3. Outcome measures

3.1. Outcomes 

The evaluation specification required there to be no pre-specified primary outcome(s). The outcomes of this study closely follow the key activities and outcomes in the FNP programme’s logic model (Appendix 1). A brief list of outcomes to be included in the evaluation is provided in Table 6 below and a full listing of all 54 outcomes is provided as an online supplement. 

Outcomes are listed according to the logic model and the following information provided:

  • the data source
  • the variables to be used
  • whether the outcome is specifically mentioned in the logic model
  • the hypothesised direction of FNP programme effect
  • the outcome to be analysed with the main method
  • any pre-defined sensitivity analyses such as adjustment for FNP

dosage or sub-group analyses to be performed.

Also included in this supplement are all data sources and outcomes considered but subsequently not used, and any identified gaps where it is indicated in the logic model but no data source is available. 

3.1.1. Categorisation of outcomes

The ability to report on outcomes will depend on several factors: geographical and study cohort coverage, data quality (e.g. completeness), and possible bias in outcomes (such as FNP nurses carrying out child health assessments). As a result, the outcomes have been categorised into either short-term, medium-term, or descriptive. 

Short term outcomes (n=20): These map well to the logic model, are known to have good data quality, and coverage across Scotland and our study cohort (thus maximising the number that can be formally analysed using statistical methods). These outcomes are likely to be associated with the pregnancy and birth period, and up to the child’s 2nd birthday (e.g. child health outcomes). These outcomes will be formally analysed using statistical methods

Medium-term outcomes (n=14): These outcomes rely on data only measured in the period after the 2nd birthday (e.g. school based outcomes at age 4 years of age onwards) and the population included in the analysis would be restricted as a result. These outcomes will also be formally analysed using statistical methods. Medium term outcomes also include those where the analysis would incorporate a time to event approach that would use our study cohort.

Descriptive outcomes (n=20): We will describe outcomes where the direction of the FNP effect is either uncertain, where outcomes are rare, or where the data are classed as experimental statistics (i.e. a type of official statistic that is undergoing development e.g. child attainment).

Table 6: Maternal and child outcomes and follow-up time points

Follow-up Time Points

Outcome Type1

During pregnancy

At birth

Post-partum assessments

10 days

6-8 weeks

2 years

27-30 months 

4-5 years

5-6 years 

Maternal Outcomes

Positive health behaviour

Alcohol/substance misuse during pregnancy

ST

             

Improved parental life-course

Childcare use

D

         

   

Return to education

ST

       

     

Highest educational attainment for all school leavers

D

             

Subsequent birth (live/still) 

ST

       

     

Inter-pregnancy/birth interval (2 outcomes)

MT

             

up to √

Child Outcomes

Competent parenting in terms of child-health

Breastfeeding (3 outcomes: initiation, at 6-8 weeks, duration)

ST

 

       

Birthweight2

D

 

           

Passive smoking

ST

   

 

   

Competent parenting: child protection

Safe home environment

ST

       

     

Safe home environment

MT

             

Improved birth outcomes

Pre-term delivery (<37 vs 37+ weeks)

ST

 

           

Pre-term delivery (<28, 28 to <32, 32 to <37,37+ weeks)

D

 

           

Improved child health

Physical development: Healthy Body Mass Index (BMI)

ST

         

   

Physical development: Healthy BMI

MT

           

 

Gross motor skills concern

ST

     

 

   

Fine motor skills concern

ST

         

   

Registered with dentist at 24 months

ST

         

   

Attended a dentist by 27-30 month visit

ST

         

   

Hospital admissions for dental procedure

MT

       

   

up to √

Hospital admissions for serious injuries

MT

       

   

up to √

Any attendance to Accident and Emergency (A&E)

D

       

   

Accidental injuries

MT

       

   

up to √

Improved child development

Any child development concern3

ST

     

 

   

Any new child development concern at 27-30 months

ST

         

   

Any student need concern

MT

           

 

(a) Personal/social & (b) Emotional/ behavioural concern

ST

     

 

   

Social, emotional, and behavioural difficulty

MT

           

 

Speech, language, and communication concern

ST

     

 

   

Language or speech disorder/Communication Support Needs

MT

           

 

Physical or motor impairment

MT

           

 

Vision concern

ST

     

 

   

Vision impairment

MT

           

 

Hearing concern

ST

     

 

   

Hearing impairment

MT

           

 

Other student need4

MT

           

 

More able pupil

D

           

 

Child attainment

D

             

Improved child protection

Child protection (CP) investigation

D

       

   

Age at first CP investigation

D

             

Number of CP investigations

D

             

Investigation requiring a CP Case Conference (CPCC

D

       

   

Type of concern identified at CPCC

D

       

   

Length of time on CP register

D

       

   

Child registered as a result of conference

D

       

   

Child de-registered 

D

               

Looked after status

D

   

 

   

Children with a looked after status

D

       

   

Time spent in first placement

D

             

Placement type

D

             

Placed for adoption

D

             

1. ST - Short term outcome; MT - Medium term outcome; D - Descriptive outcome;

2. Birthweight appropriate for gestational age and adjusted for gestational age, maternal height, maternal weight at booking, parity and ethnic group - Gestation Related Optimal Weight GROW [24]

3. Concern in any of the following areas: Gross and Fine Motor, Speech, Language and Communication, Social, emotional, behavioural, and attention, hearing and vision

4. Learning disability, Dyslexia, Other specific learning difficulty, Other moderate learning difficulty, Deafblind, Autistic spectrum disorder, Physical health problem, and Mental health problem.

Contact

Email: socialresearch@gov.scot

Back to top