The KPI Programme indicator dashboards are currently unavailable due to maintenance. We apologise for any inconvenience this may cause. >Ngā mihi, the KPI Programme team.

NGO

Background

In May 2014, the NGO Benchmarking Club was established in partnership with Platform Trust. The Club enabled nine participating NGOs to develop some core national key performance indicators (KPIs), which they considered were more meaningful and relevant to NGO services than the existing adult KPI indicators.

The commitment to establish a dedicate NGO Benchmarking Club arose from a meeting between NGO partners involved in the KPI Programme, and its purpose was to discuss how best to promote and improve mental health NGO participation in the national mental health benchmarking initiative.

Driven by the NGO partners’ desire to expand their role in the KPI Programme, it served to create opportunities for NGOs to develop their expertise in using KPIs as part of a collaborative benchmarking process. Predominantly run by participants, the Club continued to operate under the umbrella of the KPI Programme to complement the existing benchmarking activities.

The Club met for the first time on 19 November 2015 and successfully developed specific KPI’s for Mobile service types. It intentionally equipped participating NGOs to focus on KPIs that were more meaningful to the NGO sector. The Club made performance comparisons between NGO services, exploring variations in practice, learning from one another and implementing service improvements in much the same way as members of the KPI Programme did.

Operating as a separate stream the NGO Benchmarking Club met each year and held forums where KPIs were benchmarked by the participating NGOs over the following years.

 

Highlighting the value of NGOs in mental health and addiction service journeys

On 1 May 2020, the Ministry of Health issued a contract variation to the KPI Programme to strengthen and formalise support for NGO benchmarking, including the development of KPI’s that demonstrate integration that can be used to promote and enhance sector performance.

The KPI Programme and NGO representatives are continuing to work in collaboration to undertake research to provide an evidence base for indicators that relate to mental health and addiction NGO services and understand how NGO data can be best integrated to tell the whole story of tāngata whai ora service journeys and how the system works together to deliver better wellbeing outcomes for everyone.

If you would like to find out more about our NGO benchmarking stream or contributing to its growth, please get in touch.

Indicators

These are our current NGO stream indicators. Click on any indicator to view the data dashboards or read more about the technical definitions.

Please note – The NGO stream are continually reviewing their indicators and will be building further data dashboards in consultation with the sector. Please contact the KPI Programme team if you have any questions or would like to contribute to the development of indicators for this stream.

Continuity of Care

Tāngata whai ora with recorded NGO activity in the 28 days before an inpatient stay

Find out more

View data

Whānau engagement

Percentage of tāngata whai ora, who experience an in-scope activity, also had a whānau engagement activity recorded

Find out more

View data

Continuity of Care

View data

Data source

PRIMHD

Description

‘Continuity of care’ as indicated through NGO engagement before, during and after acute inpatient DHB stays.

The indicator is a measure to support services understand continuity of care between Te Whatu Ora divisions and NGO mental health services so they can identify where improvement is required to contribute to better wellbeing outcomes for tāngata whai ora who access Te Whatu Ora acute inpatient division services.

The indicator includes data for tāngata whai ora with recorded NGO activity in the 28 days before an acute inpatient stay.

Indicator rationale

Tāngata whai ora report inconsistencies in the connectedness, or continuity of care they receive between Te Whatu Ora divisions and NGO mental health services.

Denominator

Open NGO referral at time of admission to inpatient unit.

Referral Start Date at least one day before, Referral End Date at least one day after an inpatient stay.

Activity pre inpatient – 1 to 28 days before inpatient admission.

Numerator

Activity within inpatient stay – inpatient admission to discharge date.

Activity post community care – 1 to 8 days after inpatient discharge.

Inpatient criteria

Meet the criteria for post discharge community care (7-day follow up).

‘Referral from’ is not psychiatric inpatient (PI).

Activity data selected for indicator inclusion

  1. ActivityTypeCode not in T08, T35, T32
  2. ActivitySettingCode not in WR, OM, SM
  3. ActivityUnitType=CONTACT
  4. TeamType=Community Team
  5. NGOs.

Current data exclusions / known limitations

  • Services focused on housing and employment currently excluded.
  • Phone based only and based NGO services currently excluded from the data.
  • Residential services currently excluded.
  • The current ‘within’ category includes the day of admission and discharge. Inclusion could infer that NGO engagement happens on the day of admission or discharge.
  • If there are more than two NGOs with a referral open at inpatient admission and with activity in the 28-days before admission, they can be counted more than once.

Hide this info

Whānau engagement

Data source

PRIMHD

Technical notes

Percentage of tāngata whai ora with whānau engagement

  1. Activity start date is >= start date of selected quarter and <= end date of selected
  2. Tāngata whai ora with an activity
    • Activity type is not
      • T35 Did not attend
      • T08 Care/liaison co-ordination contacts
    • Activity setting is not
      • WR – Written correspondence
      • SM – SMS text messaging
      • PH – Telephone
    • Activity Unit Type is CONTACT
    • Team setting is not I Inpatient
    • Team type is not
      • 01 Inpatient team
      • 05 Forensic team
      • 08 Residential/accommodation team
      • 26 Intellectual disability
  1. Tāngata whai ora with whānau activity
    • Activity Type is one of:
      • T32 – Contact with family/whānau, consumer not present
      • T36 – Contact with family/whānau, tāngata whai ora/consumer present
    • and/or Family/whānau involvement = 1 Yes
      • Activity type is not T35 did not attend
    • Activity setting is not
      • WR – Written correspondence
      • SM – SMS text messaging
      • OM – Other social media/E therapy
  1. % of tāngata whai ora with whānau engagement in a quarter = Tāngata whai ora with whānau activity/ tāngata whai ora with an activity

First whānau engagement activity in episode of care

The process of service episode reconstruction is as follows:

1. Exclude any out of scope referrals, which are referrals where contact is not necessarily expected. These are any referrals that meet any of these criteria:

  • ReferralEndCode is RI, RO or DZ – referral was declined or discharged with no direct contact required
  • TeamType is 24 or 26 – Integrated Primary Access and Choice and Intellectual Disability teams
  • ReferralEndCode is in (DM, DG, DD, ID) AND there does not exist an in-scope activity on the referral – referral ended in a way that indicates contact may not have been expected, and there was no activity.

2. Within each unique combination of tangata whai ora and organisation, combine all overlapping in scope referrals into service episodes. This can be achieved in various ways, but the KPI programme uses a ‘gaps and islands’ approach:

  • Sort referrals by Referral Start Date, Referral End Date, Referral ID
  • Calculate the Ranked Order for each referral (sorting by Referral Start Date, Referral End Date, and then Referral ID to tiebreak)
  • For each referral calculate the Previous End Date, which is the maximum Referral End Date of any referral with a lower Ranked Order (effectively the latest end date of any referral that started before this referral for this tangata whai ora at this organisation)
  • For each referral compare Referral Start Date to Previous End Date to determine whether this is an index referral or overlap
    • if referral Start Date <= Previous End Date this referral overlaps a previous referral and should roll into that service episode; set Index Referral?=0
    • if referral Start Date> Previous End Date this referral starts a new service episode; set Index Referral?=1
  • For each referral count the number of index referrals that have previously occurred for this tangata whai ora at this organisation, and append that value to the Organisation ID and HCU to form a globally unique service episode ID. For example the service episode for client ABC1234 at organisation G-0000 would be named G-0000_ABC1234_0; G-oo0o_ABC1234_1; etc.
  • Service Episode Start Date= Referral Start Date of the index referral in each service episode.

3. Within each service episode identify the earliest in scope activity on any referral in the service episode

  • Exclude all activities where either of these criteria are met:
    • ActivitySetting is one of these
      • WR – Written correspondence
      • SM – SMS text messaging
      • PH – Telephone
      • OM – Other social media, e-therapy
    • ActivityType is one of these:
      • T08 Care/liaison coordination contacts
      • T24 Work opportunity/Employment/Vocational
      • T33 Seclusion
      • T35 Did not attend
      • T37 On leave
      • T43 Community support contacts
      • T44 Advocacy
      • T45 Peer support
      • T52 Health coaching contact
      • TCR MOH internal reference.
  • Rank all remaining in scope activities by Activity Start Datetime, Referral ID, Activity ID
  • Calculate the Ranked Order for each in-scope activity (sorting by Activity Start Datetime, and then Referral ID and Activity ID to tiebreak)
  • Where Ranked Order = 1, this is the first in scope activity on the service episode
  • First In Scope Activity Start Datetime = Activity Start Datetime of this first in scope activity This determines the time period for analysis.

4. Find the first whānau engagement datetime activity

  • Activity Type is one of:
    • T32 – Contact with family/whānau, consumer not present
    • T36 – Contact with family/whānau, tāngata whai ora/consumer present
  • and/or Family/whānau involvement = 1 Yes
    • Activity type is not T35 did not attend
  • Activity setting is not
    • WR – Written correspondence
    • SM – SMS text messaging
    • OM – Other social media/E-therapy

5. Calculate additional service episode metadata for use in analysis:

  • Initial Team Type = Team Type of the index referral
  • Age at Service Episode Start = age in years on the Referral Start Date

6. Calculate the difference between the First in Scope Activity Start Datetime and first whānau engagement datetime. For each episode group as follows

  • 14 days in under (Potential for a few negative number not an in scope activity)
  • 15-28 days
  • 29+ days
  • No whānau contact

7. Exclude initial team type

  • 01 Inpatient team
  • 05 Forensic team
  • 08 Residential/accommodation team
  • 26 Intellectual disability

8. Only include episodes with a third in scope activity.

Hide this info

NGO stream leads

Our NGO stream leads represent our sector contributors and work alongside the KPI Programme to deliver sector events and guide continuous improvement initiatives. Get to know our current stream leads.

Ross Phillips

NGO Co-chair, Business Operations Manager - Pathways

View full profile

Abigail Freeland

Policy Analyst - Atamira Platform Trust

View full profile

Simon Hughes

Business Systems Specialist - Emerge Aotearoa

View full profile

Jonathan Miller

Team Coach - Pathways

View full profile

Rana Aston

General Manager - Balance Aotearoa

View full profile