Free Standard AU & NZ Shipping For All Book Orders Over $80!
Register      Login
Journal of Primary Health Care Journal of Primary Health Care Society
Journal of The Royal New Zealand College of General Practitioners
RESEARCH ARTICLE (Open Access)

Establishing the research priorities of a national primary care research network in New Zealand: a Delphi exercise

Sharon Leitch https://orcid.org/0000-0001-9939-8773 1 * , Jing-Ru Li 1 , Tim Stokes https://orcid.org/0000-0002-1127-1952 1
+ Author Affiliations
- Author Affiliations

1 Department of General Practice and Rural Health, University of Otago, 55 Hanover Street, Dunedin 9016, New Zealand.

* Correspondence to: sharon.leitch@otago.ac.nz

Handling Editor: Felicity Goodyear-Smith

Journal of Primary Health Care https://doi.org/10.1071/HC24046
Submitted: 3 April 2024  Accepted: 23 May 2024  Published: 13 June 2024

© 2024 The Author(s) (or their employer(s)). Published by CSIRO Publishing on behalf of The Royal New Zealand College of General Practitioners. This is an open access article distributed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (CC BY-NC-ND)

Abstract

Introduction

Research using routinely collected primary health care data can improve health care quality, outcomes, policy, and health equity. Aotearoa New Zealand (NZ) lacked the infrastructure to readily access these data. The Southern Primary Care Research Network (Southern PCRN) has been established to address this issue.

Aim

This study aimed to identify the research priorities of primary health care clinicians and researchers.

Methods

A modified Delphi survey method was used to identify priority general research areas and specific research questions in NZ primary health care. Participants suggested priority research areas and research questions in Round 1. These were grouped thematically and ranked by frequency. Research questions were screened by scope and feasibility. In Round 2, participants ranked the importance of the research questions.

Results

Primary health care access, health workforce, health services, mental health, and models of primary health care were identified as priority research areas. After screening, 23 research questions were included in Round 2. Consensus was reached on 20 questions. The highest-ranked questions suggested implementation and evaluation of annual checks for people with intellectual disability, and evaluating the effects of embedding allied health practitioners and social workers in primary health care teams.

Discussion

Prioritised research areas are consistent with those identified in the literature. However, the priority research questions are emerging topics. This is the first research prioritisation exercise undertaken for the Southern PCRN. Further research is planned to explore patient priorities. These findings will help the Southern PCRN to establish a research agenda in accordance with its mission of improving health equity.

Keywords: academics, clinicians, Delphi survey, general practice, health equity, New Zealand, primary care research network, primary health care, research prioritisation.

WHAT GAP THIS FILLS
What is known about the topic: Routinely collected administrative and health data have potential to be used for research that provides real-world health insights that can inform policy and improve clinical practice and population health. Engaging stakeholders to establish priorities can help ensure research is fit for purpose, provides important health benefits, and has the greatest potential to improve health equity.
What this study adds: Primary care clinicians and academics identified the top research areas to improve health equity in primary care as the health workforce, health services, mental health, and models of primary health care. The top research questions include evaluating the impacts of annual health checks for people with intellectual disability, the role of allied health as front-line primary health care providers, and the role of an embedded social worker in a general practice clinic setting.

Introduction

Administrative and health data are routinely collected in Aotearoa New Zealand (NZ) by primary health organisations to facilitate the dissemination of primary health care funding. These data can also be utilised to conduct cost-effective research providing real-world health insights. Such insights can improve clinical practice, inform policy, and improve population health.1 Research endeavours in primary care often use routinely collected data. Primary care research networks (PCRNs) typically collate and administer such data and support researchers.2 PCRNs are well established internationally.35

Various research networks have existed in NZ.6 Currently NZ has a patchwork of regional organisations conducting primary health care research; however, no current infrastructure supports this work nationally.2 The Southern Primary Care Research Network (Southern PCRN) has recently been established in the Otago/Southland region through a collaboration between WellSouth (the regional primary health organisation) and the University of Otago. It is hoped that this network will eventually expand to a national research network. The Southern PCRN aims to improve health outcomes and reduce health inequities through primary health care research. We wish to establish a list of prioritised research topics and questions so these aims can be efficiently and effectively realised.

Research priority setting is a crucial aspect of research planning and can help identify areas of research need for both researchers and funders.7,8 Research projects informed by priority setting are more likely to generate meaningful impact and achieve feasibility during implementation.9 Applying an equity lens to prioritisation exercises can improve health equity outcomes.7,10

Research prioritisation activities engage stakeholders because of the moral, ethical, and political importance of health research.11 Primary care research has three main groups of stakeholders: patients, clinicians, and researchers. Research using routinely collected data uses anonymised patient information, that clinicians have collected and researchers wish to use.12 Stakeholder engagement particularly recognises those who contribute and collate the data.13 Inclusion of Indigenous perspectives and data sovereignty concepts may help avoid deficit framing.13,14 Stakeholder engagement can help ensure prioritised research is fit for purpose and has the greatest potential health benefits.15

This project aims to identify the research priorities of primary health care clinicians and academics. Other projects will engage with Māori and patient stakeholder groups via focus group interviews. The exercise will conclude with a multi-stakeholder workshop, which will be held with stakeholder group representatives to determine the final list of research priorities of the Southern PCRN.16 Together these projects will provide detailed insight into the research needs of this region and will help construct a research agenda for the Southern PCRN.

Methods

The Delphi process is a research method that can establish consensus amongst experts. It has been used effectively to ascertain stakeholders’ opinions in research agenda development.17 The Delphi process involves sequential survey rounds that collect and rank participants’ views. At the end of the process, a consensus view is established.18 This study used the Delphi process to understand the research priorities of primary health care researchers and academics. The study received ethics approval from the University of Otago (D23/027).

Eligible participants were primary health care clinicians working in Southern NZ and academics across NZ. Initially, the Southern PCRN will predominantly use data from this region, therefore the clinicians working here are key stakeholders. However, there is only a small cohort of primary health care academics across NZ; therefore, all were invited to participate.

A recruitment email containing the study invite and a link to the questionnaire (Supplementary File S1) was sent to individual clinicians and academics where possible. Academic and clinical groups were contacted and requested to distribute the email to members or employees. These included primary health care departments in tertiary education institutions, medical professional organisations (such as The Royal New Zealand College of General Practitioners), general practice clinics in Southland and Otago, and the WellSouth Primary Health Network. Recipients were requested to forward the study invite to their colleagues to recruit additional participants in a snowball manner.

Delphi Survey Round 1 – identifying priority general research areas and specific research questions

Each survey was hosted on the Qualtrics survey platform.19 Participants were requested to provide basic demographic and career information. Participants were asked ‘Which areas do you think are in greatest need of research in primary health care?’ They could list up to five general research areas. They were also asked ‘What are the most important questions in primary health care that need addressing to improve health equity?’ Participants could submit up to three specific research questions in the PICOT format if possible (Population, Intervention, Comparison, Outcome, Time).20

General research areas were collated, coded, and organised thematically by JL in Nvivo 12. Initial codes were informed by literature; residual areas were coded inductively. Codes were clustered into logical themes, however, some codes spanned more than one theme due to the inherent complexity of the topic. For example, ‘health service delivery funding’ was included in both ‘Health Services’ and ‘Funding’ themes. Codes were counted once per theme. The coding and themes were reviewed by SL. Code frequency determined theme ranking. The general research areas were only surveyed in Round 1 because this priority list will be used as a discussion prompt for the other stakeholder engagement exercises.

The specific research questions were screened by JL and SL for inclusion in Round 2. The screening criteria were outlined in the research protocol. They were further refined during data analysis. Research questions needed to be both relevant and feasible for final selection. JL screened the questions for relevance and feasibility. SL then reviewed the results to make sure the screening criteria were consistently applied. Divergences were discussed and resolved between SL and JL. Questions that fell out of scope were excluded, for example; ‘Does providing free medication (2 week supply) from the hospital on discharge improve whānau Māori experience of discharge?’ ‘If specialist referrals are made by hospital doctors at first point of contact (rather than being referred back to general practice), are patient outcomes improved?’ Questions that were judged not feasible to answer with PCRN data were also excluded, for example; ‘What are the barriers for people accessing health care services? What support is available for Māori kaumātua (elders)?’ ‘What influences early career health graduates career choice?’ Duplicate questions were excluded. Residual questions were refined by trimming off specific details, such as locations, to ensure wider relevance.

Delphi Survey Round 2 – ranking the research questions

Participants who completed Round 1 were invited to participate in Round 2. They were sent an email containing a link to the refined list of research questions (Supplementary File S2). Participants were asked to rate the importance of each question using a 6-point Likert scale (0 = I don’t know, 1 = not at all important, 2 = slightly important, 3 = moderately important, 4 = very important, 5 = extremely important). The mean Likert score rating was calculated to rank the questions. Consensus on inclusion was achieved when more than 51% of participants ranked a question ‘very important’ or ‘extremely important.’18 Round 2 of the Delphi survey was open from 23 August to 30 September 2023. Round 3 of the Delphi survey was considered unnecessary because consensus was obtained for 20 out of 23 questions.

Results

Participants

Fifty-eight participants met the inclusion criteria. Demographic information of the participants is presented in Table 1. Eighteen participants were academics, 18 were clinicians, and 22 worked in both roles. Clinician participants included general practitioners, nurses, physiotherapists, pharmacists, nurse practitioners, dentists, and a midwife. Academic participants’ research areas included primary health care, general practice, physiotherapy, pharmacy, dentistry, and nursing.

Table 1.Participant characteristics n = 58 (100%).

Gender
 Female50 (86.2)
 Male8 (13.8)
Ethnicity (may identify with more than one ethnicity)
 Māori11 (19.0)
 NZ European/European52 (89.7)
 Middle Eastern/Latin American/African/Other3 (5.2)
Occupations
 Primary health care academic18 (31.0)
 Primary health care clinicians18 (31.0)
 Both22 (37.9)
Academic research area
 Primary health care/general practice18 (31.0)
 Physiotherapy5 (8.6)
 Pharmacy4 (6.9)
 Dentistry3 (5.2)
 Nursing2 (3.4)
 Other9 (15.5)
Medical profession
 Nurse12 (20.7)
 General practitioner9 (15.5)
 Nurse practitioner3 (5.2)
 Physiotherapist3 (5.2)
 Dentist2 (3.4)
 Pharmacist4 (6.9)
 Other8 (13.8)
Practice locations of primary health care clinicians
 In Otago/Southland35 (60.3)
 Outside of Otago/Southland23 (39.7)
Practice experience of primary health care clinicians
 Less than 5 years2 (3.4)
 5–10 years5 (8.6)
 10–20 years12 (20.7)
 More than 20 years21 (36.2)

Research areas

Participants proposed 245 priority research areas and 133 priority research questions for primary health care. The 245 research areas were collated and organised into 20 research themes. The top five priority research areas by frequency were access to primary health care, health workforce, health services, mental health, and models of primary health care (Table 2). Codes relating to the access to primary health care theme emphasise understanding the financial impact of user-pays health care accessibility and health equity. The health workforce theme included clinician retention, primary health care education and training, pay equity, and the impact of technology. Health services included health care delivery, screening and immunisation programmes, and specific services such as chronic pain services. Mental health themes included community psychology, mental health of youth and children, and some specific mental illnesses including depression and eating disorders. A few codes in the models of primary health care theme overlapped with health services. Various broad primary health care models were included in this theme, including community pharmacy, evidence-based practice, holistic approaches, etc.

Table 2.Priority research themes ranked by frequency.

RankThemesFrequency of themes
1Access to primary health care66
2Health workforce45
3Health services35
4Mental health22
4Models of primary health care22
6Inter-professionalism18
7Chronic illness management12
8Māori health10
8Rural health10
10Consumer experience8
11Children health7
11Quality of care7
13Patient education6
14Older people’s health5
14Primary health care extended5
16Oral health4
16Preventative care4
18Primary health care education3
18Women’s health3
19Pacific health2
20Disabilities1
20Workplace health1

Research questions

In the first Delphi round, participants proposed 133 priority research questions for primary health care. Seven questions were excluded by scope. Unfeasibility was the main reason for exclusion; 103 questions were considered unfeasible to answer in a primary health care research setting using routinely collected data. Only 23 questions met the inclusion criteria of being both relevant and feasible.

Participants rated the importance of the 23 retained questions in the second Delphi round. Thirty-five valid responses were recorded. Consensus was reached on 20 out of 23 questions (Table 3). The top four questions had similar mean Likert scores. The top-ranked item queries the impact of annual checks for people with intellectual disability. The second and third-equal questions focus on the impact of embedding allied health professionals and social workers in primary health care.

Table 3.Research questions ranked by Likert score.

RankLikert mean scoreResearch questions
14.2For people with intellectual disability, do annual health checks improve health information and outcomes?
24.19Does access to allied health practitioners as front-line providers improve long-term outcomes in people with chronic overlapping pain conditions (ie fibromyalgia, irritable bowel syndrome, temporomandibular disorders, etc.)?
34.19Does attending a general practice clinic with an embedded social worker (who can assist with access to benefits and housing) improve health outcomes/emergency department (ED) presentations for adults?
34.19How do comprehensive primary and community care teams (with physio and pharmacy embedded within general practice) impact high-use patient visits?
54.13If specialist referrals are made by hospital doctors at first point of contact (rather than being referred back to general practice), are patient outcomes improved (or are repeat ED presentations or general practice visits reduced)?
64.12Does access to higher levels of community hubs of staff (eg home visits, road caravans – going to the patient/client rather than they to you) lead to better health outcomes than general practice clinics?
74.11For patients with multimorbidity, do community-based, inter-professional, exercise, and supported self-management programmes improve the clinical and quality-of-life outcomes?
84.06Do primary health care support individuals (eg kaiāwhina) improve Māori access and engagement with primary care services, compared to standard care?
94.03Does the localities model improve access to health care? Which regions is it working in? How is it working?
103.97For adults, do regular medical appointments (eg 3 or 6 monthly review) reduce unplanned visits and ED attendance?
113.94For rural residing Māori, does improved continuity-of-care with a primary care prescriber improve outcomes, compared with patients who have had multiple primary care prescribers?
123.93Is attending a Health Improvements Practitioner (HIP) more effective than using anti-depressants alone?
133.91For adults with prediabetes, does providing primary intervention dietitian-led clinics improve patient outcomes?
143.90Do patients enrolled in a practice with a clinical pharmacist embedded in the team have fewer drug-related problems than those who aren’t?
153.89For adults, does living in a rural area compared with an urban area lead to fewer public outpatient referrals?
163.88For the elderly (65 years and older) living in rural areas, would having a home visit by either a nurse practitioner or paramedic reduce use of general practice, compared to those who do not have these home visits?
173.83For Māori adults, does having health care provided by a Māori provider improve health outcomes, compared to those attending a traditional general practice?
183.62How often is there a clearly documented review of patient’s medications when they are on 5+ meds?
193.60For residents of residential care facilities in a rural setting, how often do they have geriatrician consults, compared to residents in an urban setting?
203.48Do patients with lower socioeconomic status have more dental extractions?

Discussion

Primary health care clinicians and academics in NZ considered access to health care, health workforce, health services, mental health, and models of primary health care as the top research areas to improve health equity. Research questions with the highest priority scores include the impact of annual health checks for people with intellectual disability, the role of allied health as front-line primary health care providers, and the role of an embedded social worker in a general practice clinic setting. These research priorities are consistent with those identified in international prioritisation exercises conducted in primary health care.2125 To our knowledge, this is the first attempt in NZ to prioritise primary health care research topics and questions.

In terms of study strengths, the sample size is sufficient to obtain consensus in a Delphi survey.17 Clinicians and academics came from a variety of disciplines. Māori participation was strong (11/58, 19.0%), particularly given the underrepresentation of Māori among health care clinicians and academics.26,27 The main study limitations relate to non-representative sampling. Snowball sampling methods may have influenced the diversity of the sample. Few males participated (8/58, 13.8%). No participants identified as either belonging to the Pacific community or LGBTQI+ group. Research priorities for those groups may have been omitted. Non-representative sampling may have influenced the final results, limiting their generalisability. Although used in other priority-setting exercises,20 we found requesting the questions in the PICOT format limited the generalisability of the research questions.

Health care access was the highest priority research theme area identified. Health care access is critical to achieving equitable health outcomes.28 Although the health system in NZ is largely government funded, patient co-payments in primary health care present a substantial barrier to access.29 One in eight New Zealand adults (12.9%) report they do not visit a GP due to cost.30 Patients who are not enrolled with a primary health care provider experience increased odds of amenable mortality.31 Ongoing research in this area is necessary to evaluate the impact of current health policies and any new initiatives that aim to reduce access barriers to primary health care.28 This is particularly imperative for Māori and Pacific populations, patients who experience socioeconomic deprivation, and those in underserved communities.

Closely related to health care access, the health workforce is a critical element in the health system. It is therefore unsurprising that health workforce was also identified as a priority research area.28,32 The health workforce fluctuates because of health policy, education, and retention.28,33 NZ has failed to train adequate numbers of health professionals over many decades, and struggles to recruit and retain primary health care providers in a competitive global economy.32 NZ is ostensibly committed to growing the primary health care workforce, with special attention to training Māori and Pacific clinicians, rural health practitioners, and the training of allied health professionals.34 Inter-professionalism is being promoted as a method of improving health care delivery in areas of need.34,35 Further research is required to evaluate the outcomes of increased inter-professional care.

Health services was another priority research area identified. Health service research encompasses service scope, quality, and impact on health outcomes. Routinely collected primary health care data have long been used to evaluate health service quality.36,37 Health services are closely aligned with another prioritised research theme, that of primary health care models. Over the past decade, there has been a substantial push from traditional and corporate practice models to new models of care such as the Health Care Home.28 The drivers for change include several of the other priority research areas identified in this study, including low numbers of primary health care clinicians and difficulty in accessing health care resulting in inequitable care. To date, there is no clear evidence that one model performs better than another, and Māori and Pacific patients and those in poverty still have worse health outcomes.28 Ongoing health care evaluation using routinely collected data is imperative for any emerging primary health care models going forward.

Mental health was the top ranked health condition identified as a priority research topic. Mental health conditions affect approximately one in five New Zealanders of all ages and NZ has one of the highest suicide rates among the Organisation for Economic Co-operation and Development (OECD) countries.38,39 Poor mental health is a major driver of health care use, and is correlated with premature morbidity and mortality.40,41 Primary health care plays a critical role in prevention, early diagnosis and intervention, monitoring, and access to secondary care services if needed.42 NZ recently launched an integrated model of mental health and addiction services within primary health care settings to address unmet need.43 Ongoing research to monitor the impact of such changes, as well as to identify outstanding unmet mental health needs in primary care, is required to improve equitable mental health care in NZ.

The top-ranked research question proposes evaluating the impact of implementing annual health checks for people with an intellectual disability. People with intellectual disability experience greater barriers to accessing primary health care and higher mortality and morbidity than the rest of the population.4446 An annual health check is an effective way to maintain health and identify unmet health needs of people with intellectual disability.47 NZ lacks the capacity to track the mortality and morbidity information of people with intellectual disability.48 Routinely collected primary health care data could be used to track this information for future research endeavours, to inform health policy and improve health outcomes for people with intellectual disability.

The impact of multidisciplinary teams, including allied health professionals and social workers, was a feature of the subsequent three most highly rated questions (Table 3). Question two considers the role of allied health professionals in chronic overlapping pain conditions. Nearly 20% of the NZ population experience chronic pain, and analgesia is one of the most frequently prescribed medications in primary care.4951 There is increasing recognition of the coexistence of overlapping pain conditions, which are likely underdiagnosed.52 An interdisciplinary approach is considered the gold standard in chronic pain management and is a feature of secondary pain clinic services.53 Although most patients with chronic pain are treated in primary care, little research on primary care multidisciplinary pain management teams appears to have been undertaken to date.53

The third equally ranked questions consider whether embedded social workers would improve patient health outcomes or ED presentations, and the impact of comprehensive primary care teams on high-use patient visits. Interdisciplinary primary care teams have been widely implemented as a means of improving care quality and patient outcomes, particularly for more complex patients. Evaluation of the impact of interdisciplinary teams is an emerging research topic; findings to date suggest they may be associated with positive patient outcomes.54,55 Patient experience is improved in interdisciplinary primary care team settings.56 Embedding social workers within a primary care team may improve care coordination quality.57

Primary health care clinicians and academic staff in NZ identified priority areas and questions requiring research to improve health equity. Specific research questions can guide primary care researchers planning equity-focused outcomes research with a strong primary care mandate. Additional consultation is planned with other stakeholders including patients, Māori, and Pacific community groups. Prioritised general research areas will be used as discussion starters in engagement exercises with other stakeholder groups. Taken together, these stakeholder engagement projects will help establish a formal research agenda for the Southern PCRN in accordance with its mission of improving health equity. To that end, future research should focus on primary health care access; particularly workforce issues and health care models and services, including the embedding of allied health professionals and social workers in primary health care. People with mental illness and intellectual disability were also identified as priority groups for research to improve health equity.

Supplementary material

Supplementary material is available online.

Data availability

Data will be available from the corresponding author on request.

Conflicts of interest

T. S. is an Editor of the Journal of Primary Health Care. To mitigate this potential conflict of interest he had no editor-level access to this manuscript during the peer review process for this paper. There are no other conflicts of interest to declare.

Declaration of funding

This project was supported by research funds from Health Research South Joint Clinical Start-Up Award 2022. Health Research South was not involved in the study design, collection, analysis, interpretation of the data, or the writing of the manuscript.

Acknowledgements

The authors thank participants for their time and contribution.

References

Simpson H. Health and disability system review. Final report. Pūrongo whakamutunga. Wellington: Health and Disability System Review; 2020.

Pigden A, Stokes T, Crengle S, et al. Developing a national primary care research network: a qualitative study of stakeholder views. J Prim Health Care 2022; 14(4): 338-44.
| Crossref | Google Scholar | PubMed |

Sullivan F, Butler C, Cupples M, et al. Primary care research networks in the United Kingdom. BMJ 2007; 334(7603): 1093-4.
| Crossref | Google Scholar | PubMed |

Green LA, Hickner J. A short history of primary care practice-based research networks: from concept to essential research laboratories. J Am Board Fam Med 2006; 19(1): 1-10.
| Crossref | Google Scholar | PubMed |

Morkem R, Shah R, Salman A, et al. CPCSSN data quality: an opportunity for enhancing Canadian primary care data. Ann Fam Med 2023; 21: 4964.
| Crossref | Google Scholar |

Leitch S. New Zealand needs a Practice Based Research Network. J Prim Health Care 2016; 8(1): 9-12.
| Crossref | Google Scholar | PubMed |

Viergever RF, Olifson S, Ghaffar A, et al. A checklist for health research priority setting: nine common themes of good practice. Health Res Policy Syst 2010; 8(1): 1-9.
| Crossref | Google Scholar | PubMed |

Yoshida S. Approaches, tools and methods used for setting priorities in health research in the 21st century. J Glob Health 2016; 6(1): 010507.
| Crossref | Google Scholar | PubMed |

Fun WH, Sararaks S, Tan EH, et al. Research funding impact and priority setting – advancing universal access and quality healthcare research in Malaysia. BMC Health Serv Res 2019; 19(1): 248.
| Crossref | Google Scholar | PubMed |

10  Nasser M, Ueffing E, Welch V, et al. An equity lens can ensure an equity-oriented approach to agenda setting and priority setting of Cochrane Reviews. J Clin Epidemiol 2013; 66(5): 511-21.
| Crossref | Google Scholar | PubMed |

11  Gradinger F, Britten N, Wyatt K, et al. Values associated with public involvement in health and social care research: a narrative review. Health Expect 2015; 18(5): 661-75.
| Crossref | Google Scholar | PubMed |

12  Forsythe LP, Ellis LE, Edmundson L, et al. Patient and stakeholder engagement in the PCORI pilot projects: description and lessons learned. J Gen Int Med 2016; 31: 13-21.
| Crossref | Google Scholar | PubMed |

13  Walter M, Lovett R, Maher B, et al. Indigenous data sovereignty in the era of big data and open data. Aust J Soc Issues 2021; 56(2): 143-56.
| Crossref | Google Scholar |

14  West K, Hudson M, Kukutai T. Data ethics and data governance from a Māori world view. Indigenous research ethics: claiming research sovereignty beyond deficit and the colonial legacy. Emerald Publishing Limited; 2020:67-81.

15  Grill C. Involving stakeholders in research priority setting: a scoping review. Res Involv Engagem 2021; 7(1): 75.
| Crossref | Google Scholar | PubMed |

16  Choi BC, Maza RA, Mujica OJ, et al. The Pan American Health Organization-adapted Hanlon method for prioritization of health programs. Pan Am J Public Health 2019; 43:.
| Google Scholar |

17  Nasa P, Jain R, Juneja D. Delphi methodology in healthcare research: how to decide its appropriateness. World J Methodol 2021; 11(4): 116.
| Crossref | Google Scholar | PubMed |

18  Diamond IR, Grant RC, Feldman BM, et al. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol 2014; 67(4): 401-9.
| Crossref | Google Scholar | PubMed |

19  Qualtrics. Qualtrics. 2005. Available at https://www.qualtrics.com [accessed March 2023].

20  Deane HC, Wilson CL, Babl FE, et al. PREDICT prioritisation study: establishing the research priorities of paediatric emergency medicine physicians in Australia and New Zealand. Emerg Med J 2018; 35(1): 39-45.
| Crossref | Google Scholar | PubMed |

21  Heal C, Roberts G. General practice research priority setting in Australia: informing a research agenda to deliver best patient care. Aust J Gen Pract 2019; 48(11): 789-95.
| Crossref | Google Scholar | PubMed |

22  Abrams R, Blake S. UK general practice service delivery research priorities: an adapted James Lind Alliance approach. Br J Gen Pract 2024; 74(738): e9.
| Crossref | Google Scholar | PubMed |

23  Morris RL, Stocks SJ, Alam R, et al. Identifying primary care patient safety research priorities in the UK: a James Lind Alliance Priority Setting Partnership. BMJ Open 2018; 8(2): e020870.
| Crossref | Google Scholar | PubMed |

24  Goodyear-Smith F, Bazemore A, Coffman M, et al. Primary Care research priorities in low-and middle-income countries. Ann Fam Med 2019; 17(1): 31-5.
| Crossref | Google Scholar | PubMed |

25  Groenewegen P, Hansen J, Fahy N, et al. Priority setting and cross-country learning: the relevance of TO-REACH for primary care. Prim Health Care Res Dev 2022; 23: e40.
| Crossref | Google Scholar | PubMed |

26  Crampton P, Bagg W, Bristowe Z, et al. National cross-sectional study of the sociodemographic characteristics of Aotearoa New Zealand’s regulated health workforce pre-registration students: a mirror on society? BMJ Open 2023; 13(3): e065380.
| Crossref | Google Scholar | PubMed |

27  McAllister T, Kidman J, Rowley O, et al. Why isn’t my professor Mäori. Mai J 2019; 8(2): 235-49.
| Google Scholar |

28  Sheridan N, Love T, Kenealy T, et al. Is there equity of patient health outcomes across models of general practice in Aotearoa New Zealand? A national cross-sectional study. Int J Equity Health 2023; 22(1): 79.
| Crossref | Google Scholar | PubMed |

29  Jeffreys M, Ellison-Loschmann L, Irurzun-Lopez M, et al. Financial barriers to primary health care in Aotearoa New Zealand. Fam Pract 2023; cmad096.
| Crossref | Google Scholar | PubMed |

30  Ministry of Health. Annual Data Explorer 2022/23: New Zealand Health Survey [Data File]. 2023. Available at https://minhealthnz.shinyapps.io/nz-health-survey-2022-23-annual-data-explorer/ [accessed February 2024].

31  Silwal P, Lopez MI, Pledger M, et al. Association between enrolment with a Primary Health Care provider and amenable mortality: a national population-based analysis in Aotearoa New Zealand. PLoS One 2023; 18(2): e0281163.
| Crossref | Google Scholar | PubMed |

32  Rees GH. The evolution of New Zealand’s health workforce policy and planning system: a study of workforce governance and health reform. Hum Resour Health 2019; 17(1): 51.
| Crossref | Google Scholar | PubMed |

33  O’Neill B, Aversa V, Rouleau K, et al. Identifying top 10 primary care research priorities from international stakeholders using a modified Delphi method. PLoS One 2018; 13(10): e0206096.
| Crossref | Google Scholar | PubMed |

34  Te Whatu Ora – Health New Zealand. Health Workforce Plan 2023-24. Wellington: Te Whatu Ora – Health New Zealand; 2023.

35  McNaughton SM, Flood B, Morgan CJ, et al. Existing models of interprofessional collaborative practice in primary healthcare: a scoping review. J Interprof Care 2021; 35(6): 940-52.
| Crossref | Google Scholar | PubMed |

36  de Lusignan S, van Weel C. The use of routinely collected computer data for research in primary care: opportunities and challenges. Fam Pract 2006; 23(2): 253-63.
| Crossref | Google Scholar | PubMed |

37  Tierney WM, McDonald CJ. Practice databases and their uses in clinical research. Stat Med 1991; 10(4): 541-57.
| Crossref | Google Scholar | PubMed |

38  Sutcliffe K, Ball J, Clark TC, et al. Rapid and unequal decline in adolescent mental health and well-being 2012–2019: findings from New Zealand cross-sectional surveys. Aust NZ J Psychiatry 2023; 57(2): 264-82.
| Crossref | Google Scholar | PubMed |

39  Wilson A, Nicolson M. Mental health in Aotearoa: Results from the 2018 mental health monitor and the 2018/19 New Zealand Health Survey. Wellington: Te Hiringa Hauora/Health Promotion Agency; 2020.

40  Lockett H, Lai J, Tuason C, et al. Primary healthcare utilisation among adults with mood and anxiety disorders: an analysis of the New Zealand Health Survey. J Prim Health Care 2018; 10(1): 68-75.
| Crossref | Google Scholar | PubMed |

41  Richmond-Rakerd LS, D’Souza S, Milne BJ, et al. Longitudinal associations of mental disorders with physical diseases and mortality among 2.3 million New Zealand citizens. JAMA Netw Open 2021; 4(1): e2033448.
| Crossref | Google Scholar | PubMed |

42  Tselebis A, Pachi A. Primary mental health care in a new era. Healthcare 2022; 10: 2025.
| Crossref | Google Scholar |

43  Kulshrestha V, Shahid SM. Barriers and drivers in mental health services in New Zealand: current status and future direction. Glob Health Promot 2022; 29(4): 17579759221099312.
| Crossref | Google Scholar | PubMed |

44  O’Hara J, McCarthy J, Bouras N. Intellectual disability and ill health – A review of the evidence. Adv Ment Health Intellect Disabil 2011; 5(6): 58-60.
| Crossref | Google Scholar |

45  Liao P, Vajdic C, Trollor J, et al. Prevalence and incidence of physical health conditions in people with intellectual disability – a systematic review. PLoS One 2021; 16(8): e0256294.
| Crossref | Google Scholar | PubMed |

46  Shea B, Bailie J, Dykgraaf SH, et al. Access to general practice for people with intellectual disability in Australia: a systematic scoping review. BMC Prim Care 2022; 23(1): 306.
| Crossref | Google Scholar | PubMed |

47  Robertson J, Hatton C, Emerson E, et al. The impact of health checks for people with intellectual disabilities: an updated systematic review of evidence. Res Dev Disabil 2014; 35(10): 2450-62.
| Crossref | Google Scholar | PubMed |

48  McCarthy J, Duff M. Services for adults with intellectual disability in Aotearoa New Zealand. BJPsych Int 2019; 16(3): 71-3.
| Crossref | Google Scholar | PubMed |

49  Health Mo. Annual update of key results 2018/19: New Zealand health survey. Wellington: Ministry of Health; 2019.

50  Tomlin AM, Woods DJ, Reid JJ, et al. Trends in prescription medicine use by older people in New Zealand 2010–2015: a national population-based study. N Z Med J 2020; 133(1513): 61-72.
| Google Scholar | PubMed |

51  Raghunandan R, Marra CA, Tordoff J, et al. Examining non-medical prescribing trends in New Zealand: 2016–2020. BMC Health Serv Res 2021; 21(1): 418.
| Crossref | Google Scholar | PubMed |

52  Maixner W, Fillingim RB, Williams DA, et al. Overlapping chronic pain conditions: implications for diagnosis and classification. J Pain 2016; 17(9): T93-107.
| Crossref | Google Scholar | PubMed |

53  Huttunen MH, Paananen M, Miettunen J, et al. Multidisciplinary management of persistent pain in primary care—A systematic review. Eur J Pain 2024; 1-15.
| Crossref | Google Scholar | PubMed |

54  Saint-Pierre C, Herskovic V, Sepúlveda M. Multidisciplinary collaboration in primary care: a systematic review. Fam Pract 2017; 35(2): 132-41.
| Crossref | Google Scholar | PubMed |

55  Wranik WD, Price S, Haydt SM, et al. Implications of interprofessional primary care team characteristics for health services and patient health outcomes: a systematic review with narrative synthesis. Health Policy 2019; 123(6): 550-63.
| Crossref | Google Scholar | PubMed |

56  Davidson AR, Kelly J, Ball L, et al. What do patients experience? Interprofessional collaborative practice for chronic conditions in primary care: an integrative review. BMC Prim Care 2022; 23(1): 1-12.
| Crossref | Google Scholar |

57  Couturier Y, Lanoue S, Karam M, et al. Social workers coordination in primary healthcare for patients with complex needs: a scoping review. Int J Care Coord 2023; 26(1): 5-25.
| Crossref | Google Scholar |