Free Standard AU & NZ Shipping For All Book Orders Over $80!
Register      Login
Australian Journal of Primary Health Australian Journal of Primary Health Society
The issues influencing community health services and primary health care
REVIEW (Open Access)

Systems levers for commissioning primary mental healthcare: a rapid review

Carla Meurk A B E , Meredith Harris A B , Eryn Wright A B , Nicola Reavley C , Roman Scheurer A B , Bridget Bassilios C , Caroline Salom B D and Jane Pirkis C
+ Author Affiliations
- Author Affiliations

A The University of Queensland, School of Public Health, Corner Herston Road and Wyndham Street, Herston, Qld 4006, Australia.

B Policy and Epidemiology Group, Queensland Centre for Mental Health Research, Locked Bag 500, Archerfield, Qld 4108, Australia.

C The University of Melbourne, Melbourne School of Population and Global Health, Vic. 3010, Australia.

D Institute for Social Sciences Research, The University of Queensland, Long Pocket Precinct, 80 Meiers Road, Indooroopilly, Qld 4068, Australia.

E Corresponding author. Email: c.meurk@uq.edu.au

Australian Journal of Primary Health 24(1) 29-53 https://doi.org/10.1071/PY17030
Submitted: 8 March 2017  Accepted: 23 September 2017   Published: 17 January 2018

Journal compilation © La Trobe University 2018 Open Access CC BY-NC-ND

Abstract

Primary Health Networks (PHNs) are a new institution for health systems management in the Australian healthcare system. PHNs will play a key role in mental health reform through planning and commissioning primary mental health services at a regional level, specifically adopting a stepped care approach. Selected PHNs are also trialling a healthcare homes approach. Little is known about the systems levers that could be applied by PHNs to achieve these aims. A rapid review of academic and grey literature published between 2006 and 2016 was undertaken to describe the use of systems levers in commissioning primary care services. Fifty-six documents met the inclusion criteria, including twelve specific to primary mental healthcare. Twenty-six levers were identified. Referral management, contracts and tendering processes, and health information systems were identified as useful levers for implementing stepped care approaches. Location, enrolment, capitation and health information systems were identified as useful in implementing a healthcare homes approach. Other levers were relevant to overall health system functioning. Further work is needed to develop a robust evidence-base for systems levers. PHNs can facilitate this by documenting and evaluating the levers that they deploy, and making their findings available to researchers and other commissioning bodies.

Introduction

Primary Health Networks (PHNs) began operation in Australia on 1 July 2015. PHNs have been tasked with increasing the efficiency and effectiveness of medical services for patients, particularly those at risk of poor health outcomes, and improving coordination of care to ensure that patients receive the right care in the right place, at the right time (Australian Government Department of Health 2015a). PHNs are to play a key role in mental health reforms, particularly through the planning and commissioning of primary mental health services at a regional level (Australian Government Department of Health 2015b). This will be supported by a flexible funding pool for mental health and suicide prevention services (Australian Government Department of Health 2015b).

The Australian Government expects PHNs to undertake capacity building in, and implementation of, systems and processes that will support effective commissioning of services in the future. Commissioning is defined by the Department of Health as: ‘a strategic approach to procurement that is informed by the baseline needs assessment and associated market analysis […]. Commissioning is further characterised by ongoing assessment to monitor the quality of services and ensure that relevant contractual standards are fulfilled’ (Australian Government Department of Health 2016, p. 10). Dawda et al. (2016, p. 5) elaborate on this definition and emphasise that commissioning includes ‘a range of actions including strategic needs assessment; prioritisation; planning and designing services; options appraisal; sourcing; delivery; and monitoring and review’.

With respect to primary mental healthcare, the ultimate aims of reform are to alleviate the burden of mental illness and improve the quality of life for those who experience mental ill-health. With respect to the implementation of reforms, the Australian Government has identified that PHNs will play a role in implementing a stepped care approach to delivering primary mental healthcare services (National Mental Health Commission 2014; Australian Government Department of Health 2015b). Stepped care involves a continuum of mental health services that facilitates the delivery of least intensive, most appropriate, evidence-based treatments to patients according to their level of need (National Institute for Health and Care Excellence 2011; Australian Government Department of Health 2015b). In addition, following recommendations from the Primary Health Care Advisory Group in 2016, and as part of broader primary healthcare system reforms, a healthcare homes approach is being trialled in selected practices across 10 PHNs (Health Care Homes Implementation Advisory Group 2016; Primary Health Care Advisory Group 2016). Healthcare homes are a model of integrated, technologically enhanced, primary healthcare service, where co-located providers take responsibility for coordinating care and providing multidisciplinary services for eligible patients (Cummins et al. 2007; Ferrante 2010; Moore et al. 2014; Wilks et al. 2015; Primary Health Care Advisory Group 2016).

Systems levers

Systems levers are a means by which PHNs can fulfil the imperative to influence the Australian health system (Australian Healthcare and Hospital Association 2015a, 2015b). No bespoke definitions or frameworks exist to guide PHNs in effectively using levers to achieve health system change.

One framework for understanding the levers that governing bodies have at their disposal is provided by Roberts et al. (2009, p. 127), who defined policy levers as: ‘features of the system and strategies that governments can use in each arena to improve health sector performance’. They proposed a typology of five levers that can be applied by governments to deliver reform. The framework proposed by Roberts et al. (2009) has been successfully adapted for analysing Australian mental health reforms at a national level (Whiteford 2011; Grace et al. 2015; Meurk et al. 2016), and is potentially extensible to describing levers that can be employed by local health organisations (Table 1).


Table 1.  Definition of five policy lever types relevant to national level mental health reforms
Source: Grace et al. 2015
T1

Aims

The primary aim of this rapid review was to identify and describe the systems levers that could be used to commission primary mental healthcare in a way that supports stepped care and healthcare homes approaches. The secondary aim was to adapt typology of policy levers proposed by Roberts et al. (2009) to describe systems levers relevant to regional level health governance.


Methods

Search strategy

The search comprised an academic database search and a grey literature search. Academic databases searched were: ProQuest Social Science, and Medline and PsycINFO (by Ovid). Search strings using Boolean operators took the form of ‘lever terms’ AND ‘primary mental healthcare model terms’ AND ‘country terms’ (Table 2). Lists of terms were internally connected by an OR operator. For the grey literature search, source documents were obtained from a pre-defined list of websites of government health departments, think tanks, online repositories and mental health professional bodies in countries with health systems comparable to those in Australia (Appendix 1). Health-specific websites were searched for the terms lever(s). Generalist sites were searched by adding the term ‘health’ to the search string, in order to restrict search results to health topics only. Reports that could be downloaded in PDF or DOC or DOCX formats were included for screening. Additional sources were identified through reference lists, citation searches and materials known to the authors.


Table 2.  Search terms used
Wildcard keywords were used as appropriate in order to capture variations in suffixes as well as plural and possessive forms of search terms
Click to zoom

Inclusion criteria

Following initial scoping of the literature available, we decided to take an inclusive approach. Documents were included if they explicitly or implicitly discussed levers, as defined by Roberts et al. (2009), and related to the commissioning of any healthcare services in a way that was relevant to primary mental healthcare. Inclusion criteria were: (1) the document was in English and about a high-income country or countries with health systems that are comparable to Australia’s in terms of governance, financing and the organisational role played by primary care, and are known to have implemented or piloted primary mental healthcare models at a national or state or provincial level. These included, but were not limited to, the United Kingdom, Canada, New Zealand and the Netherlands (Bywood et al. 2015; Mossialos et al. 2016); (2) the document was published between 2006 and 2016; (3) the document described, implicitly or explicitly, the application of any levers in the context of commissioning any healthcare services, except as identified in the exclusion criteria below; and (4) the document presented an analysis of primary data or described or reviewed previous or current approaches. Exclusion criteria were: (1) analysis of levers focused on national level reform or levers outside the sphere of PHN influence (e.g. local health networks as a lever of national reform, national responses to workforce issues); and (2) documents focused on levers relevant to laboratory testing, aged care homes, end-of-life care, prison care, population-level prevention and promotion, secondary care, integration between health and social services, or prescribing and pharmacy.

Screening and data extraction

Documents were initially excluded through title and abstract screening (title and executive summary screening for reports). Further exclusions occurred as analysis proceeded. Basic characteristics of each document were extracted from each source, specifically: Author/Year; Study type; Area of health; Levers identified; and Brief summary of the document, including information about country of focus and specifics of models or programs where levers were discussed. Classifications for area of health were: Primary mental healthcare; Primary healthcare; Mental health, other; and Health, other. Evidence regarding the outcomes of applying levers was extracted, if reported.

Document classification

Documents were classified according to their methods: qualitative, quantitative, mixed methods, review or position paper (categories adapted from Gardner et al. 2016). One descriptor was allocated per document. Given that the aim of this article was to identify levers, we did not apply quality criteria or bias assessment tools.

Analysis

A deductive–inductive approach to classifying lever types and sub-types was undertaken, as follows: C. Meurk sorted literature into categories according to each of the five lever types given in Table 1 (deductive analysis). This typology was adapted as new categories of lever became apparent and initial ones were identified as irrelevant to regional health governance (inductive analysis). As this process unfolded, previously categorised literature was re-read and re-sorted as necessary. This process was interpretive and occurred in tandem with the extraction, analysis and synthesis of lever descriptions, and descriptions of their significance and use. Where levers could be multiply assigned, they were classified according to a primary mechanism – what has been termed a ‘leading edge’ approach to classification (Grace et al. 2015). Supporting levers were documented. A sample of 10 references was cross-checked by E. Wright and discrepancies in the classification of levers were resolved through negotiation between C. Meurk and E. Wright.

A narrative synthesis of results included an appraisal of the relevance of levers with respect to key challenges for implementing stepped care, such as service integration, team-based care and continuity of care, where possible. Priority in interpretation was given to documents that evaluated the use of levers most relevant to the primary mental healthcare context and to an Australian context.


Results

Search results

The search resulted in 56 documents being included in the narrative synthesis (Fig. 1).


Fig. 1.  PRISMA flowchart. Adapted with permission from Moher et al. (2009).
Click to zoom

In total, 39 of the 56 documents focussed on primary healthcare, 12 on primary mental healthcare, 1 focussed on other areas of mental health, and 4 focussed on other areas of health (Table 3). Twenty-seven documents were classified as using qualitative methods, nine as using quantitative methods and five as using mixed methods. A further 13 documents were classified as reviews and 2 as position papers.


Table 3.  Characteristics of documents reviewed
PMHC, Primary Mental Health Care; PHC, Primary Health Care; MH, Mental Health, Other; H, Health, Other; Org, Organisation; Eng, Engagement; Enf, Enforcement; Info, Information; Tech, Technology; Fin&Pay, Finance and Payment
Click to zoom

Classification of systems levers

Six lever types and twenty-six different levers were identified. Organisation levers were identified in 19 documents, engagement levers in 17 documents, enforcement levers in 9 documents, information levers in 18 documents, technology levers in 11 documents, and finance and payment levers in 14 documents. Table 4 defines and identifies these lever types, the correspondence between the new typology and the typology proposed by Roberts et al. (2009), a justification for the changes made, and a list of specific levers that were mapped to each lever type.


Table 4.  Lever types identified in the included documents
Source for National level lever types is Grace et al. (2015), adapted from Roberts et al. (2009)
Click to zoom

Use of systems levers for commissioning mental healthcare

For each lever, Table 5 summarises its application(s) in the context of primary mental healthcare, its significance and use, and supporting levers (i.e. levers that are used in conjunction with the principle lever). Additional detail is given below.


Table 5.  Summary of levers for commissioning primary mental healthcare
En-dashes indicate that descriptions of key findings are intentionally left blank
Click to zoom

Organisation

Organisation levers aim to directly influence the structure of healthcare organisations, the workforce, the organisation of help seekers with respect to available services in time and space, and features that facilitate effective organisational cultures. Several of the organisation levers that were identified in the review (namely, leadership, nursing and contracting external support) were considered to be important to health systems functioning and primary care, as opposed to being only relevant to mental healthcare.

Referral management was identified as being particularly important to implementing a stepped care approach to mental healthcare (Bywood et al. 2015). Within Australia, GP referrals and mental health treatment plans are the most common referral pathways used to facilitate primary mental healthcare (Harris et al. 2010; Bassilios et al. 2013). GP mental health plans followed by vouchers and third party brokers have been the most common way to facilitate referrals to psychologists (Bassilios et al. 2013; Bywood et al. 2015). More recent innovations are technological and include web-based portals that can assist GPs to assess, manage and appropriately refer patients (WentWest Ltd 2015).

Enrolment with a primary care provider was identified as relevant to implementing a healthcare homes model, and a potential facilitator of achieving improved outcomes for people with complex needs (e.g. people with serious mental illness) (Douglas et al. 2009; Bywood et al. 2015).

Engagement

Engagement refers to the activities of fostering and maintaining relationships, and dialogue, among the actors that comprise the health system. Engagement may refer to the interactions within commissioning organisations and between commissioning organisations and service providers, clinicians and public and patient groups (Naik et al. 2013; Perkins et al. 2014). Engagement was described as a means by which commissioners could influence provider behaviour in order to improve performance (Grant et al. 2015). Franx et al. (2013) identified power sharing, mutual respect and two-way capacity building as key elements of engagement. Bywood et al. (2015) describe the key goals of engagement as identifying shared goals and achieving mutual benefit. Effective engagement was noted as important for enabling health professionals to act autonomously; conversely, poor relationships and communication may undermine this, creating uncertainty, frustration and inefficiency (Checkland et al. 2009; McCafferty et al. 2012; Checkland et al. 2013; Zachariadis et al. 2013).

Successful engagement depends on stakeholder buy-in and trust, and is undermined where time pressures preclude stakeholder involvement (Naik et al. 2013; Ashman and Willcocks 2014; Smiddy et al. 2015). Financial incentives or contractual obligation may be required to facilitate engagement (Box 2009; Smiddy et al. 2015). Engaging people with lived experience of mental illness was highlighted as being particularly important to implementing integrated care (Bywood et al. 2015). Effectively engaging referrers (e.g. GPs, emergency departments) was a key facilitating factor in the successful operation of Australia’s Access to Allied Psychological Services (ATAPS), a major primary mental healthcare program implemented from 2001 to 2016 (Bassilios et al. 2013).

Enforcement

Engagement may be viewed as dovetailing with and offsetting the excesses of the so-called ‘hard’ levers (i.e. enforcement levers) (Chambers et al. 2013; Grant et al. 2015). In contrast to ‘soft’ levers like engagement – that are used to improve performance but do not possess sufficient power to hold underperforming organisations to account – ‘hard’ levers provide a sanction-backed means of compelling action by incentivising compliance and deterring deviance (Addicott 2014; Grant et al. 2015; Schwartzkoff and Sturgess 2015; WentWest Ltd 2015). Hence, enforcement is also linked with finance and payment levers. Although legally backed agreements are necessary in enabling commissioning organisations to hold underperforming organisations to account, competitive approaches (defined as ‘rivalry in the market, striving for custom between those who have the same commodities to dispose of’ (OED Online 2017)) or overly legalistic approaches to management were seen to run the risk of undermining engagement, goodwill and cooperation (Addicott 2014; Grant et al. 2015; Schwartzkoff and Sturgess 2015). Having an emphasis on contestability (‘the credible threat or possibility of competition’; Schwartzkoff and Sturgess 2015, p. 31), rather than competition, was described as a means to offset these negative effects (Grant et al. 2015; Schwartzkoff and Sturgess 2015).

An evaluation of the ATAPS program found that retention of mental health professionals by contractual arrangements was viewed as disadvantageous, relative to retention by employment, from the point of view of mental health professionals (Bassilios et al. 2013). In particular, retention by employment was believed to offer greater continuity of care in comparison to contracting (Bassilios et al. 2013). Retention by contracting was deemed to be cheaper for commissioners of services as it allowed them to externalise costs to mental health professionals and was seen to be advantageous in offering greater choice of provider to referrers and patients (Bassilios et al. 2013).

Information

The information lever encompasses the collection, analysis, dissemination and exchange of information. Information can influence a system in multiple ways and is critical to evidence-based practice, performance management, accountability and quality improvement (Perera et al. 2013; Ashton 2015; Ham et al. 2015). Information is also important to making resource allocation decisions, fostering inter-organisation engagement, and engaging and fostering trust among stakeholders and the broader community (Franx et al. 2013; Perkins et al. 2014; Bywood et al. 2015; Ham et al. 2015). Information levers link with technology levers and payment levers, especially pay-for-performance approaches.

Successful use of data to inform commissioning is dependent in equal measures on technical skill and stakeholder support of data collection activities (Perera et al. 2013; Ashton 2015; Samra et al. 2015; Ball et al. 2016); poorly selected performance indicators run the risk of negatively affecting performance (Jacobs et al. 2006). Tremendous effort has been expended in Australia to establish high-quality routine data collection of mental healthcare processes and outcomes, as well as to develop the mental health research workforce (Bywood et al. 2015).

Information overload was described as posing a key barrier to implementing evidence-based practice, including decommissioning ineffective practices (Shepperd et al. 2013). To address this issue, systems to effectively manage the quantity of evidence, and monitor and implement evidence-based practice are needed (Shepperd et al. 2013). Lack of knowledge and skills have disproportionately negative effects on addressing the health needs of marginalised groups and minorities (Salway et al. 2016). It was noted that dissemination activities that involve providing negative feedback may cause hostility, and should be approached with sensitivity (Ball et al. 2016).

Technology

Technology is a lever for improving the efficient and effective functioning of the health system. It is closely related to the information levers and a necessary pre-requisite for the successful use of several other levers (e.g. organisation, enforcement, and finance and payment levers). Technology includes the use of health information systems, web portals, data visualisation tools and decision support tools. Health information systems, including electronic medical records, are a tool for improving data collection and increasingly a part of facilitating effective referral management, thus they are important to promoting service integration and continuity of care (Franx et al. 2013; Bywood et al. 2015).

Effective use of health information systems was described as enabling GPs to occupy the centre of a healthcare home model, even when services are not co-located, thus facilitating patient choice of provider (WentWest Ltd 2015). Decision support tools include the technologies mandated for use by the Australian Government (e.g. needs assessment), but can include several other tools – such as health technology assessment – which, although less often used, may enable effective commissioning (Elston and Stein 2007; Robinson et al. 2012; Goodwin and Frew 2013).

Finance and payment

Finance and payment act as levers by providing the resources necessary to fund healthcare activities. Several mechanisms for financing and payment were identified, including targeted marginal investment, block funding, case-based funding, capitation, fee-for-service and pay-for-performance (also referred to as payment by outcomes). Different models of payment reflect different trade-offs between administrative simplicity and target specificity, and engender different distributions of financial risk and responsibility between commissioning organisations and service providers (Marshall et al. 2014). In practice, blended arrangements are often used (Marshall et al. 2014). The pay-for-performance approach, which fuses financial and contractual mechanisms, was the most commonly discussed payment model in the literature reviewed, with several commentators expressing the need for caution in utilising this approach in terms of its possible deleterious effects on intrinsic motivation and continuity of care (Buetow 2008; Campbell et al. 2008; Marshall et al. 2014; Schwartzkoff and Sturgess 2015). The success of pay-for-performance approaches depends on the ability to select and monitor performance indicators that align with, and therefore incentivise, desirable activities and outcomes that are within a provider’s control and can be measured over the period of a contract (Schwartzkoff and Sturgess 2015). Implementation of payment by outcomes that result in delays in payment or present a significant financial risk to the contractor may be detrimental to the mental health system (Schwartzkoff and Sturgess 2015).

A Cochrane review of evidence on the effect of financial incentives on the behaviour of primary care practitioners found insufficient studies to judge the effectiveness of incentives (Scott et al. 2011). Ludwick et al. (2010) found that mode of remuneration did not affect the implementation of electronic medical records in Canada, whereas a review by McDonald et al. (2008) found inconclusive evidence linking mode of remuneration to improvements in team-based primary care.


Discussion

Effective primary mental healthcare depends on creating a system that patients can easily navigate and that is flexible to the way that symptoms and needs fluctuate. Facilitating service integration, multidisciplinary team-based care, and continuity of care are of paramount importance to achieving this. Although all levers identified in this review have applicability to PHNs with respect to their roles in improving health system functioning and primary care in general, the use of referral management, contracts, tendering and health information systems have specific implications to improving the performance of mental health systems.

Effective referral management, which focusses on mechanisms for facilitating patient access to the most appropriate, least restrictive care for their symptoms, will likely be critical to achieving better system integration and continuity of care. Contractual and payment approaches, specifically those that focus on contestability rather than competition, may help foster constructive and supportive relationships across providers that are critical to achieving system stability, integration and continuity.

Health information systems can be supportive of both mental health services and a healthcare homes model of primary care. In particular, the adoption of single multi-agency care plans may be an important facilitator of integration and continuity of care (Department of Health 2016).

Importantly, lever use is context-specific and multiple levers often work together. This is important to recognise for their successful application. However, it also raises methodological challenges in terms of how levers can be evaluated in order to build a much-needed evidence base to support their use (Greenhalgh et al. 2009; Cartwright and Hardie 2012; Grace et al. 2017).


Strengths and limitations

The key strength of this review is that it describes a range of levers from health systems that are similar to those in Australia. There are four key limitations to note. First, the classification of content according to levers relied on judgement and interpretation. Other researchers could have classified content differently. We do not think this potential variability undermines our analysis, given that it is based on an existing framework and that we undertook cross-checking of a sample of documents. Second, in the documents included in this review, only one profession (nursing) was considered as a ‘lever’ (see Table 5). Further work needs to be done to establish where and when health professionals and the workforce should be viewed as ‘levers’. Third, the literature was sparse and not necessarily based on robust evaluation methods. There is a need for further research to develop an evidence base for policy (Gardner et al. 2016). Finally, although this review focussed on the use of levers at a single level of governance (i.e. at a regional level), in practice, levers can be enacted across multiple levels of governance. Future research on levers that cross levels is warranted.


Conclusion

This review identified 26 different levers that could be used by Primary Health Networks to influence the mental health system. Although all of these levers play an important role in health system functioning in general, referral management, health information systems, contracts and tendering models may be uniquely relevant to achieving the appropriate streaming of help seekers, service integration and continuity of care – critical success factors for a stepped care model. Enrolment, location, health information systems and capitation may be particularly important for implementing a healthcare homes model. Further reviews and primary research are needed to evaluate the use of systems levers in commissioning primary mental healthcare by local health organisations. PHNs can help build an evidence base for levers by documenting the levers that they use, evaluating their use, and making this information available to researchers and other commissioning bodies for further analysis and synthesis.


Conflicts of interest

The authors declare that they have no conflicts of interest.



Acknowledgements

The authors acknowledge funding received from the Victorian Primary Health Network Alliance for this work. Carla Meurk receives salary support from the National Health and Medical Research Council (NHMRC) Centre for Research Excellence in Mental Health Systems Improvement (GNT1041131).


References

Addicott R (2014) Commissioning and contracting for integrated care. The King’s Fund, London, UK.

Ashcroft R, Silviera J, Rush B, McKenzie K (2014) Incentives and disincentives for the treatment of depression and anxiety: a scoping review. Canadian Journal of Psychiatry – Revue canadienne de psychiatrie 59, 385–392.
Incentives and disincentives for the treatment of depression and anxiety: a scoping review.Crossref | GoogleScholarGoogle Scholar |

Ashman I, Willcocks S (2014) Engaging with clinical commissioning: the attitudes of general practitioners in East Lancashire. Quality in Primary Care 22, 91–99.

Ashton T (2015) Measuring health system performance: a new approach to accountability and quality improvement in New Zealand. Health Policy 119, 999–1004.
Measuring health system performance: a new approach to accountability and quality improvement in New Zealand.Crossref | GoogleScholarGoogle Scholar |

Australian Government Department of Health (2015a) Needs assessment guide, December 2015. Commonwealth of Australia, Canberra, ACT, Australia.

Australian Government Department of Health (2015b) Australian Government response to contributing lives, thriving communities – review of mental health programmes and services. Commonwealth of Australia, Canberra, ACT, Australia.

Australian Government Department of Health (2016) Primary health networks: grant programme guidelines V1.2. Commonwealth of Australia, Canberra, ACT, Australia.

Australian Healthcare and Hospital Association (2015a) Mental Health: AHHA Primary Health Network discussion paper series: paper two. Australian Healthcare & Hospitals Association, Canberra, ACT, Australia)

Australian Healthcare and Hospital Association (2015b) Primary Health Network critical success factors: AHHA Primary Health Network discussion paper series: paper one. Australian Healthcare & Hospitals Association, Canberra, ACT, Australia.

Ball SL, Greenhalgh J, Roland M (2016) Referral management centres as a means of reducing outpatients attendances: how do they work and what influences successful implementation and perceived effectiveness? BMC Family Practice 17, 37
Referral management centres as a means of reducing outpatients attendances: how do they work and what influences successful implementation and perceived effectiveness?Crossref | GoogleScholarGoogle Scholar |

Bassilios B, Nicholas A, Reifels L, Machlin A, Ftanou M, King K, Fletcher J, Blashki G, Burgess P, Pirkis J (2013) Evaluating the Access to Allied Psychological Services (ATAPS) program: consolidated 10-year report. Centre for Health Policy, Programs and Economics, The University of Melbourne: Melbourne, Vic., Australia.

Box G (2009) Patient participation groups: the national picture. Quality in Primary Care 17, 291–297.

Breton M, Levesque J-F, Pineault R, Hogg W (2011) Primary care reform: can Quebec’s family medicine group model benefit from the experience of Ontario’s family health teams? Healthcare Policy 7, e122–e135.

Breton M, Maillet L, Haggerty J, Vedel I (2014) Mandated Local Health Networks across the province of Quebec: a better collaboration with primary care working in the communities? London Journal of Primary Care 6, 71–78.
Mandated Local Health Networks across the province of Quebec: a better collaboration with primary care working in the communities?Crossref | GoogleScholarGoogle Scholar |

Buetow S (2008) Pay-for-performance in New Zealand primary health care. Journal of Health Organization and Management 22, 36–47.
Pay-for-performance in New Zealand primary health care.Crossref | GoogleScholarGoogle Scholar |

Bywood P, Brown L, Raven M (2015) Improving the integration of mental health services in primary health care at the macro level. PHCRIS Policy Issue Review. Primary Health Care Research and Information Service, Adelaide, SA, Australia.

Campbell SM, McDonald R, Lester H (2008) The experience of pay for performance in English family practice: a qualitative study. Annals of Family Medicine 6, 228–234.
The experience of pay for performance in English family practice: a qualitative study.Crossref | GoogleScholarGoogle Scholar |

Cartwright N, Hardie J (2012) ‘Evidence-Based Policy: a Practical Guide to Doing it Better.’ (Oxford University Press: New York, NY, USA)

Chambers N, Sheaff R, Mahon A, Byng R, Mannion R, Charles N, Exworthy M, Llewellyn S (2013) The practice of commissioning healthcare from a private provider: learning from an in-depth case study. BMC Health Services Research 13, S4
The practice of commissioning healthcare from a private provider: learning from an in-depth case study.Crossref | GoogleScholarGoogle Scholar |

Chan T, Cohen A, de Lusignan S (2010) Using routine data to conduct small area health needs assessment through observing trends in demographics, recording of common mental health problems (CMHPs) and sickness certificates: longitudinal analysis of a northern and London locality. Informatics in Primary Care 18, 273–282.

Checkland K, Coleman A, Harrison S, Hiroeh U (2009) ‘We can’t get anything done because...’: making sense of ‘barriers’ to Practice-based Commissioning. Journal of Health Services Research & Policy 14, 20–26.
‘We can’t get anything done because...’: making sense of ‘barriers’ to Practice-based Commissioning.Crossref | GoogleScholarGoogle Scholar |

Checkland K, Allen P, Coleman A, Segar J, McDermott I, Harrison S, Petsoulas C, Peckham S (2013) Accountable to whom, for what? An exploration of the early development of Clinical Commissioning Groups in the English NHS. BMJ Open 3, e003769
Accountable to whom, for what? An exploration of the early development of Clinical Commissioning Groups in the English NHS.Crossref | GoogleScholarGoogle Scholar |

Cummins S, Curtis S, Diez-Roux AV, Macintyre S (2007) Understanding and representing ‘place’ in health research: a relational approach. Social Science & Medicine 65, 1825–1838.
Understanding and representing ‘place’ in health research: a relational approach.Crossref | GoogleScholarGoogle Scholar |

Dawda P, True A, Wells L (2016) Commissioning: perspectives from the ground. Australian Journal of Primary Health 22, 5–8.
Commissioning: perspectives from the ground.Crossref | GoogleScholarGoogle Scholar |

Department of Health (2016) Fifth National Mental Health Plan: draft for consultation. Available at http://www.health.gov.au/internet/main/publishing.nsf/content/8F54F3C4F313E0B1CA258052000ED5C5/$File/Fifth%20National%20Mental%20Health%20Plan.pdf [Verified 27 August 2017]

Douglas KA, Rayner FK, Yen LE, Wells RW, Glasgow NJ, Humphreys JS (2009) Australia’s primary health care workforce–research informing policy. The Medical Journal of Australia 191, 81–84.

Edwards K, Lunn J, Baass B (2015) Beyondblue NewAccess: demonstration independent evaluation. Summary of findings – reporting to August 2015. Ernst & Young: Melbourne, Vic., Australia.

Elston J, Stein K (2007) A rapid needs assessment of the provision of Health Technology Assessment in the south-west peninsula. Journal of Public Health 29, 157–164.
A rapid needs assessment of the provision of Health Technology Assessment in the south-west peninsula.Crossref | GoogleScholarGoogle Scholar |

Ferrante JM (2010) Principles of the patient-centered medical home and preventive services delivery. Annals of Family Medicine 8, 108–116.
Principles of the patient-centered medical home and preventive services delivery.Crossref | GoogleScholarGoogle Scholar |

Flodgren G, Pomey M-P, Taber SA, Eccles MP (2011) Effectiveness of external inspection of compliance with standards in improving healthcare organisation behaviour, healthcare professional behaviour or patient outcomes. Cochrane Database of Systematic Reviews 2011, CD008992

Franx G, Dixon L, Wensing M, Pincus H (2013) Implementation strategies for collaborative primary care-mental health models. Current Opinion in Psychiatry 26, 502–510.
Implementation strategies for collaborative primary care-mental health models.Crossref | GoogleScholarGoogle Scholar |

Gardner K, Powell Davies G, Edwards K, McDonald J, Findlay T, Kearns R, Joshi C, Harris M (2016) A rapid review of the impact of commissioning on service use, quality, outcomes and value for money: implications for Australian policy. Australian Journal of Primary Health 22, 40–49.
A rapid review of the impact of commissioning on service use, quality, outcomes and value for money: implications for Australian policy.Crossref | GoogleScholarGoogle Scholar |

Gask L, Rogers A, Campbell S, Sheaff R (2008) Beyond the limits of clinical governance? The case of mental health in English primary care. BMC Health Services Research 8, 63
Beyond the limits of clinical governance? The case of mental health in English primary care.Crossref | GoogleScholarGoogle Scholar |

Goodwin E, Frew EJ (2013) Using programme budgeting and marginal analysis (PBMA) to set priorities: reflections from a qualitative assessment in an English Primary Care Trust. Social Science & Medicine 98, 162–168.
Using programme budgeting and marginal analysis (PBMA) to set priorities: reflections from a qualitative assessment in an English Primary Care Trust.Crossref | GoogleScholarGoogle Scholar |

Grace FC, Meurk C, Head B, Hall W, Carstensen G, Harris M, Whiteford H (2015) An analysis of policy levers used to implement mental health reform in Australian 1992–2012. BMC Health Services Research 15, 479
An analysis of policy levers used to implement mental health reform in Australian 1992–2012.Crossref | GoogleScholarGoogle Scholar |

Grace FC, Meurk CS, Head BW, Hall WD, Harris MG, Whiteford HA (2017) An analysis of policy success and failure in formal evaluations of Australia’s National Mental Health Strategy (1992–2012). BMC Health Services Research 17, 374
An analysis of policy success and failure in formal evaluations of Australia’s National Mental Health Strategy (1992–2012).Crossref | GoogleScholarGoogle Scholar |

Grant S, Ring A, Gabbay M, Guthrie B, McLean G, Mair FS, Watt G, Heaney D, O’Donnell C (2015) Soft governance, restratification and the 2004 general medical services contract: the case of UK primary care organisations and general practice teams. Sociology of Health & Illness 37, 30–51.
Soft governance, restratification and the 2004 general medical services contract: the case of UK primary care organisations and general practice teams.Crossref | GoogleScholarGoogle Scholar |

Greenhalgh T, Humphrey C, Hughes J, MacFarlane F, Butler C, Pawson R (2009) How do you modernize a health service? A realist evaluation of whole-scale transformation in London. The Milbank Quarterly 87, 391–416.
How do you modernize a health service? A realist evaluation of whole-scale transformation in London.Crossref | GoogleScholarGoogle Scholar |

Gyani A, Shafran R, Layard R, Clark DM (2011) Enhancing recovery rates in IAPT services: lessons from analysis of the year one data. Improving Access to Psychological Therapies (IAPT), London, UK.

Ham C, Raleigh V, Foot C, Robertson R, Alderwick H (2015) Measuring the performance of local health systems: a review for the Department of Health. The King’s Fund, London, UK.

Harris M, Pirkis J, Burgess P, Olesen S, Bassilios B, Fletcher J, Blashki G, Scott A (2010) Evaluation of the better access to psychiatrists, psychologists and GPs through the Medicare Benefits Schedule initiative: component B: an analysis of Medicare Benefits Schedule (MBS) and Pharmaceutical Benefits Scheme (PBS) administrative data. Centre for Health Policy, Programs and Economics, The University of Melbourne, Melbourne, Vic., Australia.

Health Care Homes Implementation Advisory Group (2016) Terms of reference: Health Care Homes Implementation Advisory Group. (Commonwealth of Australia, Department of Health) Available at http://www.health.gov.au/internet/main/publishing.nsf/content/primary-tor-health-care-homes [Verified 7 June 2017]

Hilferty F, Cassells R, Muir K, Duncan A, Christensen D, Mitrou F, Gao G, Mavisakalyan A, Hafekost K, Tarverdi Y, Ngo H, Nguyen H, Wingrove C, Katz I (2015) Is headspace making a difference to young people’s lives? Final report of the independent evaluation of the headspace program. Social Policy Research Centre, University of New South Wales, Sydney, NSW, Australia.

Jacobs R, Martin S, Goddard M, Gravelle H, Smith P (2006) Exploring the determinants of NHS performance ratings: lessons for performance assessment systems. Journal of Health Services Research & Policy 11, 211–217.
Exploring the determinants of NHS performance ratings: lessons for performance assessment systems.Crossref | GoogleScholarGoogle Scholar |

Ludwick D, Manca D, Doucette J (2010) Primary care physicians’ experiences with electronic medical records: implementation experience in community, urban, hospital, and academic family medicine. Canadian Family Physician Medecin de Famille Canadien 56, 40–47.

Marshall L, Charlesworth A, Hurst J (2014) The NHS payment system: evolving policy and emerging evidence research report. Nuffield Trust, London, UK.

May J, Cooper R, Magin P, Critchley A (2008) Integrated models or mayhem? Lessons learnt from three integrated primary health care entities in regional New South Wales. Australian Health Review 32, 595–604.
Integrated models or mayhem? Lessons learnt from three integrated primary health care entities in regional New South Wales.Crossref | GoogleScholarGoogle Scholar |

McCafferty S, Williams I, Hunter D, Robinson S, Donaldson C, Bate A (2012) Implementing world class commissioning competencies. Journal of Health Services Research & Policy 17, 40–48.
Implementing world class commissioning competencies.Crossref | GoogleScholarGoogle Scholar |

McDonald J, Harris MF, Cumming J, Powell Davies G, Burns P (2008) The implementation and impact of different funding initiatives on access to multidisciplinary primary health care and policy implications. The Medical Journal of Australia 188, S69–S72.

Meurk C, Leung J, Hall W, Head BW, Whiteford H (2016) Establishing and governing e-mental health care in Australia: a systematic review of challenges and a call for policy-focussed research. Journal of Medical Internet Research 18, e10
Establishing and governing e-mental health care in Australia: a systematic review of challenges and a call for policy-focussed research.Crossref | GoogleScholarGoogle Scholar |

Moher D, Liberati A, Tetzlaff J, Altman D, The PRISMA Group (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Medicine 6, e1000097
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement.Crossref | GoogleScholarGoogle Scholar |

Moore TG, McHugh-Dillon H, Bull K, Fry R, Laidlaw B, West S (2014) The evidence: what we know about place-based approaches to support children’s wellbeing. Murdoch Children’s Research Institute and The Royal Children’s Hospital Centre for Community Child Health, Melbourne, Vic., Australia.

Mossialos E, Wenzl M, Osborn R, Sarnak D (Eds) (2016) 2015 international profile of health care systems. (Commonwealth Fund: New York, NY, USA, and Washington, DC, USA) Available at http://www.commonwealthfund.org/~/media/files/publications/fund-report/2016/jan/1857_mossialos_intl_profiles_2015_v7.pdf [Verified 24 May 2017]

Naik YJ, Anderton C, Fell G (2013) Integrating specialist advice following reforms: an interview-based survey. JRSM Short Reports 4, 24
Integrating specialist advice following reforms: an interview-based survey.Crossref | GoogleScholarGoogle Scholar |

National Institute for Health and Care Excellence (2011) Commissioning stepped care for people with common mental health disorders. National Institute for Health and Care Excellence, London, UK.

National Mental Health Commission (2014) The national review of mental health programmes and services. National Mental Health Commission: Sydney, NSW, Australia.

Naylor C, Goodwin N (2011) The use of external consultants by NHS commissioners in England: what lessons can be drawn for GP commissioning? Journal of Health Services Research & Policy 16, 153–160.
The use of external consultants by NHS commissioners in England: what lessons can be drawn for GP commissioning?Crossref | GoogleScholarGoogle Scholar |

Noble D, Smith D, Mathur R, Robson J, Greenhalgh T (2012) Feasibility study of geospatial mapping of chronic disease risk to inform public health commissioning. BMJ Open 2, e000711
Feasibility study of geospatial mapping of chronic disease risk to inform public health commissioning.Crossref | GoogleScholarGoogle Scholar |

Nolan E, Hewison A (2008) Teamwork in primary care mental health: a policy analysis. Journal of Nursing Management 16, 649–661.
Teamwork in primary care mental health: a policy analysis.Crossref | GoogleScholarGoogle Scholar |

O’Cathain A, Sampson F, Strong M, Pickin M, Goyder E, Dixon S (2015) Do marginal investments made by NHS healthcare commissioners in the UK produce the outcomes they hope to achieve? Observational study. BMJ Open 5, e009336
Do marginal investments made by NHS healthcare commissioners in the UK produce the outcomes they hope to achieve? Observational study.Crossref | GoogleScholarGoogle Scholar |

OED Online (2017) Competition, n. (Oxford University Press) Available at http://www.oed.com/view/Entry/37578?rskey=SVqmqC&result=1 [Verified 6 June 2017]

Pearce CM, de Lusignan S, Phillips C, Hall S, Travaglia J (2013) The computerized medical record as a tool for clinical governance in Australian primary care. Interactive Journal of Medical Research 2, e26
The computerized medical record as a tool for clinical governance in Australian primary care.Crossref | GoogleScholarGoogle Scholar |

Perera GAR, Dowell AC, Morris CJ (2013) Constructing a framework for quality activity in primary care. Australian Health Review 37, 98–103.
Constructing a framework for quality activity in primary care.Crossref | GoogleScholarGoogle Scholar |

Perkins N, Coleman A, Wright M, Gadsby E, McDermott I, Petsoulas C, Checkland K (2014) The ‘added value’ GPs bring to commissioning: a qualitative study in primary care. The British Journal of General Practice 64, e728–e734.
The ‘added value’ GPs bring to commissioning: a qualitative study in primary care.Crossref | GoogleScholarGoogle Scholar |

Petsoulas C, Allen P, Checkland K, Coleman A, Segar J, Peckham S, McDermott I (2014) Views of NHS commissioners on commissioning support provision. Evidence from a qualitative study examining the early development of clinical commissioning groups in England. BMJ Open 4, e005970
Views of NHS commissioners on commissioning support provision. Evidence from a qualitative study examining the early development of clinical commissioning groups in England.Crossref | GoogleScholarGoogle Scholar |

Petsoulas C, Peckham S, Smiddy J, Wilson P (2015) Primary care-led commissioning and public involvement in the English National Health Service. Lessons from the past. Primary Health Care Research and Development 16, 289–303.
Primary care-led commissioning and public involvement in the English National Health Service. Lessons from the past.Crossref | GoogleScholarGoogle Scholar |

Phillips CB, Pearce CM, Hall S, Travaglia J, De Lusignan S, Love T, Kljakovic M (2010) Can clinical governance deliver quality improvement in Australian general practice and primary care? A systematic review of the evidence. The Medical Journal of Australia 193, 602–607.

Primary Health Care Advisory Group (2016) Better outcomes for people with chronic and complex health conditions. Primary Health Care Advisory Group final report. Department of Health, Canberra, ACT, Australia.

Roberts M, Hsiao W, Berman P, Reich M (2009) ‘Getting Health Reform Right: A Guide to Improving Performance and Equity.’ (Oxford Scholarship Online: New York, NY, USA)

Robinson S, Dickinson H, Freeman T, Rumbold B, Williams I (2012) Structures and processes for priority-setting by health-care funders: a national survey of primary care trusts in England. Health Services Management Research 25, 113–120.
Structures and processes for priority-setting by health-care funders: a national survey of primary care trusts in England.Crossref | GoogleScholarGoogle Scholar |

Salway S, Mir G, Turner D, Ellison GTH, Carter L, Gerrish K (2016) Obstacles to “race equality” in the English National Health Service: insights from the healthcare commissioning arena. Social Science & Medicine 152, 102–110.
Obstacles to “race equality” in the English National Health Service: insights from the healthcare commissioning arena.Crossref | GoogleScholarGoogle Scholar |

Samra R, Bottle A, Aylin P (2015) Monitoring patient safety in primary care: an exploratory study using in-depth semistructured interviews. BMJ Open 5, e008128
Monitoring patient safety in primary care: an exploratory study using in-depth semistructured interviews.Crossref | GoogleScholarGoogle Scholar |

Schwartzkoff J, Sturgess GL (2015) Commissioning and contracting for better mental health outcomes. Research report, October 2015. (Rooftop Social for Mental Health Australia) Available at https://mhaustralia.org/sites/default/files/docs/system_reform_-_mhca_project_-_flagship_ng_and_contracting_for_better_m.pdf [Verified 10 November 2017].

Scott A, Sivey P, Ait Ouakrim D, Willenberg L, Naccarella L, Furler J, Young D (2011) The effect of financial incentives on the quality of health care provided by primary care physicians. Cochrane Database of Systematic Reviews 2011, CD008451

Shepperd S, Adams R, Hill A, Garner S, Dopson S (2013) Challenges to using evidence from systematic reviews to stop ineffective practice: an interview study. Journal of Health Services Research & Policy 18, 160–166.
Challenges to using evidence from systematic reviews to stop ineffective practice: an interview study.Crossref | GoogleScholarGoogle Scholar |

Silvester BV, Carr SJ (2009) A shared electronic health record: lessons from the coalface. The Medical Journal of Australia 190, S113–S116.

Smiddy J, Reay J, Peckham S, Williams L, Wilson P (2015) Developing patient reference groups within general practice: a mixed-methods study. The British Journal of General Practice 65, e177–e183.
Developing patient reference groups within general practice: a mixed-methods study.Crossref | GoogleScholarGoogle Scholar |

WentWest Ltd (2015) High performing mental health in primary care: options for system and funding innovation. Western Sydney Primary Health Network, Sydney, NSW, Australia.

WentWest Ltd (2016) Western Sydney Primary Health Network commissioning framework consultation paper. Commissioning innovative solutions and monitoring outcomes. WentWest Ltd, Sydney, NSW, Australia.

Whiteford H (2011) Shaping National Mental Health Policy. In ‘Oxford Textbook of Community Mental Health.’ (Eds G Thornicroft, G Szmukler, K Mueser, R Drake) pp. 273–278. (Oxford University Press: New York, NY, USA)

Wilks S, Lahausse J, Edwards B (2015) Commonwealth place-based service delivery initiatives: key learnings project. Australian Institute of Family Studies, Melbourne, Vic., Australia.

Zachariadis M, Oborn E, Barrett M, Zollinger-Read P (2013) Leadership of healthcare commissioning networks in England: a mixed-methods study on clinical commissioning groups. BMJ Open 3, e002112
Leadership of healthcare commissioning networks in England: a mixed-methods study on clinical commissioning groups.Crossref | GoogleScholarGoogle Scholar |




Appendix 1. List of websites searched for grey literature


Australia

Commonwealth

New South Wales

Western Australia

Victoria

South Australia

Northern Territory

Tasmania

ACT

New Zealand

Canada

Canadian provinces

Alberta mental health and addiction services

United Kingdom

Netherlands


Australia

United Kingdom

Canada

Netherlands

New Zealand


Australia

New Zealand

United Kingdom

Canada

Netherlands