A rapid review of the impact of commissioning on service use, quality, outcomes and value for money: implications for Australian policy
Karen Gardner A , G. Powell Davies A , Karen Edwards A , Julie McDonald A , Terry Findlay A , Rachael Kearns A , Chandni Joshi A and Mark Harris A BA Centre for Primary Health Care and Equity, 3rd Floor AGSM Building, University of New South Wales, NSW 2052, Australia.
B Corresponding author. Email: m.f.harris@unsw.edu.au
Australian Journal of Primary Health 22(1) 40-49 https://doi.org/10.1071/PY15148
Submitted: 13 October 2015 Accepted: 4 December 2015 Published: 29 February 2016
Journal Compilation © La Trobe University 2016
Abstract
The aim of this systematic review was to assess evidence of the impact of commissioning on health service use, quality, outcomes and value for money and to consider findings in the Australian context. Systematic searches of the literature identified 444 papers and, after exclusions, 36 were subject to full review. The commissioning cycle (planning, contracting, monitoring) formed a framework for analysis and impacts were assessed at individual, subpopulation and population levels. Little evidence of the effectiveness of commissioning at any level was available and observed impacts were highly context-dependent. There was insufficient evidence to identify a preferred model. Lack of skills and capacity were cited as major barriers to the implementation of commissioning. Successful commissioning requires a clear policy framework of national and regional priorities that define agreed targets for commissioning agencies. Engagement of consumers and providers, especially physicians, was considered to be critically important but is time consuming and has proven difficult to sustain. Adequate information on the cost, volume and quality of healthcare services is critically important for setting priorities, and for contracting and monitoring performance. Lack of information resulted in serious problems. High-quality nationally standardised performance measures and data requirements need to be built into contracts and ongoing monitoring and evaluation. In Australia, there is significant work to be done in areas of policy and governance, funding systems and incentives, patient enrolment or registration, information systems, individual and organisational capacity, community engagement and experience in commissioning.
Additional keywords: contracting, planning, primary health care, purchasing.
What is known about the topic? |
|
What does this paper add? |
|
Introduction
Commissioning is a term that has only recently gained currency in Australian policy. While there is no single authoritative definition of commissioning (Newman et al. 2012; Dickinson 2015), it is defined broadly as the process of planning, purchasing and monitoring services for a population (e.g. geographically defined), subpopulation (e.g. people with diabetes in a given region) or individual client (often in the context of care coordination). The core process of commissioning involves three main areas of activity: strategic planning, contracting services, and monitoring and evaluation (Fig. 1).
Commissioning health services emerged in the United Kingdom (UK) in the late 1980s (Bovaird et al. 2012) and has been followed by other countries, for their own reasons. In the UK, commissioning was implemented in an attempt to use market forces and introduce non-government and private providers to bring innovation into a highly centralised system. In parts of Eastern Europe, it has been used to move away from exclusively state-run health services towards greater private sector provision. In the United States (US) it has been used to organise affordable health care for people within specific health insurance arrangements (military veterans who have received care from the Veteran’s Health Administration, employees, Medicare recipients and members of Health Maintenance Organisations).
The policy reasons for considering a greater role for commissioning in Australia are described in the Reform of the Federation discussion paper (Australian Government 2015) and the paper by the Primary Health Care Advisory Group (2015). Moving away from a system that rewards occasions of service to one that places greater emphasis on the quality and cost of service delivery is an important driver. In the context of an uncapped, largely fee-for-service primary healthcare system for private medical or allied services, a significant intention is to improve access to care for specific patient groups while keeping a cost-effective, sustainable system. In terms of service provision, there is a need to offer more appropriate care packages for older people or those with chronic conditions or complex needs, and to provide services that will avoid or reduce hospitalisation. This requires the ability to combine different sources of funding, and rationalise often conflicting systems of accountability between the Commonwealth and the states. Pooling funds and jointly commissioning services is one way of achieving this. Further impetus comes from the interest of private health insurers in providing support services for members who may become users of hospital services.
There have been several reviews of different types of commissioning in the healthcare sector but limited consideration of commissioning as it might be applied in the health system in Australia. This paper draws on a rapid systematic review of the evidence on the effectiveness of commissioning conducted in July and August 2015 to consider lessons for Australia. The specific research questions were:
-
What national and international forms of commissioning primary care at jurisdictional or local/regional level have been shown to be effective, for which population groups and in what contexts?
-
What are the impacts, risks and unintended consequences associated with these?
Drawing on the evidence, we consider which aspects of commissioning could be applied in Australia and what regulatory, governance, policy and funding arrangements might be required to support them.
Methods
A rapid review was conducted, consistent with accepted methodology (National Collaborating Centre for Methods and Tools 2014). The project team put together a comprehensive search strategy and set of search terms (Box 1). Searches were conducted in Medline, Embase, CINAHL, Informit and the Cochrane Database of Systematic Reviews. Hand searching of key journals (Health Policy, Health Services Research and Policy, and Health Economics) and citations from key papers was also conducted. Relevant website searches from Australia, the US, the UK, New Zealand and Europe, and consultation with key experts in each of these countries, identified grey literature.
Box 1. Search terms | |
| |
Only studies conducted since 2005 that incorporated key aspects of commissioning of primary healthcare services with a focus on purchasing services at the primary and acute care interface or chronic disease management, disability or mental health were included in the review. Studies had to report on key elements or activities of a local/regional level commissioning process as well as impacts on processes of care, client outcomes, cost containment, patient satisfaction or barriers and facilitators to implementation of commissioning. Qualitative and quantitative studies were included. Studies were excluded if they did not explicitly include some elements of commissioning and report on at least some impact, outcome or barrier/enabler to implementation (inclusion and exclusion criteria are contained in Appendix S2 available online as supplementary material).
Five researchers (JM, KG, MH, RK, CJ) extracted data from the peer-reviewed literature. The quality of studies was not formally assessed. The commissioning cycle (planning, contracting, monitoring) formed a framework for analysis of the literature and impacts were assessed at individual, subpopulation or population levels.
Results
Following exclusion of duplicates, 444 papers were identified in the initial search and, of these, 408 that did not meet our criteria were excluded (Fig. 2). Many of these were descriptive papers that drew on expert opinion to describe various approaches, related policies or reforms, or which explored some aspect of commissioning such as clinician involvement. Several of these papers were retained as background to the review and, together with 20 grey literature reports, were used to consider the regulatory, governance, policy and funding arrangements that might be required to support commissioning in Australia. Thirty-six papers were reviewed.
Characteristics of identified studies
Of the 36 studies included, 30 were from UK (including one comparison of commissioning in England and Germany), one from Finland, four from US, one from New Zealand. No studies from Australia or Canada were identified that met our inclusion criteria. This may be because commissioning has only recently emerged as a major policy issue in these countries.
As shown in Table 1, included studies covered a range of different commissioning organisations, including primary care trusts (PCTs), fundholding practices, practice-based commissioning (PBC), clinical commissioning groups (CCGs) and joint commissioning in the UK, municipal contracting in Finland, managed care and accountable care in the US, and district health boards in New Zealand. Studies were predominantly qualitative, involving cases studies and interviews and/or surveys of the perceived impacts, levels of engagement, success factors, barriers and enablers to commissioning, or satisfaction among different stakeholder groups. Five quantitative studies assessed the impact of commissioning on cost containment and service use, and there was one cluster randomised controlled trial on the impact of pay-for-outcomes on smoking cessation rates.
Focus of studies on the elements of commissioning
Sixteen studies addressed at least one of the elements of the commissioning process (Table 2). No studies of monitoring were identified. In relation to planning, there was a strong focus on the importance of comprehensive needs assessment for groups and populations (Elvey et al. 2006; Shaw et al. 2013). Six studies addressed priority setting and rationing. Marks et al. (2011) found limited use of priority setting tools (decision support) for resource allocation. Priority setting needs to be embedded in routine planning and budgeting processes (Robinson et al. 2012a, 2012b) and provide support for disinvestment as well as investment decision making (Rooshenas et al. 2013). Shaw et al. (2013) found that commissioning care, especially long-term care, is time consuming and complex, and supported best by an incremental approach.
Studies of contracting focused predominantly on partnerships supporting commissioning of specialist services for subpopulation groups (Freeman and Peck 2006) and the impact of service and contract design on improving models of care. Slater and White (2007) found that PBC supported service redesign to improve models of care. Freeman and Peck (2006) reported that service users perceived that commissioning in PCTs had improved specialist models of care for mental health, and drug and alcohol services. CCGs were not supportive of outsourcing contracting or other support functions as these were perceived to potentially lead to fragmentation and increased transaction costs (Petsoulas et al. 2014). Alternative Provider of Medical Services (APMS) contractual processes were time consuming, expensive and perhaps unsustainable (Coleman et al. 2013).
Ly and Glied (2014) showed that in the US, contracting opportunities conferred significant benefits on physicians, although they added modest costs in terms of time spent outside patient care and perceived lower adequacy of time with patients. Simplifications that reduce the administrative burden of contracting may improve care by optimising allocation of physician effort.
Levels of commissioning and services commissioned
A range of services can be purchased for individuals on the basis of an individual assessment, such as through a care plan, for specific subpopulations or groups on the basis of a jurisdictional needs assessment or for whole populations within a specified region. As can be seen from Table 3, individual care for specific populations is commissioned in the US. At the subpopulation level, services have been commissioned for people with specific needs such as children, or specific services such as mental health, services for older people or those with long-term conditions, health and social care, chronic disease, and services to reduce health inequalities. Services purchased for populations include dental, pharmacy and GP services.
Evidence of impact of commissioning
There was very limited evidence to assess the impact of commissioning on service use, outcomes or value. Of the seven relevant studies related to commissioning at individual, group and population level (Dusheiko et al. 2006; Freeman and Peck 2006; Goldman 2010; Salmon et al. 2012; Barnes et al. 2013; Ly and Glied 2014; McLeod et al. 2015), three studies described impacts on health service use, one on outcomes, one on quality and two on value for money.
With respect to service use, Barnes et al. (2013) found that in the context of inappropriate treatment of routine childhood conditions, service redesign led to reductions in emergency admissions for children. A study of joint commissioning for health and social care services demonstrated no change in length of stay, reduced hospitalisation or delay in transfer of care (Goldman 2010). A third study of fund-holding practices demonstrated reduced emergency and elective admissions (Dusheiko et al. 2006).
One study of joint health and social care commissioning demonstrated improved quality of care as perceived by users and carers for patients with mental illness (Freeman and Peck 2006). One study, a randomised trial as part of PCT commissioning, demonstrated improvements in smoking rates (McLeod et al. 2015). Two US studies involved analysis of economic benefit. A study of US managed care reported improved physician incomes and time with patients but little overall improvement in value (Ly and Glied 2014). A study of accountable care in three practices showed reduced costs and improved quality of care (Salmon et al. 2012).
Factors found to facilitate or impede commissioning
There were a limited number of studies exploring the facilitators and barriers to commissioning. Successful commissioning relies on detailed knowledge of service and sector as well as information sharing and networking (Checkland et al. 2012). Identified barriers include lack of resources (Bradley et al. 2006), time and personnel; difficulties associated with maintaining relationships with partners (Checkland et al. 2009) and obtaining external support (Naylor and Goodwin 2011); and limited use of decision support tools (Marks et al. 2011). Attitudes vary on the extent to which GP commissioning is likely to deliver population benefits (Gridley et al. 2012; Perkins et al. 2014), especially with respect to reducing inequalities (Turner et al. 2013).
Discussion
In Australia, commissioning has been used largely to fill gaps in primary healthcare service delivery for individuals and subpopulations rather than as a framework for mainstream health services. For individuals, services not included in Medicare, such as home care (Veterans’ Home Care) and disability care (National Disability Insurance Scheme) have been commissioned. For subgroups, commissioning has focused on conditions where there is a problem of access to high-quality specialist care – for example, for people with severe mental illness or diabetes, or those in palliative care. For populations, commissioning has tended to centre on groups not otherwise adequately served – in particular, rural areas or Indigenous populations. There is little experience with commissioning mainstream primary health care and little published literature from Australian programs other than from Coordinated Care Trials in the 1990s and evaluations of existing programs, such as the After Hours Other Medical Practitioners program.
Internationally, the evidence base for the impact of commissioning was weak. Most studies examined commissioning for populations; few explored commissioning for subpopulation groups or for individuals. There was insufficient evidence to identify any preferred form of commissioning. Although planning, contracting and monitoring are all critical elements in the process of commissioning, the emphasis of studies is on planning, with some attention to contracting but very little on monitoring contracts and performance, or supporting patient choice. The lack of emphasis on monitoring and evaluation may reflect the relatively early stage of development of commissioning.
Grey literature reports cite lack of skills and capacity as major barriers to the implementation of commissioning. Skills are especially important in the securing or contracting domain for procurement, risk and contract management (Figueras et al. 2005). Local commissioners and providers need to have the competency for local decision management (Russell et al. 2013). This includes priority setting, engagement of the population and stakeholders, quantifying, costing, structuring demand and ensuring services are effective and high quality. Collaboration and partnership, information management, innovation, governance, compliance, accountability, project management and leadership are key (Dickinson 2015). There need to be measures in place to ensure stability of the management workforce as high staff turnover undermines the relationship (Newman et al. 2012). This implies significant investment in developing skills in the workforce to be involved in the commissioning process and support (resources and advice) for members in the field.
Successful commissioning also requires a clear policy framework of national and regional priorities that define agreed targets for commissioning agencies. Most countries appear to be moving away from a strict competitive model in which there is a distance between purchaser and provider as this runs counter to many models of integrated care and provides little real benefit in terms of lower pricing of services.
The European Observatory report ‘Purchasing to improve health’ (Figueras et al. 2005) found that engagement of consumers and providers, especially physicians, is considered to be critically important but has proven difficult to sustain. Providers need autonomy to respond flexibly to contracts (Figueras et al. 2005). Much of the backlash against managed care was a result of perceived restrictions on the care that could be provided. Commissioners need the flexibility to be able to respond to patient needs and changing conditions, and to develop innovative solutions. Strict interpretation of competition law in New Zealand made it difficult to develop the long-term contracts and relationships between purchasers and providers that are necessary for effective commissioning and service continuity (Ashton et al. 2004). Integrated care involving primary and secondary care or health and social care is especially difficult to deliver in the context of competition and separation of purchaser and provider (Mannion 2008). Commissioning for long-term condition services requires competition and purchasing policy that allows commissioning to be undertaken in partnership with providers, blurring the distinction between commissioners and providers (Shaw et al. 2013).
Both providers and consumers need to be informed and have an opportunity to provide input into the commissioning process (Joyce 2015). This takes time but is crucial in building trust and legitimacy for commissioning, especially where difficult decisions have to be made (Dickinson et al. 2013). It needs to be clearly driven by policy mandating clinician and consumer involvement in the commissioning process (Sampson et al. 2012).
In the countries studied, policy and governance settings are usually defined by government and professional bodies that have broad stewardship over the health system. These define the broader context in which commissioning occurs, including workforce supply, professional standards, funding and incentives as well as regulating the scope of services that can be commissioned for each subgroup of people (Figueras et al. 2005). Governments may also define the models of care or healthcare package, including the structure, quality, amount and cost of services. There is usually some restriction of access to services to remain within budget (Mannion 2008). For individual commissioning, this implies some degree of patient enrolment or registration. Excessive gatekeeping that restricts provider autonomy or choice of preferred providers was found to be counterproductive in the US (Ham 2008). More recent models, such as accountable care organisations, have involved a greater choice being offered to providers and patients (Robinson 2004).
It is also important that there is not high variability in uptake of the program by providers, as occurred in UK GP-holding in the 1990s, as this is likely to lead to inequities (Mannion 2008). This needs to be addressed through widespread efforts to engage providers, to monitor uptake both geographically and socio-economically, and to monitor any consequent inequities of access to quality care that may arise.
Adequate information on the cost, volume and quality of healthcare services is critically important for setting priorities, contracting and monitoring performance. Lack of information resulted in serious problems in New Zealand in the 1990s (Ham 2008); these have been partly addressed with the introduction of the Primary Care Strategy in 2001 (King 2001) and subsequent developments. There needs to be clarity of roles and responsibilities and supportive legal frameworks for commissioning. This is particularly important in the context of funds pooling or flexible use of budgets and joint commissioning involving different levels of government or sectors (Newman et al. 2012).
There is a need for high-quality nationally standardised performance measures and data requirements to be built into contracts, alongside ongoing monitoring and evaluation. This should be reinforced by public reporting, and incentives to reward providers and consumers for good quality of care, as part of ‘value-based purchasing’ (Guterman et al. 2013). A poor fit between goals and intended outcomes and performance measures may lead to unintended consequences (e.g. sacrificing quality over cost saving).
Conclusions
Little evidence of the effectiveness of commissioning at any one level (population, subgroup or individual patient) is available and observed impacts are highly context-dependent. This review suggests that there is significant work to be done in areas of policy and governance, funding systems and incentives, patient enrolment or registration, information systems, individual and organisational capacity, community engagement and experience in commissioning. Australia might be wise to start commissioning in areas where the benefits are clearest, monitoring progress carefully and only expanding as experience is gained and all the elements required are in place.
Conflicts of interest
None declared.
Acknowledgements
This paper describes the results of a systematic review that was part of a larger study commissioned by the New South Wales Ministry of Health. We have permission to publish from the work.
References
Ashman I, Willcocks S (2014) Engaging with clinical commissioning: the attitudes of general practitioners in East Lancashire. Quality in Primary Care 22, 91–99.Ashton T, Cumming J, McLean J (2004) Contracting for health services in a public health system: the New Zealand experience. Health Policy (Amsterdam) 69, 21–31.
| Contracting for health services in a public health system: the New Zealand experience.Crossref | GoogleScholarGoogle Scholar |
Ashton T, Tenbensel T, Cumming J, Barnett P (2008) Decentralizing resource allocation: early experiences with District Health Boards in New Zealand. Journal of Health Services Research & Policy 13, 109–115.
| Decentralizing resource allocation: early experiences with District Health Boards in New Zealand.Crossref | GoogleScholarGoogle Scholar |
Australian Government (2015) Reform of the Federation: discussion paper. Australian Government, Canberra.
Barnes K, Longfield P, Jones K, Littlemore G, McDonough C, McIntyre A, McLaughlin M (2013) Evidence based commissioning: calculating shift potentials for paediatric services. Clinical Governance 18, 39–48.
| Evidence based commissioning: calculating shift potentials for paediatric services.Crossref | GoogleScholarGoogle Scholar |
Baxter K, Weiss M, Le Grand J (2007) Collaborative commissioning of secondary care services by primary care Trusts. Public Money & Management 27, 207–214.
| Collaborative commissioning of secondary care services by primary care Trusts.Crossref | GoogleScholarGoogle Scholar |
Bovaird T, Dickinson H, Allen K (2012) Commissioning across government: review of evidence. Third Sector Research Centre research report (86). Available at http://www.birmingham.ac.uk/generic/tsrc/documents/tsrc/reports/research-report-86-commissioning-across-govt.pdf [Accessed 11 January 2016]
Bradley F, Elvey R, Ashcroft D, Noyce P (2006) Commissioning services and the new community pharmacy contract: (2) drivers, barriers and approaches to commissioning. The Pharmaceutical Journal 277, 189–192.
Bravo Vergel Y, Ferguson B (2006) Difficult commissioning choices: lessons from English primary care trusts. Journal of Health Services Research & Policy 11, 150–154.
| Difficult commissioning choices: lessons from English primary care trusts.Crossref | GoogleScholarGoogle Scholar |
Checkland K, Coleman A, Harrison S, Hiroeh U (2009) ‘We can’t get anything done because…’: making sense of ‘barriers’ to Practice-based Commissioning. Journal of Health Services Research & Policy 14, 20–26.
| ‘We can’t get anything done because…’: making sense of ‘barriers’ to Practice-based Commissioning.Crossref | GoogleScholarGoogle Scholar |
Checkland K, Snow S, McDermott I, Harrison S, Coleman A (2012) ‘Animateurs’ and animation: what makes a good commissioning manager? Journal of Health Services Research & Policy 17, 11–17.
| ‘Animateurs’ and animation: what makes a good commissioning manager?Crossref | GoogleScholarGoogle Scholar |
Checkland K, Coleman A, McDermott I, Segar J, Miller R, Petsoulas C, Wallace A, Harrison S, Peckham S (2013) Primary care-led commissioning: applying lessons from the past to the early development of clinical commissioning groups in England. The British Journal of General Practice 63, e611–e619.
| Primary care-led commissioning: applying lessons from the past to the early development of clinical commissioning groups in England.Crossref | GoogleScholarGoogle Scholar | 23998841PubMed |
Coleman A, Checkland K, McDermott I, Harrison S (2013) The limits of market-based reforms in the NHS: the case of alternative providers in primary care. BMC Health Services Research 13, S3
| The limits of market-based reforms in the NHS: the case of alternative providers in primary care.Crossref | GoogleScholarGoogle Scholar | 23735051PubMed |
Dickinson H (2015) Commissioning public services evidence review: evidence for Australian public services. Melbourne School of Government, University of Melbourne.
Dickinson H, Glasby J, Nicholds A, Sullivan H (2013) Making sense of joint commissioning: three discourses of prevention, empowerment and efficiency. BMC Health Services Research 13, S6
| Making sense of joint commissioning: three discourses of prevention, empowerment and efficiency.Crossref | GoogleScholarGoogle Scholar | 23734566PubMed |
Dusheiko M, Gravelle H, Jacobs R, Smith P (2006) The effect of financial incentives on gatekeeping doctors: evidence from a natural experiment. Journal of Health Economics 25, 449–478.
| The effect of financial incentives on gatekeeping doctors: evidence from a natural experiment.Crossref | GoogleScholarGoogle Scholar | 16188338PubMed |
Elvey R, Bradley F, Ashcroft D, Noyce P (2006) Commissioning services and the new community pharmacy contract: (1) [harmaceutical needs assessments and uptake of new contracts]. The Pharmaceutical Journal 277, 161–163.
Figueras J, Robinson R, Jakubowski E (2005) ‘Purchasing to improve health systems performance.’ (Open University Press: Madenhead, UK.)
Freeman T, Peck E (2006) Evaluating partnerships: a case study of integrated specialist mental health services. Health & Social Care in the Community 14, 408–417.
| Evaluating partnerships: a case study of integrated specialist mental health services.Crossref | GoogleScholarGoogle Scholar |
Goldman C (2010) Joint financing across health and social care: money matters but outcomes matter more. Journal of Integrated Care 18, 3–10.
| Joint financing across health and social care: money matters but outcomes matter more.Crossref | GoogleScholarGoogle Scholar |
Gridley K, Spiers G, Aspinal F, Bernard S, Atkin K, Parker G (2012) Can general practitioner commissioning deliver equity and excellence? Evidence from two studies of service improvement in the English NHS. Journal of Health Services Research & Policy 17, 87–93.
| Can general practitioner commissioning deliver equity and excellence? Evidence from two studies of service improvement in the English NHS.Crossref | GoogleScholarGoogle Scholar |
Guterman S, Zezza MA, Schoen C (2013) Paying for value: replacing Medicare’s sustainable growth rate formula with incentives to improve care. Issue Brief (Commonwealth Fund) 16, 1–10.
Ham C (2008) World class commissioning: a health policy chimera? Journal of Health Services Research & Policy 13, 116–121.
| World class commissioning: a health policy chimera?Crossref | GoogleScholarGoogle Scholar |
Hussey P, Ridgely S, Rosenthal M (2011) The PROMETHEUS bundled payment experiment: slow start shows problems in implementing new payment models. Health Affairs 30, 2116–2124.
| The PROMETHEUS bundled payment experiment: slow start shows problems in implementing new payment models.Crossref | GoogleScholarGoogle Scholar | 22068404PubMed |
Joyce C (2015) Person-centred services? Rhetoric versus reality Australian Journal of Primary Health
| Person-centred services? Rhetoric versus realityCrossref | GoogleScholarGoogle Scholar | 26349619PubMed |
Kennington E, Shepherd E, Evans D, Duggan C (2013) Benefits of healthy living pharmacies for commissioner and contractor/employer. International Journal of Pharmacy Practice 21, 122
King A (2001) The Primary Health Care Strategy. The New Zealand Ministry of Health. Wellington, New Zealand. Available at http://www.health.govt.nz/system/files/documents/publications/phcstrat.pdf [Verified February 2016]
Ly DP, Glied SA (2014) The impact of managed care contracting on physicians. Journal of General Internal Medicine 29, 237–242.
| The impact of managed care contracting on physicians.Crossref | GoogleScholarGoogle Scholar | 24002628PubMed |
Mannion R (2008) General practitioner commissioning in the English national health service: continuity, change and future challenges. International Journal of Health Services 38, 717–730.
| General practitioner commissioning in the English national health service: continuity, change and future challenges.Crossref | GoogleScholarGoogle Scholar | 19069289PubMed |
Marks L, Cave S, Hunter D, Mason J, Peckham S, Wallace A (2011) Governance for health and wellbeing in the English NHS. Journal of Health Services & Research Policy 16, 14–21.
| Governance for health and wellbeing in the English NHS.Crossref | GoogleScholarGoogle Scholar |
McCafferty S, Williams I, Hunter D, Robinson S, Donaldson C, Bate A (2012) Implementing world class commissioning competencies. Journal of Health Services Research & Policy 17, 40–48.
| Implementing world class commissioning competencies.Crossref | GoogleScholarGoogle Scholar |
McLeod H, Blissett D, Wyatt S, Mohammed MA (2015) Effect of pay-for-outcomes and encouraging new providers on national health service smoking cessation services in England: a cluster controlled study. PLoS One 10, e0123349
| Effect of pay-for-outcomes and encouraging new providers on national health service smoking cessation services in England: a cluster controlled study.Crossref | GoogleScholarGoogle Scholar | 25875959PubMed |
National Collaborating Centre for Methods and Tools (2014) Methods: synthesis 1. Rapid reviews: methods and implications [fact sheet]. Available at http://www.nccmt.ca/pubs/Methods_Synthesis1.pdf [Verified 11 January 2016]
Naylor C, Goodwin N (2011) The use of external consultants by NHS commissioners in England: what lessons can be drawn for GP commissioning? Journal of Health Services Research & Policy 16, 153–160.
| The use of external consultants by NHS commissioners in England: what lessons can be drawn for GP commissioning?Crossref | GoogleScholarGoogle Scholar |
Newman M, Bangpan M, Kalra N, Mays N, Kwan I, Roberts T (2012) Commissioning in health, education and social care: models, research bibliography and in-depth review of joint commissioning between health and social care agencies. Available at http://eppi.ioe.ac.uk/cms/Default.aspx?tabid=3356 [Verified 1 January 2016]
Newton JT, Alexandrou B, Bate BD, Best H (2006) A qualitative analysis of the planning, implementation and management of a PDS scheme: Lessons for local commissioning of dental services. British Dental Journal 200, 625–630.
| A qualitative analysis of the planning, implementation and management of a PDS scheme: Lessons for local commissioning of dental services.Crossref | GoogleScholarGoogle Scholar | 1:STN:280:DC%2BD28zltFahtQ%3D%3D&md5=d393554ecad3397b71463c5700dc9648CAS | 16767141PubMed |
O’Brien S (2013) SA Health Clinical Commissioning Intentions July 2013–June 2017. South Australian Department for Health and Ageing, Adelaide. Available at https://www.sahealth.sa.gov.au/wps/wcm/connect/e32a3e8040b4d859a817fb809397f885/Clinical+Commissioning+Intentions-Plan%26Comm-Pol%26Comm-20130812.pdf?MOD=AJPERES&CACHEID=e32a3e8040b4d859a817fb809397f885 [Verified February 2016]
Perkins N, Coleman A, Wright M, Gadsby E, McDermott I, Petsoulas C, Checkland K (2014) The ‘added value’ GPs bring to commissioning: a qualitative study in primary care. The British Journal of General Practice 64, e728–e734.
Petsoulas C, Allen P, Checkland K, Coleman A, Segar J, Peckham S, Mcdermott I (2014) Views of NHS commissioners on commissioning support provision: evidence from a qualitative study examining the early development of clinical commissioning groups in England. BMJ Open 4, e005970
| Views of NHS commissioners on commissioning support provision: evidence from a qualitative study examining the early development of clinical commissioning groups in England.Crossref | GoogleScholarGoogle Scholar | 25320000PubMed |
Primary Health Care Advisory Group (2015) Better outcomes for people with chronic and complex health conditions through primary health care. Available at http://www.health.gov.au/internet/main/publishing.nsf/Content/2D8BCF439DE725CACA257E93001B462A/$File/discussion.pdf [Verified 1 January 2016]
Robinson JC (2004) Reinvention of health insurance in the consumer era. Journal of the American Medical Association 291, 1880–1886.
| Reinvention of health insurance in the consumer era.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BD2cXjsVajsbk%3D&md5=9307f5068fd72ef2cda4397851fb3e0aCAS | 15100208PubMed |
Robinson S, Williams I, Dickinson H, Freeman T, Rumbold B (2012a) Priority-setting and rationing in healthcare: evidence from the English experience. Social Science & Medicine 75, 2386–2393.
| Priority-setting and rationing in healthcare: evidence from the English experience.Crossref | GoogleScholarGoogle Scholar |
Robinson S, Williams I, Freeman T, Rumbold B, Williams I (2012b) Structures and processes for priority-setting by health-care funders: a national survey of primary care trusts in England. Health Services Management Research 5, 113–120.
| Structures and processes for priority-setting by health-care funders: a national survey of primary care trusts in England.Crossref | GoogleScholarGoogle Scholar |
Rooshenas L, Owen-Smith A, Donovan J, Hollingworth W (2013) Saving money in the NHS: a qualitative investigation of disinvestment practices, and barriers to change. Lancet 382, S18
| Saving money in the NHS: a qualitative investigation of disinvestment practices, and barriers to change.Crossref | GoogleScholarGoogle Scholar |
Russell J, Greenhalgh T, Lewis H, MacKenzie I, Maskrey N, Montgomery J, O’Donnell C (2013) Addressing the ‘postcode lottery’ in local resource allocation decisions: a framework for clinical commissioning groups. Journal of the Royal Society of Medicine 106, 120–123.
| Addressing the ‘postcode lottery’ in local resource allocation decisions: a framework for clinical commissioning groups.Crossref | GoogleScholarGoogle Scholar | 23564895PubMed |
Salmon R, Sanderson M, Walters B, Kennedy K, Flores R, Muney A (2012) A collaborative accountable care model in three practices showed promising results on costs and quality of care. Health Affairs 31, 2379–2387.
| A collaborative accountable care model in three practices showed promising results on costs and quality of care.Crossref | GoogleScholarGoogle Scholar | 23129667PubMed |
Sampson F, O’Cathain A, Strong M, Pickin M, Esmonde L (2012) Commissioning processes in primary care trusts: a repeated cross-sectional survey of health care commissioners in England. Journal of Health Services Research & Policy 17, 31–39.
| Commissioning processes in primary care trusts: a repeated cross-sectional survey of health care commissioners in England.Crossref | GoogleScholarGoogle Scholar |
Shaw SE, Smith JA, Porter A, Rosen R, Mays N (2013) The work of commissioning: a multisite case study of healthcare commissioning in England’s NHS. BMJ Open 3, e003341
| The work of commissioning: a multisite case study of healthcare commissioning in England’s NHS.Crossref | GoogleScholarGoogle Scholar | 24014483PubMed |
Sheaff R, Chambers N, Charles N, Exworthy M, Mahon A, Byng R, Mannion R (2013) How managed a market? Modes of commissioning in England and Germany. BMC Health Services Research 13, S8
| How managed a market? Modes of commissioning in England and Germany.Crossref | GoogleScholarGoogle Scholar | 23734631PubMed |
Slater B, White J (2007) Practice-based commissioning: learning from a development programme. Journal of Integrated Care 15, 13–25.
| Practice-based commissioning: learning from a development programme.Crossref | GoogleScholarGoogle Scholar |
Song Z (2014) Accountable care organizations in the U.S. health care system. Journal of Clinical Outcomes Management 21, 364–371.
Turner D, Salway S, Mir G, Ellison GT, Skinner J, Carter L, Bostan B (2013) Prospects for progress on health inequalities in England in the post-primary care trust era: professional views on challenges, risks and opportunities. BMC Public Health 13, 274
| Prospects for progress on health inequalities in England in the post-primary care trust era: professional views on challenges, risks and opportunities.Crossref | GoogleScholarGoogle Scholar | 23530661PubMed |
Tynkkynen LK, Lehto J, Miettinen S (2012) Framing the decision to contract out elderly care and primary health care services – perspectives of local level politicians and civil servants in Finland. BMC Health Services Research 12, 201
| Framing the decision to contract out elderly care and primary health care services – perspectives of local level politicians and civil servants in Finland.Crossref | GoogleScholarGoogle Scholar | 22805167PubMed |
Wilson E, Sussex J, Macleod C, Fordham R (2007) Prioritizing health technologies in a Primary Care Trust. Journal of Health Services Research & Policy 12, 80–85.
| Prioritizing health technologies in a Primary Care Trust.Crossref | GoogleScholarGoogle Scholar |