Developing a model for primary care quality improvement success: a comparative case study in rural, urban and Kaupapa Māori organisations
Jane Cullen![https://orcid.org/0000-0002-0830-4784](/media/client/orcid_16x16.png)
![https://orcid.org/0000-0002-4281-8519](/media/client/orcid_16x16.png)
![https://orcid.org/0000-0003-1520-5263](/media/client/orcid_16x16.png)
![https://orcid.org/0000-0002-9177-5172](/media/client/orcid_16x16.png)
1 Massey University, Palmerston North, New Zealand.
2 Royal Melbourne Institute of Technology, Melbourne, Australia.
3 Department of Primary Care, University of Otago, Wellington, New Zealand.
Abstract
Primary care is under pressure to achieve accessible, equitable, quality health care, while being increasingly under resourced. There is a need to understand factors that influence quality improvement (QI) to support a high-performing primary care system. Literature highlights the impact of context on QI but there is little primary care research on this topic.
This qualitative case study research seeks to discover the contextual factors influencing QI in primary care, and how the relationships between contextual factors, the QI initiative, and the implementation process influence outcomes.
The Consolidated Framework for Implementation Research was used to frame this qualitative study exploring primary care experiences in depth. Six sites were selected to provide a sample of rural, urban and Kaupapa Māori settings. Qualitative data was collected via semi-structured interviews and compared and contrasted with the organisational documents and data provided by participants.
Cases reported success in achieving improved outcomes for patients, practices, and staff. Strong internal cultures of ‘Clan’ and ‘Adhocracy’ typologies supported teamwork, distributed leadership, and a learning climate to facilitate iterative sensemaking activities. To varying degrees, external network relationships provided resources, knowledge, and support.
Organisations were motivated by a combination of patient/community need and organisational culture. Network relationships assisted to varying degrees depending on need. Engaged and distributed leadership based on teamwork was observed, where leadership was shared and emerged at different levels and times as the need arose. A learning climate was supported to enable iterative sensemaking activities to achieve success.
Keywords: case study, context, distributed leadership, general practice, implementation, learning climate, network relationships, quality improvement.
WHAT GAP THIS FILLS |
What is known about the topic: The context surrounding improvement efforts contributes to observed variation in initiative outcomes. Studies into factors influencing QI success generally focus on secondary care organisations and little is understood about the relationship between the initiative, implementation process and context in primary care. |
What this study adds: This is an extension of a previous cross-case comparison. Additional cases enabled deeper understanding and refinement of key factors and proposed directionality of interrelationships influencing QI. A refined model is shared depicting factors and relationships for effective QI. |
Introduction
Despite decades of healthcare quality improvement (QI) efforts and notable successes,1,2 results have not always been successfully replicated3,4 and quality problems persist.5 The primary care system is under pressure to achieve accessible, equitable, quality health care, and reduce demand on hospital and specialist services while increasingly under resourced.6,7 Building an understanding of what is needed to support quality improvement and achievement of a high-performing primary healthcare system is critical in the current environment.6,8
Literature highlights the impact of context on QI outcomes,9–11 but the relationships between the context, QI intervention (QII) and implementation process have not been established.10,12 Research into factors influencing QI success has predominantly occurred in secondary care settings.13,14 General practice and other primary care services are unique settings with high degrees of heterogeneity and uncertainty.4,15 Primary care research into determinants of effective improvement is sparse, lacks consensus and often focuses on what was done rather than describing underpinning theory, contextual factors and their relationship to each other and success.15,16
Therefore, we seek to identify: (1) the contextual factors influencing primary care improvement initiatives, and (2) how contextual factors (inner and outer socio-technical setting), the improvement intervention, and implementation process influence each other and the outcomes in primary care.
Research from a 15-year program of primary care transformation in the United States suggests that a complexity-informed approach is required.4 This research found an adaptive reserve centred on relationships was required for primary care QI and developed a relationship-centred model tested by path analysis.17,18 The results found strong associations between relationships, sensemaking and learning when there were higher degrees of trust and reflection, without establishing any causal link to improved quality or outcomes.18 Pfadenhauer defines context as ‘comprising not only the setting but also roles, interactions and relationships’,19 supporting thinking that the people-related factors of QI, such as teamwork, leadership, and culture, are critical contextual factors.9,16
Fig. 1 provides a high-level view of current research into understanding factors and their relationships influencing primary care QI. The intervention encompasses the topic and planned changes, including factors such as complexity and adaptability.10,20 The process is how the intervention is implemented, including methodology and facilitation.10,16,21 Contextual factors are the inner and outer socio-technical setting, including structures, people-related characteristics, and relationships.10,20,21 The model shows the overlap and interrelationships between the three components.
Methods
This qualitative multi-case study employs the Consolidated Framework for Implementation Research (CFIR)20 to guide data collection and analysis. CFIR was chosen because of its broad coverage, demonstrated applicability to primary care,22,23 and generic conceptual applicability.22,24 The CFIR domains and constructs illustrated in Fig. 2, are a good fit with the primary care QI model (Fig. 1), to enable identification of primary care specific constructs and relationships.
A sampling strategy based on known characteristics of the New Zealand (NZ) primary care setting was used to select relevant general practice, primary health organisation (PHO) sites and improvement topics, resulting in a mixture of rural, urban, very-low-cost access (VLCA), Kaupapa Māori (guided by Māori worldview and principles) practices and one PHO. Case study sites were asked to choose a successful QII to discuss. After several case interviews, effort was made to find cases that used ‘scientific QI’ methods,25 leading to inclusion of Case 4 (C4) and C6. Fig. 3 outlines site characteristics and improvement topics.
In-person, semi-structured interviews were conducted between October 2018 and January 2020. The qualitative interview data was compared and contrasted with the organisational documents and data provided by participants. Further method details, including consent, were provided in the 3-case comparison26 and remain the same for this study. However, it is worth repeating the care taken to honour the gift of Kaupapa Māori providers’ data and ensure principles were represented correctly from the participants perspective. The authors are all of European descent and do not have the lived understanding of Kaupapa Māori principles, therefore representatives from C2 and C5 were provided opportunity to provide feedback on their case report to ensure correct representation.
Results
Descriptive characteristics showing the key differences and similarities between the cases and the chosen QII are shown below in Table 1. Interview participant titles show the spread of staff interviewed and involved in the QII. C1 was in a remote rural setting and all the other cases were in urban settings of varying sizes and locations across NZ. Two were VLCA practices, as well as all the practices within Case 5, a PHO.
Case 1 (C1) | Case 2 (C2) | Case 3 (C3) | Case 4 (C4) | Case 5 (C5) | Case 6 (C6) | ||
---|---|---|---|---|---|---|---|
Organisation | A PHO and VLCAA practice co-located with Community Mental Health and other health services | A Kaupapa MāoriB VLCA practice | An integrated family health service | General practice | A Kaupapa Māori PHO with varied primary health care services including 5 VLCA general practices | A general practice co-located with a range of other health services | |
Setting | Remote rural practice | Urban practice within a satellite town of a large city | Urban practice in a large city | Urban practice in a large city | Sited in urban suburbs surrounding a large city | Urban practice in a large city | |
Practice size (100th percentile is the largest at approx. 29 000 patients) | Approx. 6000 enrolled patients | Approx. 3000 enrolled patients | Approx. 6000 enrolled patients | Approx. 13 000 enrolled patients | PHO approx. 18 000 enrolled patients; practices: 2500–5500 | Approx. 20 000 enrolled patients | |
76th percentile | 40th percentile | 76th percentile | 95th percentile | From 38 to 67th percentile | 99th percentile | ||
FTE, unless otherwise stated | General practitioners (GPs): 7, employed over varying hours | GPs: 2.5 | GPs: 5 | Head count of 13 GPs with various FTE | Practice headcount: | Chief executive | |
Nurse practitioner: 1 | PNs: 2.35 | GPs: 25 | GP director | ||||
Practice nurses (PNs): 2 | PNs: 30 | Finance/admin: 2 | |||||
Community health team 3.6 | PHO: approx. 120 staff in a range of roles | GPs: 11.9 | |||||
PNs: 9.5 | |||||||
Reception: 10 | |||||||
Interview participantsC | PHO clinical director | GP director | GP director | Clinical nurse Lead | Quality leader | General manager | |
CMH district manager | Practice manager | DHB service integration facilitator | GP director | Clinical lead nurse | Medical director | ||
General practice (mental health) liaison nurse | Nurse lead | PHO project manager | Clinic RN | Hub senior lead | GP associate | ||
Practice nurse | Administration team lead | Practice nurse | General manager | Hub administrator | |||
General practitioner (GP) | Community health worker/receptionist | Receptionist | Administration manager | ||||
Community health worker | PHO data nnalyst | ||||||
Practices nurses (2) | PHO nurse director | ||||||
Intervention | Physical health for patients with a mental health diagnosis | Telephone triage project | Patient prioritisation at reception | Nurse-led acute paediatric (initially 13 years and under) clinic. | A central telephone call answering and appointment booking service | Model of care change from acute care and general practice to general practice only | |
Date of QII | 2017 | 2014 | 2017 | 2018 | 2018 | 2018 | |
Date of interviews | October 2018 | October 2018 | January 2019 | August 2019 | January 2020 | December 2019 |
AVLCA: Very low-cost access (VLCA) practices have an enrolled population that is at least 50% economically deprived or Māori and Pacific Island peoples and the practice receives funding to maintain low fees.
BKaupapa Māori: ‘an approach that is guided by Māori worldviews and principles'35
CAll of those interviewed were actively involved in the improvement apart from those in italics.
The main themes identified were a mix of CFIR constructs and emergent themes identified from the qualitative data during the transcription, analysis, and writing-up process in an iterative and ongoing process. A small sample of quotes that illustrate these themes from each case is provided in the Supplementary File S1. Cross-case results analysis is reported using the main CFIR domains as headings. The main constructs identified in this study and the relative strength of these in comparison to each other are presented in Appendix 1. The addition of a further three cases led to the revision of strengths for planning in C1–3. Relative strength of identified constructs is based on a combination of the frequency, passion and stated importance assigned to that construct by the participants.
QII outcomes were not evaluated as part of this study although cases provided evidence supporting the QII success. Every case used feedback from patients and staff to assess progress towards achievement of goals. Four of the cases used quantitative time series data, one case used before and after data, and the other case used high level data that the QII is thought to have contributed to. All the QIIs were seeking improved access in varying ways but they also sought or had additional benefits as they balanced patient needs, practice sustainability and staff wellbeing. All cases considered their projects to be successful, not only in achieving the desired patient outcomes but also benefitting the practice and/or staff wellbeing. C3 and C5 saw unintended consequences, with increased workload in other parts of the system as they improved patient access and experience. Improved value for practice resources was achieved in C2, C4 and C6 as well as improved patient and provider experience.
Intervention characteristics
All QIIs except for C1 were internally generated. Although the C1 QII was initiated by the PHO, it had been of concern for some time within the practice team. All QII topics showed influences from the wider health environment, national primary care initiatives, and changes such as the Health Care Home Collaborative and funding changes.
Both C2 and C4 needed the QII to be cost neutral, but other cases provided funding to varying degrees for their QII. All teams did background investigations into their topics, seeking to learn from the examples of others. In most cases they drew on similar QIIs implemented elsewhere to develop evidence supporting the QII and how it would be an advantage to both patients and the organisation. This was supported by contextual knowledge, their ‘gut’ instinct, and qualitative and quantitative data to establish baseline understanding and review progress. The QII had to show adaptability to fit their context as they learnt more through local implementation. C4 found that ‘it was the data that kept telling the story that enabled us to tweak and adjust.’
Context
Identified patient need was a source of motivation for all cases and linked to the inner setting through a sense of community responsibility that was particularly strong in the Kaupapa Māori organisations. While several cases had other drivers, patient need was a core motivating factor without which the QIIs could not have been implemented.
All the teams had strong network relationships nationally and with their local communities, PHOs and/or District Health Boards (DHBs). PHO and/or DHB staff were members of the team in C1, C3 and C4 (C5 was a PHO) and C2, C3, C4 and C6 had staff in PHO or DHB governance positions. Several practices’ PHOs used these QIIs to demonstrate successful QI to others. They were all strongly connected to their population, communities, local services and providers and utilised these networks for most cases in these QIIs, but in all cases as part of maintaining contextual awareness.
Teams spoke of the need to do the QII for their patients and community, and this related to maintaining practice viability. The identified patient need connected with a strong sense of community responsibility for the enrolled population. This was particularly strong in Kaupapa Māori and rural teams, where for example (C5) ‘a lot of the people work [here] because they are passionate about the community’ and many of the cases spoke of going ‘the extra mile’ or ‘above and beyond’. C4 and C6, were strongly motivated by financial concerns and the need to stay in business, but C2 and C5 also sought to manage finances in their QIIs.
Culture played a significant role in why and how these QIIs were accomplished. Fig. 3 contains radar charts displaying the mix of culture types, based on the Competing Values Framework,27 self-identified by participants, and a synthesis of the interview data. Teams identified strongly with the ‘Clan’ and ‘Adhocracy’ culture types. The two largest urban practices within a large metropolitan city (C4 and C6) had spread across the culture types and had strong ‘Hierarchy’ culture elements. The Hierarchy culture is more formalised, structured, and focused on smooth functioning and efficiency.27 There is no ‘correct’ culture type, but the culture should ideally respond to the environmental demands on the organisation.27
In a ‘Clan’ culture, success is achieved by caring for people and meeting the needs of clients. It is friendly, like a large family held together by loyalty and teamwork, with promotion of participation and consensus.27 Every case spoke of teamwork, and several spoke of closer family-like relationships, particularly in the Kaupapa Māori organisations, where the unique cultural relationships of whānau (extended family group) and whanaungatanga (relationships and kinships) were key.
The ‘Adhocracy’ domain describes a creative working environment where employees take risks, leaders are seen as innovators and the long-term goal is to grow and create new resources.27 The quotes in Table 2, a sample of participants’ views, not only reflect that participants were constantly looking for ways to improve, but also reflect that they were looking to improve their way of improving.
Case 1 | We are quite innovative and over the years we have been a team that will try new things. | |
There is very much a ‘can-do’ attitude and always has been. And the nice thing about [the IFHS], […], is that its non-hierarchical. | ||
Case 2 | We are always trying to create new ways of doing things to be able to improve the practice. | |
I find that we can give our own feedback as staff. […] I give my own opinion all the time. | ||
Case 3 | We just constantly want to improve things. But our way of improving is also hopefully improving. | |
Not too much of a hierarchy, everybody is involved in the planning, decision and evaluation, everybody. | ||
Case 4 | We’re constantly trying to improve. | |
I feel that we do a lot of thinking and trying to figure out what we can do better, is there something we can do to fix this particular problem. | ||
Case 5 | So, everything from the way we set up our services, how can we run it better, how can we have a safer process. | |
It’s quite common for staff to voice ideas, […] be able to run with those […] and trial new things. | ||
Case 6 | We’ve always been a group of people that have tended to be if not spearheading, certainly very quickly early adopters. We’ve been more cutting edge. | |
We make decisions and do it. And if we’ve made a decision and it’s not working, we stop it. |
Together Clan and Adhocracy cultures combined to create a learning climate where staff felt valued, safe, and supported to ‘voice ideas’ and learn by ‘trial and error’ with a ‘can-do’ attitude. The teams included senior staff as well as a variety of front-line staff, including receptionists, nurses, administration staff and general practitioners, demonstrating both self-efficacy and agency. Engaged staff and leadership were key, and the mixed staff and shared leadership can be seen in Table 1. Teams spoke of flattened hierarchy and distributed leadership behaviours as they shared leadership roles and tasks to varying degrees relevant to their context and QII.
Processes varied according to skills and experience of participants. Participants spoke of known change methods: C2, Kotter change model;28 C3, Model of Emergent Learning;29 and C4, Plan-Do-Study-Act cycles. Only C4 used improvement science, and C6, although very experienced in QI, said ‘we were meticulous in following the process, but we didn’t use particular tools.’ Patient co-design was not part of the QIIs: C3 commented, ‘not having the knowledge or model of how to incorporate it.’ Only C1 and C6 employed a structured approach to consumer feedback. C6 hired a research company to undertake focus groups and surveys to inform service design and C1 undertook a post-trial survey. Preparation and planning were key and were mentioned as a strength in C3, C5 and C6. Every team used existing regular meetings to iteratively plan actions and review progress, ‘tweaking’ processes until things worked as planned.
Discussion
This research sought to identify the key contextual factors in primary care QI, and how they were interrelated with each other, the intervention, and the process of implementation. A revised model depicting primary care QI is presented in Fig. 4 showing the key factors identified in this study and their relationships. The quadruple aim30 is used to indicate success as case QIIs sought and achieved multiple aims. The model shows the inner and outer context overlapping due to interrelatedness and soft boundaries. The specific construct interrelationships and directionality are demonstrated by the arrows (Fig. 4).
Context, consisting of the inner and outer socio-technical settings, was a key determinant for selection of the QII in all cases. The inner and outer settings overlapped with shared relationships and strong connections. The QII was chosen to address the identified patient need but that also had benefits for the practice and staff. Network relationships assist participants in developing suitable QIIs through access to knowledge and examples from other settings. The QIIs in C2, C3 and C4 were delivered without direct financial outlay, but for all cases, they cost money in terms of staff time. Even when external support is provided, practices must supply ‘unpaid labour’ for QIIs.31 The advantage of the QII over previous ways of working for the practice, its patients and staff had to be clear and show alignment with organisational values before commencing the QII. This is reflected in the multiple aims of the QIIs aligning to the quadruple aim.30
The participants were motivated to improve by a sense of community responsibility. This was an emergent theme, not included in CFIR, and seems to be particular to primary care.32,33 NZ studies have highlighted how important a culture-centred, participatory approach is for successful change.34,35 For C2 and C4, staff were motivated to improve services by the kaupapa Māori values of manaakitanga (value, respect and care for) and whanaungatanga, which are only partially represented by the theme ‘community responsibility’. Across all cases, a commitment to provide quality care for their communities and strong connections to each other was apparent.
Engaged leadership and distributed leadership were observed, where leadership was shared and emerged at different levels and times as the need arose. In primary care, less senior, operational staff were often vital to action change,36 and participants described distributed leadership with ‘flat hierarchy’ and a ‘team approach’. The engaged and participative leadership style was a key contributor to the learning climate, and both are known for being key to continual improvement.18,32,37,38
The CFIR defines learning climate as one: ‘in which: (a) leaders express their own fallibility and need for team members’ assistance and input; (b) team members feel that they are essential, valued, and knowledgeable partners in the change process; (c) individuals feel psychologically safe to try new methods; and (d) there is sufficient time and space for reflective thinking and evaluation’.20 This combines elements of the Clan and Adhocracy cultures in a frame with a focus on learning. Learning is essential in QI as it is by learning that behaviours change.18,38,39 Here we saw teams draw on their natural skills and resources within the practice and through network relationships in a supported environment in order to learn and improve.
Network relationships with other organisations such as PHOs, DHBs, and national organisations were present in all cases, even if not required for these QII. These network relationships provided support, where needed, in the form of personnel time and expertise, as well as sharing or enabling access to knowledge and at times funding. Team members also drew on personal, professional, and community networks for support. Miller et al.32 found that the most resilient practices were consistently engaged with their local health systems, forming part of the practice's adaptive reserve.32 In NZ, the collaborative network supporting the implementation of the Health Care Home initiative has been identified as an innovation enabler, although complex relationships between DHBs and PHOs have created barriers in the past.40 All these cases draw on, and contribute to, national and local resources at an individual and organisational level, forming strong connections across the health system.
The interventions were well planned, and formal improvement methodology was only applied by C4, with several staff trained in improvement methodology and initially supported by an improvement advisor. Quantitative data collection and analysis was strong in C4 and C6, but overall was limited across the cases. Healthcare studies have found sensemaking to be a key problem-solving process in complex settings where there is scant and ambiguous data.18,32,41 Participants described an iterative social process of ‘sensemaking’ where participants combined available information, tacit knowledge, and experiences to reflect and make sense of events, to learn from and plan actions. Sensemaking activities were critical in these complex contexts for successful improvement and were enabled by psychologically safe42 learning climates and distributed leadership. Distributed leadership and learning climate can be natural, emergent properties or deliberately enacted over time based on practice and literature to guide development.43–45
Limitations
There are several limitations in this study. Case study research provides an in-depth view of individual cases and only six cases were considered. Primary care services are heterogeneous, and the conclusions may not be generalisable to other settings even within primary care. The interviews were conducted varying amounts of time after the initiatives, and while the teams felt confident in their recollection of events, it is possible that their recollection may have changed over time. Finally, the data collection for this study was completed prior to the arrival of COVID-19 in NZ, and primary care has been affected considerably by the pandemic. There are now likely to be other factors present in primary care that will affect QI efforts, including increasing resource and capacity constraints. Research to ascertain the generalisability of these findings in the current environment is recommended.
Conclusion
Community/patient need was a core motivator that connected with the sense of community responsibility in the participants. This (and more) was expressed as manaakitanga and whanaungatanga in Kaupapa Māori organisations. The teams drew on available knowledge, their networks, and resources to identify quality improvement interventions that addressed identified needs, and were adaptable and a good contextual fit. Formal improvement methods were generally not applied; however, teams combined structured planning with sensemaking activities to evaluate and adjust to achieve the desired outcome. This provided just enough structure and adaptability to respond to the current and changing conditions as they sought improvement without overly increasing the burden of effort within a resource-constrained environment.
Distributed leadership underpinned by teamwork was key to success, enabling inclusion of different perspectives and shared responsibility. This supported a psychologically safe learning climate for sensemaking and testing ideas. Distributed leadership, teamwork, and a learning climate enabled effective sensemaking to occur through iterative cycles of problem-solving, testing, and reviewing ideas to achieve successful outcomes.
References
1 Dixon-Woods M, Bosk CL, Aveling EL, et al. Explaining Michigan: developing an ex post theory of a quality improvement program. Milbank Q 2011; 89(2): 167-205.
| Crossref | Google Scholar |
2 Charlesworth K, Jamieson M, Davey R, et al. Transformational change in healthcare: an examination of four case studies. Aust Health Rev 2016; 40(2): 163-7.
| Crossref | Google Scholar |
3 Dixon-Woods M, Leslie M, Tarrant C, et al. Explaining Matching Michigan: an ethnographic study of a patient safety program. Implement Sci 2013; 8(1): 70.
| Crossref | Google Scholar |
4 Crabtree BF, Nutting PA, Miller WL, et al. Primary care practice transformation is hard work: insights from a 15-year developmental program of research. Med Care 2011; 49(Suppl): S28-35.
| Crossref | Google Scholar |
5 Braithwaite J, Glasziou P, Westbrook J. The three numbers you need to know about healthcare: the 60-30-10 Challenge. BMC Med 2020; 18(1): 102.
| Crossref | Google Scholar |
8 Rifkin SB. Alma Ata after 40 years: Primary Health Care and Health for All—from consensus to complexity. BMJ Glob Health 2018; 3(Suppl 3): e001188.
| Crossref | Google Scholar |
9 Subramanian L, Elam M, Healey AJ, et al. Context matters—but what aspects? The need for evidence on essential aspects of context to better inform implementation of quality improvement initiatives. Jt Comm J Qual Patient Saf 2021; 47(11): 748-52.
| Crossref | Google Scholar |
12 Coles E, Anderson J, Maxwell M, et al. The influence of contextual factors on healthcare quality improvement initiatives: a realist review. Syst Rev 2020; 9(1): 94.
| Crossref | Google Scholar |
13 Imison C, Curry N, Holder H, et al. Shifting the Balance of Care: Great Expectations. 2017. Available at https://www.nuffieldtrust.org.uk/research/shifting-the-balance-of-care-great-expectations [11 November 2017]
14 Kaplan HC, Froehle CM, Cassedy A, et al. An exploratory analysis of the Model for Understanding Success in Quality. Health Care Manage Rev 2013; 38: 325-38.
| Crossref | Google Scholar |
15 Lau R, Stevenson F, Ong BN, et al. Achieving change in primary care—causes of the evidence to practice gap: systematic reviews of reviews. Implement Sci 2016; 11(1): 40.
| Crossref | Google Scholar |
16 Brennan SE, Bosch M, Buchan H, et al. Measuring organizational and individual factors thought to influence the success of quality improvement in primary care: a systematic review of instruments. Implement Sci 2012; 7(1): 121.
| Crossref | Google Scholar |
17 Lanham HJ, McDaniel Jr RR, Crabtree BF, et al. How improving practice relationships among clinicians and nonclinicians can improve quality in primary care. Jt Comm J Qual Patient Saf 2009; 35(9): 457-66, AP1–2.
| Crossref | Google Scholar |
18 Lanham HJ, Palmer RF, Leykum LK, et al. Trust and reflection in primary care practice redesign. Health Serv Res 2016; 51(4): 1489-514.
| Crossref | Google Scholar |
19 Pfadenhauer LM, Gerhardus A, Mozygemba K, et al. Making sense of complexity in context and implementation: the Context and Implementation of Complex Interventions (CICI) framework. Implement Sci 2017; 12(1): 21.
| Crossref | Google Scholar |
20 Damschroder LJ, Aron DC, Keith RE, et al. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci 2009; 4(1): 50.
| Crossref | Google Scholar |
21 Coles E, Wells M, Maxwell M, et al. The influence of contextual factors on healthcare quality improvement initiatives: what works, for whom and in what setting? Protocol for a realist review. Syst Rev 2017; 6(1): 168.
| Crossref | Google Scholar |
22 Keith RE, Crosson JC, O’Malley AS, et al. Using the Consolidated Framework for Implementation Research (CFIR) to produce actionable findings: a rapid-cycle evaluation approach to improving implementation. Implement Sci 2017; 12(1): 15.
| Crossref | Google Scholar |
23 Kowalski CP, Veeser M, Heisler M. Formative evaluation and adaptation of pre-and early implementation of diabetes shared medical appointments to maximize sustainability and adoption. BMC Fam Pract 2018; 19(1): 109.
| Crossref | Google Scholar |
24 Ilott I, Gerrish K, Booth A, et al. Testing the Consolidated Framework for Implementation Research on health care innovations from South Yorkshire. J Eval Clin Pract 2013; 19(5): 915-24.
| Crossref | Google Scholar |
25 Skela-Savič B, Macrae R, Lillo-Crespo M, et al. The development of a consensus definition for healthcare improvement science (HIS) in seven European countries: a consensus methods approach. Slovenian J Public Health 2017; 56(2): 82-90.
| Crossref | Google Scholar |
26 Cullen J, Childerhouse P, McBain L. Contextual antecedents of quality improvement: a comparative case study in rural, urban and Kaupapa Māori general practice. J Prim Health Care 2022; 14: 179-86.
| Crossref | Google Scholar |
29 Darling M, Guber H, Smith J, et al. Emergent learning: a framework for whole-system strategy, learning, and adaptation. Found Rev 2016; 8(1): 59-73.
| Crossref | Google Scholar |
30 Bodenheimer T, Sinsky C. From triple to quadruple aim: care of the patient requires care of the provider. Ann Fam Med 2014; 12(6): 573-6.
| Crossref | Google Scholar |
31 Casalino LP. Technical assistance for primary care practice transformation: free help to perform unpaid labor? Ann Fam Med 2018; 16(Suppl 1): S12-5.
| Crossref | Google Scholar |
32 Miller WL, Crabtree BF, Nutting PA, et al. Primary care practice development: a relationship-centered approach. Ann Fam Med 2010; 8(Suppl 1): S68-79.
| Crossref | Google Scholar |
33 Larkins S, Carlisle K, Turner N, et al. ‘At the grass roots level it’s about sitting down and talking’: exploring quality improvement through case studies with high-improving Aboriginal and Torres Strait Islander primary healthcare services. BMJ Open 2019; 9(5): e027568.
| Crossref | Google Scholar |
34 Harding T, Oetzel J. Implementation effectiveness of health interventions for indigenous communities: a systematic review. Implement Sci 2019; 14(1): 76.
| Crossref | Google Scholar |
35 Beaton A, Manuel C, Tapsell J, et al. He Pikinga Waiora: supporting Māori health organisations to respond to pre-diabetes. Int J Equity Health 2019; 18(1): 3.
| Crossref | Google Scholar |
36 Donahue KE, Halladay JR, Wise A, et al. Facilitators of transforming primary care: a look under the hood at practice leadership. Ann Fam Med 2013; 11(Suppl 1): S27-33.
| Crossref | Google Scholar |
37 Crabtree BF, Howard J, Miller WL, et al. Leading innovative practice: leadership attributes in LEAP practices. Milbank Q 2020; 98: 399-445.
| Crossref | Google Scholar |
38 Bailie R, Matthews V, Brands J, et al. A systems-based partnership learning model for strengthening primary healthcare. Implement Sci 2013; 8: 143.
| Crossref | Google Scholar |
39 Avby G, Kjellström S, Andersson Bäck M. Tending to innovate in Swedish primary health care: a qualitative study. BMC Health Serv Res 2019; 19(1): 42.
| Crossref | Google Scholar |
41 Maitlis S, Christianson M. Sensemaking in organizations: taking stock and moving forward. Acad Manag Ann 2014; 8(1): 57-125.
| Google Scholar |
42 Edmondson AC, Lei Z. Psychological safety: the history, renaissance, and future of an interpersonal construct. Annu Rev Organ Psychol Organ Behav 2014; 1(1): 23-43.
| Crossref | Google Scholar |
43 Carroll JS, Edmondson AC. Leading organisational learning in health care. Qual Saf Health Care 2002; 11(1): 51-6.
| Crossref | Google Scholar |
44 Kiran T, Ramji N, Derocher MB, et al. Ten tips for advancing a culture of improvement in primary care. BMJ Qual Saf 2018; 28: 582-7.
| Crossref | Google Scholar |
Appendix 1. Comparison of factor strength between the six cases
Model domains | Factors | Case 1 | Case 2 | Case 3 | Case 4 | Case 5 | Case 6 | |
---|---|---|---|---|---|---|---|---|
Outer context | Network relationships | +++ | +++ | +++ | +++ | +++ | ++ | |
Identified need | +++ | +++ | ++ | ++ | +++ | +++ | ||
Inner context | Community responsibility | ++ | +++ | + | ++ | +++ | ++ | |
Distributed leadership | +++ | ++ | +++ | +++ | +++ | ++ | ||
Learning climate | + | + | +++ | +++ | +++ | +++ | ||
Teamwork | ++ | +++ | +++ | +++ | +++ | +++ | ||
Intervention | Fit with context | +++ | +++ | ++ | +++ | +++ | +++ | |
Relative advantage | +++ | +++ | +++ | +++ | +++ | +++ | ||
Adaptability | +++ | +++ | +++ | +++ | +++ | ++ | ||
Process | Planning | +++ | + | +++ | +++ | +++ | +++ | |
Sensemaking | ++ | +++ | +++ | +++ | +++ | +++ |
Table factor strength key: Present = +, stronger = ++, Strongest = +++.