Register      Login
Journal of Primary Health Care Journal of Primary Health Care Society
Journal of The Royal New Zealand College of General Practitioners
RESEARCH ARTICLE (Open Access)

Palliative medicine Master Classes for primary care: an evaluation

Amanda Landers https://orcid.org/0000-0002-7385-3739 1 * , Raewyn Jenkins 2 , Persijn J. Honkoop 3
+ Author Affiliations
- Author Affiliations

1 Department of Medicine, University of Otago, 2 Riccarton Avenue, Christchurch 8140, New Zealand.

2 Nurse Maude Hospice Palliative Care Service, Merivale, Christchurch, New Zealand.

3 Southlink Health Services, Rangiora Family Doctors, Rangiora, New Zealand.

* Correspondence to: amanda.landers@otago.ac.nz

Handling Editor: Tim Stokes

Journal of Primary Health Care 14(3) 207-213 https://doi.org/10.1071/HC22045
Published: 11 July 2022

© 2022 The Author(s) (or their employer(s)). Published by CSIRO Publishing on behalf of The Royal New Zealand College of General Practitioners. This is an open access article distributed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (CC BY-NC-ND)

Abstract

Introduction: General practitioners (GP) are key in the delivery of primary palliative care in the community, so appropriate knowledge and skills are needed. Previous research has suggested there may be gaps in training opportunities.

Aims: To develop and evaluate a Master Class series presented by a hospice palliative care service to their local GPs and other health-care professionals. A secondary aim was to measure the lasting impacts of the educational intervention.

Methods: The study setting was the Canterbury region of Aotearoa New Zealand (NZ). GPs and other health-care professionals were surveyed using a research team-designed questionnaire rating self confidence in the nominated learning objectives before and after the Master Classes. The participants were also asked to self-rate the application of the knowledge to their practice 3 years after the Master Class sessions were attended.

Results: There were 56 sets of questionnaires completed. The participants tended to be experienced female GPs with a range of palliative care patients in their practice. There was significant improvement in most learning outcomes across the Master Classes series. The attendees reported the Master Classes were relevant and clear, with useful resources. The improvements in the learning outcomes were largely sustained over 3 years.

Discussion: The provision of palliative care education that aligns with clinical practice improves knowledge, skills and confidence in GPs who provide most of the end-of-life care in New Zealand.

Keywords: co‐design, competencies, education, educational evaluation, Kirkpatrick levels of learning, Master Classes, palliative care, primary care.

WHAT GAP THIS FILLS
What is already known: GPs provide most of the palliative care for their communities. Ongoing palliative care education is required to upskill GPs and improve their confidence in end-of-life care.
What this study adds: The Master Classes improved the knowledge and confidence of the participants in multiple areas of providing end-of-life care. Many of the competencies from the educational intervention were retained over several years.



Introduction

Palliative care is an approach that focuses on quality of life for people with life-limiting illness and their families through the assessment of physical, psychological, social, financial, and emotional needs.1 In 2017, a Lancet Commission stated that the alleviation of the burden of pain, suffering and severe distress associated with life-limiting health conditions and with end-of-life is a global health and equity imperative.2 In Aotearoa New Zealand (NZ), palliative care is generally provided by primary care. In 2015, a NZ Ministry of Health report defined primary palliative care as integral in the national model of care.3 In this report, the number of people requiring palliative care is projected to rise by 51% by 2038.3 This report also states that 81% of all deaths will require a palliative approach at the end-of-life. Of these, 60% will die under the care of a GP at home or in residential care.

The current model of palliative care in NZ has regional differences, but generally consists of a core team of district nurses, community pharmacies, practice nurses and the GP.4 A recent review showed the continuity of care and long-term relationships with patient and families that GPs provide as key factors in quality provision of end-of-life care services.5 General practitioners also report that palliative care is an essential part of their job.6 In a UK-wide GP survey, 97% felt that primary care played a pivotal role in the delivery of this care to their communities.6 Patients with palliative care needs appreciate the ability of GPs to co-ordinate health care, and their knowledge of a wide variety of health issues.57 In NZ, the primary care team is supported where necessary, by secondary care and specialist palliative care services.4

The provision of primary palliative care does pose some specific challenges. End-of-life care requires an individualised approach for each patient, a broad knowledge of different diseases, and complex symptom management. Furthermore, palliative care sometimes requires the knowledge of specific medications, or medical procedures that a GP does not encounter often, which include prescribing methadone, palliative care emergencies, or opioid rotation. Jors et al. surveyed experienced clinicians about their recommendations for the improvement of palliative care education.8 Suggestions included communication training, knowledge of how to care for family caregivers and basic information on palliative care. Although uncommon presentations of illness might present General Practice with a fresh challenge, the time-constrained environment can lead to palliative care delivery becoming burdensome.9 These challenges result in a GP feeling they need further training and the importance of continuing education in palliative medicine.8

It is unknown to what extent NZ GPs report they lack specific knowledge about palliative care. An University of Otago review of the undergraduate palliative and end-of-life curriculum in NZ highlighted that this area of medicine has only recently been added.10 General practitioners acquire relevant skills on the job, or through continuing medical education. It is unclear to what extent GPs have been able to acquire these skills, as no systematic assessment of potential gaps with specifically designed educational tools, has been published.

In NZ there is a need to provide palliative care to a diverse range of ethnic groups, particularly the indigenous Māori population, paying close attention to Te Tiriti (Treaty of Waitangi) obligations.11 Māori, along with Pacific people, experience inequities in the delivery and uptake of palliative care services and have worse health outcomes.12 Therefore, it is important the care is delivered in a culturally appropriate manner.13 Palliative care educational interventions may help address any inadequacies in cultural competence for the learner who is potentially involved in the delivery of end-of-life care in Aotearoa New Zealand.

This study aims to assess improvements in confidence levels of GPs and other health-care professionals before and after delivery of a Master Class series by a specialist palliative care service. The retention of the palliative care knowledge was also evaluated 3 years after the educational intervention. Finally, we plan to use the outcomes of this study to develop a palliative care online module for primary care addressing any knowledge gaps highlighted.


Methods

Study participants

The study took place in the Canterbury region of NZ in 2017 and 2018. Ethical approval was obtained from the Nurse Maude Hospice Palliative Care Ethics Committee. The Master Classes were advertised to primary care providers throughout the region. Participants who had attended a previous session were emailed directly and offered a place in the workshop. The participants were predominantly health-care professionals able to prescribe medication. Convenience sampling was utilised by asking the clinicians attending the sessions to participate in the evaluation. Consent to participate in the study was obtained immediately prior to the Master Class commencement.

Master Class development

In response to a perceived gap in palliative care education for primary care, the lead investigator (AL) assessed current literature and overseas educational programmes for relevant palliative care topics and learning outcomes for primary care. Two of the authors (AL, RJ) worked in a large urban community palliative care service with a strong primary care interface. The original topics were chosen in response to many conversations with local GPs. The Master Classes commenced in 2011 and received strong support from primary care. Each session was evaluated, which was utilised to obtain more specific knowledge of educational needs.

Master Class design

The Master Class series consisted of four workshops delivered over 2 years and included education on opioids, symptom management, non-malignant palliative care, food, and fluids at the end-of-life and ethical dilemmas. The overall learning objectives were to improve knowledge and understanding of several aspects of palliative care and be able to apply this knowledge to end-of-life care. The classes also provided a valuable opportunity to meet members of the specialist palliative care team in person who may be consulting on their patients. The Master Classes were held in the evening, lasted 3 h and each class was facilitated by three local palliative care physicians. Numbers were kept to a maximum of 20 to encourage interaction. All the Master Classes included case-based learning and the opportunity for the health-care professional to bring along their own cases to discuss. The Master Classes were endorsed by The Royal New Zealand College of General Practitioners (RNZCGP) for continuous professional development.

Study design

Our study was designed based on the Kirkpatrick model as a way of evaluating the effectiveness of training programmes. The Kirkpatrick four levels of evaluation provide a framework for measuring educational interventions.14 The first level is a simple evaluation of a course or training session, whereas the second level enquires about changes in confidence. The third level of evaluation focuses on application of the educational intervention learning outcomes and the last step measures changes in practice from the perspective of patients and colleagues. Our study design utilised the first three levels.

For each Master Class, the key learning outcomes were identified as 15–18 first-person statements and formed the basis of the questionnaire (Supplementary materials S1–S4). Participants were given paper copies of the questionnaire before and after the Master Class. The questionnaire included demographics such as gender, age, and years of practice. There was also a question on their role in the provision of palliative care and the approximate number of palliative patients they manage per year. The participants were asked to rate their confidence against the statements on a 100-point scale (0 being not very confident, 100 being very confident) before each Master Class. They were subsequently asked to complete the same questionnaire immediately post each Master Class. The survey ended with a question asking if anything could have been done better.

In 2021, the participants were asked to complete a survey rating their current level of application of knowledge and confidence against 31 listed palliative care competencies (or behaviours) (Supplementary materials S5). A five-point scale was used (1 being little or no application and 5 being a strong degree of application). Participants were also asked to list any palliative care topics that had not been included in the Master Classes and if they would be interested in an online Palliative Care module in the future.

Data analysis

The survey results were analysed using descriptive statistical methods in Microsoft Excel (2016; Microsoft Corporation) to obtain averages, ranges, and standard deviations. Data for the pre and post outcomes were compared using paired t-tests. A P-value <0.05 was the threshold for statistical significance. Effect sizes of each Master Class were determined in the conventional way by measuring differences in means as a proportion of the standard deviation. Evaluation of the free-text questions involved simple content analysis by authors AL and RJ, which identified recurrent themes.


Results

Respondent characteristics

Fifty-six pairs of surveys were completed by the workshop participants. It is unknown how many unique participants there were as the information was collected anonymously and it is possible the same person filled out questionnaires at multiple Master Classes. Most participants who attended the workshops were experienced female GPs (Table 1). There was a small group of Nurse Practitioners and Medical Registrars. The number of palliative care patients they had varied from one to >10 per year. The demographics were similar for the 3-year follow-up group.


Table 1.  Characteristics of participants who attended all four Master Class workshops and the 3-year follow-up group.
Click to zoom

Master Class outcomes

Almost all the learning objectives measured in the questionnaires improved significantly. The top five objectives ranked by mean change are displayed in Table 2. The learning objectives that did not significantly improve included: confidence with subcutaneous infusions, ethical dilemmas, and advance care planning (see Supplementary materials S6 for full results). These topics already showed a high degree of confidence and did not show much improvement. The overall effect size of each workshop (range 0.98–1.82) showed a high degree of change.


Table 2.  Five most improved learning objectives from each workshop as per the mean change.
Click to zoom

In the 3-year follow-up questionnaire, there was a very strong, or strong degree of application of the Master Class content for most of the learning objectives (Fig. 1). The most strongly applied information to practice included: prescribing breakthrough pain options, using the correct opioids in a palliative patient, and managing constipation. The palliative care emergency topics were least applied.


Fig. 1.  Degree of application to practice of the Master Class learning objectives the participants reported 3 years after the educational sessions.
F1

Qualitative analysis

Analysis of the qualitative comments from the participants showed some common themes. The respondents reported that the educational material was relevant and practical to their clinical practice. Clarity of the teaching and quality of the resources was mentioned. Several participants reported that the format was engaging, and they particularly enjoyed the multiple speakers.


Discussion

General practitioners are crucial to the provision of palliative care in the community. Education, training, and support from specialist services helps primary care to improve their skills and confidence in the complexities of symptom management, the use of certain medications and goal setting at the end-of-life. This study shows that evidence-based Master Classes designed with local input appears to be effective as an educational model. The improvements from the Master Classes were sustained after three years, except for those situations rarely seen by General Practice such as palliative care emergencies. The participants indicated there was interest in an online palliative care module for further advancement.

Comparison with existing literature

The content of the Master Classes was developed in collaboration between the specialist palliative care service and local GPs. Previous studies have shown that GPs report the need for ongoing palliative care training.15,16 Often, these courses are designed by specialist services; however, unless the content has practical application to the GP, they will be less effective.17 Co-designing our educational intervention allowed us to resolve any discordance between the priorities of the expert and the participants, as well as deliver the material in an engaging format.15

Evaluations of continuing education are important in ensuring the delivery of high-quality content.18 Assessments of the content of palliative care educational interventions and how they impact physician practice and patient outcomes are scarce in the literature.19,20 We used the Kirkpatrick model to guide our evaluation at the time of the intervention and assess behaviour changes three years later.14 The Kirkpatrick model has been used in education evaluation since the 1950s and has been found to offer curriculum developers a simple framework to assess interventions.21 The model can be adapted to different settings and topics. Artioli et al. assessed a palliative care training programme designed by palliative care specialists for hospital health-care professionals.22 The research team utilised the Kirkpatrick model to evaluate the programme content of the course and tested knowledge that increased significantly. Their positive outcomes were similar to our findings.

Various educational formats for training in palliative care have been studied, including online options.2325 Online training formats have the added advantage of reaching rural and remote practitioners more easily, particularly as 16% of the NZ population lives rurally.26 Dy et al. developed an online palliative care module for hospital specialists to manage pain in ambulatory patients.23 Similar to our study, they found pre-test knowledge of pain management was low across many domains and scores improved immensely after the educational intervention. A randomised-controlled trial utilising an online palliative care education programme showed improvements in symptom management for patients and decreased family anxiety.24 The participants in this study also reported increased confidence in communication and knowledge. Although our participants highly rated the face-to-face element, the emergence of coronavirus disease 2019 (COVID-19) has made the online environment for medical education more convenient. It is reassuring to see that in the literature, results were similar for online formats.

Strengths and limitations

The main strength of our study was the formal evaluation of a palliative care educational intervention using the Kirkpatrick model, both immediate and long-term. The three-year follow-up survey identified the lasting effects of the education and the strong degree of relevance of the course content. Other strengths of the study were the diverse nature of the participants and the co-design of the course material.

The limitations included a relatively low number of participants who were all from the same region; therefore, outcomes may not be representative of all GPs across New Zealand. Data were not collected about the ethnicities of the participants, which would be important for future evaluations. Education in the delivery of culturally appropriate palliative care was not included in the content as the information mainly focused on symptom management. Those who attended the Master Classes were likely to be a highly motivated group, willing to learn about palliative care topics and engage with the content. Although the study aimed to evaluate the enduring impacts of the learning, this was all self-reported.

Implications for practice and future research

Continuing medical education is vital for updating and upskilling practitioners in health. The interface between specialist palliative care and General Practice is strong, particularly in community settings. A co-designed palliative care course with content relevant to GPs and other health-care professionals can make a significant positive and lasting impact; however, the evaluation highlighted that not all the content was necessary, and further refinements can now be made to the curriculum. The Master Classes were all in person, with the training delivered in a hospice by several palliative care specialists. A change in educational format may be necessary as the world faces pandemics, isolation, physician time pressures and the growing complexity of patients. In the future, palliative care education may need a hybrid, blended format of in-person and online options. In-person training helps with collegiality and engagement, whereas online content is accessible to more health-care professionals. This change in educational delivery will need evaluation and further refinement to find the best balance for positive learning outcomes. Future research should focus on the potential of online modules and more personalised education based on individual knowledge gaps. Consultation with Māori and Pacific clinicians to ensure the content is culturally appropriate and provides information to improve palliative care provision to these communities is vital.


Conclusion

These Palliative Care Master Classes for primary care led to a lasting improvement in many learning outcomes. Educational programmes such as Master Classes may help meet the global demand for ongoing medical education on palliative care.


Data availability

The data used in this research are available on request.


Conflicts of interest

The authors declare no conflicts of interest.


Declaration of funding

This study received no specific funding.


Author contributions

Initial research design and interview questionnaire were done by AL and RJ. AL, RJ and PH were involved in the data analysis and writing of the article. All the authors have read and approved the final version of the paper.


Supplementary material

Supplementary material is available online.



Acknowledgements

The authors would like to thank Nurse Maude Association for supporting the Master Classes.


References

[1]  Sepúlveda C, Marlin A, Yoshida T, et al. Palliative care: the World Health Organization’s global perspective. J Pain Symptom Manage 2002; 24 91–6.
Palliative care: the World Health Organization’s global perspective.Crossref | GoogleScholarGoogle Scholar | 12231124PubMed |

[2]  Knaul FM, Farmer PE, Krakauer EL, et al. Alleviating the access abyss in palliative care and pain relief—an imperative of universal health coverage: the Lancet Commission report. Lancet 2018; 391 1391–454.
Alleviating the access abyss in palliative care and pain relief—an imperative of universal health coverage: the Lancet Commission report.Crossref | GoogleScholarGoogle Scholar | 29032993PubMed |

[3]  Ministry of Health. Review of Adult Palliative Care Services in New Zealand. Wellington: Ministry of Health; 2017.

[4]  Ministry of Health. Resource and Capability Framework for Integrated Adult Palliative Care Services in New Zealand. Wellington: Ministry of Health; 2013.

[5]  Green E, Knight S, Gott M, et al. Patients’ and carers’ perspectives of palliative care in general practice: a systematic review with narrative synthesis. Palliat Med 2018; 32 838–50.
Patients’ and carers’ perspectives of palliative care in general practice: a systematic review with narrative synthesis.Crossref | GoogleScholarGoogle Scholar | 29343169PubMed |

[6]  Mitchell S, Loew J, Millington-Sanders C, et al. Providing end-of-life care in general practice: findings of a national GP questionnaire survey. Br J Gen Pract 2016; 66 e647–e53.
Providing end-of-life care in general practice: findings of a national GP questionnaire survey.Crossref | GoogleScholarGoogle Scholar | 27381483PubMed |

[7]  Mitchell GK. How well do general practitioners deliver palliative care? A systematic review. Palliat Med 2002; 16 457–64.
How well do general practitioners deliver palliative care? A systematic review.Crossref | GoogleScholarGoogle Scholar | 12465692PubMed |

[8]  Jors K, Seibel K, Bardenheuer H, et al. Education in end-of-life care: what do experienced professionals find important? J Cancer Educ 2016; 31 272–8.
Education in end-of-life care: what do experienced professionals find important?Crossref | GoogleScholarGoogle Scholar | 25773135PubMed |

[9]  Taubert M, Nelson A. ‘Oh God, not a Palliative’: out-of-hours general practitioners within the domain of palliative care. Palliat Med 2010; 24 501–9.
‘Oh God, not a Palliative’: out-of-hours general practitioners within the domain of palliative care.Crossref | GoogleScholarGoogle Scholar | 20501510PubMed |

[10]  Aotearoa New Zealand Undergraduate Medicine Palliative and End of Life Care Curriculum Working Group. A Framework for the Implementation of Palliative and End of Life Care in Undergraduate Medical Education. Dunedin: University of Otago; 2019.

[11]  Hospice New Zealand. Mauri Mate: a Māori Palliative Care Framework for Hospices; 2019. Available at https://www.hospice.org.nz/mauri‐mate/ (accessed 22 February 2022).

[12]  Foliaki S, Pulu V, Denison H, et al. Pacific meets west in addressing palliative care for Pacific populations in Aotearoa/New Zealand: a qualitative study. BMC Palliat Care 2020; 19 1–12.
Pacific meets west in addressing palliative care for Pacific populations in Aotearoa/New Zealand: a qualitative study.Crossref | GoogleScholarGoogle Scholar |

[13]  Shahid S, Taylor EV, Cheetham S, et al. Key features of palliative care service delivery to Indigenous peoples in Australia, New Zealand, Canada and the United States: a comprehensive review. BMC Palliat Care 2018; 17 1–20.
Key features of palliative care service delivery to Indigenous peoples in Australia, New Zealand, Canada and the United States: a comprehensive review.Crossref | GoogleScholarGoogle Scholar |

[14]  Kirkpatrick JD, Kirkpatrick WK. Kirkpatrick’s four levels of training evaluation: Alexandria, VA: ATD press; 2016.

[15]  Charlton R, Currie AA. UK perspective on worldwide inadequacies in palliative care training: a short postgraduate course is proposed. Am J Hosp Palliat Care 2008; 25 63–71.
UK perspective on worldwide inadequacies in palliative care training: a short postgraduate course is proposed.Crossref | GoogleScholarGoogle Scholar | 18160545PubMed |

[16]  Stähli A, Stiel S, Paal P, et al. Postgraduate palliative care education and curricular issues in Central Asia, Eastern and South-Eastern Europe: Results from a quantitative study. Palliat Med Pract 2020; 14 81–8.
Postgraduate palliative care education and curricular issues in Central Asia, Eastern and South-Eastern Europe: Results from a quantitative study.Crossref | GoogleScholarGoogle Scholar |

[17]  Carroll T, Weisbrod N, O’Connor A, et al. Primary palliative care education: a pilot survey. Am J Hosp Palliat Care 2018; 35 565–9.
Primary palliative care education: a pilot survey.Crossref | GoogleScholarGoogle Scholar | 28782375PubMed |

[18]  Weiner SJ, Jackson JL, Garten S. Measuring continuing medical education outcomes: a pilot study of effect size of three CME interventions at an SGIM annual meeting. J Gen Intern Med 2009; 24 626–9.
Measuring continuing medical education outcomes: a pilot study of effect size of three CME interventions at an SGIM annual meeting.Crossref | GoogleScholarGoogle Scholar | 19263177PubMed |

[19]  Alvarez MP, Agra Y. Systematic review of educational interventions in palliative care for primary care physicians. Palliat Med 2006; 20 673–83.
Systematic review of educational interventions in palliative care for primary care physicians.Crossref | GoogleScholarGoogle Scholar | 17060266PubMed |

[20]  Downar J. Resources for educating, training, and mentoring all physicians providing palliative care. J Palliat Med 2018; 21 S-57–62.
Resources for educating, training, and mentoring all physicians providing palliative care.Crossref | GoogleScholarGoogle Scholar |

[21]  Paull M, Whitsed C, Girardi A. Applying the Kirkpatrick model: Evaluating an ‘interaction for learning framework’ curriculum intervention. Issues Educ Res 2016; 26 490–507.

[22]  Artioli G, Bedini G, Bertocchi E, et al. Palliative care training addressed to hospital healthcare professionals by palliative care specialists: a mixed-method evaluation. BMC Palliat Care 2019; 18 88
Palliative care training addressed to hospital healthcare professionals by palliative care specialists: a mixed-method evaluation.Crossref | GoogleScholarGoogle Scholar | 31655585PubMed |

[23]  Dy SM, Hughes M, Weiss C, et al. Evaluation of a web-based palliative care pain management module for housestaff. J Pain Symptom Manage 2008; 36 596–603.
Evaluation of a web-based palliative care pain management module for housestaff.Crossref | GoogleScholarGoogle Scholar | 18440767PubMed |

[24]  Pelayo M, Cebrián D, Areosa A, et al. Effects of online palliative care training on knowledge, attitude and satisfaction of primary care physicians. BMC Fam Pract 2011; 12 1–11.
Effects of online palliative care training on knowledge, attitude and satisfaction of primary care physicians.Crossref | GoogleScholarGoogle Scholar |

[25]  Ward J, Walsh J. A palliative medicine course for general practitioners based on the CRISIS criteria for effective continuing education. Educ Prim Care 2009; 20 41–3.
A palliative medicine course for general practitioners based on the CRISIS criteria for effective continuing education.Crossref | GoogleScholarGoogle Scholar | 19618651PubMed |

[26]  Environmental Health Intelligence New Zealand. Urban-rural profile New Zealand. Massey University; 2018. Available at https://www.ehinz.ac.nz/indicators/population-vulnerability/urbanrural-profile/