Free Standard AU & NZ Shipping For All Book Orders Over $80!
Register      Login
Journal of Primary Health Care Journal of Primary Health Care Society
Journal of The Royal New Zealand College of General Practitioners
RESEARCH ARTICLE (Open Access)

Keeping it going: the importance of delivering interprofessional education during the COVID-19 pandemic

Eileen McKinlay 1 12 , Don Banks 2 , Karen Coleman 3 , Ben Darlow 1 , Gay Dungey 4 , Tracy Farr 1 , Rebecca Fyfe 1 , Ben Gray 1 , Liz Kemp 5 , Miriam Mitchell 6 , Caroline Morris 1 , Julia Myers 7 , Hazel Neser 8 , Meredith Perry 5 , Rowena Price 9 , Wendy Thompson 10 , Belinda Westenra 2 , Sue Pullon 11
+ Author Affiliations
- Author Affiliations

1 Department of Primary Health Care and General Practice, University of Otago Wellington, Box 7343, Wellington, New Zealand.

2 Whitireia New Zealand.

3 Hutt Valley District Health Board, New Zealand.

4 Department of Radiation Therapy, University of Otago Wellington, New Zealand.

5 School of Physiotherapy, University of Otago Wellington, New Zealand.

6 School of Nursing, Massey University, New Zealand.

7 Department of Medicine, University of Otago Wellington, New Zealand.

8 Mary Potter Hospice, New Zealand.

9 Acute Pain Management Service, Capital and Coast District Health Board, New Zealand.

10 Wellington Regional Hospital, Capital and Coast District Health Board, New Zealand.

11 Centre for Interprofessional Education, University of Otago, New Zealand.

12 Corresponding author. Email: eileen.mckinlay@otago.ac.nz

Journal of Primary Health Care 13(4) 359-369 https://doi.org/10.1071/HC21070
Published: 6 December 2021

Journal Compilation © Royal New Zealand College of General Practitioners 2021 This is an open access article licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License

Abstract

BACKGROUND AND CONTEXT: Globally, the coronavirus disease 2019 (COVID-19) pandemic has highlighted the need for better interprofessional collaboration and teamwork. When disciplines have worked together to undertake testing, deliver care and administer vaccines, progress against COVID-19 has been made. Yet, teamwork has often not happened, wasting precious resources and stretching health-care workforces. Continuing to train health professionals during the pandemic is challenging, particularly delivering interprofessional education that often uses face-to-face delivery methods to optimise interactional learning. Yet, continuing to offer interprofessional education throughout the pandemic is critical to ensure a collaboration-ready health workforce. One example is continuing the established INVOLVE (Interprofessional Visits to Learn Interprofessional Values through Patient Experience) interprofessional education initiative.

ASSESSMENT OF PROBLEM: Educators have not always prioritised interprofessional education during the pandemic, despite its immediate and long-term benefits. The INVOLVE interprofessional education initiative, usually delivered face-to-face, was at risk of cancellation.

RESULTS: A quality improvement analysis of the strategies used to continue INVOLVE demonstrated that it is possible to deliver interprofessional education within the constraints of a pandemic by using innovative online and hybrid educational strategies. Educators and students demonstrated flexibility in responding to the sudden changes in teaching and learning modalities.

STRATEGIES: When pandemic alert levels change, interprofessional educators and administrators can now choose from a repertoire of teaching approaches.

LESSONS: Four key lessons have improved the performance and resilience of INVOLVE: hold the vision to continue interprofessional education; be nimble; use technology appropriately; and there will be silver linings and unexpected benefits to the changes.

Keywords: Educator; interprofessional education; IPE; online teaching; pandemic.

WHAT GAP THIS FILLS
What is already known: Interprofessional collaboration and teamwork skills benefit the health services, but must be learned and practised just like other essential skills. Interprofessional education undertaken in pre-registration years supports acquisition of teamwork skills, but this is typically undertaken in face-to-face encounters.
What this study adds: A pandemic can disrupt delivery of interprofessional education at a time when learning teamwork skills is most needed. Committed educator teams can ensure continued delivery by using online and hybrid teaching technologies. Students appreciate being able to continue to participate in interprofessional education, particularly interacting with other disciplines and undertaking meaningful educational activities that include people with multimorbidity.



Background and context

Globally, the ongoing fight against the coronavirus disease 2019 (COVID-19) pandemic has shown both the benefits of health professional interprofessional collaboration and teamwork and the threats to health and health professionals when teamwork does not occur.15

New Zealand’s COVID-19 elimination strategy has three pillars: (1) prevent entry into the country through border restrictions and managed isolation for new arrivals; (2) respond to COVID-19 incursions with community-wide lockdowns that limit physical interaction; and (3) mass vaccination. Each pillar requires interprofessional teamwork. Interprofessional teams are also treating people with acute COVID-19 symptoms in managed isolation facilities and hospitals and supporting the rehabilitation of patients with long-COVID-19.6

Yet, teamwork skills do not just happen. Like any other essential skill-set, teamwork needs to be learned and practised, starting during pre-registration training. Before the pandemic, preregistration interprofessional education (IPE) initiatives were increasingly offered in university and other training organisations. Recognised learning outcomes from IPE include interprofessional communication, role clarification, reflective practice interprofessional coordination, collaborative leadership, and teamwork.7,8 Collaborative practice skills are learned and practised through IPE so that students are teamwork-ready when they graduate.9

The INVOLVE initiative (INterprofessional Visits to Learn Interprofessional Values through Patient Experience) has been run for more than a decade. Multifaceted evaluation has demonstrated achievement of learning outcomes.10 Students enjoy taking part in INVOLVE,11,12 particularly interacting with students of disciplines other than their own.13 Students completing INVOLVE have improved attitudes towards health-care teams and obtained greater knowledge of other disciplines.14 Students also value home visits to a person with multimorbidity, the clinical topic on which the initiative is based, learning who is involved in the person’s social network and hearing the person’s perspective of what interprofessional interaction occurs.15,16 A description of the INVOLVE initiative is presented in Figure 1.


Figure 1.  The INVOLVE IPE Interprofessional Visits to Learn Interprofessional Values through Patient Experience interprofessional education) initiative.
F1

In 2020, with the changing pandemic alert levels impacting on face-to-face teaching, many changes were made to the delivery of INVOLVE to enable students to continue to participate in IPE and develop collaborative skills. In this article, we describe the quality improvement process17,18 used to assess the effectiveness of the change strategies through use of the following structure: assessment of the problem, mechanisms for change; assessment of the change; strategies for quality improvement and lessons for others.


Assessment of the problem

Throughout the pandemic, the University of Otago (and likely others) has focused on continuing the delivery of uni-professional training programmes. Despite its importance, and similar to other countries,19,20 some IPE initiatives have been cancelled or postponed in favour of uni-professional classes, with little emphasis on developing alternative forms of IPE delivery.21 Educators may not recognise the importance of health science students learning inter-professionally, in real-time, about the impact of a pandemic on people with multimorbidity22,23 and the likely increased disparities for this group,24,25, particularly for Māori and Pacific peoples and people living with higher deprivation.2529 These people are the most physiologically and psychologically at-risk from COVID-1922,23,3037 and their existing health conditions, coupled with COVID-19 mitigation strategies (eg stay-at-home lockdowns), have meant isolation from family and friends and challenges in accessing both health care3840 and COVID-19 vaccination.41,42


Mechanisms for change

Keeping INVOLVE IPE going during the COVID-19 pandemic

When the first nationwide Alert Level 4 stay-at-home lockdown was imposed in March 2020,43 the Wellington Interprofessional Teaching Initiative, a partnership of several teaching organisations,13 made it their priority to continue delivery of INVOLVE IPE, knowing that teamwork is an essential skill in global health crises.20 Two key strategies were used to continue IPE training when alert levels changed (see Table 1 for a summary of changes).


Table 1.  Summary of changes to INVOLVE in 2020–21 as a result of COVID-19 alert level changes
Click to zoom

INVOLVE was redeveloped to be delivered entirely online by Zoom videoconferencing and with hybrid mixes of online, Zoom and physically distanced and ‘standard’ classroom teaching. Students now know INVOLVE will continue, despite some other teaching being cancelled.

Gaining the perspectives of people with multimorbidity, formerly undertaken only through home visits, can now be undertaken by Zoom or phone, face-to-face, or by use of case vignettes developed from real people.

Assessment of the change: how did the change strategies used to deliver INVOLVE affect students?

Before the pandemic, students routinely completed anonymous online evaluations at the end of each INVOLVE cycle. Likert scale questions asked about learning outcomes and open-ended questions about experiences. Evaluation ratings from students in INVOLVE sessions where alert levels changed did not differ notably from typical pre-pandemic INVOLVE 2019 ratings (see Appendix 1 for a comparison of medians and interquartile ranges).

Since the pandemic started, we have added and thematically analysed free-text questions about the impact of alert levels changes to monitor effects on students. Considered responses from students reflected positive and negative views. Table 2 presents a summary of comments.


Table 2.  Student views of INVOLVE sessions impacted by changed alert levels
Click to zoom

Home visits to a person with multimorbidity has always been a highlight of INVOLVE. At the start of the pandemic, when we rapidly switched to delivering INVOLVE online, we were unable to arrange recruitment of people with multimorbidity. Instead, we provided a patient case vignette to each interprofessional group. Evaluation ratings of INVOLVE programmes where groups of students worked inter-professionally on vignettes were similar to programmes involving home visits, indicating that students were able to engage with these to achieve learning outcomes.

In a pandemic situation, stay-at-home orders and ‘bubble’ recommendations,44,45 particularly for more at-risk populations, mean students cannot always physically visit people. Abrupt alert-level changes resulted in overnight cancellation of home visits and switching to phone or Zoom visits challenged students. Students found it difficult to undertake conversations with people using phone or Zoom communication tools (not unlike health professionals using telehealth46). To support skills development, we developed resources for guidance and provided debriefing opportunities in the second workshop, when students present in their interprofessional groups.


THE LESSONS

Internationally, IPE educators are sharing examples of IPE initiatives that have been successfully used in the COVID-19 pandemic.4748 This pandemic will likely continue for several years and future pandemics are likely.49 The way we live and practice health care will likely be very different from pre-pandemic times, and new teamwork skills will be required to adapt, including different ways to provide collaborative care.50,51 We used two strategies to adapt INVOLVE. We moved immediately to use online, Zoom and hybrid forms of teaching according to alert levels and broadened the options for students to interact with people with multimorbidity. The quality improvement process used to assess the impact of these strategies led us to identify key lessons that may support other IPE educators.

Hold the vision and be ahead of the game

Foresee the challenges and commit to continuing IPE throughout a pandemic. As soon as changes to alert levels or rules about physical distancing that affect face-to-face IPE teaching are announced or imminent, immediately make plans for alternative delivery methods.21

Be aware that making prompt and creative changes relies considerably on trust among the IPE educator team members. Sometimes a small group will need to lead the changes and the others must swing in behind. The Wellington Interprofessional Teaching team has worked together for many years and was proactive and flexible in considering options for teaching delivery.

Meet interprofessional collaborative practice objectives by using real-time opportunities to learn about teamwork in a pandemic and the impact of a pandemic on the health and wellbeing for people with multimorbidity.3135,52

Ensure students are supported. The wellbeing of the students is the key focus. Take account of the impact of stay-at-home lockdowns on students and the potential for more inequity in learning. Students may live in suboptimal or unsupportive physical or emotional environments, some with poor internet connectivity. During long lockdowns, students may need to take on additional caregiving responsibilities for family members or take-up employment in essential services. Solutions our university offered were access to a hardship fund and urgent provision of internet resources and electronic devices.53 Remember, some students will not ask for help.

The COVID-19 pandemic has considerably impacted young people’s mental health.5456 The move to online learning associated with physical isolation from other students and educators will not suit some students’ preferences for face-to-face, in-class learning.5759 Some issues can be mitigated in an on-line learning environment by using a more informal conversational style, ensuring the tone, warmth and clarity of the email communications and in the design of the Zoom workshops. Zoom breakout rooms seem to help to build group social and interprofessional connection and encourage students to keep on their video feeds to assist making personal connection. Having an IPE administrator also attend the Zoom workshops is helpful as students will have already had contact with this staff member through email. Administrators can welcome students as they arrive, provide support if they encounter difficulty and monitor on-line messages.

Account for the wider context

Throughout the pandemic, alert level changes have substantially affected the New Zealand health services, and it may not be appropriate to ask general practices to recruit people with multimorbidity for IPE. Patient–case vignettes can be substituted.

Continue to reach out for help. General practices were very conscious of the need to continue the teaching initiatives and were often able to recruit people with multimorbidity during alert level changes.

Be nimble

Decisions need to be made quickly when alert levels change, often with limited and unfolding information. It is particularly challenging to deal with overnight changes in alert levels, the first time it happens, and easier to see in retrospect how responses could be improved. Act promptly and communicate clearly.

Be realistic about performance expectations on all sides

Keep things as simple as possible

Nominate one key person to communicate email messages or electronic announcements to students and staff. Messages need to be clear, with unambiguous subject lines and copied to all relevant people.

Do not send too many messages; we found that students and educators struggled with the volume of electronic information.

Use technology appropriately

Using stable electronic technologies in effective ways is critical during the pandemic. Using Zoom (or another equivalent platform) and an e-learning platform (eg Blackboard, Moodle) made it possible for educators to facilitate IPE during changing alert levels.21 But beware: not all educators are comfortable with these technologies. Help them to achieve a minimum, no-frills skill level.

Supply brief step-by-step instructions for educators. These are best crafted by someone who can see technology processes from an educator view rather than an IT guru view.

Remember students do not demand perfection in times of uncertainty.59

Anticipate and be patient with the pauses and freezes that occur on Zoom.

Shorter-length workshops mean less fatigue for educators and students.

Provide more student Zoom breakout room exercises to enable regular changes in focus.

Not all educators have perfect internet connections at home, so try to have two educators in a Zoom room plus an administrator. If one connection fails, hopefully the others will be secure.

Teaching administrators have a key role. Administrators are likely already known and trusted by students and educators. Administrators often have stronger IT and multi-tasking skills than educators and can focus on IT and logistics, leaving educators free to focus on teaching. Administrators can use the Zoom chat function to personally message educators or students during class and provide troubleshooting suggestions or alerts.

Technology for students

Have resources available and provide these ‘just-in-time’ when students need the resource on how to conduct Zoom and multi-user phone conversations. Even though students had not received prior teaching about the value and application of these (telehealth) communication tools, they immediately grasped the idea.

Similarly, develop resources to support students to undertake effective Zoom and phone conversations. Students need information on how to build an empathetic connection, assure confidentiality in a virtual setting, have a conversation with someone who has more complex communication needs (eg being deaf), account for a lack of or reduced visual cues, have a conversation that involves multiple people, and how to manage hard-to-gauge pauses.

Use technology to measure outcomes

Collect information from students about IPE initiatives affected by changing alert levels and compare this with previously collected information.

Use an appreciative inquiry approach as well as a quality improvement process to understand what has worked well and what is challenging.60

Take account of the context of a pandemic when considering the results (eg if a variant is affecting particular age groups or ethnicities, or countries and causing heightened anxiety).

Use technology to ask for and receive help.

Reach out to other educators with brief and reasonable requests. Paradoxically, during the stay-at-home lockdown, some staff had more time and headspace to think of solutions and to help.

Facilitate access to technology specialists, IPE administrators and other staff specialists.

Remember staff with young children are under increased pressure with parenting and home schooling.

Silver linings

There were several unexpected silver linings for INVOLVE as a result of the changes necessitated by the pandemic.

Understanding the role of the home-visit: We found that the physical home visit was not an essential component of the INVOLVE initiative and communicating with people at home using Zoom and phone proved very successful. Home visits, however, have advantages, when possible, as they change the balance of power between patients and students. Students can assess a person’s context and environment and gain insight into their life and interests.

Comprehensively and consistently detailed case vignettes, based on real people, could achieve the same learning outcomes. Paradoxically, using vignettes democratised students’ access to the equivalent of physical home visits. It resolved the usual pre-pandemic difficulties students with conflicting timetables had when trying to find a suitable time to undertake the home visit. Vignettes also alleviated the challenges of contacting a person at home, travel costs and travel time.

Using Zoom during the changing alert levels widened the pool of disciplines and students able to take part in INVOLVE. We were able to include speech language therapy students from another city, as well as accommodate increased numbers of students from other disciplines (as their clinical placements had been cancelled). This was a bonus for the INVOLVE class as a whole, as well as for these particular students. Similarly, we invited more guest educators as observers to join the Zoom INVOLVE workshops.

Welcome relief: Delivering INVOLVE via Zoom during stay-at-home lockdowns created warm connections, welcome relief, distraction or a meeting opportunity for the students who were feeling particularly isolated (eg international students worried about families in faraway countries, or New Zealand students who were in lockdown by themselves). Similarly, offering opportunities for students to talk to people with health issues (multimorbidity) via Zoom or phone meant a different social interaction for these potentially isolated people and an opportunity to brighten their day.61

Learning telehealth skills: Students switching to using Zoom or phone communication tools has alerted us to telehealth being a suitable IPE topic and a necessary skill to develop for the future where telehealth applications bring benefits to patients, professionals and students.62,63


Conclusion

Keeping IPE going during the COVID-19 pandemic requires a united educator team committed to the outcome of interprofessional collaboration and improving health service delivery. The team themselves have needed to demonstrate IPE competencies of communication, mutual respect and collaboration.

We have recognised the importance of collaborative health care in this particular time of health system strain. We quickly anticipated the threat to IPE delivery and implemented strategies and evaluated these using a quality improvement process and then responded by making improvements. The lessons highlight the needs of the students, being quick witted, creative, adaptable to uncertainty and change and drawing on the help of supporters.


Competing interests

The authors taught the INVOLVE interprofessional education initiative during the COVID-19 lockdowns or alert level changes in 2020 and 2021.

Dr Ben Gray is an Associate Editor of The Journal of Primary Health Care and was blinded from the peer review process for this paper.


Funding

This research did not receive any specific funding.


Data Availability

The data used to generate the results are not available.


Author statement

The authors are members of the Wellington Interprofessional Teaching Initiative. In March 2020, the educator team converted the face-to-face INVOLVE IPE initiative to online delivery by Zoom and have facilitated it online by Zoom or hybrid methods throughout the pandemic. This article was conceptualised at a meeting of the Wellington Interprofessional Teaching Initiative. The authors have contributed to all aspects of the paper.



Acknowledgements

We warmly thank Sue Garrett for statistical help, Ellie Pritchard for supporting the INVOLVE Zoom sessions, Molly White, Marissa O’Leary, and Ashley Symes for support in developing the Zoom educator instructions.


References

[1]  Thompson R, Kusy M. Has the COVID Pandemic Strengthened or Weakened Health Care Teams? A Field Guide to Healthy Workforce Best Practices. Nurs Adm Q. 2021; 45 135–41.
Has the COVID Pandemic Strengthened or Weakened Health Care Teams? A Field Guide to Healthy Workforce Best Practices.Crossref | GoogleScholarGoogle Scholar | 33570881PubMed |

[2]  Tannenbaum SI, Traylor AM, Thomas EJ, Salas E. Managing teamwork in the face of pandemic: evidence-based tips. BMJ Qual Saf. 2021; 30 59–63.
Managing teamwork in the face of pandemic: evidence-based tips.Crossref | GoogleScholarGoogle Scholar | 32471858PubMed |

[3]  Butler CR, Wong SP, Vig EK, et al. Professional roles and relationships during the COVID-19 pandemic: a qualitative study among US clinicians. BMJ Open. 2021; 11 e047782.
| 33766845PubMed |

[4]  Natale JE, Boehmer J, Blumberg DA, et al. Interprofessional/interdisciplinary teamwork during the early COVID-19 pandemic: experience from a children’s hospital within an academic health center. J Interprof Care. 2020; 34 682–6.
Interprofessional/interdisciplinary teamwork during the early COVID-19 pandemic: experience from a children’s hospital within an academic health center.Crossref | GoogleScholarGoogle Scholar | 32674638PubMed |

[5]  Singh J, Matthees B. Facilitating interprofessional education in an online environment during the COVID-19 pandemic: a mixed method study. Healthcare. 2021; 9 567.
Facilitating interprofessional education in an online environment during the COVID-19 pandemic: a mixed method study.Crossref | GoogleScholarGoogle Scholar | 34065009PubMed |

[6]  Mahase E. Covid-19: What do we know about “long covid”? BMJ. 2020; 370 m2815.
Covid-19: What do we know about “long covid”?Crossref | GoogleScholarGoogle Scholar | 32665317PubMed |

[7]  University of Otago Centre for Interprofessional Education. A curriculum and quality framework for interprofessional education at Otago: Strategic Plan 2020–2024 Statement of Policy Recommendations. Dunedin: University of Otago; 2019.

[8]  Canadian Interprofessional Health Collaborative. National Interprofessional Competency Framework. University of British Columbia: Interprofessional Health Collaborative; 2010.

[9]  Darlow B, Brown M, Gallagher P, et al. Longitudinal impact of interprofessional education on attitudes, skills and career trajectories: a protocol for a quasiexperimental study in New Zealand. BMJ Open. 2018; 8 e018510.
Longitudinal impact of interprofessional education on attitudes, skills and career trajectories: a protocol for a quasiexperimental study in New Zealand.Crossref | GoogleScholarGoogle Scholar | 29358432PubMed |

[10]  Pullon S, Darlow B, McKinlay E. Building evaluation into the development of interprofessional education initiatives. In: Leading research and evaluation in interprofessional education and collaborative practice. Forman D, Jones M, Thistlethwaite J, editors. London, UK: Palgrave Macmillan; 2016. p. 145–66.

[11]  Pullon S, McKinlay E, Beckingsale L, et al. Interprofessional education for physiotherapy, medical and dietetics students: a pilot programme. J Prim Health Care. 2013; 5 52–8.
Interprofessional education for physiotherapy, medical and dietetics students: a pilot programme.Crossref | GoogleScholarGoogle Scholar | 23457695PubMed |

[12]  Darlow B, Donovan S, Coleman K, et al. What makes an interprofessional education programme meaningful to students? Findings from focus group interviews with students based in New Zealand. J Interprof Care. 2016; 30 355–61.
What makes an interprofessional education programme meaningful to students? Findings from focus group interviews with students based in New Zealand.Crossref | GoogleScholarGoogle Scholar | 27152540PubMed |

[13]  McKinlay E, Brown M, Beckingsale L, et al. Forming inter-institutional partnerships to offer pre-registration IPE: a focus group study. J Interprof Care. 2020; 34 380–7.
Forming inter-institutional partnerships to offer pre-registration IPE: a focus group study.Crossref | GoogleScholarGoogle Scholar | 31750747PubMed |

[14]  Darlow B, Coleman K, McKinlay E, et al. The positive impact of interprofessional education: a controlled trial to evaluate a programme for health professional students. BMC Med Educ. 2015; 15 98.
The positive impact of interprofessional education: a controlled trial to evaluate a programme for health professional students.Crossref | GoogleScholarGoogle Scholar | 26041132PubMed |

[15]  McKinlay E, McDonald J, Darlow B, Perry M. The social networks of New Zealand patients with multimorbidity and the work of those nominated as their ‘significant supporters’: an exploratory study. Health Soc Care Community. 2019; 27 392–9.
The social networks of New Zealand patients with multimorbidity and the work of those nominated as their ‘significant supporters’: an exploratory study.Crossref | GoogleScholarGoogle Scholar | 30175532PubMed |

[16]  McKinlay E, McDonald J, Darlow B, Perry M. Social networks of patients with multimorbidity: a qualitative study of patients’ and supporters’ views. J Prim Health Care. 2017; 9 153–61.
Social networks of patients with multimorbidity: a qualitative study of patients’ and supporters’ views.Crossref | GoogleScholarGoogle Scholar | 29530227PubMed |

[17]  Yeap BH. A new perspective for quality improvement in teaching and learning processes. EDU-COM 2008 International Conference Sustainability in Higher Education: Directions for Change; 2008. 19–21 November 2008; Perth, W. Aust.: Edith Cowan University.

[18]  Thiel M, Harden K, Brazier L-J, et al. Improving the interdisciplinary clinical education of a palliative care program through quality improvement initiatives. Palliat Med Rep. 2020; 1 270–9.
Improving the interdisciplinary clinical education of a palliative care program through quality improvement initiatives.Crossref | GoogleScholarGoogle Scholar | 33274342PubMed |

[19]  CAIPE. Collaborative working during the COVID-19 pandemic. CAIPE; 2021. [cited 2021 Aug 26]. Available from: https://www.caipe.org/covid-19

[20]  Sani I, Hamza Y, Chedid Y, et al. Understanding the consequence of COVID-19 on undergraduate medical education: Medical students’ perspective. Ann Med Surg. 2020; 58 117–9.
Understanding the consequence of COVID-19 on undergraduate medical education: Medical students’ perspective.Crossref | GoogleScholarGoogle Scholar |

[21]  Kent F, George J, Lindley J, Brock T. Virtual workshops to preserve interprofessional collaboration when physical distancing. Med Educ. 2020; 54 661–2.
Virtual workshops to preserve interprofessional collaboration when physical distancing.Crossref | GoogleScholarGoogle Scholar | 32302425PubMed |

[22]  Richardson SJ, Carroll CB, Close J, et al. Research with older people in a world with COVID-19. Age Ageing. 2020; 49 901–6.
Research with older people in a world with COVID-19.Crossref | GoogleScholarGoogle Scholar | 32584954PubMed |

[23]  Lauretani F, Ravazzoni G, Roberti MF, et al. Assessment and treatment of older individuals with COVID-19 multi-system disease: clinical and ethical implications. Acta Biomed. 2020; 91 150–68.
Assessment and treatment of older individuals with COVID-19 multi-system disease: clinical and ethical implications.Crossref | GoogleScholarGoogle Scholar | 32420939PubMed |

[24]  McLeod M, Gurney J, Harris R, et al. COVID‐19: we must not forget about Indigenous health and equity. Aust NZ J Public Health. 2020; 44 253–6.
COVID‐19: we must not forget about Indigenous health and equity.Crossref | GoogleScholarGoogle Scholar |

[25]  Hall KH, Doolan-Noble F, McKinlay E, et al. Ethics and equity in the time of Coronavirus. J Prim Health Care. 2020; 12 102–6.
Ethics and equity in the time of Coronavirus.Crossref | GoogleScholarGoogle Scholar | 32594974PubMed |

[26]  Ballantyne A, Dai E. Social responsibility, solidarity, and equity in the time of COVID-19. N Z Med Stud J. 2020; 31 13–5.

[27]  Steyn N, Binny RN, Hannah K, et al. Estimated inequities in COVID-19 infection fatality rates by ethnicity for Aotearoa New Zealand. N Z Med J. 2020; 133 28–39.
Estimated inequities in COVID-19 infection fatality rates by ethnicity for Aotearoa New Zealand.Crossref | GoogleScholarGoogle Scholar | 32994635PubMed |

[28]  Steyn N, Binny RN, Hannah K, et al. Māori and Pacific People in New Zealand have higher risk of hospitalisation for COVID-19. N Z Med J. 2021; 134 28–43.
| 34239143PubMed |

[29]  Levene LS, Seidu S, Greenhalgh T, Khunti K. Pandemic threatens primary care for long term conditions. BMJ. 2020; 371 m3793.
Pandemic threatens primary care for long term conditions.Crossref | GoogleScholarGoogle Scholar | 33020049PubMed |

[30]  Mair FS, Foster HM, Nicholl BI. Multimorbidity and the COVID-19 pandemic–An urgent call to action. J Comorb. 2020; 10 1–2.
Multimorbidity and the COVID-19 pandemic–An urgent call to action.Crossref | GoogleScholarGoogle Scholar |

[31]  United Nations. A disability-inclusive response to COVID-19. Geneva, Switzerland: United Nations; 2020.

[32]  Woolf SH, Chapman DA, Sabo RT, et al. Excess deaths from COVID-19 and other causes, March-July 2020. JAMA. 2020; 324 1562–4.
Excess deaths from COVID-19 and other causes, March-July 2020.Crossref | GoogleScholarGoogle Scholar | 33044483PubMed |

[33]  Office for National Statistics. Coronavirus (COVID-19) related deaths by disability status, England and Wales: 2 March to 14 July 2020. United Kingdom: Office for National Statistics; 2020.

[34]  Negrini S, Grabljevec K, Boldrini P, et al. Up to 2.2 million people experiencing disability suffer collateral damage each day of COVID-19 lockdown in Europe. Eur J Phys Rehabil Med. 2020; 56 361–65.
Up to 2.2 million people experiencing disability suffer collateral damage each day of COVID-19 lockdown in Europe.Crossref | GoogleScholarGoogle Scholar | 32383576PubMed |

[35]  Sinnathamby MA, Whitaker H, Coughlan L, et al. All-cause excess mortality observed by age group and regions in the first wave of the COVID-19 pandemic in England. Euro Surveill. 2020; 25 2001239.
All-cause excess mortality observed by age group and regions in the first wave of the COVID-19 pandemic in England.Crossref | GoogleScholarGoogle Scholar |

[36]  Luan MM. Psychological effect of covid-19 on persons living with disabilities: an empirical study perspective from South Africa. J Soc Psychol Relig Studies. 2020; 2 25–39.

[37]  Lai AG, Pasea L, Banerjee A, et al. Estimated impact of the COVID-19 pandemic on cancer services and excess 1-year mortality in people with cancer and multimorbidity: near real-time data on cancer care, cancer deaths and a population-based cohort study. BMJ Open. 2020; 10 e043828.
Estimated impact of the COVID-19 pandemic on cancer services and excess 1-year mortality in people with cancer and multimorbidity: near real-time data on cancer care, cancer deaths and a population-based cohort study.Crossref | GoogleScholarGoogle Scholar | 33203640PubMed |

[38]  Imlach F, McKinlay E, Kennedy J, et al. Seeking healthcare during lockdown: challenges, opportunities and lessons for the future. Int J Health Policy Manag. 2021; 1–9.
Seeking healthcare during lockdown: challenges, opportunities and lessons for the future.Crossref | GoogleScholarGoogle Scholar |

[39]  Imlach F, McKinlay E, Middleton L, et al. Telehealth consultations in general practice during a pandemic lockdown: survey and interviews on patient experiences and preferences. BMC Fam Pract. 2020; 21 269.
Telehealth consultations in general practice during a pandemic lockdown: survey and interviews on patient experiences and preferences.Crossref | GoogleScholarGoogle Scholar | 33308161PubMed |

[40]  Imlach F, McKinlay E, Kennedy J, et al. Access and delays in seeking health care during lockdown: challenges, opportunities and lessons for the future. J Health Serv Pol Res. 2020.

[41]  Kerr F. Health experts say the Government has failed to protect Māori and Pasifika from the latest outbreak, calling it “our worst nightmare”. Stuff; 2021. [cited 2021 Aug 29]. Available from: https://www.stuff.co.nz/pou-tiaki/300386818/health-experts-say-the-government-has-failed-to-protect-mori-and-pasifika-from-the-latest-outbreak-calling-it-our-worst-nightmare

[42]  Dreaver B. Covid-19 in NZ: Lingering issues with ministry and efforts to vaccinate Pasifika and Māori. Stuff; 2021. [cited 2021 Aug 29]. Available from: https://www.stuff.co.nz/national/health/coronavirus/300393621/covid19-in-nz-lingering-issues-with-ministry-and-efforts-to-vaccinate-pasifika-and-mori.)

[43]  Ministry of Health. Alert Level 4. Wellington: Ministry of Health; 2021. [cited 2021 June 2]. Available from: https://covid19.govt.nz/alert-levels-and-updates/alert-level-4/.)

[44]  Basu A, Kuziemsky C, de Araújo Novaes M, et al. Telehealth and the COVID-19 pandemic: international perspectives and a health systems framework for telehealth implementation to support critical response. Yearb Med Inform. 2021; 30 126–33.
Telehealth and the COVID-19 pandemic: international perspectives and a health systems framework for telehealth implementation to support critical response.Crossref | GoogleScholarGoogle Scholar | 33882598PubMed |

[45]  Jones TA, Vidal G, Taylor C. Interprofessional education during the COVID-19 pandemic: finding the good in a bad situation. J Interprof Care. 2020; 34 633–46.
Interprofessional education during the COVID-19 pandemic: finding the good in a bad situation.Crossref | GoogleScholarGoogle Scholar | 32811228PubMed |

[46]  Romito LM, Pfeifle AL, Weber ZA, Daulton BJ. Successful conversion of simulation‐based interprofessional education in a pandemic. J Dent Educ. 2020; 85 1107–10.

[47]  Prasad N, Fernando S, Willey S, et al. Online interprofessional simulation for undergraduate health professional students during the COVID-19 pandemic. J Interprof Care. 2020; 34 706–10.
Online interprofessional simulation for undergraduate health professional students during the COVID-19 pandemic.Crossref | GoogleScholarGoogle Scholar | 32917099PubMed |

[48]  Smart A. Building relationships in the middle of lockdown: The challenge of facilitating learner interaction remotely. Developing and Sustaining Interprofessional Relationships. Auckland: University of Auckland and Auckland University of Technology; 2020.

[49]  Kaur H, Garg S, Joshi H, et al. A Review: Epidemics and pandemics in human history. Int J Pharma Res Health Sci. 2020; 8 3139–42.
A Review: Epidemics and pandemics in human history.Crossref | GoogleScholarGoogle Scholar |

[50]  Bayram M, Springer S, Garvey CK, Özdemir V. COVID-19 digital health innovation policy: A portal to alternative futures in the making. OMICS 2020; 24 460–9.
COVID-19 digital health innovation policy: A portal to alternative futures in the making.Crossref | GoogleScholarGoogle Scholar | 32511054PubMed |

[51]  Chiarella M, Russell L, Brooks P. The lack of integration in Australia’s health workforce: there are silos everywhere. Croakey Health Media; 2020. [cited 2020 November 16]. Available from: https://www.croakey.org/the-lack-of-integration-in-australias-health-workforce-there-are-unconnected-silos-everywhere/.

[52]  Lackie K, Najjar G, El-Awaisi A, et al. Interprofessional education and collaborative practice research during the COVID-19 pandemic: Considerations to advance the field. J Interprof Care. 2020; 34 583–6.
Interprofessional education and collaborative practice research during the COVID-19 pandemic: Considerations to advance the field.Crossref | GoogleScholarGoogle Scholar | 32838595PubMed |

[53]  University of Otago. Pūtea Tautoko student support fund. University of Otago; 2021. [cited 2021 November 18]. Available from: https://www.otago.ac.nz/coronavirus/information-for-students/.

[54]  Aristovnik A, Keržič D, Ravšelj D, et al. Impacts of the COVID-19 pandemic on life of higher education students: a global perspective. Sustainability. 2020; 12 8438.
Impacts of the COVID-19 pandemic on life of higher education students: a global perspective.Crossref | GoogleScholarGoogle Scholar |

[55]  Hasan N, Bao Y. Impact of “e-Learning crack-up” perception on psychological distress among college students during COVID-19 pandemic: A mediating role of “fear of academic year loss”. Child Youth Serv Rev. 2020; 118 105355.
Impact of “e-Learning crack-up” perception on psychological distress among college students during COVID-19 pandemic: A mediating role of “fear of academic year loss”.Crossref | GoogleScholarGoogle Scholar | 32834276PubMed |

[56]  Savitsky B, Findling Y, Ereli A, Hendel T. Anxiety and coping strategies among nursing students during the covid-19 pandemic. Nurse Educ Pract. 2020; 46 102809.
Anxiety and coping strategies among nursing students during the covid-19 pandemic.Crossref | GoogleScholarGoogle Scholar | 32679465PubMed |

[57]  Fatani TH. Student satisfaction with videoconferencing teaching quality during the COVID-19 pandemic. BMC Med Educ. 2020; 20 396.
Student satisfaction with videoconferencing teaching quality during the COVID-19 pandemic.Crossref | GoogleScholarGoogle Scholar | 33129295PubMed |

[58]  Serhan D. Transitioning from face-to-face to remote learning: Students’ attitudes and perceptions of using Zoom during COVID-19 pandemic. Int J Techn Educ Sci. 2020; 4 335–42.
Transitioning from face-to-face to remote learning: Students’ attitudes and perceptions of using Zoom during COVID-19 pandemic.Crossref | GoogleScholarGoogle Scholar |

[59]  Bluteau P. The good enough facilitator: exploring online interprofessional therapeutic facilitation in times of COVID-19. J Interprof Care. 2020; 34 647–54.
The good enough facilitator: exploring online interprofessional therapeutic facilitation in times of COVID-19.Crossref | GoogleScholarGoogle Scholar | 32838599PubMed |

[60]  Preskill H, Catsambas TT. Reframing evaluation through appreciative inquiry. Sage Publications, Inc.; 2006.

[61]  Prickett KC, Fletcher M, Chapple S, et al. Life in lockdown: The economic and social effect of lockdown during Alert Level 4 in New Zealand. Wellington: Victoria University of Wellington; 2020.

[62]  Bautista CA, Huang I, Stebbins M, et al. Development of an interprofessional rotation for pharmacy and medical students to perform telehealth outreach to vulnerable patients in the COVID-19 pandemic. J Interprof Care. 2020; 34 694–7.
Development of an interprofessional rotation for pharmacy and medical students to perform telehealth outreach to vulnerable patients in the COVID-19 pandemic.Crossref | GoogleScholarGoogle Scholar | 32917114PubMed |

[63]  Winship JM, Falls K, Gregory M, et al. A case study in rapid adaptation of interprofessional education and remote visits during COVID-19. J Interprof Care. 2020; 34 702–5.
A case study in rapid adaptation of interprofessional education and remote visits during COVID-19.Crossref | GoogleScholarGoogle Scholar | 32838597PubMed |




Appendix 1.  Medians and interquartile ranges INVOLVE 1–4 2020* and INVOLVE 1 and 5 2021* compared to an INVOLVE 2019 ‘typical’ class

Students are asked to score their responses from: 1 = to a very small extent; 5 = to a very large extent



Click to zoom