Using evaluation to improve medical student rural experience
Jennifer J. Moffatt A C and Janine E. Wyatt BA University of Queensland, School of Medicine, 288 Herston Road, Herston, Brisbane, Qld 4006, Australia.
B University of Queensland, School of Medicine, Level 2, Health Science Learning and Discovery Centre, PO Box 4143, Rockhampton, Qld 4700, Australia. Email: j.wyatt@uq.edu.au
C Corresponding author. Email: Jennifer.moffatt@uqconnect.edu.au
Australian Health Review 40(2) 174-180 https://doi.org/10.1071/AH14195
Submitted: 21 October 2014 Accepted: 9 June 2015 Published: 10 August 2015
Abstract
Objective The aim of this evaluation was to see whether interventions implemented to improve the Rural Medicine Rotation made this a more effective rural medical education experience. Multiple interventions targeting the student experience, lecturers and preceptors were implemented.
Methods A quasi-experimental design using pre- and post-measures was used. The participants were all University of Queensland, School of Medicine, Rural Medicine Rotation students who completed the 2009 and 2010 rural medicine rotation evaluations. There were 769 students, with an 84% response rate in 2009 and an 80% response rate in 2010. In addition, all the 25 program preceptors who were visited in 2009 and the 34 who were visited in 2010 participated in the study.
Results The implementation of interventions resulted in significant improvement in three outcome measures, namely teaching effectiveness, provision of an environment supportive of learning in a rural/remote setting and opportunities for professional growth. Two of the three other outcome measures – ensuring a safe clinical placement and opportunities for procedural skills experience and development – were very positively evaluated in both 2009 and 2010.
Conclusions The interventions contributed to a more effective rural medical education experience, providing students with the opportunity to develop skills and knowledge relevant for rural medicine and to gain an understanding of the context in which rural medicine is practiced.
What is known about the topic? Many Australian medical schools offer students rural-based educational opportunities based on the premise that placing medical students in a rural setting may ultimately lead to them choosing careers in rural medicine. However, there is a paucity of evidence on the factors that are considered necessary for medical students to gain a positive rural experience of short conscripted rural placements.
What does the paper add? This paper identifies successful interventions to the rotation and placements that provide a positive experience of the rural clinical placement for students. These interventions occurred within an ongoing evaluation program embedded in the rotation.
What are the implications for practitioners? Through ongoing evaluation, interventions can be selected and implemented that succeed in contributing to students having a positive rural clinical placement experience. This paper demonstrates how an embedded continuous improvement program serves to provide direction for ongoing modifications.
References
[1] Australian Institute of Health and Welfare (AIHW). Medical workforce 2010. Canberra: AIHW; 2012. Available at: http://www.aihw.gov.au/publication-detail/?id=10737421480 [verified 8 April 2012].[2] Joyce CM, Scott A, Jeon S-H, Humphreys J, Kalb G, Witt J, Leahy A. The ‘Medicine in Australia: Balancing Employment and Life (MABEL)’ longitudinal survey: protocol and baseline data for a prospective cohort study of Australian doctors’ workforce participation. BMC Health Serv Res 2010; 10 50
| The ‘Medicine in Australia: Balancing Employment and Life (MABEL)’ longitudinal survey: protocol and baseline data for a prospective cohort study of Australian doctors’ workforce participation.Crossref | GoogleScholarGoogle Scholar | 20181288PubMed |
[3] Department of Health and Ageing. Funding agreement for the University of Queensland Rural Undergraduate Support and Coordination (RUSC) program 2008–09 to 2010–11. Canberra: Department of Health and Ageing; 2008–2011.
[4] Laven G, Wilkinson D. Rural doctors and rural background: how strong is the evidence? A systematic review. Aust J Rural Health 2003; 11 277–84.
| Rural doctors and rural background: how strong is the evidence? A systematic review.Crossref | GoogleScholarGoogle Scholar | 14678410PubMed |
[5] Henry J, Edwards B, Crotty B. Why do medical graduates choose rural careers? Rural Remote Health 2009; 9 1083
| 19257797PubMed |
[6] Stagg P, Greenhill J, Worley PS. A new model to understand the career choice and practice location decisions of medical graduates. Rural Remote Health 2009; 9 1245
| 1:STN:280:DC%2BD1MjovVCjsw%3D%3D&md5=925b25433b66cda7a5a59e8c94975773CAS | 19943714PubMed |
[7] Holm HA. Quality assurance of medical education: a prerequisite for good medical practice. Tidsskr Nor Laegeforen 1992; 112 3565–9.
| 1:STN:280:DyaK3s%2FpslehsA%3D%3D&md5=8245d7338a0e65a4660533ed0651ba2eCAS | 1462328PubMed |
[8] Page S, Birden H. Twelve tips on rural medical placements: what has worked to make them successful. Med Teach 2008; 30 592–6.
| Twelve tips on rural medical placements: what has worked to make them successful.Crossref | GoogleScholarGoogle Scholar | 18608947PubMed |
[9] Playford D, Larson A, Wheatland B. Going country: rural student placement factors associated with future rural employment in nursing and allied health. Aust J Rural Health 2006; 14 14–19.
| Going country: rural student placement factors associated with future rural employment in nursing and allied health.Crossref | GoogleScholarGoogle Scholar | 16426427PubMed |
[10] Halaas G, Zink T, Brooks K, Miller J. Clinical skills day: preparing third year medical students for their rural rotation. Rural Remote Health 2007; 7 788
| 1:STN:280:DC%2BD2sngtVCktg%3D%3D&md5=408c0dc660c91b29f4655ebeec92a63eCAS | 17922608PubMed |
[11] Penman J, Oliver M. Meeting the challenges of assessing clinincal placement venues in a Bachelor of Nursing program. J Univ Teach Learn Pract 2004; 1 59–73.
[12] Australian Institute of Health and Welfare (AIHW). A guide to remoteness classifications. Catalogue no. PHE 53. Canberra: AIHW; 2004.
[13] Darcy Associates. Best practice clinical learning environments within health services for undergraduate and early-graduate learners final report. Melbourne: Department of Human Services, Victoria; 2009.
[14] Australian Health Workforce Institute (AHWI). A framework for effective clinical placements in rural and remote primary care settings. Melbourne: AHWI; 2013.
[15] Barrow M, McKimm J. Assuring and maintaining quality in clinical education. Br J Hosp Med 2010; 71 224–8.
| Assuring and maintaining quality in clinical education.Crossref | GoogleScholarGoogle Scholar |
[16] Hawe P, Deleging D, Hall J. Evaluating health promotion: a health worker’s guide. Sydney: MacLennan & Petty; 1990.
[17] Jason M. Evaluating programs to increase student achievement. Thousand Oaks, CA: Corwin; 2008.
[18] Peachey L, McBain-Rigg K. The challenges of remote area medical education. Med J Aust 2011; 194 495–6.
| 21644889PubMed |
[19] Wright RE. Student evaluations and consumer orientation of universities. J Nonprofit Public Sect Mark 2000; 8 33–40.
| Student evaluations and consumer orientation of universities.Crossref | GoogleScholarGoogle Scholar |
[20] Kember D, Leung D, Kwan K. Does the use of student feedback questionnaires improve the overall quality of teaching? Assess Eval High Educ 2002; 27 411–25.
| Does the use of student feedback questionnaires improve the overall quality of teaching?Crossref | GoogleScholarGoogle Scholar |
[21] Nasser F, Fresko B. Faculty views of student evaluation of college teaching. Assess Eval High Educ 2002; 27 187–98.
| Faculty views of student evaluation of college teaching.Crossref | GoogleScholarGoogle Scholar |
[22] Patel A, Underwood P, The Nguyen H, Vigats M. Safeguard or mollycoddle? An exploratory study describing potentially harmful incidents during medical student placements in Aboriginal communities in Central Australia. Med J Aust 2011; 194 497–500.
| 21644890PubMed |
[23] Tyagi S, Corbett S, Welfare M. Safety on elective: a survey on safety advice and adverse events during electives. Clinical Medicine 2006; 6 154–6.
| 16688972PubMed |
[24] Han GS, Wearne B, O’Meara P, McGrail M, Chesters J. Medical students’ and GP registrars’ accommodation needs in the rural community: insight from a Victorian study. Aust Health Rev 2003; 26 92–105.
| Medical students’ and GP registrars’ accommodation needs in the rural community: insight from a Victorian study.Crossref | GoogleScholarGoogle Scholar | 15485379PubMed |
[25] O’Brien M, Phillips B, Hubbard W. Enhancing the quality of undergraduate allied health clinical education: a multidisciplinary approach in a regional/rural health service. Focus Health Prof Educ 2010; 12 11–22.
[26] Bayley S, Magin P, Sweatman J, Regan C. Effects of compulsory rural vocational training for Australian general practitioners: a qualitative study. Aust Health Rev 2011; 35 81–5.
| Effects of compulsory rural vocational training for Australian general practitioners: a qualitative study.Crossref | GoogleScholarGoogle Scholar | 21367336PubMed |
[27] Killam LA, Carter LM. Challenges to the student nurse on clinical placement in the rural setting: a review of the literature. Rural Remote Health 2010; 10 1523
| 1:STN:280:DC%2BC3cjlsFertg%3D%3D&md5=659873e0a4d50b569910e58e149a6160CAS | 20715883PubMed |
[28] Deaville J, Grant A. Overcoming the pull factor of convenient urban living: perceptions of rural general practice placements. Med Teach 2011; 33 e211–17.
| Overcoming the pull factor of convenient urban living: perceptions of rural general practice placements.Crossref | GoogleScholarGoogle Scholar | 21456980PubMed |
[29] Krahe LM, McColl AR, Pallant JF, Cunningham CE, Dewitt DE. A multi-university study of which factors medical students consider when deciding to attend a rural clinical school in Australia. Rural Remote Health 2010; 10 1477
| 20828219PubMed |
[30] Prideaux D, Alexander H, Bower A, Dacre J, Haist J, Jolly B, Norcini J, Roberts T, Rothman A, Rowe R, Tallett S. Clinical teaching: maintaining an educational role for doctors in the new health care environment. Med Educ 2000; 34 820–6.
| Clinical teaching: maintaining an educational role for doctors in the new health care environment.Crossref | GoogleScholarGoogle Scholar | 1:STN:280:DC%2BD3M%2Fit1Wrtw%3D%3D&md5=d31f08badf2e44be0e7460ef18b6e59bCAS | 11012932PubMed |
[31] Diab P, McNeill P, Ross A. Review of final-year medical students’ rural attachment at district hospitals in KwaZulu-Natal: student perspectives. S Afr Fam Pract 2014; 56 57–62.
| Review of final-year medical students’ rural attachment at district hospitals in KwaZulu-Natal: student perspectives.Crossref | GoogleScholarGoogle Scholar |
[32] Price DA, Miflin BM, Mudge PR, Jackson CL. The quality of medical teaching and learning in rural settings: the learner’s perspective. Med Educ 1994; 28 239–51.
| The quality of medical teaching and learning in rural settings: the learner’s perspective.Crossref | GoogleScholarGoogle Scholar | 1:STN:280:DyaK2czgvFChtA%3D%3D&md5=e314575e2fdfac664e152c887a7f8140CAS | 8035717PubMed |
[33] Denzin NK. The research act, 2nd edn. New York: McGraw-Hill; 1978.
[34] Golafshani N. Understanding reliability and validity in qualitative research. Qual Rep 2003; 8 597–607.
[35] Birden H, Wilson I. Rural placements are effective for teaching medicine in Australia: evaluation of a cohort of students studying in rural placements. Rural Remote Health 2012; 12 2167
| 23157496PubMed |