Evaluation of population health short courses: implications for developing and evaluating population health professional development initiatives
Lucio Naccarella A D , Louise Greenstock B and Iain Butterworth CA Health Systems and Workforce Unit (previously The Australian Health Workforce Institute), The University of Melbourne, 207 Bouverie Street, Carlton, Vic. 3053, Australia.
B Independent Consultant (previously at The Australian Health Workforce Institute, The University of Melbourne), Unit 31, 123 Victoria Street, Brunswick East, Vic. 3057, Australia.
C Victorian Department of Health North and West Metropolitan Region, 145 Smith Street, Fitzroy, Vic. 3065, Australia.
D Corresponding author. Email: l.naccarella@unimelb.edu.au
Australian Journal of Primary Health 22(3) 218-225 https://doi.org/10.1071/PY14140
Submitted: 19 September 2014 Accepted: 28 January 2015 Published: 10 July 2015
Abstract
Population health as an approach to planning is key to improving the health and well-being of whole populations and to reduce inequities within and between population groups. The Victorian Department of Health North and West Metropolitan Region, in collaboration with The University of Melbourne (School of Population Health), have delivered four annual population health short courses. The short courses were designed to equip participants with knowledge and skills to implement population health approaches upon their return to their workplaces. For three consecutive years, online surveys (n = 41) and semi-structured interviews (n = 35), underpinned by participatory and realist evaluation approaches, were conducted to obtain the perceptions and experiences of the population health short course participants. Evaluation findings indicate that participants’ understanding of population health concepts increased; however, there were mixed outcomes in assisting participants’ implementation of population health approaches upon their return to their workplaces. A core list of perceived requirements, enablers and barriers emerged at an individual, organisational and system level as influencing the capability of participants to implement population health approaches. Evaluation recommendations and actions taken to revise short course iterations are presented, providing evidence that the evaluation approaches were appropriate and increased the use of evaluation learnings. Implications of evaluation findings for professional development practice (i.e. shift from a ‘Course’ as a one-off event to a Population Health ‘Program’ of inter-dependent components) and evaluation (i.e. participatory realist evaluation approaches) are presented.
Additional keyword: professional development programs.
References
Armstrong EG, Doyle J, Bennett NL (2003) Transformative professional development of physicians as educators: assessment of a model. Academic Medicine 78, 702–708.| Transformative professional development of physicians as educators: assessment of a model.Crossref | GoogleScholarGoogle Scholar | 12857688PubMed |
Butterworth I (2011) A regional health and wellbeing implementation strategy for Melbourne’s North and West Metropolitan Region: harnessing the capability of the Regional Management Forum. Paper presented at the Fifth State of Australian Cities Conference, Melbourne, December 2011. Available at http://soac.fbe.unsw.edu.au/2011/papers/Iain%20Butterworth%20SOAC%202011%20Paper%200189%20final%20draft.pdf [Verified 23 June 2014]
Butterworth I (2013) Melbourne’s North and West Metropolitan Regional Management Forum: building community capacity through the Regional Health and Wellbeing Implementation Strategy. Paper presented at the Sixth State of Australian Cities Conference, Sydney, 29 November 2013. Available at http://www.soacconference.com.au/wp-content/uploads/2014/01/Butterworth-Governance.pdf [Verified 23 June 2014]
Butterworth I, Fisher AT (2001) Adult education and the built environment. Adult Learning 13, 10–14.
Cousins JB, Earl LM (1992) The case for participatory evaluation. Educational Evaluation and Policy Analysis 14, 397–418.
| The case for participatory evaluation.Crossref | GoogleScholarGoogle Scholar |
Department of Health North West Metropolitan Region Population Health Short Course (2011) Available at http://www.inwpcp.org.au/sites/default/files/files/Short_Course_Flier%202-3%20May%202012.pdf [Verified 15 May 2014]
Frenk J, Chen L, Bhutta ZA, Cohen J, Crisp N, Evans T, Fineberg H, García PJ, Ke Y, Kelley P, Kistnasamy B, Meleis A, Naylor D, Pablos-Mendez A, Reddy S, Scrimshaw S, Sepulveda J, Serwadda D, Zurayk H (2010) Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet 376, 1923–1958.
| Health professionals for a new century: transforming education to strengthen health systems in an interdependent world.Crossref | GoogleScholarGoogle Scholar | 21112623PubMed |
Guskey TR (2000) ‘Evaluating professional development.’ (Corwin: Thousand Oaks, CA)
Keleher H (2011) Population health planning for health equity. Australian Journal of Primary Health 17, 327–333.
| Population health planning for health equity.Crossref | GoogleScholarGoogle Scholar | 22112701PubMed |
Kirkpatrick DL (1977) Evaluating training programs: evidence vs. proof. Training and Development Journal 31, 9–12.
Mann K, Gordon J, MacLeod A (2009) Reflection and reflective practice in health professions education: a systematic review. Advances in Health Sciences Education: Theory and Practice 14, 595–621.
| Reflection and reflective practice in health professions education: a systematic review.Crossref | GoogleScholarGoogle Scholar |
Mezirow and Associates (2000) ‘Learning as transformation: critical perspectives on a theory in progress.’ (Jossey–Bass: San Francisco, CA)
Neuwelt P, Matheson D, Arroll B, Dowell A, Winnard D, Crampton P, Sheridan NF, Cumming J (2009) Putting population health into practice through primary health care. The New Zealand Medical Journal 122, 98–104.
Pawson R, Tilley N (1997) ‘Realistic evaluation.’ (Sage: London)
Robert A, Kronley PA, Handley C (2001) Framing the field: professional development: in context. Available at http://www.peecworks.org/peec/peec_research/01795C09-001D0211.0/fin%20proj%20framingthefield.pdf. [Verified 23 June 2014]
Strauss A, Corbin J (1998) ‘Basics of qualitative research. Techniques and procedures for developing grounded theory.’ (Sage: London)
Victorian Health Care Association (2010) Population health. Available at http://www.vha.org.au/policy-publications/population-health [Verified 23 June 2014]
Wright K, Rowitz L, Merkle A, Reid WM, Robinson G, Herzog B, Weber D, Carmichael D, Balderson TR, Baker E (2000) Competency development in public health leadership. American Journal of Public Health 90, 1202–1207.
| Competency development in public health leadership.Crossref | GoogleScholarGoogle Scholar | 1:STN:280:DC%2BD3cvhs1Cgsw%3D%3D&md5=e99b2454418e89950da60402b5d84486CAS | 10936996PubMed |
