Program logic: a framework for health program design and evaluation – the Pap nurse in general practice program
Christine M. HallinanHorsham Campus Research Precinct, University of Ballarat, Vic. 3400, Australia. Email: c.hallinan@ballarat.edu.au
Australian Journal of Primary Health 16(4) 319-325 https://doi.org/10.1071/PY09072
Submitted: 28 September 2009 Accepted: 14 October 2010 Published: 3 December 2010
Abstract
In this paper, program logic will be used to ‘map out’ the planning, development and evaluation of the general practice Pap nurse program in the Australian general practice arena. The incorporation of program logic into the evaluative process supports a greater appreciation of the theoretical assumptions and external influences that underpin general practice Pap nurse activity. The creation of a program logic model is a conscious strategy that results an explicit understanding of the challenges ahead, the resources available and time frames for outcomes. Program logic also enables a recognition that all players in the general practice arena need to be acknowledged by policy makers, bureaucrats and program designers when addressing through policy, issues relating to equity and accessibility of health initiatives. Logic modelling allows decision makers to consider the complexities of causal associations when developing health care proposals and programs. It enables the Pap nurse in general practice program to be represented diagrammatically by linking outcomes (short, medium and long term) with both the program activities and program assumptions. The research methodology used in the evaluation of the Pap nurse in general practice program includes a descriptive study design and the incorporation of program logic, with a retrospective analysis of Australian data from 2001 to 2009. For the purposes of gaining both empirical and contextual data for this paper, a data set analysis and literature review was performed. The application of program logic as an evaluative tool for analysis of the Pap PN incentive program facilitates a greater understanding of complex general practice activity triggers, and also allows this greater understanding to be incorporated into policy to facilitate Pap PN activity, increase general practice cervical smear and ultimately decrease burden of disease.
References
Australian Government (2005) Federal Budget 2005–2006. Rebate for Pap smears taken in rural Australia: Australian Government Budget 2005–06. Commonwealth of Australia, Canberra. Available at http://www.budget.gov.au/2005-06/ministerial/html/dotars-11.htm [Verified 10 September 2008]Australian Institute of Health and Welfare (2002) Cervical screening in Australia 1998–1999. AIHW Cat. No. 16. Available at http://www.aihw.gov.au/publications/can/csa98-99/csa98-99.pdf [Verified 20 September 2009]
Australian Institute of Health and Welfare (2008) Cervical screening in Australia 2005–2006. AIHW Cat. No. CAN 41. Available at http://www.aihw.gov.au/publications/can/csa05-06/ [Verified 20 September 2009]
Australian Institute of Health and Welfare (2009a) Cervical screening in Australia 2006–2007. AIHW Cat. No. CAN 43. Available at http://www.aihw.gov.au/publications/index.cfm/title/10676 [Verified 8 March 2010]
Australian Institute of Health and Welfare (2009b) General practice activity in Australia 1998–99 to 2007–08: 10 year data tables. AIHW Cat. No. GEP 25. Available at http://www.aihw.gov.au/publications/gep/gep-25-11013/gep-25-11013-c13.pdf [Verified 20 September 2009]
Australian Medical Association (2006) AMA primary health care position statement – 2006. Australian Medical Association. Available at http://www.ama.com.au/node/2502 [Verified 28 September 2010]
Bosch XF, de Sanjosé S (2003) Chapter 1: human papillomavirus and cervical cancer—burden and assessment of causality. Journal of the National Cancer Institute. Monographs 31, 3–13.
Brazil K, Ozer E, Cloutier MM, Levine R, Stryer D (2005) From theory to practice: improving the impact of health services research. BMC Health Services Research 5, 1
| From theory to practice: improving the impact of health services research.Crossref | GoogleScholarGoogle Scholar | 15638931PubMed |
Canfell K, Sitas F, Beral V (2006) Cervical cancer in Australia and the United Kingdom: comparison of screening policy and uptake, and cancer incidence and mortality. The Medical Journal of Australia 185, 482–486.
Christie L, Gamble J, Creedy D (2005) Women’s views of registered nurses as Papanicolau smear providers’. Contemporary Nurse 20, 160–168.
Clifford GM, Smith JS, Plummer M, Muñoz N, Franceschi S (2003) Human papillomavirus types in invasive cervical cancer worldwide: a meta-analysis. British Journal of Cancer 88, 63–73.
| Human papillomavirus types in invasive cervical cancer worldwide: a meta-analysis.Crossref | GoogleScholarGoogle Scholar | 1:STN:280:DC%2BD3s%2Fks12qtw%3D%3D&md5=e9fbda71cf2e6184341f575beba03e4cCAS | 12556961PubMed |
Cooksy LJ, Gill P, Kelly A (2001) The program logic model as an integrative framework for a multimethod evaluation. Evaluation and Program Planning 24, 119–128.
| The program logic model as an integrative framework for a multimethod evaluation.Crossref | GoogleScholarGoogle Scholar |
Cuzick J, Sasieni P, Davies P, Adams J, Normand C, Frater A, van Ballegooijen M, van den Akker-van Marle E (2000) A systematic review of the role of human papillomavirus (HPV) testing within a cervical screening programme: summary and conclusions. British Journal of Cancer 83, 561–565.
| A systematic review of the role of human papillomavirus (HPV) testing within a cervical screening programme: summary and conclusions.Crossref | GoogleScholarGoogle Scholar | 1:STN:280:DC%2BD3cvjt1Ontw%3D%3D&md5=c9f46f72cffb9b765a39477354725d53CAS | 10944591PubMed |
Department of Health and Ageing (2005) Medicare Australia: MBS items (10998, 10999) for Pap smears taken by a practice nurse in a regional, rural or remote area. Australian Government, Canberra. Available at http://www.medicareaustralia.gov.au/provider/incentives/files/mbs_items_for_pap_smears_nov_2005.pdf [Verified 10 October 2009]
Department of Health and Ageing (2006) Medicare Australia: MBS items (10998, 10999) for Pap smears taken by a practice nurse on behalf of a medical practitioner. Australian Government, Canberra. Available at http://www.nevdgp.org.au/files/practicesupport/practicemanagernursesupport/MBS%20items%20for%20Pap%20smears%20in%20all%20areas-%20Nov%2006.pdf [Verified 11 September 2009]
Department of Health and Ageing (2008) Practice incentives program. Australian Government, Canberra. Available at http://www.medicareaustralia.gov.au/provider/incentives/index.jsp [Verified 14 September 2009]
Department of Health and Ageing (2010a) National cervical screening program. Australian Government, Canberra. Available at http://www.health.gov.au/internet/screening/publishing.nsf/Content/cervical-about [Verified 1 September 2009]
Department of Health and Ageing (2010b) Medicare Benefits Schedule: MBS on line. Australian Government, Canberra. Available at http://www9.health.gov.au/mbs/search.cfm?q=10998&sopt=I [Verified 11 April 2010]
Dickinson JA (2002) Cervical screening: time to change the policy. The Medical Journal of Australia 176, 547–550.
Foley E, Hutchinson R, Pascoe T, Snowdon T, Watts I, Whitecross L (2004) General practice nursing in Australia RCNA/RACGP nursing in general practice project. Available at http://www.rcna.org.au/pages/practiceproj.php [Verified 10 September 2009]
Franco EL, Rohan TE, Villa LL (1999) Epidemiologic evidence and human papillomavirus infection as a necessary cause of cervical cancer. Journal of the National Cancer Institute 91, 506–511.
| Epidemiologic evidence and human papillomavirus infection as a necessary cause of cervical cancer.Crossref | GoogleScholarGoogle Scholar | 1:STN:280:DyaK1M7os1Crsw%3D%3D&md5=d502c3fdd9bc39d0f3ce2c4f8f5a4873CAS | 10088620PubMed |
Funnell S (1997) Program logic: an adaptable tool for designing and evaluating programs. Evaluation News and Comment 6, 5–17.
Hay C (2002) ‘Political analysis: a critical introduction.’ (Palgrave, Macmillan: Hampshire)
Jasiak S, Passmore E (2007) Enhancing the roles of practice nurses: outcomes of cervical screening education and training in NSW barriers. The Australian Journal of Advanced Nursing 27, 40–45.
Keleher H, Joyce C, Parker R, Piterman L (2007) Practice nurses in Australia: current issues and future directions. The Medical Journal of Australia 187, 108–110.
Kellogg Foundation (2004) ‘Logic model development guide.’ (W. K. Kellogg Foundation: Michigan) Available at http://www.publichealth.vic.edu.au/current/economics/upload/05b-kellogg-foundation-logic-model-development-guide.pdf [Verified 10 October 2008]
Lewis, J (2005) ‘Health policy and politics: networks, ideas and power.’ (IP communications: East Hawthorn)
McGoldrick M, Crawford M, Peers M (2007) Cervical screening in general practice – strategies for improving participation. Australian Family Physician 36, 183–184.
Mills J, Hallinan C (2009) The social world of Australian practice nurses and the influence of medical dominance: an analysis of the literature. International Journal of Nursing Practice 15, 489–494.
| The social world of Australian practice nurses and the influence of medical dominance: an analysis of the literature.Crossref | GoogleScholarGoogle Scholar | 19958402PubMed |
National Health and Medical Research Council (2006) Screening to prevent cervical cancer: guidelines for the management of asymptomatic women with screen-detected abnormalities. Reference No. WH39. Available at http://www.nhmrc.gov.au/PUBLICATIONS/synopses/wh39syn.htm [Verified 14 September 2009]
Owen J (2006) ‘Program evaluation: forms and approaches.’ 4th edn. (Allen and Unwin: Crows Nest)
PapScreen Vic (2008) Barriers to screening for women, Pap Screen Victoria. Available at http://www.papscreen.org.au/browse.asp?ContainerID=c14 [Verified 14 September 2009]
Parkin D, Bray F, Ferlay J, Pisani P (2002) Global cancer statistics 2002. International Agency for Research on Cancer, GLOBOCAN, Lyon. Available at http://caonline.amcancersoc.org/cgi/reprint/55/2/74 [Verified 14 September 2009]
Royal Australian College of General Practitioners (2009) ‘Guidelines for preventative activities in general practice.’ 7th edn. Available at http://www.racgp.org.au/Content/NavigationMenu/ClinicalResources/RACGPGuidelines/eRedBook/redbook_7th_edition_May_2009.pdf [Verified 20 September 2009]
Shafi M, Welton K (2007) Colposcopy and cervical intraepithelial neoplasia. Obstetrics, Gynaecology and Reproductive Medicine 17, 106–180.
Taylor-Powel E, Jones L, Henert E (2002) Enhancing program performance with logic models. Available at http://www1.uwex.edu/ces/lmcourse [Verified 9 September 2009]
The Health Communications Unit (2001) ‘Logic models workbook version 6.’ (Centre for Health Promotion, University of Toronto: Canada) Available at http://www.thcu.ca/infoandresources/publications/logicmodel.wkbk.v6.1.full.aug27.pdf [Verified 14 September 2008]
Victorian Cervical Cytology Registry (2009) Evaluation of Pap tests collected by nurses in Victoria during 2009. Victorian Cervical Cytology Registry. Available at http://www.vccr.org/downloads/VCCR_Nurses_report_2009.pdf [Verified 13 March 2010]
Walboomers JM, Jacobs MV, Manos MM, Bosch FX, Kummer JA, Shah KV, Snijders PJ, Peto J, Meijer CJ, Muńoz N (1999) Human papillomavirus is a necessary cause of invasive cervical cancer worldwide. The Journal of Pathology 189, 12–19.
| Human papillomavirus is a necessary cause of invasive cervical cancer worldwide.Crossref | GoogleScholarGoogle Scholar | 1:STN:280:DyaK1Mzot1CjsQ%3D%3D&md5=c1aa01db92926e1a93cda6acedcf0be1CAS | 10451482PubMed |
Watts I, Foley E, Hutchinson R, Pascoe T, Whitecross L, Snowdon T (2004) General practice nursing in Australia RCNA/RACGP nursing in general practice project. Available at http://www.rcna.org.au/pages/practiceproj.php [Verified 20 September 2009]
Young J, Ward J (2003) Randomised trial of intensive academic detailing to promote opportunistic recruitment of women to cervical screening by general practitioners. Australian and New Zealand Journal of Public Health 27, 273–281.
| Randomised trial of intensive academic detailing to promote opportunistic recruitment of women to cervical screening by general practitioners.Crossref | GoogleScholarGoogle Scholar | 14705281PubMed |