Impact evaluation of a youth sexually transmissible infection awareness campaign using routinely collected data sources
Judy Gold A B I , Jane Goller A , Margaret Hellard A B C , Megan S. C. Lim A , Jane Hocking D , Christopher K. Fairley E , Tim Spelman A , Kathleen McNamee F , Philip Clift G and Rebecca Guy HA Centre for Population Health, Burnet Institute, Melbourne, Vic. 3004, Australia.
B Department of Epidemiology and Preventive Medicine, Monash University, Melbourne, Vic. 3004, Australia.
C The Nossal Institute for Global Health, The University of Melbourne, Melbourne, Vic. 3010, Australia.
D Centre for Women’s Health, Gender and Society, The University of Melbourne, Melbourne, Vic. 3053, Australia.
E Melbourne Sexual Health Centre and The School of Population Health, The University of Melbourne, Melbourne, Vic. 3010, Australia.
F Family Planning Victoria, Melbourne, Vic. 3128, Australia.
G Department of Human Services, Melbourne, Vic. 3000, Australia.
H National Centre in HIV Epidemiology and Clinical Research, The University of New South Wales, Sydney, NSW 2010, Australia.
I Corresponding author. Email: judy@burnet.edu.au
Sexual Health 8(2) 234-241 https://doi.org/10.1071/SH10082
Submitted: 5 July 2010 Accepted: 15 September 2010 Published: 18 May 2011
Abstract
Background: Young people are at high risk of sexually transmissible infections (STI) and notifications of chlamydia are rising rapidly. In 2007, a Victorian multimedia campaign aimed to increase STI testing and condom use among 18–25-year-olds. We conducted a retrospective impact evaluation using multiple sources of routinely collected data. Methods: Population-level chlamydia testing data from general practice, chlamydia testing data from five government primary care clinics with a high caseload of young people, and behavioural data from an annual youth behavioural survey were analysed. Analyses included time-series regression to assess trends in testing levels, Kruskal–Wallis tests to assess changes in positivity, and χ2-tests to assess knowledge and behaviour change. Results: There was no significant difference in the slope of monthly chlamydia testing in population-level or clinic-based surveillance during the campaign compared with before or after the campaign, and no changes in chlamydia positivity. Between 2007 and 2008, there was a significant increase in STI knowledge among females (P < 0.01) and in the proportion of females reporting always using a condom with casual (P = 0.04) and new sexual partners (P < 0.01) in the annual behavioural survey. Conclusions: Our findings suggest the campaign had no impact on STI testing but may have contributed to an increase in knowledge and condom use among females; however, this increase could not be directly attributed to the campaign. Future campaigns targeting young people for STI testing should consider alternative messages and approaches, and include robust evaluation mechanisms to measure campaign impact prospectively.
Additional keywords: Australia, chlamydia, condom use, media campaigns, testing, young people.
References
[1] National Centre in HIV Epidemiology and Clinical Research. HIV/AIDS, viral hepatitis and sexually transmissible infections in Australia, Annual Surveillance Report 2007. Sydney: The University of New South Wales, Australian Institute of Health and Welfare; 2007. Available online at: http://www.nchecr.unsw.edu.au/NCHECRweb.nsf/resources/SurvRep07/$file/ASR2007.PDF [accessed March 2008].[2] National Notifiable Diseases Surveillance System. Number of notifications of chlamydial infection, Australia, in the period of 1991 to 2007 and year-to-date notifications for 2008. Canberra: Communicable Diseases Australia, Australian Government Department of Health and Ageing; 2008. Available online at: http://www9.health.gov.au/cda/Source/Rpt_3.cfm [accessed March 2008].
[3] National Notifiable Diseases Surveillance System. Number of notifications of chlamydial infection, received from State and Territory health authorities in the period of 1991 to 2007 and year-to-date notifications for 2008. Canberra: Department of Health and Ageing; 2008. Available online at: http://www9.health.gov.au/cda/Source/Rpt_4.cfm [accessed April 2008].
[4] de Visser RO, Smith AM, Rissel CE, Richters J, Grulich AE. Sex in Australia: safer sex and condom use among a representative sample of adults. Aust N Z J Public Health 2003; 27 223–9.
| Sex in Australia: safer sex and condom use among a representative sample of adults.Crossref | GoogleScholarGoogle Scholar | 14696715PubMed |
[5] Lim MS, Hellard ME, Aitken CK, Hocking JS. Surveillance of STI risk behaviour among young people attending a music festival in Australia, 2005–08. Aust N Z J Public Health 2009; 33 482–4.
| Surveillance of STI risk behaviour among young people attending a music festival in Australia, 2005–08.Crossref | GoogleScholarGoogle Scholar | 19811488PubMed |
[6] Smith A, Agius P, Mitchell A, Barrett C, Pitts M. Secondary students and sexual health: results of the 4th National Survey of Australian Secondary Students, HIV/AIDS and Sexual Health. Melbourne: Australian Research Centre in Sex, Health and Society, La Trobe University; 2009. Available online at: http://www.latrobe.edu.au/arcshs/assets/downloads/reports/SSASH_2008_Final_Report.pdf [accessed August 2009].
[7] Victorian sexually transmissible infections strategy 2006–2009. Melbourne: Rural and Regional Health and Aged Care Services Division, Victorian Department of Human Services; 2006. Available online at: http://www.health.vic.gov.au/ideas/diseases/sti_strategy [accessed March 2008].
[8] Department of Health and Ageing. National sexually transmissible infections strategy 2005–2008. Canberra: Commonwealth Department of Health and Ageing; 2005.
[9] Harris M, Bailey L, Bridges-Webb C, Furler J, Joyner B, Litt J, et al. Guidelines for preventive activities in general practice. Melbourne: The Royal Australian College of General Practitioners; 2005. Available online at: http://www.racgp.org.au/redbook/download/2005Redbook_6th_ed.pdf [accessed March 2009].
[10] Kong F, Guy R, Bergeri I, Boyle DJ, Hocking JS, Merritt T, et al Chlamydia testing rates among Australian General Practitioners. Med J Aust ; in press
[11] Open Mind Research Group. ‘You never know who you’ll meet’ campaign evaluation tracking report. Melbourne: Open Mind Research Group; 2008.
[12] Nutbeam D. Evaluating health promotion – progress, problems and solutions. Health Promot Int 1998; 13 27–44.
| Evaluating health promotion – progress, problems and solutions.Crossref | GoogleScholarGoogle Scholar |
[13] Guy RJ, Prybylski D, Fairley CK, Hellard ME, Kaldor JM. Can data from HIV voluntary counselling and testing be used to assess the impact of public health interventions? A literature review. Int J STD AIDS 2009; 20 378–83.
| Can data from HIV voluntary counselling and testing be used to assess the impact of public health interventions? A literature review.Crossref | GoogleScholarGoogle Scholar | 1:STN:280:DC%2BD1Mzltlymtw%3D%3D&md5=4b968a1fa362ffefcd25b8282fec3e3aCAS | 19451320PubMed |
[14] Potvin L, Richard L. Evaluating community health promotion programs. In: Rootman I, Goodstadt M, Hyndman B, McQueen DV, Potvin L, Springett J, et al., editors. Evaluation in health promotion: principles and perspectives. Geneva: World Health Organization; 2001. pp. 213–40.
[15] Rutherford GW, McFarland W, Spindler H, White K, Patel SV, Aberle-Grasse J, et al Public health triangulation: approach and application to synthesizing data to understand national and local HIV epidemics. BMC Public Health 2010; 10 447
| Public health triangulation: approach and application to synthesizing data to understand national and local HIV epidemics.Crossref | GoogleScholarGoogle Scholar | 20670448PubMed |
[16] Medicare Benefits Schedule (MBS) item statistics reports. Canberra: Medicare Australia, Australian Government; 2009. Available online at: http://www.medicareaustralia.gov.au/statistics/dyn_mbs/forms/mbs_tab4ag.shtml#info [accessed February 2009].
[17] Goller JL, Guy RJ, Gold J, Lim MS, El-Hayek C, Stoovè MA, et al Establishing a linked sentinel surveillance system for blood-borne viruses and sexually transmissible infections: methods, system attributes and early findings. Sex Health 2010; 7 425–33.
| Establishing a linked sentinel surveillance system for blood-borne viruses and sexually transmissible infections: methods, system attributes and early findings.Crossref | GoogleScholarGoogle Scholar | 21062582PubMed |
[18] Chen MY, Karvelas M, Sundararajan V, Hocking JS, Fairley CK. Evidence for the effectiveness of a chlamydia awareness campaign: increased population rates of chlamydia testing and detection. Int J STD AIDS 2007; 18 239–43.
| Evidence for the effectiveness of a chlamydia awareness campaign: increased population rates of chlamydia testing and detection.Crossref | GoogleScholarGoogle Scholar | 17509173PubMed |
[19] Vidanapathirana J, Abramson MJ, Forbes A, Fairley C. Mass media interventions for promoting HIV testing: Cochrane systematic review. Int J Epidemiol 2006; 35 233–4.
| 1:STN:280:DC%2BD283gt1GmsQ%3D%3D&md5=aa2c75e632c8b0a825ecd64d9de2c61fCAS | 16464935PubMed |
[20] Wilkins A, Mak DB. Sending out an SMS: an impact and outcome evaluation of the Western Australian Department of Health’s 2005 chlamydia campaign. Health Promot J Austr 2007; 18 113–20.
| 17663646PubMed |
[21] Andersen B, Ostergaard L, Moller JK, Olesen F. Effectiveness of a mass media campaign to recruit young adults for testing of Chlamydia trachomatis by use of home obtained and mailed samples. Sex Transm Infect 2001; 77 416–8.
| Effectiveness of a mass media campaign to recruit young adults for testing of Chlamydia trachomatis by use of home obtained and mailed samples.Crossref | GoogleScholarGoogle Scholar | 1:STN:280:DC%2BD3MnovVyrtQ%3D%3D&md5=02c537d4fa0a89d84c0b31aa5514016bCAS | 11714938PubMed |
[22] Oh MK, Grimley DM, Merchant JS, Brown PR, Cecil H, Hook EW. Mass media as a population-level intervention tool for Chlamydia trachomatis screening: report of a pilot study. J Adolesc Health 2002; 31 40–7.
| Mass media as a population-level intervention tool for Chlamydia trachomatis screening: report of a pilot study.Crossref | GoogleScholarGoogle Scholar | 12090964PubMed |
[23] Beck EJ, Cunningham DG, Moss VW, Harris JR, Pinching AJ, Jeffries DJ. HIV testing: changing trends at a clinic for sexually transmitted diseases in London. Br Med J (Clin Res Ed) 1987; 295 191–3.
| HIV testing: changing trends at a clinic for sexually transmitted diseases in London.Crossref | GoogleScholarGoogle Scholar | 1:STN:280:DyaL1c%2FgtFegug%3D%3D&md5=c277903bc45f4263d13e85d0a80abfb7CAS | 3115372PubMed |
[24] National HIV. Testing day at CDC-funded HIV counseling, testing, and referral sites – United States, 1994–1998. MMWR Morb Mortal Wkly Rep 2000; 49 529–32.
| 10923852PubMed |
[25] Zimmerman RS, Palmgreen PM, Noar SM, Lustria ML, Lu HY, Lee Horosewski M. Effects of a televised two-city safer sex mass media campaign targeting high-sensation-seeking and impulsive-decision-making young adults. Health Educ Behav 2007; 34 810–26.
| Effects of a televised two-city safer sex mass media campaign targeting high-sensation-seeking and impulsive-decision-making young adults.Crossref | GoogleScholarGoogle Scholar | 17602097PubMed |
[26] Alstead M, Campsmith M, Halley CS, Hartfield K, Goldbaum G, Wood RW. Developing, implementing, and evaluating a condom promotion program targeting sexually active adolescents. AIDS Educ Prev 1999; 11 497–512.
| 1:STN:280:DC%2BD3c7lsFeisQ%3D%3D&md5=8f3662f070220ed03a5bc7a9f2535c8bCAS | 10693646PubMed |
[27] Bull SS, Posner SF, Ortiz C, Beaty B, Benton K, Lin L, et al POWER for reproductive health: results from a social marketing campaign promoting female and male condoms. J Adolesc Health 2008; 43 71–8.
| POWER for reproductive health: results from a social marketing campaign promoting female and male condoms.Crossref | GoogleScholarGoogle Scholar | 18565440PubMed |
[28] Tyden T, Bergholm M, Hallen A, Odlind V, Olsson SE, Sjoden PO, et al Evaluation of an STD-prevention program for Swedish university students. J Am Coll Health 1998; 47 70–5.
| Evaluation of an STD-prevention program for Swedish university students.Crossref | GoogleScholarGoogle Scholar | 1:STN:280:DyaK1cvlsF2rsA%3D%3D&md5=dd16841690bb0b09f3435cb95c9fee54CAS | 9782662PubMed |
[29] Brotherton A, O’Donnell D, Mackie B. Safe sex no regrets campaign. Sydney: AIDS/Infectious Diseases Branch, NSW Department of Health; 2005. Available online at: http://www.archi.net.au/e-library/awards/baxter05/consumer_participation/safe_sex [accessed January 2009].
[30] Crawford G, Brown G, Nicholson C, Yam S, Langdon T. Safe sex no regrets: implementation & evaluation report 2007/2008. Perth: WA AIDS Council; 2008. Available online at: http://safesexnoregrets.com.au/mediacampaign.html [accessed January 2009].
[31] Snyder LB, Hamilton MA, Mitchell EW, Kiwanuka-Tondo J, Fleming-Milici F, Proctor D. A meta-analysis of the effect of mediated health communication campaigns on behavior change in the United States. J Health Commun 2004; 9 71–96.
| A meta-analysis of the effect of mediated health communication campaigns on behavior change in the United States.Crossref | GoogleScholarGoogle Scholar | 14960405PubMed |
[32] Lim M, Hocking JS, Hellard ME, Aitken CK. SMS STI: a review of the uses of mobile phone text messaging in sexual health. Int J STD AIDS 2008; 19 287–90.
| SMS STI: a review of the uses of mobile phone text messaging in sexual health.Crossref | GoogleScholarGoogle Scholar | 18482956PubMed |