Cost-effectiveness of a complex intervention in general practice to increase uptake of long-acting reversible contraceptives in Australia†
Milena Lewandowska A J , Richard De Abreu Lourenco A , Marion Haas A B , Cathy J. Watson C , Kirsten I. Black D , Angela Taft E , Jayne Lucke F , Kevin McGeechan A B , Kathleen McNamee G H , Jeffrey F. Peipert I and Danielle Mazza CA Centre for Health Economics Research and Evaluation, University of Technology Sydney, NSW, Australia. Email: Richard.DeAbreuLourenco@chere.uts.edu.au; Marion.Haas@chere.uts.edu.au
B School of Public Health, University of Sydney, NSW, Australia. Email: Kevin.McGeechan@sydney.edu.au
C Department of General Practice, Monash University, Melbourne, Vic., Australia. Email: Cathy.Watson@monash.edu; Danielle.Mazza@monash.edu
D Royal Prince Alfred Hospital, University of Sydney, NSW, Australia. Email: Kirsten.Black@sydney.edu.au
E Judith Lumley Centre, La Trobe University, Melbourne, Vic., Australia. Email: A.Taft@latrobe.edu.au
F School of Psychology and Public Health, La Trobe University, Melbourne, Vic., Australia. Email: J.Lucke@latrobe.edu.au
G Family Planning Victoria, Vic., Australia. Email: kmcnamee@fpv.org.au
H Obstetrics and Gynaecology, Monash Health, Monash University, Melbourne, Vic., Australia.
I Department of Obstetrics and Gynaecology, Indiana University School of Medicine, Indianapolis, IN, USA. Email: jpeipert@iu.edu
J Corresponding author. Email: Milena.Lewandowska@chere.uts.edu.au
Australian Health Review 45(6) 728-734 https://doi.org/10.1071/AH20282
Submitted: 2 October 2020 Accepted: 9 March 2021 Published: 26 October 2021
Journal Compilation © AHHA 2021 Open Access CC BY-NC-ND
Abstract
Objective The aim of this study was to evaluate the cost-effectiveness of the Australian Contraceptive ChOice pRoject (ACCORd) intervention.
Methods An economic evaluation compared the costs and outcomes of the ACCORd intervention with usual care (UC). Data from the ACCORd trial were used to estimate costs and efficacy in terms of contraceptive uptake and quality of life. Rates of contraceptive failure and pregnancy were sourced from the literature. Using a Markov model, within-trial results were extrapolated over 10 years and subjected to univariate sensitivity analyses. Model outputs were expressed as the cost per quality-adjusted life years (QALY) gained and cost per unintended pregnancy resulting in birth (UPB) avoided.
Results Over 10 years, compared with UC, initiating contraception through the ACCORd intervention resulted in 0.02 fewer UPB and higher total costs (A$2505 vs A$1179) per woman. The incremental cost-effectiveness of the ACCORd intervention versus UC was A$1172 per QALY gained and A$7385 per UPB averted. If the start-up cost of the ACCORd intervention was removed, the incremental cost-effectiveness ratio was A$81 per QALY gained and A$511 per UPB averted. The results were most sensitive to the probability of contraceptive failure, the probability of pregnancy-related healthcare service utilisation or the inclusion of the costs of implementing the ACCORd intervention.
Conclusions From a health system perspective, if implemented appropriately in terms of uptake and reach, and assuming an implicit willingness to pay threshold of A$50 000 the ACCORd intervention is cost-effective.
What is known about the topic? The uptake of long-active reversible contraceptives (LARC) in Australia is low. The ACCORd trial assessed the efficacy of providing structured training to general practitioners (GPs) on LARC counselling, together with access to rapid referral to insertion clinics.
What does this paper add? This study is the first to assess the cost-effectiveness of a complex intervention in the general practice setting aimed at increasing the uptake of LARC in Australia.
What are the implications for practitioners? The results show that implementing a complex intervention in general practice involving GP education and the availability of rapid referral to LARC insertion clinics is a cost-effective approach to increase LARC use and its attending efficacy. If the majority of Australian GPs were able to deliver effectiveness-based contraceptive counselling and either insert LARC or use a rapid referral process to a LARC insertion clinic, the additional cost associated with the purchase of LARC products and their insertion would be offset by reductions to health system costs as a result of fewer UPB and abortions. Moreover, the benefits to women’s physical and psychological health of avoiding such events is substantial.
Keywords: ACCORd, contraceptive counselling, economic evaluation, general practice, health economics, health services, long-acting reversible contraceptives, quality of life.
Introduction
In Australia and other high-income countries, unintended pregnancies (UPs) are relatively common, and many result in abortion.1,2 In a survey of Australian women conducted in 2010–11, 30% of women reported a UP; one in four pregnancies were terminated.3
International evidence suggests that long-acting reversible contraception (LARC) products such as subdermal hormone implants (etonorgestrel subdermal implant (Implanon NXT)) and hormone intrauterine devices (IUD; levonorgestrel (Mirena) and the copper IUD (Cu IUD)) can reduce the rate of UPs.4–6 Compared with short-acting reversible contraception (SARC), including the oral contraception pill (OC), LARC methods are not dependent on user compliance and therefore have a very low failure rate.6 Thus, increasing the uptake of LARC in Australia is likely to reduce the rate of UPs, the associated negative effect a UP has on a woman’s quality of life and health service costs.7
LARC methods have been shown to be cost-effective8–10 compared with other contraceptive methods, despite increased health care utilisation and up-front costs associated with their insertion. However, the uptake of LARC in Australia is low.11 Important barriers to increasing LARC uptake include a lack of familiarity with their use at the primary care level and misconceptions among both general practitioners (GPs) and women about LARC.12 Therefore, training to provide structured effectiveness-based contraceptive counselling and access to rapid referral to LARC insertion clinics provided by gynaecologists are potential strategies for increasing their utilisation.
Australian Contraceptive ChOice pRoject (ACCORd), an adaptation of the US Contraceptive Choice Project (CHOICE),13 was designed as a cluster randomised controlled trial.14 The aim of the ACCORd study was to test whether a complex intervention based in general practice consisting of online education for GPs on effectiveness-based contraceptive counselling, together with the availability of a fast-track referral process to a LARC insertion clinic, is a cost-effective means of increasing the uptake of LARC compared with usual care (UC) among Australian women (an overview of the baseline characteristics of the women included in the ACCORd trial is presented in Supplementary Table S1).
Methods
The economic evaluation of the ACCORd trial was undertaken in two parts: (1) a within-trial cost-effectiveness analysis restricted to the period of the ACCORd study; and (2) a longer-term modelled evaluation.
The within-trial analysis focused on the short-term costs and outcomes of the ACCORd intervention (the proportion of women using LARC). A quasi-societal perspective was used to calculate costs, including the cost of the intervention and the cost associated with use of healthcare services. Contraception-specific health service utilisation was measured largely using Australian Medicare data (Medical Benefits Schedule (MBS) and Pharmaceutical Benefits Scheme (PBS)) for women participating in the ACCORd study; costs were calculated as the sum of observed out-patient service use. Hospital costs associated with pregnancy (as observed in ACCORd) and costs associated with the purchase and insertion of IUDs funded outside the public healthcare system were included based on reported Australian-Refined Diagnosis-Related Groups (for pregnancy) and private sector costs (for the copper IUD). Direct non-medical costs (e.g. transportation) and indirect costs (productivity losses) were not included in the analysis.
Total costs per group (intervention or UC group) are reported for the within-trial period (12 months) and disaggregated by service component: the cost of the contraceptive product; insertion and removal of the device; and management of contraceptive failure. Because the outcome of interest was the proportion of women using LARC at 12 months, the incremental analysis is expressed as the cost per additional woman using LARC at 12 months.
A Markov model was constructed to extrapolate the costs and outcomes observed in the ACCORd study over 10 years, allowing us to estimate the cost per quality-adjusted life years (QALY) gained. The model structure is shown in Fig. 1.
The model consisted of three health states: (1) discontinuation of the contraceptive method (non-medical contraceptive (NMC)); (2) commencement of a contraceptive method (‘start LARC’, ‘start OC’); or (3) continuing use of a method. The NMC alternative included women who stopped using a contraceptive method due to adverse events or personal choice. The proportion and direction of method switch was estimated using information from the within-trial analysis and is provided in Table 1. The key assumptions underpinning the transitions applied in the model are as follows:
-
women could switch between contraceptive methods once per cycle (each cycle = 6 months), but a switch independent of contraceptive failure could only occur once in the overall duration of the model
-
all switches were from OC to LARC and NMC; there were no switches from LARC and NMC
-
contraceptive failures were assumed to occur at the end of each cycle
-
method failure resulted in termination of pregnancy (TOP) or unplanned pregnancy resulting in birth (UPB). Women who experienced a method failure were assumed to switch to a new method. Those whose method was effective continued to use the same method. We assumed that UPB and TOP could occur once per year for an individual woman.
Costs included are as described for the within-trial analysis. The costs of side-effects, such as infections and adverse events related to method use, were not included in the analysis because the occurrence of such events reported by ACCORd Trial Data Monitoring Committee was very low.15
Health state transitions and treatment use were based on data observed in the ACCORd trial (see Table 1). The probability of method failure and pregnancy outcomes was sourced from the literature.8 The number of QALYs gained was calculated using the results of the 36-Item Short Form Health Survey (SF-36) surveys completed by women participants in ACCORd for which quality of life weights were estimated using the Short Form Health Survey Six-Dimension (SF-6D) algorithm with Australian weights.16,17 The number of UPB avoided was expressed as the cumulative number of UPB resulting from contraceptive failure over the time horizon of the analysis.
All costs were discounted at a rate of 5% per year. The within-trial data analysis was performed in STATA version 15.1 (StataCorp LLC, College Station, TX, USA) and the modelled analysis was performed in Tree Age Pro 2019 (TreeAge Software, Williamstown, MA, USA). Differences in mean costs between groups were estimated by bootstrapping.
One-way sensitivity analyses were conducted, rather than probabilistic sensitivity analyses, because this is consistent with Australian and international health technology assessment guidelines18 and avoids potential uncertainties associated with determining parameter ranges and distributions for probabilistic analyses.18 Sensitivity analyses were used to test the effects on the incremental cost-effectiveness ratio (ICER) of varying the failure rates of the methods, assuming switching from the LARC method to OC and NMC (in 5% of women) after the initial replacement period for LARC (i.e. 5 years for Mirena19 and the copper IUD;20 3 years for Implanon NXT21), and the costs of contraceptive products, UPB and TOP.
We also conducted two scenario analyses: (1) we tested the effect on the ICER of removing the start-up costs of the ACCORd intervention; and (2) we applied standard MBS fees for healthcare services rather than mean costs per service obtained from the within-trial-based costs. This second analysis served as a robustness check on the sensitivity of the results to the estimation of the costs from the observed administrative data. Australian funding authorities have no explicit willingness to pay (WTP) threshold. However, we have assumed an implicit WTP of A$50 000 as the benchmark for determining cost-effectiveness.22
Results
Within-trial analysis
The results from the ACCORd trial showed that 13.8% more women in the intervention group used LARC compared with the UC group (46.6% vs 32.8%; P = 0.0015).14 Cost data related to medical services (MBS data) were available for 212 women (69%) in the ACCORd intervention group and for 306 women (71%; P = 0.56) in the UC group; data on the use of contraceptive products (PBS data) were available for 206 women (67%) in the intervention group and for 297 women (69%, P = 0.11) in the UC group. An analysis of these data showed a difference in LARC use that was consistent with the primary analysis from ACCORd: 6% more women in the intervention group used LARC compared with the UC group (45% vs 39%; P = 0.17).
Markov model analysis
The results of the within-trial analysis comparing the total costs and mean cost per woman are presented in Table 2. It is assumed that the patterns of care among women consenting to the use of their Medicare data are not different to those who did not consent and that the mean costs per women are therefore representative of all women in the trial.
Overall, compared with UC, women in the intervention group had both a lower annual mean Medicare cost per woman and lower total Medicare costs over the trial period. The mean cost of OC was lower than LARC in both groups (Table 2). Although the total cost of health care utilisation was lower in the intervention than UC group, the total cost associated with UPB was higher for the intervention group due to the higher proportion of unintended pregnancies in this group (0.05 vs 0.04). However, this difference was not statistically significant (P = 0.37).
When the start-up costs of the intervention were included, the cost per additional woman using LARC at 12 months was A$11 149. However, the intervention was more effective and less costly when start-up costs were removed; that is, compared with UC, the intervention resulted in both an increase of 14 percentage points in the proportion of women using LARC and a reduction in the mean cost per woman of A$226.The results of the modelled analysis are presented in Table 3. The key difference between this and the within-trial analysis is the addition of the quality of life effects. The results of the SF-6D survey showed no differences between the groups in terms of quality of life (0.63 vs 0.65 on a scale 0–1; P = 0.14). Although the number of specific pregnancy-related events (e.g. obstetric care) varied between the groups, the frequency of these events was very low, resulting in no statistically significant difference between the groups in terms of quality of life. Accordingly, the same quality of life weights were applied to events within the analysis, regardless of the treatment group, namely an overall quality of life weight of 0.60 for women without a pregnancy event, a weight of 0.59 for TOP events and a weight of 0.62 for UPB events.
The base case analysis resulted in a cost per QALY gained of A$1172 for the intervention compared with UC. After excluding start-up costs (A$1234 per woman), the ICER was A$81 per QALY gained for the intervention compared with UC group. This shows that the ICER is most sensitive to variations in the probability of method failure resulting in UPB or TOP. However, the results are relatively robust to variations in costs related to method failure and variation in probability of switching from LARCs to OC or NMC (see results of the sensitivity analyses provided as a tornado plot in Figure S1).
The results of the scenario analysis in which mean MBS and PBS item fees related to gynaecological services were used instead of mean costs based on the results of the within-trial analysis are presented in Table 3. These results were consistent with those of the base case.
Discussion
LARC methods have been shown to be a highly cost-effective means of reducing the rate of unplanned pregnancies.24,25 Our analysis shows that the ACCORd intervention has the potential to be highly cost-effective, assuming an implicit WTP of A$50 000,22 in terms of both increasing the number of women using LARC and the longer-term quality of life outcomes. Importantly, we show that the cost-effectiveness of the ACCORd intervention is influenced by both the efficacy of outcomes and the ability to defray start-up costs.
Our evaluation of the cost-effectiveness of the ACCORd intervention over a 10- year period indicates that, from a healthcare perspective, the ACCORd intervention is more effective than UC in preventing UPB and abortions but is more expensive. However, our assessment has also shown that the value to both the healthcare system and society of the ACCORd intervention is enhanced if more women access it (reducing the impact of start-up costs).
To the best of our knowledge, this study is the first to assess the cost-effectiveness of a complex intervention in the general practice setting aimed at increasing the uptake of LARC in Australia. The results are similar to studies of the cost-effectiveness of GP educational initiatives in other areas, such as diabetes26 and the management of lower back pain,27,28 which have shown that adding advice, education and behavioural counselling to usual GP care is efficient at the primary care level and has a positive financial effect on the health system.
This study has several strengths. The within-trial analysis is based on the results of a rigorous pragmatic randomized control trial. Most women participants consented to the use of their Medicare data for the analysis of medical service and pharmaceutical utilisation and costs, increasing the accuracy of the results and hence the relevance in the Australian context of the cost inputs to the model. The information about quality of life was collected from women participants and Australian weights were used to estimate the utilities for the QALY outcome measure.
The study also has some limitations. Because GPs who agreed to participate in ACCORd may have been more interested in contraception and LARC uptake than the average GP, the overall uptake of LARC, and therefore the benefits accruing to the wider population, are uncertain. The time span of the trial may not have adequately captured resource utilisation for women in the intervention and control groups. Therefore, we did not restrict the analysis based on study start date. Although the Markov model includes a pathway for non-prescribed contraceptive methods, we did not include the effect on the costs and effectiveness of these types of contraception, because we assumed the use of these methods would be similar in both groups. The use of private prescriptions was not included in the analysis because it was likely to be very low and not different across the groups. Our sensitivity analyses showed that the model results were robust to variations in the cost of care.
In this analysis we applied the same quality of life scores to women in both the intervention and UC groups. This is reasonable because it is unlikely that consulting a GP who participated in the ACCORd study would alter a woman’s quality of life. Finally, the start-up cost of the ACCORd intervention may be overestimated. Because ACCORd involved an educational intervention, it is likely to have had a spin-off effect on women who were not directly included in the trial; we did not seek to capture the benefits to women who attended intervention GPs but did not participate in ACCORd, but note that this is likely to have enhanced the cost-effectiveness of the intervention.
Our results show that implementing a complex intervention in general practice involving GP education and the availability of rapid referral to LARC insertion clinics is a cost-effective approach to increase LARC use and its attending efficacy. Such uptake is likely to have benefits beyond those included in our analysis. Although the quality of life weights applied assumed no difference between the groups in terms of the impact of pregnancy events on women, LARC use may benefit women in ways not captured by standard quality of life measures (e.g. increased convenience, lower rates of heavy menstrual bleeding, improved fertility control, improved spacing of pregnancies and enhanced productivity). Further research should explore how such benefits may be valued.
If the majority of Australian GPs were able to deliver effectiveness-based contraceptive counselling and either insert LARC or use a rapid referral process to a LARC insertion clinic, the additional cost associated with the purchase of LARC products and their insertion would be offset by reductions to health system costs as a result of fewer UP and abortions. Moreover, the benefits to women’s physical and psychological health of avoiding such events is substantial.7
Competing interests
The authors declare that they have no competing interests.
Declaration of funding
This project was funded by Department of Health, Australian Government and the National Health and Medical Research Council (Reference no. APP1081743).
Acknowledgements
The authors thank the doctors and women who participated in the ACCORd trail, as well as Rebecca Addo, PhD, Research Fellow at CHERE UTS, who provided assistance in verification of the economic model applied in this study.
References
[1] Rowe H, Holton S, Kirkman M, Bayly C, Jordan L, et al. Prevalence and distribution of unintended pregnancy: the Understanding Fertility Management in Australia National Survey. Aust N Z J Public Health 2016; 40 104–9.| Prevalence and distribution of unintended pregnancy: the Understanding Fertility Management in Australia National Survey.Crossref | GoogleScholarGoogle Scholar | 26456762PubMed |
[2] Sedgh G, Singh S, Hussain R. Intended and unintended pregnancies worldwide in 2012 and recent trends. Stud Fam Plann 2014; 45 301–14.
| Intended and unintended pregnancies worldwide in 2012 and recent trends.Crossref | GoogleScholarGoogle Scholar | 25207494PubMed |
[3] Rassi A, Wattimena J, Black K. Pregnancy intention in an urban Australian antenatal population. Aust N Z J Public Health 2013; 37 568–73.
| Pregnancy intention in an urban Australian antenatal population.Crossref | GoogleScholarGoogle Scholar | 24892156PubMed |
[4] Family Planning NSW. Reproductive and sexual health in Australia. 2013. Available at https://www.fpnsw.org.au/sites/default/files/assets/rshinaust_book_webedition_1.pdf [accessed 24 June 2021].
[5] Secura GM, Madden T, McNicholas C, Mullersman J, Buckel CM, et al. Provision of no-cost, long-acting contraception and teenage pregnancy. N Engl J Med 2014; 371 1316–23.
| Provision of no-cost, long-acting contraception and teenage pregnancy.Crossref | GoogleScholarGoogle Scholar | 25271604PubMed |
[6] Winner B, Peipert JF, Zhao Q, Buckel C, Madden T, et al. Effectiveness of long-acting reversible contraception. N Engl J Med 2012; 366 1998–2007.
| Effectiveness of long-acting reversible contraception.Crossref | GoogleScholarGoogle Scholar | 22621627PubMed |
[7] Schwarz EB, Smith R, Steinauer J, Reeves MF, Caughey AB. Measuring the effects of unintended pregnancy on women’s quality of life. Contraception 2008; 78 204–10.
| Measuring the effects of unintended pregnancy on women’s quality of life.Crossref | GoogleScholarGoogle Scholar | 18692610PubMed |
[8] Trussell J, Henry N, Hassan F, Prezioso A, Law A, et al. Cost-effectiveness analysis of levonorgestrel-releasing intrauterine system (LNG-IUS) 13.5 mg in contraception. Contraception 2014; 89 451–459.
| Cost-effectiveness analysis of levonorgestrel-releasing intrauterine system (LNG-IUS) 13.5 mg in contraception.Crossref | GoogleScholarGoogle Scholar | 24576791PubMed |
[9] Mavranezouli I. The cost-effectiveness of long-acting reversible contraceptive methods in the UK: analysis based on a decision-analytic model developed for a National Institute for Health and Clinical Excellence (NICE) clinical practice guideline. Hum Reprod 2008; 23 1338–45.
| The cost-effectiveness of long-acting reversible contraceptive methods in the UK: analysis based on a decision-analytic model developed for a National Institute for Health and Clinical Excellence (NICE) clinical practice guideline.Crossref | GoogleScholarGoogle Scholar | 18372257PubMed |
[10] Trussell J, Lalla AM, Doan QV, Reyes E, Pinto L, et al. Cost effectiveness of contraceptives in the United States. Contraception 2009; 79 5–14.
| Cost effectiveness of contraceptives in the United States.Crossref | GoogleScholarGoogle Scholar | 19041435PubMed |
[11] Richters J, Fitzadam S, Yeung A, Caruana T, Rissel C, et al Contraceptive practices among women: the second Australian study of health and relationships. Contraception 2016; 94 548–55.
| Contraceptive practices among women: the second Australian study of health and relationships.Crossref | GoogleScholarGoogle Scholar | 27373543PubMed |
[12] Mazza D, Bateson D, Frearson M, Goldstone P, Kovacs G, et al. Current barriers and potential strategies to increase the use of long-acting reversible contraception (LARC) to reduce the rate of unintended pregnancies in Australia: an expert roundtable discussion. Aust N Z J Obstet Gynaecol 2017; 57 206–12.
| Current barriers and potential strategies to increase the use of long-acting reversible contraception (LARC) to reduce the rate of unintended pregnancies in Australia: an expert roundtable discussion.Crossref | GoogleScholarGoogle Scholar | 28294293PubMed |
[13] Secura GM, Allsworth JE, Madden T, Mullersman JL, Peipert JF. The Contraceptive CHOICE Project: reducing barriers to long-acting reversible contraception. Am J Obstet Gynecol 2010; 203 115e1–7.
| The Contraceptive CHOICE Project: reducing barriers to long-acting reversible contraception.Crossref | GoogleScholarGoogle Scholar |
[14] Mazza D, Watson CJ, Taft A, Lucke J, McGeechan K, et al. Increasing long acting reversible contraceptives: the Australian Contraceptive ChOice pRoject (ACCORd) cluster randomized trial. Am J Obstet Gynecol 2020; 222 S921.e1–e13.
| Increasing long acting reversible contraceptives: the Australian Contraceptive ChOice pRoject (ACCORd) cluster randomized trial.Crossref | GoogleScholarGoogle Scholar |
[15] Borgatta L, Buhling KJ, Rybowski S, Roth K, Rosen K. A multicentre, open-label, randomised phase III study comparing a new levonorgestrel intrauterine contraceptive system (LNG-IUS 8) with combined oral contraception in young women of reproductive age. Eur J Contracept Reprod Health Care 2016; 21 372–9.
| A multicentre, open-label, randomised phase III study comparing a new levonorgestrel intrauterine contraceptive system (LNG-IUS 8) with combined oral contraception in young women of reproductive age.Crossref | GoogleScholarGoogle Scholar | 27494570PubMed |
[16] Norman R, Viney R, Brazier J, Burgess L, Cronin P, et al. Valuing SF-6D health states using a discrete choice experiment. Med Decis Making 2014; 34 773–86.
| Valuing SF-6D health states using a discrete choice experiment.Crossref | GoogleScholarGoogle Scholar | 24025661PubMed |
[17] Whitehurst DG, Norman R, Brazier JE, Viney R. Comparison of contemporaneous EQ-5D and SF-6D responses using scoring algorithms derived from similar valuation exercises. Value Health 2014; 17 570–7.
| Comparison of contemporaneous EQ-5D and SF-6D responses using scoring algorithms derived from similar valuation exercises.Crossref | GoogleScholarGoogle Scholar | 25128050PubMed |
[18] Ramsey SD, Willke RJ, Glick H, Reed SD, Augustovski F, et al. Cost-effectiveness analysis alongside clinical trials II – an ISPOR Good Research Practices Task Force Report. Value Health 2015; 18 161–72.
| Cost-effectiveness analysis alongside clinical trials II – an ISPOR Good Research Practices Task Force Report.Crossref | GoogleScholarGoogle Scholar | 25773551PubMed |
[19] Therapeutic Goods Administration. Public summary document: MIRENA levonorgestrel 52mg intrauterine drug delivery system sachet. 2021. Available at https://www.ebs.tga.gov.au/servlet/xmlmillr6?dbid=ebs/PublicHTML/pdfStore.nsf&docid=73027&agid=(PrintDetailsPublic)&actionid=1 [accessed 24 June 2021].
[20] Therapeutic Goods Administration. Public summary document: Basin Medical Pty Ltd – Mona Lisa® Cu375 – intrauterine device, metal-covered. 2018. Available at https://www.ebs.tga.gov.au/servlet/xmlmillr6?dbid=ebs/PublicHTML/pdfStore.nsf&docid=300911&agid=(PrintDetailsPublic)&actionid=1 [accessed 24 June 2021].
[21] Therapeutic Goods Administration. Public summary document: IMPLANON NXT (etonogestrel) subdermal implant. 2021. Available at https://www.ebs.tga.gov.au/ebs/picmi/picmirepository.nsf/pdf?OpenAgent&id=CP-2011-PI-02693-3&d=20211002172310101 [accessed 2 October 2021].
[22] Wang S, Gum D, Merlin T. Comparing the ICERs in medicine reimbursement submissions to NICE and PBAC – does the presence of an explicit threshold affect the ICER proposed? Value Health 2018; 21 938–43.
| Comparing the ICERs in medicine reimbursement submissions to NICE and PBAC – does the presence of an explicit threshold affect the ICER proposed?Crossref | GoogleScholarGoogle Scholar | 30098671PubMed |
[23] Chemist Warehouse. Copper Load 375 IUD – Copper IUD. 2020. Available at https://www.chemistwarehouse.com.au/buy/82637/copper-load-375-iud-copper-iud [accessed 10 March 2020].
[24] Lynch M, De Abreu Lourenco R, Flattery M, Haas M. Reviewing the cost-effectiveness of long-acting reversible contraceptive methods in an Australian context. Aust N Z J Obstet Gynaecol 2019; 59 21–35.
| Reviewing the cost-effectiveness of long-acting reversible contraceptive methods in an Australian context.Crossref | GoogleScholarGoogle Scholar | 30311634PubMed |
[25] Concepcion K, Lacey S, McGeechan K, Estoesta J, Bateson D, et al. Cost-benefit analysis of enhancing the uptake of long-acting reversible contraception in Australia. Aust Health Rev 2020; 44 385–91.
| Cost-benefit analysis of enhancing the uptake of long-acting reversible contraception in Australia.Crossref | GoogleScholarGoogle Scholar | 31655632PubMed |
[26] McRae IS, Butler JR, Sibthorpe BM, Ruscoe W, Snow J, et al. A cost effectiveness study of integrated care in health services delivery: a diabetes program in Australia. BMC Health Serv Res 2008; 8 205
| A cost effectiveness study of integrated care in health services delivery: a diabetes program in Australia.Crossref | GoogleScholarGoogle Scholar | 18834551PubMed |
[27] Lin C-WC, Haas M, Maher CG, Machado LAC, van Tulder MW. Cost-effectiveness of general practice care for low back pain: a systematic review. Eur Spine J 2011; 20 1012–23.
| Cost-effectiveness of general practice care for low back pain: a systematic review.Crossref | GoogleScholarGoogle Scholar |
[28] Morgan T, Wu J, Ovchinikova L, Lindner R, Blogg S, et al. A national intervention to reduce imaging for low back pain by general practitioners: a retrospective economic program evaluation using Medicare Benefits Schedule data. BMC Health Serv Res 2019; 19 983
| A national intervention to reduce imaging for low back pain by general practitioners: a retrospective economic program evaluation using Medicare Benefits Schedule data.Crossref | GoogleScholarGoogle Scholar | 31864352PubMed |
† This trial has been registered with the Australian and New Zealand Clinical Trial Registry (ANZCTR ID 12615001346561, 10 December 2015).