Highlighting efficiency and redundancy in the Royal Australian College of General Practice standards for accreditation
David McNaughton
A * , Paul Mara B and Michael Jones A
A
B
Abstract
Accreditation to standards developed by the Royal Australian College of General Practice provides assurance to the community of the quality and safety of general practices in Australia. The objective of this study was to conduct an empirical evaluation of the 5th edition standards. Minimal empirically driven evaluation of the standards has been conducted since their publication in 2020.
Data encompass consecutive Australian general practice accreditation assessments between December 2020 and July 2022 recorded from a single accrediting agency. Met and not met compliance (binary) scores for 124 indicators evaluated at the site visit were recorded. A subset of indicators derived from a selection of existing and consistently non-conformant indicators within each criterion was generated. Concordance between the indicator subset and the criterion was assessed to determine the predictive ability of the indicator subset in distinguishing practices who are conformant to the entire criterion.
A total of 757 general practices were included in the analysis. On average, 113.69 (s.d. = 8.16) of 124 indicators were evaluated as conformant at the site visit. In total, 52 (42%) indicators were required to obtain a true positive conformity rate above 95% for all criterions of the standards. For criterion 1 (General Practice 1) conformity to the entire criterion (nine indicators; >95% true positive rate) could be obtained by including 2/9 indicators (C1-1a and C1-2a).
Our results identified that indicator non-conformity was driven by a small proportion of indicators and identifying a subset of these consistently non-conformant indicators predicted a true positive rate above 95% at the criterion level.
Keywords: accreditation, community standards, general practice, health policy, healthcare, patient safety, practice indicators, quality and safety.
References
1 The Royal Australian College of General Practitioners. Standards for General Practices, 5th edn. RACGP; 2020. Available at https://www.racgp.org.au/running-a-practice/practice-standards/standards-5th-edition/standards-for-general-practices-5th-ed-1
2 Braithwaite J, Greenfield D, Westbrook J, et al. Health service accreditation as a predictor of clinical and organisational performance: a blinded, random, stratified study. Qual Saf Health Care 2010; 19(1): 14-21.
| Crossref | Google Scholar | PubMed |
3 Greenfield D, Braithwaite J. Health sector accreditation research: a systematic review. Int J Qual Health Care 2008; 20(3): 172-183.
| Crossref | Google Scholar | PubMed |
4 The Royal Australian College of General Practitioners. Standards for General Practices, 4th edn. RACGP; 2010. Available at https://www.racgp.org.au/FSDEDEV/media/documents/Running%20a%20practice/Practice%20standards/4th%20edition/Standards-4th-edtion.pdf
5 Khoury J, Krejany CJ, Versteeg RW, et al. A process for developing standards to promote quality in general practice. Fam Pract 2019; 36(2): 166-171.
| Crossref | Google Scholar | PubMed |
6 RACGP. Changes to the RACGP Standards for general practices, 5th edn. 2021. Available at https://www.racgp.org.au/getmedia/c62916d5-1e28-4ad8-a380-7b13fbf52ae2/Changes-to-the-RACGP-Standards-for-general-practices-5th-edition-2.pdf.aspx
7 The Royal Australian College of General Practitioners. General Practice: Health of the Nation 2020. 2020. Available at https://www.racgp.org.au/getmedia/c2c12dae-21ed-445f-8e50-530305b0520a/Health-of-the-Nation-2020-WEB.pdf.aspx
8 MP Consulting. Review of General Practice Accreditation Arrangements. 2021. Available at https://consultations.health.gov.au/primary-health-networks-strategy-branch/review-of-general-practice-accreditation-arrangeme/user_uploads/review-of-the-ngpa-scheme---consultation-paper---final---110821--004-.pdf
9 Jones M, McNaughton D, Mara P. General practice accreditation – does time spent on-site matter? Aust Health Rev 2023; 47(6): 689-693.
| Crossref | Google Scholar | PubMed |
10 Hays R, Miller G, Booth B, Harris B, Harris J, Stirton F. The development of general practice standards in Australia: General practice standards in Australia. Med Educ 1998; 32(2): 199-204.
| Crossref | Google Scholar | PubMed |
11 Mott K, Kidd M, Weller D. Quality and Outcomes in General Practice. General Practice in Australia; 2000. Available at https://www.researchgate.net/profile/Kathy‐Mott‐2/publication/237259847_Quality_and_outcomes_in_general_practice/links/0046353746a606b5f4000000/Quality‐and‐outcomes‐in‐general‐practice.pdf
12 Australian Commission on Safety and Quality in Health Care. National Safety and Quality Primary and Community Healthcare Standards. 2021. Available at https://www.safetyandquality.gov.au/sites/default/files/2021-10/national_safety_and_quality_primary_and_community_healthcare_standards.pdf
13 Sarkies M, Francis-Auton E, Long J, et al. Audit and feedback to reduce unwarranted clinical variation at scale: a realist study of implementation strategy mechanisms. Implement Sci 2023; 18(1): 71.
| Crossref | Google Scholar | PubMed |
14 McNaughton DT, Mara P, Jones MP. The impact of self-assessment and surveyor assessment on site visit performance under the National General Practice Accreditation scheme. Aust Health Rev 2024;
| Crossref | Google Scholar | PubMed |
17 Australian Commission on Safety and Quality in Healthcare. Policy - Approval under the National General Practice Accreditation (NGPA) Scheme to conduct assessments. 2022. Available at https://www.safetyandquality.gov.au/publications-and-resources/resource-library/policy-approval-under-national-general-practice-accreditation-ngpa-scheme-conduct-assessments
18 ACSQHC. Assessment outcomes data and lessons learnt for the NGPA Scheme. 2023. Available at https://www.safetyandquality.gov.au/assessment-outcomes-data-and-lessons-learnt-ngpa-scheme
