Bullying in the Australian medical workforce: cross-sectional data from an Australian e-Cohort study
Deborah A. Askew A F , Philip J. Schluter B , Marie-Louise Dick A , Patricia M. Régo C , Catherine Turner D and David Wilkinson EA Discipline of General Practice, University of Queensland, Herston, QLD 4072, Australia. Email: m.dick@uq.edu.au
B Department of Public Health and General Practice, University of Otago, Oxford Terrace, Christchurch 8140, New Zealand. Email: Philip.schluter@otago.ac.nz
C Discipline of Medical Education, The University of Queensland, Herston, QLD 4072, Australia. Email: p.rego@uq.edu.au
D School of Nursing and Midwifery, The University of Queensland, Herston, QLD 4072, Australia. Email: c.turner@uq.edu.au
E School of Medicine, The University of Queensland, Herston, QLD 4072, Australia. Email: d.wilkinson@uq.edu.au
F Corresponding author. Email: d.askew@uq.edu.au
Australian Health Review 36(2) 197-204 https://doi.org/10.1071/AH11048
Submitted: 20 May 2011 Accepted: 21 September 2011 Published: 25 May 2012
Journal Compilation © AHHA 2012
Abstract
Objective. This study aimed to describe the prevalence of perceived workplace bullying in the Australian medical workforce, and investigate the relationship between workplace bullying and job satisfaction, health status, and current and planned medical workforce participation.
Methods. An electronic cross-sectional survey of doctors currently in the paid workforce, conducted between April 2008 and October 2009, was nested within a longitudinal cohort study investigating factors affecting the recruitment and retention of the Australian medical workforce. To address the specific aims of this study, a subset of questions in the survey investigated the prevalence of self-reported bullying; physical and mental health; workforce participation patterns; job satisfaction; and job stressors.
Results. Seven hundred and forty-seven participants responded to the bullying question and were included in this analysis. Twenty-five percent of participants reported being bullied in the last 12 months. There were no differences in the reported rates of bullying across age groups, sex and country of medical qualification. Bullied doctors were least satisfied with their jobs (P < 0.001), had taken more sick leave in the last 12 months (P < 0.001), and were more likely to be planning to decrease the number of hours worked in medicine in the next 12 months (P = 0.01) or ceasing direct patient care in the next 5 years (independent of their age or the number of hours currently worked in patient care) (P = 0.006).
Conclusions. Our findings suggest that Australian doctors, independent of age or sex, have experienced workplace bullying, and although no conclusions can be made about causal pathways, there were strong associations between this exposure and poorer health and wellbeing, and on remaining in the medical workforce.
What is known about the topic? Bullying and harassment have a significant impact on mental health, job satisfaction, and intention to leave the workforce. Workplace bullying in healthcare organisations affects the individuals involved, the organisations and the patients. The prevalence of workplace bullying throughout the medical workforce in Australia or elsewhere has not been investigated, with previous studies focussing on subsets of doctors, particularly junior doctors.
What does this paper add? This paper found that 25% of doctors participating in this study reported experiencing persistent behaviours in the last 12 months that had undermined their professional confidence or self-esteem. There were no differences in the prevalence of bullying observed between sexes, age groups, country of medical qualifications, or employment sector. Victims of bullying had poorer mental health, had taken more sick leave in the last 12 months, were less satisfied with their current jobs and with being doctors, were more affected by job stressors and were more likely to be considering ceasing direct patient care than non-bullied doctors.
What are the implications for practitioners? Practitioners need to be alert for potential bullying and harassment within healthcare organisations and be prepared to act decisively to minimise its impact on staff health, satisfaction and retention, and patient quality of care.
Introduction
The World Health Organisation (WHO) recognises that the supply and retention of an appropriately prepared, deployed and supported health workforce is a critical global issue.1 Significant resources are invested into training the health workforce, therefore, it is important to understand and address factors that negatively affect the retention of trained personnel.1 The Doctors’ electronic-Cohort (DeC) Study was established in 2008 to increase understanding about the factors associated with the recruitment and retention of the Australian medical workforce.
Workplace psychosocial factors such as stress, harassment and bullying have a significant impact on mental health, job satisfaction, and intention to leave the workforce.2 Although there is no single, universal definition of workplace bullying, it is generally accepted to be repeated systematic, interpersonal abusive behaviours that negatively affect the targeted individual.3 It is the impact of the bullying behaviour on the victim that is central to the concept of bullying, rendering the intentions of the perpetrator largely irrelevant.3–5
Workplace bullying in healthcare organisations affects the individuals involved, the organisations and the patients.3,6–8 Victims of workplace bullying suffer more psychological distress, greater dissatisfaction with work and life, and are more likely to quit work.3,6,7 At the organisational level, workplace bullying negatively affects staff performance, quality of care and patient satisfaction.3,6 The prevalence of workplace bullying throughout the medical workforce in Australia or elsewhere has not been investigated, with previous studies focussing on subsets of doctors, particularly junior doctors.2,3,9–17 We report here on cross-sectional data gathered through the DeC Study on the prevalence and potential impact of bullying in the Australian medical workforce.
Methods
DeC Study participants
The DeC Study was open for participation to all doctors registered with the Australian Medical Registration Board and all medical students attending an Australian university. This nested cross-sectional study focussed on doctors currently in paid work.
Study design and procedures
The current study was a cross-sectional analysis of data collected through the first measurement wave of the DeC study.
The DeC Study design mirrored the Nurses and Midwives e-Cohort Study (NMeS), taking advantage of the methodological and practical advances made by that study. Details of the NMeS have been reported elsewhere.18–20
Briefly, the DeC Study aimed to be a 5-year cohort study using a purpose-built internet-based survey (see http://doctors.e-cohort.net). Potential participants entered the study website and reviewed information about the study. Following provision of informed consent, participants were automatically directed to the study registration page, where they established a personal profile (username and password) and recorded baseline demographic and contact details. Once registered, participants could access the baseline survey which consisted of up to 120 questions and took between 20 and 40 min to complete. Data were entered on a question-by-question basis so that entered data were saved if a participant suspended the survey or lost their internet connection. At the next login, participants were automatically re-directed to the last question they completed. Participants were unable to peruse the survey questions before commencing it, and were unable to go back to previously answered or unanswered questions.
Regular electronic contact was maintained with participants: a welcome message within 2 weeks of registering; birthday cards; and regular newsletters about progress of the study. Emailed reminders were sent at 2 and 6 weeks after registration to participants who had not completed the survey. Prior to the close of the baseline measurement wave, participants with incomplete surveys were sent additional individualised requests to complete the survey via email and, depending on the available contact details, via mobile phones or personalised letters.
Recruitment
A mix of direct and indirect recruitment strategies were used. Direct recruitment strategies were used when we had contact details of potential participants or when other organisations contacted their members on our behalf. They included: inclusion of a hard-copy invitation with the Queensland Medical Board’s annual registration renewal notice; postcards mailed to all doctors registered in New South Wales and the Australian Capital Territory; email or hard-copy invitations sent to The University of Queensland School of Medicine Alumni members; email invitations sent to all members of the Royal Australian College of General Practitioners (RACGP); and through personal networks. Indirect recruitment strategies included: conference presentations; advertisements and advertorials in print or electronic newsletters of several Medical Colleges, Divisions of General Practice, relevant professional organisations (e.g. Australian Association for Academic Primary Care) and State Government health departments; and promotional materials inserted into conference satchels.
Registration for the DeC Study was open from 24 April 2008 to 30 June 2009. Participants had until 31 October 2009 to complete the baseline survey.
Questionnaire
The questionnaire contained a mix of standardised instruments and instruments adapted purposefully to address the aims of this study. During the development of the survey, feedback was obtained from academic and service doctors to ensure content and face validity, and pilot testing was conducted to ensure data system robustness and integrity, and to maximise the user friendliness of the web-based questionnaire.
Exposure to bullying was assessed by asking participants to respond in the positive or negative to the following question: ‘In the last 12 months, have you been subjected to persistent behaviour by others which has eroded your professional confidence or self esteem?’.2 Participants answering ‘yes’ to this question were then asked to indicate the main source of the undermining, bullying, or harassing behaviours; if they had complained about the bullying; and the main reason for not complaining if they had not done so.
All participants were asked about their current level of medical workforce participation, their field of medicine, workplace setting, employment sector, and absenteeism over the last 12 months for annual leave or illness (their own or others). Participants were asked if they intended to change the number of hours they worked in medicine in the next 12 months (increase, decrease or no change), if they were intending to cease direct patient care in the next 5 years, and the age at which they intended to retire. Questions from the Canadian Physicians Health Study21 assessed job satisfaction and an established job stressor questionnaire was used to assess levels and sources of job-stress.22 Current health status was assessed using the SF-36 (version 2).23 A variety of demographic characteristics, including age, sex, marital status, number of children, year and country of medical qualification, and country of birth were also collected.
Data storage and security
Participants entered their data directly into a structured query language (SQL) database, via the electronic survey. The Study’s website was secured with a Secure Sockets Layer (SSL), which is an encrypted protocol for transmitting private documents via the internet. SSL creates a connection between client and server, through which data can be sent securely. All participants had a unique ID generated automatically at registration.18–20
Data processing and statistical analysis
Data were copied from the SQL database into SAS® software, Version 9.2 (SAS Institute Inc., Cary, NC, USA) where data cleaning was undertaken. Participants were not personally identified in analysis datasets; all datasets included the participant ID only. As the answering of each question was voluntary, the overall number of responses varied for each question. Therefore, when summary statistics were computed and reported, the number of valid responses to each question was also provided. Characteristics of participants were compared with national medical workforce data where possible.24 Means between groups were compared using Student’s t-test and categories compared using Fisher’s exact test. All analyses were undertaken using SAS® software and a significance level of 5% was used.
Ethics
The DeC Study was granted ethical approval by The University of Queensland’s Behavioural and Social Science Ethics Review Committee (2007000349).
Results
A total of 1817 individuals registered for the DeC Study. Of these, 866 were medical students, 151 failed to commence the survey, and 800 were registered doctors representing a response rate of around 1.2% of registered doctors (Australian medical workforce estimated to be 67 208 in 200724). Of the 764 doctors currently in paid work, 747 completed the bullying component of the DeC Study questionnaire and are included in this analysis.
Medical labour force
Table 1 compares the demographic characteristics of our study sample with the Australian medical workforce.24 Our respondents appear representative of the national medical workforce with respect to age, number of hours worked, and country of medical qualification, but not with respect to sex and State or Territory of principal place of work.
Workplace characteristics
Twenty-seven doctors were interns, 549 were specialists (including general practitioners (GPs)) or specialist registrars and 188 were neither interns nor specialists. No further information about the job classification of these 188 doctors is available, and we therefore refer to them as ‘undifferentiated doctors’. Nearly one-third of participating doctors were GPs (31%). Most doctors worked in either a hospital (58%) or a general practice (38%), with half working in the public sector and 30% working in the private, for-profit sector (Table 2).
Bullying
Twenty-five percent of respondents (186/747) reported having been bullied in the last 12 months (Table 3). There were no differences in the prevalence of bullying observed between sexes, age groups, job classifications (interns, specialists (or specialist registrars), or undifferentiated doctors), country of medical qualification, or employment sector.
Consultants, registrars and other senior doctors were the most commonly reported source of the bullying (44%) for all respondents, followed by managers, administrators and clerical staff (27%). There were no differences in the reported source of the bullying between doctors in the different job classifications (P = 0.43), although compared with the other respondents, the undifferentiated doctors were more likely to report being bullied by patients. Respondents were also able to provide free-text responses describing the source of the bullying, and several respondents cited governmental agencies and specialist colleges.
No formal or informal complaint had been made by 58 respondents (31%), mainly because they considered it insufficiently serious or had dealt with it themselves. Undifferentiated doctors were more likely to have not complained because they were afraid of the consequences (Table 3). Of the 128 doctors (69%) who had made either an informal or formal complaint, 24% (31) were satisfied with the outcome of their complaint.
Experience of bullying, workforce participation and health indicators
Workforce participation and health indicators by experience of workplace bullying are presented in Table 4. Victims of bullying had poorer mental health (P < 0.001) and had taken more time off work sick (P < 0.001) in the preceding 12 months than non-bullied respondents. They were also less satisfied with being doctors (P < 0.001), were more likely to be considering decreasing the number of hours they work in medicine in the next 12 months (P = 0.01) and ceasing direct patient care within the next 5 years (P = 0.006). Furthermore, they had higher levels of workplace stress than non-bullied doctors (Table 5).
Discussion
Bullying is occurring in the Australian medical workforce, with 25% of doctors in this study having experienced persistent behaviours in the last 12 months that have undermined their professional confidence or self-esteem. There were no differences in the prevalence of bullying observed between sexes, age groups, country of medical qualifications, or employment sector. Although no conclusions can be made about causal pathways, there were strong associations between reported experiences of bullying and poorer mental health, higher rates of sick leave in the last 12 months, less job and career satisfaction, greater impact of job stressors, and consideration being given to ceasing direct patient care.
The study utilised the internet for survey administration and data collection, thereby increasing the convenience for participants, decreasing costs for the researchers, improving data quality, and enabling rapid analysis and dissemination of findings.25 Much of our questionnaire was developed using existing instruments enabling comparisons with previously-reported research. A major limitation of this study was the low number of participants. However, the embedding of the questions relating to bullying within the broad-based multi-domain questionnaire makes response bias by victims of bullying highly unlikely. Past web-driven population surveys have also generally yielded low to moderate response rates,26 although the deleterious effect of the resulting biases has been argued.27 As with all screening measures that use a sensitive rather than specific measure, we are at risk of including false positives amongst our positive cases. The cross-sectional nature of the data presented here prevents any determination of causality between bullying and mental health, absenteeism, job satisfaction, job stressors and workforce participation. Despite these limitations, our finding that 25% of participants reported being bullied suggests that bullying may be a problem in the Australian medical workforce that requires further investigation.
Our study is the first to examine bullying within a cross-section of a national medical workforce and with 747 respondents, is amongst the largest published studies investigating this issue. Previous studies have investigated the prevalence of bullying in specific sectors of the workforce, including junior doctors,2,11,12,14,17 trainee psychiatrists,10 postgraduate hospital dentists,15 and staff of specific regional health administrations.13,28 However, comparisons between studies are difficult because different definitions of bullying and data collection methods were used. Nonetheless, studies using comparable approaches to ours have reported similar rates of bullying: 18% in junior doctors,2 and 25% in postgraduate hospital dentists.15 Studies investigating the prevalence of bullying generally enquire about perceived victimisation, as we did, or exposure to specific bullying behaviours, or a mix of both approaches.3 But, as the defining characteristic of bullying is the impact of the behaviour on the victim, not the behaviour itself or the intent of the perpetrator,29 simply asking about exposure to specific behaviours without assessing their impact may inflate the prevalence of bullying. Indeed, studies adopting this latter approach reported higher rates of bullying than our study.
Workplace bullying is not unique to the medical workforce, however, its negative impact on the quality and safety of patient care magnifies its harmful consequences in this environment. A recent review of Australian hospitals in one state, initiated after two widely publicised cases of serious medical errors, found that bullying was widespread, with ‘associated intimidation and intolerance of dissent’ contributing to a malfunctioning healthcare system.8,30 The healthcare sector is under stress with increasing recognition that traditional roles and systems for healthcare delivery are no longer appropriate. This has led to rapid and widespread reform throughout the sector, with concomitant confusion and ambiguity about roles and responsibilities and the creation of opportunities for the abuse of power through bullying. Nevertheless, it is every worker’s moral and legal right to a safe and healthy working environment, and an organisation where bullying occurs is not such an environment.31 Organisation-wide anti-bullying policies are required, irrespective of the size or number of employees, that clearly define bullying, identify what is and what is not bullying behaviours, are publicly endorsed by the senior management, provide a safe mechanism for reporting bullying, and include both informal and formal strategies for prompt resolution in a sensitive, rather than punitive, manner.32 This is especially important because the perpetrator may consider his/her behaviour, for example, appropriate disciplinary action or ‘my style of teaching’5 and be unaware of the negative impact on the victim’s ability to function in a professional role in the workplace. Therefore, education and awareness-raising may be an important first measure by alerting the perpetrator of the distress they are causing and facilitating behaviour changes.5
The seriousness and complexity of workplace bullying should not be underestimated. It is important to not confuse bullying with effective supervision which may, at times, include managing poor performance or medical errors. Simply put, the latter is supportive and constructive, whereas the former is undermining and destructive.5 Bullying affects both the victim and the organisation in which it occurs. It has a detrimental impact on the health, performance, productivity and retention of staff, and the safety and satisfaction of patients.6 Although our cross-sectional data are unable to draw any conclusions about causality, an association between bullying and several adverse health measures has been demonstrated. Further research through longitudinal investigations is urgently needed to disentangle the causes and effects of bullying.32 The results of these investigations could enable the development of education programs and policies that address bullying in the medical workforce at four discrete, but interconnected levels: the victims; the perpetrators; the individual organisations; and the entire culture of medicine. With the recognised shortages of doctors in Australia and worldwide, action is required to address this issue that has a detrimental impact on the viability of the Australian medical workforce.
Competing interests
The authors declare there are no competing interests.
Acknowledgements
This research is funded by the Australian Research Council and Queensland Health, in partnership with the Royal Australian College of General Practitioners. These organisations did not have any role in the study design; collection, analysis, and interpretation of data; in the writing of the report; and in the decision to submit this article for publication. All researchers were independent of the funders. We also acknowledge the doctors who participated in our study.
References
[1] World Health Organisation. Working together for health: The World Health Report 2006. Geneva: World Health Organisation, 2006.[2] Paice E, Aitken M, Houghton A, Firth-Cozens J. Bullying among doctors in training: cross sectional questionnaire survey. BMJ 2004; 329 658–9.
| Bullying among doctors in training: cross sectional questionnaire survey.Crossref | GoogleScholarGoogle Scholar |
[3] Bentley T, Catley B, Cooper-Thomas H, Gardner D, O’Driscoll M, Trenberth L. Understanding stress and bullying in New Zealand workplaces, 2009. Available at http://www.massey.ac.nz/massey/fms//Massey%20News/2010/04/docs/Bentley-et-al-report.pdf [verified April 2010].
[4] Rayner C, Hoel H. A summary review of literature relating to workplace bullying. J Community Appl Soc Psychol 1997; 7 181–91.
| A summary review of literature relating to workplace bullying.Crossref | GoogleScholarGoogle Scholar |
[5] Hicks B. Time to stop bullying and intimidation. Hosp Med 2000; 61 428–31.
| 1:STN:280:DC%2BD3cvjsVKisA%3D%3D&md5=2a731bdefe86d0ae4a8c341ddfa7b849CAS |
[6] Martin WF. Is your hospital safe? Disruptive behavior and workplace bullying. Hosp Top 2008; 86 21–8.
| Is your hospital safe? Disruptive behavior and workplace bullying.Crossref | GoogleScholarGoogle Scholar |
[7] McAvoy BR, Murtagh J. Workplace bullying. BMJ 2003; 326 776–7.
| Workplace bullying.Crossref | GoogleScholarGoogle Scholar |
[8] Van Der Weyden MB. In the wake of the Garling inquiry into New South Wales public hospitals: a change of cultures? Med J Aust 2009; 190 51–2.
[9] Ahmer S, Yousafzai AW, Bhutto N, Alam S, Sarangzai AK, Iqbal A. Bullying of medical students in Pakistan: a cross-sectional questionnaire survey. PLoS ONE 2008; 3 e3889
| Bullying of medical students in Pakistan: a cross-sectional questionnaire survey.Crossref | GoogleScholarGoogle Scholar |
[10] Ahmer S, Yousafzai AW, Siddiqi M, Faruqui R, Khan R, Zuberi S. Bullying of trainee psychiatrists in Pakistan: a cross-sectional questionnaire survey. Acad Psychiatry 2009; 33 335–9.
| Bullying of trainee psychiatrists in Pakistan: a cross-sectional questionnaire survey.Crossref | GoogleScholarGoogle Scholar |
[11] Bairy KL, Thirumalaikolundusubramanian P, Sivagnanam G, Saraswathi S, Sachidananda A, Shalini A. Bullying among trainee doctors in Southern India: a questionnaire study. J Postgrad Med 2007; 53 87–90.
| Bullying among trainee doctors in Southern India: a questionnaire study.Crossref | GoogleScholarGoogle Scholar | 1:STN:280:DC%2BD2s3os1Clug%3D%3D&md5=7eec22ddb41f149a464d02afb9535fc4CAS |
[12] Quine L. Workplace bullying in junior doctors: questionnaire survey. BMJ 2002; 324 878–9.
| Workplace bullying in junior doctors: questionnaire survey.Crossref | GoogleScholarGoogle Scholar |
[13] Rutherford A, Rissel C. A survey of workplace bullying in a health sector organisation. Aust Health Rev 2004; 28 65–72.
| A survey of workplace bullying in a health sector organisation.Crossref | GoogleScholarGoogle Scholar |
[14] Scott J, Blanshard C, Child S. Workplace bullying of junior doctors: cross-sectional questionnaire survey. N Z Med J 2008; 121 10–4.
[15] Steadman L, Quine L, Jack K, Felix DH, Waumsley J. Experience of workplace bullying behaviours in postgraduate hospital dentists: questionnaire survey. Br Dent J 2009; 207 379–80.
| Experience of workplace bullying behaviours in postgraduate hospital dentists: questionnaire survey.Crossref | GoogleScholarGoogle Scholar | 1:STN:280:DC%2BD1MjhtVShsg%3D%3D&md5=2e43cb6d83e97f974442cc6311c8546cCAS |
[16] Stebbing J, Mandalia S, Portsmouth S, Leonard P, Crane J, Bower M, Earl H, Quine L. A questionnaire survey of stress and bullying in doctors undertaking research. Postgrad Med J 2004; 80 93–6.
| A questionnaire survey of stress and bullying in doctors undertaking research.Crossref | GoogleScholarGoogle Scholar | 1:STN:280:DC%2BD2c7itV2htg%3D%3D&md5=6cd9335fbe1e0db2ecf0396948c60331CAS |
[17] Cheema S, Ahmad K, Giri S, Kaliaperumal V, Naqvi S. Bullying of junior doctors prevails in Irish health system: a bitter reality. Ir Med J 2005; 98 274–5.
| 1:STN:280:DC%2BD2MnhvFWitQ%3D%3D&md5=c15fb89c3d79261094681a1c3daabf2cCAS |
[18] Huntington A, Gilmour J, Schluter P, Tuckett A, Bogossian F, Turner C. The Internet as a research site: establishment of a web-based longitudinal study of the nursing and midwifery workforce in three countries. J Adv Nurs 2009; 65 1309–17.
| The Internet as a research site: establishment of a web-based longitudinal study of the nursing and midwifery workforce in three countries.Crossref | GoogleScholarGoogle Scholar |
[19] Turner C, Bain C, Schluter PJ, Yorkston E, Bogossian F, McClure R, Huntington A. Cohort profile: the Nurses and Midwives e-Cohort Study – a novel electronic longitudinal study. Int J Epidemiol 2009; 38 53–60.
| Cohort profile: the Nurses and Midwives e-Cohort Study – a novel electronic longitudinal study.Crossref | GoogleScholarGoogle Scholar |
[20] Schluter P, Turner C, Huntington A, Bain C, McClure R. Work/life balance and health: the Nurses and Midwives e-Cohort Study. Int Nurs Rev 2011; 58 28–36.
| 1:STN:280:DC%2BC3M7lslGhug%3D%3D&md5=6e8619097bc0711bf5f1d9bd977a3911CAS |
[21] Frank E, Segura C. Health practices of Canadian physicians. Can Fam Physician 2009; 55 810–1.
[22] Røvik JO, Tyssen R, Hem E, Gude T, Ekeberg O, Moum T, Vaglum P. Job stress in young physicians with an emphasis on the work-home interface: a nine-year, nationwide and longitudinal study of its course and predictors. Ind Health 2007; 45 662–71.
| Job stress in young physicians with an emphasis on the work-home interface: a nine-year, nationwide and longitudinal study of its course and predictors.Crossref | GoogleScholarGoogle Scholar |
[23] Ware J, Kosinski M, Dewey J. How to score Version 2 of the SF-36 Health Survey. Lincoln, RI: Quality Metric Inc.; 2000.
[24] Australian Institute of Health and Welfare. Medical labour force 2007. National health labour force series no. 44. Cat. no. HWL 42. Canberra: AIHW; 2009. Available at http://www.aihw.gov.au/publications/hwl/hwl-45-10723/hwl-45-10723.pdf [verified October 2009].
[25] Smith B, Smith TC, Gray GC, Ryan MA. When epidemiology meets the Internet: web-based surveys in the Millennium Cohort Study. Am J Epidemiol 2007; 166 1345–54.
| When epidemiology meets the Internet: web-based surveys in the Millennium Cohort Study.Crossref | GoogleScholarGoogle Scholar |
[26] Ekman A, Dickman PW, Klint A, Weiderpass E, Litton JE. Feasibility of using web-based questionnaires in large population-based epidemiological studies. Eur J Epidemiol 2006; 21 103–11.
| Feasibility of using web-based questionnaires in large population-based epidemiological studies.Crossref | GoogleScholarGoogle Scholar |
[27] Nohr EA, Frydenberg M, Henriksen TB, Olsen J. Does low participation in cohort studies induce bias? Epidemiology 2006; 17 413–8.
| Does low participation in cohort studies induce bias?Crossref | GoogleScholarGoogle Scholar |
[28] Quine L. Workplace bullying in NHS community trust: staff questionnaire survey. BMJ 1999; 318 228–32.
| Workplace bullying in NHS community trust: staff questionnaire survey.Crossref | GoogleScholarGoogle Scholar | 1:STN:280:DyaK1M7hsFeitA%3D%3D&md5=e42f8a77e630caceb805e91b57679dffCAS |
[29] Dickson D. Bullying in the workplace. Anaesthesia 2005; 60 1159–61.
| Bullying in the workplace.Crossref | GoogleScholarGoogle Scholar |
[30] Skinner CA, Braithwaite J, Frankum B, Kerridge RK, Goulston KJ, on behalf of the Hospital Reform Group Reforming New South Wales public hospitals: an assessment of the Garling inquiry. Med J Aust 2009; 190 78–9.
[31] Australian Human Rights Commission. Good practice, good business: eliminating discrimination and harassment from your workplace – workplace bullying. Available at http://www.humanrights.gov.au/info_for_employers/pdf/7_workplace_bullying.pdf [verified August 5, 2001].
[32] Kieseker R, Marchant T. Workplace bullying in Australia: a review of current conceptualisations and existing research. Australian Journal of Management and Organisational Behaviour 1999; 2 61–75.