Application of ecological momentary assessment in workplace health evaluation
Lina Engelen A B C , Josephine Y. Chau A B , Sarah Burks-Young A B and Adrian Bauman A BA Prevention Research Collaboration, School of Public Health, University of Sydney, Sydney, NSW 2006, Australia.
B The Charles Perkins Centre, University of Sydney, Level 6, Sydney, NSW 2006, Australia.
C Corresponding author. Email: lina.engelen@sydney.edu.au
Health Promotion Journal of Australia 27(3) 259-263 https://doi.org/10.1071/HE16043
Submitted: 6 May 2016 Accepted: 28 July 2016 Published: 31 August 2016
Abstract
Issue addressed: Ecological momentary assessment (EMA) involves repeated sampling of current behaviours and experiences in real-time at random intervals. EMA is an innovative measurement method for program evaluation, using mobile technology (e.g. smartphones) to collect valid contextual health promotion data with good compliance. The present study examined the feasibility of using EMA for measuring workplace health outcomes.
Methods: Twenty-two office-based adults were prompted at four random times per work-day during a 5-day period to respond to a short survey via a smartphone application. The prompting stopped when participants had either responded 12 times or the 5-day period had ended. The questions pertained to posture, task currently being undertaken, social interactions, musculoskeletal issues, mood, and perceptions of engagement and creativity.
Results: In total 156 responses were collected. Nine participants completed all 12 surveys; the average completion rate was 58% (7/12). The average completion time was initially 50 s and reduced to 24 s during the later surveys. On average the participants were sitting and standing in 79% and 14% of survey instances, respectively. The participants reported they were working alone at their desks in 68% of instances. Reported productivity and stress were on average 6 and 3 out of 10, respectively, but varied up to 6–8 points within one person, hence the method appears sensitive to temporal variations in perceptions and mood.
Conclusion: Given the rich real-time data, minimal participant burden and use of readily available technology, EMA has substantial potential in workplace health promotion evaluation through the measurement of participants’ well being, activities, and behaviour change.
So what?: An in-the-moment method using readily available mobile technology to assess participants’ perceptions, mood and activity that provides rich information with minimal participant burden is a promising way to evaluate future health promotion programs.
Key words: experience sampling method, methodology, novel, smartphone.
References
[1] Schulte PA, Guerin RJ, Schill AL, Bhattacharya A, Cunningham TR, Pandalai SP, et al (2015) Considerations for incorporating “well-being” in public policy for workers and workplaces. Am J Public Health 105, e31–e44.| Considerations for incorporating “well-being” in public policy for workers and workplaces.Crossref | GoogleScholarGoogle Scholar | 26066933PubMed |
[2] Cancelliere C, Cassidy JD, Ammendolia C, Côté P (2011) Are workplace health promotion programs effective at improving presenteeism in workers? A systematic review and best evidence synthesis of the literature. BMC Public Health 11, 395
| Are workplace health promotion programs effective at improving presenteeism in workers? A systematic review and best evidence synthesis of the literature.Crossref | GoogleScholarGoogle Scholar | 21615940PubMed |
[3] World Health Organization (WHO). Preventing noncommunicable diseases in the workplace through diet and physical activity. World Economic Forum Report of a Joint Event. 2008. Available at: https://www.mendeley.com/research/preventing-noncommunicable-diseases-workplace-through-diet-physical-activityworld-economic-forun-rep/?utm_source=desktop&utm_medium=1.13.8&utm_campaign=open_catalog&userDocumentId=%7Bc49e660c-8c05-4afe-aee8-0b9155260404%7D [Verified 8 September 2015].
[4] Schwarz N, Kahneman D, Xu J. Global and episodic reports of hedonic experiences. In Belli R, Stafford F, Alwin D, editors. Calendar and time diary methods in life course research (pp. 157–174). Thousand Oaks: Sage; 2009.
[5] Fisher CD, To ML (2012) Using experience sampling methodology in organizational behavior. J Organ Behav 33, 865–77.
| Using experience sampling methodology in organizational behavior.Crossref | GoogleScholarGoogle Scholar |
[6] Beal D. Industrial/organizational psychology. In Mehl M, Conner T, editors. Handbook of research methods for studying daily life (pp. 601–619). New York: Guilford Press; 2011.
[7] Society for Ambulatory Assessment. Complete list of literature 2009–2015. 2015. Available at: http://www.saa2009.org/wp-content/uploads/2016/05/Complete-list-of-literature_2006-2015.pdf [Verified 9 June 2016].
[8] Trull TJ, Ebner-Priemer UW (2009) Using experience sampling methods/ecological momentary assessment (ESM/EMA) in clinical assessment and clinical research: introduction to the special section. Psychol Assess 21, 457–62.
| Using experience sampling methods/ecological momentary assessment (ESM/EMA) in clinical assessment and clinical research: introduction to the special section.Crossref | GoogleScholarGoogle Scholar | 19947780PubMed |
[9] Zirkel S, Garcia JA, Murphy MC (2015) Experience-sampling research methods and their potential for education research. Educ Res 44, 7–16.
| Experience-sampling research methods and their potential for education research.Crossref | GoogleScholarGoogle Scholar |
[10] Alliger GM, Williams KJ (1993) Using signal-contingent experience sampling methodology to study work in the field: a discussion and illustration examining task perceptions and mood. Pers Psychol 46, 525–49.
| Using signal-contingent experience sampling methodology to study work in the field: a discussion and illustration examining task perceptions and mood.Crossref | GoogleScholarGoogle Scholar |
[11] Uy MA, Foo M-D, Aguinis H (2010) Using experience sampling methodology to advance entrepreneurship theory and research. Organ Res Methods 13, 31–54.
| Using experience sampling methodology to advance entrepreneurship theory and research.Crossref | GoogleScholarGoogle Scholar |
[12] Stone A, Shiffman S, Atienza A, Nebeling L. The science of real-time data capture: self-reports in health research. New York: Oxford University Press; 2007.
[13] Hektner J, Schmidt JA, Csikszentmilhayli M. Experience sampling method: measuring the quality of everyday life. Thousand Oaks: Sage Publications; 2007.
[14] Statista. Share of mobile users that use a smartphone in Australia from 2014 to 2019. 2016. Available at: http://www.statista.com/statistics/257041/smartphone-user-penetration-in-australia/ [Verified 1 May 2016].
[15] Runyan JD, Steenbergh TA, Bainbridge C, Daugherty DA, Oke L, Fry BN (2013) A smartphone ecological momentary assessment/intervention “app” for collecting real-time data and promoting self-awareness. PLoS One 8, e71325
| A smartphone ecological momentary assessment/intervention “app” for collecting real-time data and promoting self-awareness.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC3sXhtleru7vK&md5=93d349e2794e072247973fa855092334CAS | 23977016PubMed |
[16] Phillips MM, Phillips KT, Lalonde TL, Dykema KR (2014) Feasibility of text messaging for ecological momentary assessment of marijuana use in college students. Psychol Assess 26, 947–57.
| Feasibility of text messaging for ecological momentary assessment of marijuana use in college students.Crossref | GoogleScholarGoogle Scholar | 24749751PubMed |
[17] Graves LEF, Murphy RC, Shepherd SO, Cabot J, Hopkins ND (2015) Evaluation of sit–stand workstations in an office setting: a randomised controlled trial. BMC Public Health 15, 1145
| Evaluation of sit–stand workstations in an office setting: a randomised controlled trial.Crossref | GoogleScholarGoogle Scholar |
[18] Shiffman S, Stone A, Hufford M (2008) Ecological momentary assessment. Annu Rev Clin Psychol 4, 1–32.
| Ecological momentary assessment.Crossref | GoogleScholarGoogle Scholar | 18509902PubMed |
[19] Ilies R, Judge T (2004) An experience-sampling measure of job satisfaction and its relationships with affectivity, mood at work, job beliefs, and general job satisfaction. Eur J Work Organ Psy 13, 367–89.
| An experience-sampling measure of job satisfaction and its relationships with affectivity, mood at work, job beliefs, and general job satisfaction.Crossref | GoogleScholarGoogle Scholar |