Strike a match on my burnout perceptions: Evidence on the validity of measuring burnout through a visual scale in Italy

Arianna Costantini, Michela Vignoli, Lorenzo Avanzi

First published October 18, 2024

https://doi.org/10.26387/bpa.2024.00013

Abstract

This research investigates the validity of the Matches visual burnout scale in Italy, examining convergent,
criterion, incremental, and predictive validity, test−retest reliability, and sociodemographic differences. Study 1, involving
1241 Italian employees, supports convergent validity with the Italian version of the Copenhagen Burnout Inventory (CBI).
Person−centered analyses reveal similarities in employees’ profiles using both measures. Criterion validity is partially
confirmed by significant correlations with workaholism, task, and contextual performance. However, person−centered
analyses highlight differences in the nomological network of burnout across profiles estimated with different burnout
assessments. The Matches measure shows incremental validity over the CBI in predicting work engagement and task
performance. Yet, sociodemographic differences are inconsistent between the Matches measure and the CBI. Study 2,
with 564 employees, indicates strong test−retest reliability of the Matches measure. Additionally, the Matches measure
significantly predicts subsequent self−rated health.

References

  • ASPAROUHOV, T., & MUTHÉN, B. (2021). Auxiliary variables in mixture modeling: Using the BCH method in Mplus to estimate a distal outcome model and an arbitrary second model. MplusWeb Notes. No. 21, version 11.

  • AVANZI, L., BALDUCCI, C., & FRACCAROLI, F. (2013). Contributo alla validazione italiana del Copenhagen Burnout Inventory (CBI). Psicologia della Salute, 2, 120−135.

  • BAKKER, A.B., DEMEROUTI, E., & SANZ−VERGEL, A.I. (2014). Burnout and work engagement: The JD−R approach. Annual Review of Organizational Psychology and Organizational Behavior, 1, 389−411.

    doi.org/10.1146/annurev−orgpsych−031413−091235
  • BALDUCCI, C., ALESSANDRI, G., ZANIBONI, S., AVANZI, L., BORGOGNI, L., & FRACCAROLI, F. (2021). The impact of workaholism on day−level workload and emotional exhaustion, and on longer−term job performance. Work & Stress, 35, 6−26.

    doi.org/10.1080/02678373.2020.1735569
  • BALDUCCI, C., FRACCAROLI, F., & SCHAUFELI, W.B. (2010). Psychometric properties of the Italian version of the Utrecht Work Engagement Scale (UWES−9). European Journal of Psychological Assessment, 26, 143−149.

    psycnet.apa.org/doi/10.1027/1015−5759/a000020
  • BARR, C.D., SPITZMÜLLER, C., & STUEBING, K.K. (2008). Too stressed out to participate? Examining the relation between stressors and survey response behavior. Journal of Occupational Health Psychology, 13, 232−243.

    doi.org/10.1037/1076−8998.13.3.232
  • BUONO, C., SPAGNOLI, P., CLARK, M., HAYNES, N.J., MOLINARO, D., & BALDUCCI, C. (2024). A further examination of the Multidimensional Workaholism Scale (MWS) in Italy and US: Measurement equivalence, convergent, discriminant,and predictive validity. Journal of Personality Assessment, 106,384−395.

    doi.org/10.1080/00223891.2023.2276268
  • CLARK, M.A., SMITH, R.W., & HAYNES, N.J. (2020). The Multidimensional Workaholism Scale: Linking the conceptualization and measurement of workaholism. Journal of Applied Psychology, 105, 1281−1307.

    doi.org/10.1037/apl0000484
  • DEMEROUTI, E., BAKKER, A.B., NACHREINER, F., & SCHAUFELI, W.B. (2001). The job demands−resources model of burnout. Journal of Applied Psychology, 86, 499−512.

    doi.org/10.1037/0021−9010.86.3.499
  • FERGUSON, S.L., MOORE, G.E.W., & HULL, D.M. (2019). Finding latent groups in observed data: A primer on latent profile analysis in Mplus for applied researchers. International Journal of Behavioral Development, 44 (5), 458–468.

    https:/doi.org/10.1177/0165025419881721
  • GABRIEL, A.S., PODSAKOFF, N.P., BEAL, D.J., SCOTT, B.A., SONNENTAG, S., TROUGAKOS, J.P., & BUTTS, M.M. (2019). Experience sampling methods: A discussion of critical trends and considerations for scholarly advancement. Organizational Research Methods, 22, 969−1006.

    doi.org/10.1177/1094428118802626
  • HEINEMANN, L.V., & HEINEMANN, T. (2017). Burnout research: Emergence and scientific investigation of a contested diagnosis. SAGE Open, 7, 1−12.

    doi.org/10.1177/2158244017697154
  • HINKIN, T.R. (2005). Scale development: Principles and practices. In R.A. Swanson & E.F. Holton (Eds.), Research in organizations: Foundations and methods in inquiry. Berrett−Koehler Publishers.

  • HOWARD, M.C., & HOFFMAN, M.E. (2018). Variable-centered,person-centered, and person-specific approaches: Where theory meets the method. Organizational Research Methods, 21, 846–876.

  • JENSEN, M.T., & KNUDSEN, K. (2017). A two−wave cross−lagged study of business travel, work−family conflict, emotional exhaustion, and psychological health complaints. European Journal of Work and Organizational Psychology, 26, 30−41.

    doi.org/10.1080/1359432X.2016.1197206
  • JUNG, T., & WICKRAMA, K. (2008). An introduction to latent class growth analysis and growth mixture modeling. Social and Personality Psychology Compass, 2, 302–317.

  • KOOPMANS, L., BERNAARDS, C.M., HILDEBRANDT, V.H., DEVET, H.C., & VAN DER BEEK, A.J. (2014). Construct validity of the individual work performance questionnaire. Journal of Occupational and Environmental Medicine, 56, 331−337.

    doi.org/10.1097/jom.0000000000000113
  • KRISTENSEN, T.S., BORRITZ, M., VILLADSEN, E., & CHRISTENSEN, K.B. (2005). The Copenhagen Burnout Inventory: A new tool for the assessment of burnout. Work & Stress, 19, 192−207.

  • KUNIN, T. (1998). The construction of a new type of attitude measure. Personnel Psychology, 51, 823−824.

    doi.org/10.1111/j.1744−6570.1998.tb00739.
  • LEE, R.T., & ASHFORTH, B.E. (1996). A meta−analytic examination of the correlates of the three dimensions of job burnout. Journal of Applied Psychology, 81, 123−133.

    doi.org/10.1037/0021−9010.81.2.123
  • LEITER, M.P., & MASLACH, C. (2016). Latent burnout profiles: A new approach to understanding the burnout experience. Burnout Research, 3, 89−100.

    dx.doi.org/10.1016/j.burn.2016.09.001
  • MÄKIKANGAS, A., HYVÖNEN, K., & FELDT, T. (2017). The energy and identification continua of burnout and work engagement: Developmental profiles over eight years. Burnout Research, 5,44−54.

    doi.org/10.1016/j.burn.2017.04.002
  • MASLACH, C., & JACKSON, S.E. (1981). The measurement of experienced burnout. Journal of Organizational Behavior, 2,99−113.

    doi.org/10.1002/job.4030020205
  • MASLACH, C., & LEITER, M.P. (2008). Early predictors of job burnout and engagement. Journal of Applied Psychology, 93,498−512.

    doi.org/10.1037/0021−9010.93.3.498
  • NYLUND, K. L., ASPAROUHOV, T., & MUTHÉN, B.O. (2007). Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling, 14 (4), 535–569.

    https:/doi.org/10.1080/10705510701575396
  • SCHAUFELI, W.B., & ENZMANN, D. (1998). The burnout companion to study and practice: A critical analysis. London: Taylor & Francis.

  • SCHAUFELI, W.B., & GREENGLASS, E.R. (2001). Introduction to special issue on burnout and health. Psychology & Health, 16, 501−510.

    doi.org/10.1080/08870440108405523
  • SCHAUFELI, W.B., SALANOVA, M., GONZÁLEZ−ROMÁ, V., & BAKKER, A.B. (2002). The measurement of engagement and burnout: A two sample confirmatory factor analytic approach. Journal of Happiness Studies, 3, 71−92.

    doi.org/10.1023/A:1015630930326
  • SPURK, D., HIRSCHI, A., WANG, M., VALERO, D., & KAUFFELD,S. (2020). Latent profile analysis: A review and “how to”guide of its application within vocational behavior research. Journal of Vocational Behavior, 120, 103445.

    doi.org/10.1016/j.jvb.2020.103445
  • WORLD HEALTH ORGANIZATION (1996). Statistics Netherlands. Health interview surveys: Towards international harmonization of methods and instruments, vol. 58. Copenhagen: WHO Regional Office for Europe, WHO Regional Publications, European; 1996.

  • WORLD HEALTH ORGANIZATION (2019). ICD−11: International classification of diseases (11th revision).

  • ZAPATA, C.P.M., CALDERWOOD, C., & BONCOEUR, O.D. (2022). Matches measure: A visual scale of job burnout. Journal of Applied Psychology, 108 (6), 977−1000.

    doi.org/10.1037/apl0001053
  • ROSSI, C. (2023, October 10). Lavoro, tre italiani su quattro hanno avuto almeno un sintomo del burnout. la Repubblica. https://www.repubblica.it/economia/2023/10/10/news/lavoro_italiani_burnout_ufficio−417422482/

SHOW ALL REFERENCES (33)HIDE REFERENCES

Related articles

Article info

Cite the article:

Author Surname Author Initial. Title. Publication Title. Year Published;Volume number(Issue number):Pages Used. doi:DOI Number.


Costantini Arianna . Vignoli Michela . Avanzi Lorenzo . Strike a match on my burnout perceptions: Evidence on the validity of measuring burnout through a visual scale in Italy. BPA Applied Psychology Bulletin. 2024;17. doi:10.26387/bpa.bpa.2024.00013.