A further contribution to the Italian validation of the Burnout Assessment Tool: Measurement invariance in teachers and employees

Carmela Buono, Claudio Giovanni Cortese, Paola Spagnoli

Accepted September 25, 2022

First published December 16, 2022

https://doi.org/10.26387/bpa.2022.00007

Abstract

The Burnout Assessment Tool proposed by Schaufeli, De Witte and Desart (2019) is a recent instrument
for assessing the burnout syndrome. This study aims to investigate the psychometric characteristics of the Italian version of the Burnout Assessment Tool (BAT) and to contribute to the validation of the BAT scale by testing measurement invariance across two Italian samples, teachers and employees and concurrent validity examining the correlation
between burnout and depression. Reliability was also examined. Confirmatory factorial analysis (CFA) was used to test factorial validity on a sample of 554 employees and 226 teachers. Measurement invariance was tested using Multigroups confirmatory factorial analysis (MCGFA). Results supported the factorial validity of the second-order factor model of the BAT. Reliability and concurrent validity were also supported. Finally, the results confirmed that the Italian version of the BAT was invariant across the samples. Results showed that the BAT is a valid and reliable tool to measure the burnout syndrome in the Italian context for teachers and employees. Limitations and suggestions for further research are also discussed.

References

  • AKDEMIR, Ö.A. (2019). The effect of teacher burnout onorganizational commitment in Turkish context. Journal ofEducation and Training Studies, 7 (4), 171-179.

  • ANGELINI, G., BUONOMO, I., BENEVENE, P., CONSIGLIO, P.,ROMANO, L. & FIORILLI, C. (2021). The Burnout AssessmentTool (BAT): A Contribution to Italian validation with teachers’.Sustainability, 13 (16), 9065.

  • ARMON,G.,MELAMED,S.,TOKER,S.,BERLINER,S.&SHAPIRA,I. (2014). Joint effect of chronic medical illness and burnout ondepressive symptoms among employed adults. Health Psychology,33 (3), 264.

  • ARMON, G., SHIROM, A., SHAPIRA, I. & MELAMED, S. (2008).On the nature of burnout-insomnia relationships: A prospectivestudy of employed adults. Journal of Psychosomatic Research, 65(1), 5-12.

  • AYYAGARI, R., GROVER, V. & PURVIS, R. (2011). Technostress:Technological antecedents and implications. MIS Quarterly, 831-858.

  • BAKKER, A.B., DEMEROUTI, E. & DOLLARD, M.F. (2008).How job demands affect partners’ experience of exhaustion:Integrating work-family conflict and crossover theory. Journal ofApplied Psychology, 93 (4), 901.

  • BENTLER, P.M. & BONETT, D.G. (1980). Significance testsand goodness of fit in the analysis of covariance structures.Psychological Bulletin, 88 (3), 588-606.

  • BIANCHI, R., SCHONFELD, I.S. & LAURENT, E. (2015). Burnoutdoes not help predict depression among French school teachers.Scand. J. Work Environ. Health, 41, 565-568.

  • BROWN, T.A. (2015). Confirmatory factor analysis for appliedresearch (2nd ed.). The Guilford Press.

  • BROWN, T.A., & MOORE, M.T. (2012). Confirmatory factoranalysis. In R.H. Hoyle (Ed.), Handbook of structural equationmodeling. The Guilford Press.

  • BYRNE,B.M.(2004).TestingforMultigroupInvarianceUsingAMOSGraphics: A road less traveled. Structural Equation Modeling, 11(2), 272-300.

  • CHEN, F.F. (2007). Sensitivity of goodness of fit indexes tolack of measurement invariance. Struct Equ Modeling: AMultidisciplinary Journal, 14 (3), 464-504.

  • CHEN, F.F. (2008). What happens if we compare chopsticks withforks? The impact of making inappropriate comparisons in cross-cultural research. Journal of Personality and Social Psychology, 95(5), 1005.

  • CHO, Y.N., RUTHERFORD, B.N., FRIEND, S.B., HAMWI, G.A.& PARK, J. (2017). The role of emotions on frontline employeeturnover intentions. Journal of Marketing Theory and Practice, 25(1), 57-68.

  • CONSIGLIO, C., MAZZETTI, G. & SCHAUFELI, W.B. (2021).Psychometric properties of the Italian version of the BurnoutAssessment Tool (BAT). International Journal of EnvironmentalResearch and Public Health, 18 (18), 9469.

  • DE BEER, L.T., SCHAUFELI, W.B., DE WITTE, H., HAKANEN,J.J., SHIMAZU, A., GLASER, J. et al. (2020). Measurementinvariance of the Burnout Assessment Tool (BAT) across sevencross-national representative samples. International Journal ofEnvironmental Research and Public Health, 17 (15), 5604.

  • DIMITROV, D.M. (2010). Testing for factorial invariance in thecontext of construct validation. Measurement and Evaluation inCounseling and Development, 43 (2), 121-149.

  • DYLAG, A., JAWOREK, M., KARWOWSKI, W., KOZUSZNIK,M. & MAREK, T. (2013). Discrepancy between individualand organizational values: Occupational burnout and workengagement among white-collar workers. International Journalof Industrial Ergonomics, 43 (3), 225-231.

  • EATON, L. (2019). Health workforce burn-out. Bulletin of the WorldHealth Organization, 97 (9), 585-586.

  • GEORGE, D. & MALLERY, M. (2010). SPSS for windows step by step:A simple guide and reference (10th ed.). Boston, MA: Pearson.

  • GRAVETTER, F. & WALLNAU, L. (2014). Essentials of statistics forthe behavioral sciences (8th ed.). Belmont, CA: Wadsworth.

  • HAKANEN, J.J., BAKKER, A.B. & SCHAUFELI, W.B. (2006).Burnout and work engagement among teachers. Journal of SchoolPsychology, 43 (6), 495-513.  

  • HOBFOLL, S.E. (2002). Social and psychological resources andadaptation. Review of General Psychology, 6, 307-324.

  • ILO-ORGANIZZAZIONE INTERNAZIONALE DEL LAVORO(2021). Stime e analisi aggiornate sull’impatto del COVID-19 sulmondo del lavoro. https://www.ilo.org/wcmsp5/groups/public/—europe/—ro-geneva/—ilo- rome/documents/publication/wcms_767283.pdf

  • INGERSOLL, R.M. & MAY, H. (2012). The magnitude, destinations,and determinants of mathematics and science teacher turnover.Educational Evaluation and Policy Analysis, 34 (4), 435-464.

  • KIM, H., JI, J. & KAO, D. (2011). Burnout and physical health amongsocial workers: A three-year longitudinal study. Social work, 56(3), 258-268.

  • KORUNKA, C., KUBICEK, B., PASKVAN, M. & ULFERTS, H.(2015). Changes in work intensification and intensified learning:challenge or hindrance demands? Journal of ManagerialPsychology, 30 (7), 786-800.

  • KRISTENSEN, T.S., HANNERZ, H., HØGH, A. & BORG, V.(2005). The Copenhagen Psychosocial Questionnaire: A toolfor the assessment and improvement of the psychosocial workenvironment. Scandinavian Journal of Work, Environment &Health, 438-449.

  • KUBICEK, B., PASKVAN, M. & KORUNKA, C. (2015). Developmentand validation of an instrument for assessing job demands arisingfrom accelerated change: The intensification of job demands scale(IDS). European Journal of Work and Organizational Psychology,24 (6), 898-913.

  • KYRIACOU, C. (2001). Teacher stress: Directions for future research.Educational Review, 53 (1), 27-35.

  • LANE, C. & HOBFOLL, S.E. (1992). How loss affects anger andalienates potential supporters. Journal of Consulting and ClinicalPsychology, 60 (6), 935.

  • LITTLE, T.D., SLEGERS, D.W. & CARD, N.A. (2006). A non-arbitrary method of identifying and scaling latent variables inSEM and MACS models. Structural Equation Modeling, 13 (1),59-72.

  • LOVIBOND, P.F. & LOVIBOND, S.H. (1995). The structure ofnegativeemotionalstates:ComparisonoftheDepressionAnxietyStress Scales (DASS) with the Beck Depression and AnxietyInventories. Behaviour Research and Therapy, 33 (3), 335-343.

  • MÄKIKANGAS, A., LEITER, M.P., KINNUNEN, U. & FELDT,T. (2020). Profiling development of burnout over eight years:relation with job demands and resources. European Journal ofWork and Organizational Psychology, 1-12.

  • MASLACH, C. & JACKSON, S.E. (1981). The measurement ofexperienced burnout. Journal of Organizational Behavior, 2 (2),99-113.

  • MASLACH, C. & LEITER, M.P. (2016). Understanding the burnoutexperience: Recent research and its implications for psychiatry.World Psychiatry, 15 (2), 103-111.

  • MASLACH, C., SCHAUFELI, W.B. & LEITER, M.P. (2001). Jobburnout. Annual Review of Psychology, 52 (1), 397-422.

  • MELAMED, S., SHIROM, A., TOKER, S. & SHAPIRA, I. (2006).Burnout and risk of type 2 diabetes: A prospective study ofapparently healthy employed persons. Psychosomatic Medicine,68 (6), 863-869.

  • MOHREN, D.C., SWAEN, G.M., KANT, I., VAN AMELSVOORT,L.G., BORM, P.J. & GALAMA, J.M. (2003). Common infectionsand the role of burnout in a Dutch working population. Journalof Psychosomatic Research, 55 (3), 201- 208.

  • MOLERO JURADO, M.D.M., PEREZ-FUENTES, M.D.C., ATRIA,L., OROPESA RUIZ, N.F. & GAZQUEZ LINARES, J.J. (2019).Burnout, perceived efficacy, and job satisfaction: Perception ofthe educational context in high school teachers. BioMed ResearchInternational, 1021408.

  • PODSAKOFF, P.M., MacKENZIE, S.B., LEE, J.Y. & PODSAKOFF,N.P. (2003). Common method biases in behavioral research:A critical review of the literature and recommended remedies.Journal of Applied Psychology, 88 (5), 879.

  • ROBINSON,O.P.,BRIDGES,S.A.,ROLLINS,L.H.&SCHUMACKER,R.E. (2019). A study of the relation between special educationburnout and job satisfaction. Journal of Research in SpecialEducational Needs, 19 (4), 295-303.

  • ROSA, H. (Ed.). (2010). High-speed society: Social acceleration, power,and modernity. Pennsylvania: Penn State Press.

  • RUDNEV, M., LYTKINA, E., DAVIDOV, E., SCHMIDT, P. & ZICK,A. (2018). Testing measurement invariance for a second-orderfactor: A cross-national test of the alienation scale. Methods,Data, Analyses: A Journal for Quantitative Methods and SurveyMethodology (MDA), 12 (1), 47-76.

  • SALVAGIONI, D.A.J., MELANDA, F.N., MESAS, A.E., GONZALEZ,A.D., GABANI, F.L. & ANDRADE, S.M.D. (2017). Physical,psychological and occupational consequences of job burnout:A systematic review of prospective studies. PloS one, 12 (10),e0185781.

  • SALVAGIONI, D.A.J., MESAS, A.E., MELANDA, F.N., GONZALEZ,A.D. & DE ANDRADE, S.M. (2022). Burnout and long-termsickness absence from the teaching function: A cohort study.Safety and Health at Work.

  • SCHABRACQ, M.J. (2005). Stress, alienation and shared leadership.Research Companion to Organizational Health Psychology,122-131.

  • SCHAUFELI, W.B., LEITER, M.P. & MASLACH, C. (2009).Burnout: 35 years of research and practice. Career DevelopmentInternational, 14 (3), 204-220.

  • SCHAUFELI, W.B. & ENZMANN, D. (1998). The burnout companionto study and practice: A critical analysis. Philadelphia: Taylor &Francis.

  • SCHAUFELI, W.B., DE WITTE, H. & DESART, S. (2019). ManualBurnout Assessment Tool (BAT). KU Leuven, Belgium:Unpublished internal report.

  • SCHONFELD, I.S. & BIANCHI, R. (2016). Burnout and depression:two entities or one? Journal of Clinical Psychology, 72 (1), 22-37.

  • SPAGNOLI, P., MANUTI, A., BUONO, C. & GHISLIERI, C. (2021).The good, the bad and the blend: The strategic role of the “middleleadership”inwork-family/lifedynamicsduringremoteworking.Behavioral Sciences, 11 (8), 112.

  • SPAGNOLI, P., BUONO, C., KOVALCHUK, L.S., CORDASCO, G.& ESPOSITO, A. (2021). Perfectionism and burnout during theCOVID-19 crisis: A two-wave cross-lagged study. Frontiers inPsychology, 11, 4087.

  • TOKER, S., MELAMED, S., BERLINER, S., ZELTSER, D. &SHAPIRA, I. (2012). Burnout e rischio di malattia coronarica:Uno studio prospettico su 8838 dipendenti. PsychosomaticMedicine, 74, 840-847.

  • VANDENBERG, R.J. & LANCE, C.E. (2000). A review andsynthesis of the measurement invariance literature: Suggestions,practices, and recommendations for organizational research.Organizational Research Methods, 3 (1), 4-70.

  • WHEELER, D.L., VASSAR, M., WORLEY, J.A. & BARNES, L.B.B.(2011). A reliability generalization meta-analysis of coefficientalpha for the Maslach Burnout Inventory. Educ Psychol Measur,71, 231-244.

  • WHO-WORLD HEALTH ORGANIZATION (2019). Burn-out an“occupationalphenomenon”.ICD11.https://www.who.int/news/item/28-05-2019-burn-out-an-occupational-phenomenon-international-classification-of-diseases

SHOW ALL REFERENCES (57)HIDE REFERENCES

Related articles

Article info

Cite the article:

Author Surname Author Initial. Title. Publication Title. Year Published;Volume number(Issue number):Pages Used. doi:DOI Number.


Buono Carmela . Cortese Claudio Giovanni . Spagnoli Paola . A further contribution to the Italian validation of the Burnout Assessment Tool: Measurement invariance in teachers and employees. BPA Applied Psychology Bulletin. 2022;295(1):8-23. doi:10.26387/bpa.295.1.

Citation tool

How to cite this article

Author Surname Author Initial. Title. Publication Title. Year Published;Volume number(Issue number):Pages Used. doi:DOI Number.


Buono Carmela . Cortese Claudio Giovanni . Spagnoli Paola . A further contribution to the Italian validation of the Burnout Assessment Tool: Measurement invariance in teachers and employees. BPA Applied Psychology Bulletin. 2022;295(1):8-23. doi:10.26387/bpa.295.1.