Keywords
Nursing
psychometric properties
validation study
satisfaction
quality of health care
Abstract
Introduction: This study aims to investigate the psychometric properties of the Home Health Care Survey of the Consumer Assessment of Healthcare Providers and System (HHCAHPS) in the Italian context.
Methods: This is a secondary analysis of data from the [blinded for peer review] study. A total of 9,780 patients cared for by home healthcare services completed the HHCAHPS along with a measure of satisfaction for the care received. Structural validity was assessed with a confirmatory analytical approach (CFA). Construct validity was ascertained via hypothesis testing (convergent validity) by correlating the HHCAHPS scores with the scores derived from the measure of patient satisfaction for care. Internal consistency was assessed with the Omega (ω) coefficient.
Results: Structural validity was confirmed, with satisfactory fit indices of the CFA model specified according to the conceptualized three-factor structure (“care of patients”, “communication with the providers”, and “specific care issues”). Construct validity was confirmed with moderate correlations between the level of satisfaction for care and the factors “communication with the providers” (r= 0.39, p <0.001), “care of patients” (r=0.34, p <0.001), and “specific care issues” (r=0.19, p<0.001). Internal consistency was satisfactory for the “specific care issues” factor (ω = 0.81), while it was at the threshold of acceptability for the other factors (ω = 0.60-0.62).
Conclusions: This study shows that the HHCAHPS is valid and sufficiently reliable when tested on the Italian population. Therefore, this tool can be supportive for promoting research and designing interventions to promote patient-centered care within home healthcare settings.
References
Berwick DM, Nolan TW, Whittington J. The triple aim: care, health, and cost. Health Aff (Millwood). 2008;27(3):759–69.
Fatima I, Humayun A, Iqbal U, Shafiq M. Dimensions of service quality in healthcare: a systematic review of literature. International Journal for Quality in Health Care [Internet]. 2019 Feb 1 [cited 2025 Feb 6];31(1):11–29. Available from: https://academic.oup.com/intqhc/article/31/1/11/5037014
Poghosyan L, Norful AA, Fleck E, Bruzzese JM, Talsma A, Nannini A. Primary Care Providers’ Perspectives on Errors of Omission. J Am Board Fam Med [Internet]. 2017 Nov [cited 2025 Feb 6];30(6):733–42. Available from: http://www.jabfm.org/lookup/doi/10.3122/jabfm.2017.06.170161
Bagnasco A, Alvaro R, Lancia L, Manara DF, Zega M, Rocco G, Rasero L, Mazzoleni B, Sasso L. Protocol for evaluating quality and safety for the public through home care nursing in Italy: a multicentre cross-sectional descriptive observational study (AIDOMUS-IT). BMJ Open. 2023 May 18;13(5):e071155.
Rudnicka E, Napierała P, Podfigurna A, Męczekalski B, Smolarczyk R, Grymowicz M. The World Health Organization (WHO) approach to healthy ageing. Maturitas. 2020 Sep;139:6–11.
Institute of Medicine (US) Committee on Quality of Health Care in America. Crossing the Quality Chasm: A New Health System for the 21st Century [Internet]. Washington (DC): National Academies Press (US); 2001 [cited 2025 Feb 6]. Available from: http://www.ncbi.nlm.nih.gov/books/NBK222274/
Bastemeijer CM, Boosman H, van Ewijk H, Verweij LM, Voogt L, Hazelzet JA. Patient experiences: a systematic review of quality improvement interventions in a hospital setting. Patient Relat Outcome Meas [Internet]. 2019 May 21 [cited 2025 Feb 6];10:157–69. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6535098/
Godovykh M, Pizam A. Measuring patient experience in healthcare. International Journal of Hospitality Management [Internet]. 2023 Jul 1 [cited 2025 Feb 6];112:103405. Available from: https://www.sciencedirect.com/science/article/pii/S0278431922002717
Martínez JA, Martínez L. Some insights on conceptualizing and measuring service quality. Journal of Retailing and Consumer Services [Internet]. 2010 Jan [cited 2025 Feb 5];17(1):29–42. Available from: https://linkinghub.elsevier.com/retrieve/pii/S0969698909000733
Brady MK, Cronin JJ. Some New Thoughts on Conceptualizing Perceived Service Quality: A Hierarchical Approach. Journal of Marketing [Internet]. 2001 Jul [cited 2025 Feb 6];65(3):34–49. Available from: https://journals.sagepub.com/doi/10.1509/jmkg.65.3.34.18334
Dagger TS, Sweeney JC, Johnson LW. A Hierarchical Model of Health Service Quality: Scale Development and Investigation of an Integrated Model. Journal of Service Research [Internet]. 2007 Nov [cited 2025 Feb 5];10(2):123–42. Available from: https://journals.sagepub.com/doi/10.1177/1094670507309594
Goldstein E, Farquhar M, Crofton C, Darby C, Garfinkel S. Measuring Hospital Care from the Patients’ Perspective: An Overview of the CAHPS® Hospital Survey Development Process. Health Services Research [Internet]. 2005 Dec [cited 2025 Feb 5];40(6p2):1977–95. Available from: https://onlinelibrary.wiley.com/doi/10.1111/j.1475-6773.2005.00477.x
O’Malley AJ, Zaslavsky AM, Hays RD, Hepner KA, Keller S, Cleary PD. Exploratory Factor Analyses of the CAHPS® Hospital Pilot Survey Responses across and within Medical, Surgical, and Obstetric Services. Health Services Research [Internet]. 2005 Dec [cited 2025 Feb 5];40(6p2):2078–95. Available from: https://onlinelibrary.wiley.com/doi/10.1111/j.1475-6773.2005.00471.x
Centers for Medicare & Medicaid Services. Home Health Consumer Assessment of Healthcare Providers and Systems Survey (HHCAHPS) [Internet]. 2025 [cited 2025 Feb 5]. Available from: https://homehealthcahps.org/General-Information/About-Home-Health-Care-CAHPS-Survey
Rudnicka E, Napierała P, Podfigurna A, Męczekalski B, Smolarczyk R, Grymowicz M. The World Health Organization (WHO) approach to healthy ageing. Maturitas [Internet]. 2020 Sep [cited 2025 Feb 6];139:6–11. Available from: https://linkinghub.elsevier.com/retrieve/pii/S0378512220302826
Gagnier JJ, Lai J, Mokkink LB, Terwee CB. COSMIN reporting guideline for studies on measurement properties of patient-reported outcome measures. Qual Life Res. 20210405th ed. 2021 Aug;30(8):2197–218.
Terwee CB, Prinsen CAC, Chiarotto A, Westerman MJ, Patrick DL, Alonso J, Bouter LM, de Vet HCW, Mokkink LB. COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Qual Life Res. 2018 May;27(5):1159–70.
Lynn MR. Determination and quantification of content validity. Nurs Res. 1986 Dec;35(6):382–5.
Forero C, Maydeu-Olivares A, Gallardo-Pujol D. Factor Analysis with Ordinal Indicators: A Monte Carlo Study Comparing DWLS and ULS Estimation. Structural Equation Modeling. 2009 Oct;16:625–41.
Wang J, Wang X. Confirmatory factor analysis. In: Structural Equation Modeling [Internet]. John Wiley & Sons, Ltd; 2019 [cited 2025 Feb 7]. p. 33–117. Available from: https://onlinelibrary.wiley.com/doi/abs/10.1002/9781119422730.ch2
Bolcato M, Sanavio M, Fassina G, Rodriguez D, Aprile A. Healthcare professionals and patient information: a fresh look from the new italian law on consent. Clin Ter. 2021 Mar 15;172(2):104–8.
Schmitt N. Uses and Abuses of Coefficient Alpha. Psychological Assessment. 1996 Dec;8:350.
Azizam NA, Shamsuddin K. Healthcare Provider-Patient Communication: A Satisfaction Study in the Outpatient Clinic at Hospital Kuala Lumpur. Malays J Med Sci. 2015 Jun;22(3):56–64.
Ngantcha P, Amith M, Tao C, Roberts K. Patient-Provider Communication Training Models for Interactive Speech Devices. Digit Hum Model Appl Health Saf Ergon Risk Manag (2021). 2021;12777:250–68.
Jenstad LM, Howe T, Breau G, Abel J, Colozzo P, Halas G, Mason G, Rieger C, Simon L, Strachan S. Communication between healthcare providers and communicatively-vulnerable patients with associated health outcomes: A scoping review of knowledge syntheses. Patient Educ Couns. 2024 Feb;119:108040.
Lord L, Gale N. Subjective experience or objective process: understanding the gap between values and practice for involving patients in designing patient-centred care. J Health Organ Manag. 2014;28(6):714–30.
Kuipers SJ, Cramm JM, Nieboer AP. The importance of patient-centered care and co-creation of care for satisfaction with care and physical and social well-being of patients with multi-morbidity in the primary care setting. BMC Health Serv Res. 2019 Jan 8;19(1):13.
Yu C, Xian Y, Jing T, Bai M, Li X, Li J, Liang H, Yu G, Zhang Z. More patient-centered care, better healthcare: the association between patient-centered care and healthcare outcomes in inpatients. Front Public Health. 2023;11:1148277.