Abstract
Introduction
The introduction of process innovations in healthcare organizations faces challenges in knowledge sharing and incorporating best practices due to a strong professional autonomy, leading to resistance to change. The healthcare paradigm is shifting towards value-based organizations with a patient-centered approach, requiring multidisciplinary care. Change management is crucial, but current approaches are often limited. This study proposes a conceptual framework to support change management in healthcare services redesign.
Methods
The proposed conceptual framework was developed applying Jabareen's multidimensional and multi-method approach. The methodology involved 8 steps consisting in literature review, thematic and content analyses, concepts deconstruction and aggregation, graphical design of the framework, external validation and revision.
Results
The framework integrates 53 evidences from the literature, 3 macro areas of interest and 42 change management models applied to the healthcare context, through 244 implementation actions. Aggregation of concepts led to 15 macro topics applicable to all levels of change and composing the proposed framework. Interviews validated the framework, emphasizing the importance of people-focused approaches and addressing resistance to change. Moreover, steps most and less cited in the literature are highlighted and differences between developed countries and economies in transition or developing countries are explored.
Conclusions
The article proposes a 15-step framework for change in healthcare services redesign. It integrates evidence from literature and change management models, emphasizing stakeholder involvement. A case study in South Africa highlights the importance of awareness, planning, communication, training, and continuous review. Further validation and adaptation are recommended.
References
Antwi M, Kale M. Change management in healthcare. The Monieson Centre for Business Research in Healthcare, Vol. 1 No. 30. 2014. OCLC Number: 905858789.
Mintzberg H. Structure in fives: Designing effective organizations, Englewood Cliffs, NJ: Prentice-Hall. 1983. ISBN-13: 978-0138554798.
Lipsitz LA. Understanding health care as a complex system: the foundation for unintended consequences. JAMA. 2012;308(3):243-244. Doi: 10.1001/jama.2012.7551.
WHO - World Health Organization. People-centred and integrated health services: an overview of the evidence: interim report. World Health Organization. 2015. https://apps.who.int/iris/handle/10665/155004.
Silvola S, Restelli U, Bonfanti M, Croce D. Co-Design as Enabling Factor for Patient-Centred Healthcare: A Bibliometric Literature Review. Clinicoecon Outcomes Res. 2023;15:333-347. Doi: https://doi.org/10.2147/CEOR.S403243.
Allen B. Effective design, implementation, and management of change in healthcare. Nurs Stand. 2016 Sep 14;31(3):58-71. Doi: 10.7748/ns.2016.e10375.
Beasley L, Grace S, Horstmanshof L. Responding and adapting to change: an allied health perspective. Leadersh Health Serv (Bradf Engl). 2020 Jul 23;33(4):339-349. Doi: 10.1108/LHS-07-2019-0050.
Harrison R, Fischer S, Walpola RL, Chauhan A, Babalola T, Mears S, Le-Dao H. Where Do Models for Change Management, Improvement and Implementation Meet? A Systematic Review of the Applications of Change Management Models in Healthcare. J Healthc Leadersh. 2021 Mar 12;13:85-108. Doi: 10.2147/JHL.S289176.
Lukas CV, Holmes SK, Cohen AB, Restuccia J, Cramer IE, Shwartz M, Charns MP. Transformational change in health care systems: an organizational model. Health Care Manage Rev. 2007 Oct-Dec;32(4):309-20. Doi: 10.1097/01.HMR.0000296785.29718.5d.
Al-Haddad S, Kotnour T. Integrating the organisational change literature: a model for successful change. Journal of Organizational Change Management. 2015; 28(2):234-262. Doi: 10.1108/JOCM-11-2013-0215.
United Nations. World economic situation and prospects. 2023.
Jabareen Y. Building a Conceptual Framework: Philosophy, Definitions, and Procedure. Int J Qual Methods. 2009; 8(4):49–62. Doi: 10.1177/160940690900800406.
Miles MB, Huberman AM, Saldana J. Qualitative Data Analysis: A Methods Sourcebook. London: SAGE Publications, 2014. ISBN-13: 978-1506353074.
Likert R. A technique for the measurement of attitudes. Arch Psychology. 1932;22(140):55.
Armenakis AA, Harris S, Feild H. Paradigms in organizational change: Change agent and change target perspectives. In R. Golembiewski (Ed.), Handbook of organizational behavior. New York: Marcel Dekker. 1999a. ISBN: 9780429271366.
Armenakis AA, Bedeian AG. Organizational change: a review of theory and research in the 1990s. Journal of Management. 1999b;25(3)293-315. Doi: 10.1177/014920639902500303.
Beckhard R, Harris RT. Organizational Transitions: Managing Complex Change, 2nd ed. MA: Addison-Wesley. 1987. ISBN-13: 9780201108873.
Schein E. Models and tools for stability and change in human systems. The Sol Journal, Vol. 4 No. 2, pp. 34-46. 2002. Doi: 10.1162/152417302762251327.
Beer M, Eisenstat RA, Spector B. Why change programs don’t produce change. Harvard Business Review. 1990;68(6):158-166.
Boyatzis RE. An overview of intentional change from a complexity perspective. Journal of Management Development. 2006; 25(7):607-623. Doi: 10.1108/02621710610678445.
Stoller JK. Implementing change in respiratory care. Respir Care. 2010 Jun;55(6):749-57.
Bullock R, Batten D. It's just a phase we're going through: a review and synthesis of OD phase analysis. Group & Organization Management, 1985. 10(4): p. 383-412. Doi: 10.1177/105960118501000403.
Chen CK, Yu CH, Chang HC. ERA model: a customer-orientated organizational change model for the public service. Total Quality Management & Business Excellence. 2006;17(10):1301-1322. Doi: 10.1080/14783360600753794.
Conner D. Leading at the Edge of Chaos: How to Create the Nimble Organization. John Wiley, New York, NY. 1998. ISBN-13: 978-0471295570.
Davenport TH. Process Innovation: Reengineering Work Through Information Technology. Harvard Business Press. 1993. ISBN-13: 978-0875843667.
Deming WE. The New Economics. Massachusetts Institute of Technology Press. 1993. ISBN: 9780262541169.
Deming WE. Out of the crisis. Massachusetts Inst. of Technology, Center for Advanced Eng. Study. 1986. ISBN: 9780262541152.
Gazarin M, Ingram-Crooks J, Hafizi F, Hall L, Weekes K, Casselman C, Burnett S, Lennard M, Pinches A, Tse D. Improving urinary catheterisation practices in a rural hospital in Ontario. BMJ Open Qual. 2020 Feb;9(1):e000703. Doi: 10.1136/bmjoq-2019-000703.
Dickson GS, Canadian Health Services Research Foundation, Canadian Electronic Library. Evidence-informed change management in Canadian healthcare organizations. Canadian Health Services Research Foundation. 2012. ISBN: 978-1-927024-57-7.
Galpin TJ. The Human Side of Change: A Practical Guide to Organization Redesign, 1st ed., Jossey-Bass Publishers, San Francisco, CA. 1996. ISBN-13: 978-0787902162.
Garvin DA. Learning in Action: A Guide to Putting the Learning Organization to Work. Boston, Harvard Business School Press. 2000.ISBN-13: 978-1591391906.
Detwiller M, Petillion W. Change management and clinical engagement: critical elements for a successful clinical information system implementation. Comput Inform Nurs. 2014 Jun;32(6):267-73; quiz 274-5. Doi: 10.1097/CIN.0000000000000055.
Grenny J, Patterson K, Maxfield D, McMillan R, Al Switzler. the new science of leading change. New York: McGraw-Hill Education, 2013. ISBN-13: 978-0071808866.
Hamel G. Leading the Revolution, Harvard Business School Press, Boston, MA. 2000. ISBN-13: 978-1578511891.
Hiatt JM, Creasey TJ. Change Management: The People Side of Change. Fort Collins, CO: Prosci Inc. 2012. ISBN-13: 978-1930885615.
Balluck J, Asturi E, Brockman V. Use of the ADKAR® and CLARC ® Change Models to Navigate Staffing Model Changes During the COVID-19 Pandemic. Nurse Lead. 2020 Dec;18(6):539-546. Doi: 10.1016/j.mnl.2020.08.006
Hiatt JM. ADKAR: A Model for Change in Business, Government, and Our Community. Prosci Inc. 2006. ISBN-13: 78-1930885509.
Hinings CR, Greenwood R. The dynamics of strategic change. B. Blackwell. 1989.
Hord SM, Rutherford WL, Luling-Austin L, Hall GE. Taking charge of change. Alexandria, VA.: Association for Supervision and Curriculum Development. 1987.
Lin MCJ, Hughes B, Katica M, Dining-Zuber C, Plsek P. Service design and change of systems: human-centered approaches to implementing and spreading service design. Int J Design. 2011;5(2):73–86. ISBN-13: 978-0871201447.
IHI - Institute for Healthcare Improvement. Triple Aim: Concept Design. 2009.
IMA - Implementing Management Association. Leading People Through Business Changes: How the Accelerating Implementation Methodology (AIM) Improves Business Outcomes. White Paper. https://www.imaworldwide.com/white-paper-leading-people-through-business-changes?hsCtaTracking=73685e9c-6fac-489a-959e-68224eadbe3d%7Cd5ed55bf-34be-42f1-b0b1-7bd5e84d50e8.
Spira C, Kwizera A, Jacob S, Amongin D, Ngonzi J, Namisi CP, Byaruhanga R, Rushwan H, Cooper P, Day-Stirk F, Berrueta M, García-Elorrio E, Belizán JM. Improving the quality of maternity services in Uganda through accelerated implementation of essential interventions by healthcare professional associations. Int J Gynaecol Obstet. 2017 Oct;139(1):107-113. Doi: 10.1002/ijgo.12241.
Spira C, Dhital R, Jacob S, Dangal G, Gurung G, Prasad Shrestha L, Prasad Bista K, Bajracharya K, Bajrachayra L, Baral G, Maiya Kaway N, Rushawn H, Cooper P, Day-Stirk F, Berrueta M, Gibbons L, García-Elorrio E, Belizán JM. Improving the quality of maternity services in Nepal through accelerated implementation of essential interventions by healthcare professional associations. Int J Gynaecol Obstet. 2018 Dec;143(3):379-386. Doi: 10.1002/ijgo.12678.
Infoway CH. A Framework and Toolkit for Managing eHealth Change: People and Processes. Canada Health Infoway. 2013.
Judson AS. Changing Behavior in Organizations: Minimizing Resistance to Change. Blackwell Business, Cambridge, Mass. 1991. ISBN-13: 978-0631178033.
Kanter RM, Stein B, Jick T. The Challenge of Organizational Change: How Companies Experience it and Leaders Guide it. Free Press/Maxwell Macmillan Canada/ Maxwell Macmillan International, New York, NY/Toronto/New York, NY. 1992. ISBN-13: 978-0029169919
Spence Laschinger HK, Gilbert S, Smith LM, Leslie K. Towards a comprehensive theory of nurse/patient empowerment: applying Kanter's empowerment theory to patient care. J Nurs Manag. 2010 Jan;18(1):4-13. doi: 10.1111/j.1365-2834.2009.01046.x.
Todnem R. Organisational change management: a critical review. Journal of Change Management. December 2005;5(4):369-380. Doi: 10.1080/14697010500359250
Kanter RM. Challenge of organizational change: How companies experience it and leaders guide it. 2003. ISBN-13: 978-0029169919
Kemmis S, McTaggart R. Participatory action research: communicative action and the public sphere. In: Denzin, Norman K., and Lincoln, Yvonna S., (eds.) The Sage Handbook of Qualitative Research. Sage Publications, Thousand Oaks, California, USA. 2005;559-603. ISBN-13: 978-1412974172.
Kotter JP, Cohen, DS. The Heart Of Change, Bucuresti, Ed. Meteor Press, 2008. ISBN-13: 978-1422187333.
Andersen SE, Knudsen JD; Bispebjerg Intervention Group. A managed multidisciplinary programme on multi-resistant Klebsiella pneumoniae in a Danish university hospital. BMJ Qual Saf. 2013 Nov;22(11):907-15. Doi: 10.1136/bmjqs-2012-001791.
Baloh J, Zhu X, Ward MM. Implementing team huddles in small rural hospitals: How does the Kotter model of change apply? J Nurs Manag. 2018 Jul;26(5):571-578. Doi: 10.1111/jonm.12584.
Bousquet J, Hellings PW, Agache I, Amat F, Annesi-Maesano I, Ansotegui IJ, Anto JM, Bachert C, Bateman ED, Bedbrook A, Bennoor K, Bewick M, Bindslev-Jensen C, Bosnic-Anticevich S, Bosse I, Brozek J, Brussino L, Canonica GW, Cardona V, Casale T, Cepeda Sarabia AM, Chavannes NH, Cecchi L, Correia de Sousa J, Costa E, Cruz AA, Czarlewski W, De Carlo G, De Feo G, Demoly P, Devillier P, Dykewicz MS, El-Gamal Y, Eller EE, Fonseca JA, Fontaine JF, Fokkens WJ, Guzmán MA, Haahtela T, Illario M, Ivancevich JC, Just J, Kaidashev I, Khaitov M, Kalayci O, Keil T, Klimek L, Kowalski ML, Kuna P, Kvedariene V, Larenas-Linnemann D, Laune D, Le LTT, Carlsen KL, Lourenço O, Mahboub B, Mair A, Menditto E, Milenkovic B, Morais-Almeida M, Mösges R, Mullol J, Murray R, Naclerio R, Namazova-Baranova L, Novellino E, O'Hehir RE, Ohta K, Okamoto Y, Okubo K, Onorato GL, Palkonen S, Panzner P, Papadopoulos NG, Park HS, Paulino E, Pawankar R, Pfaar O, Plavec D, Popov TA, Potter P, Prokopakis EP, Rottem M, Ryan D, Salimäki J, Samolinski B, Sanchez-Borges M, Schunemann HJ, Sheikh A, Sisul JC, Rajabian-Söderlund R, Sooronbaev T, Stellato C, To T, Todo-Bom AM, Tomazic PV, Toppila-Salmi S, Valero A, Valiulis A, Valovirta E, Ventura MT, Wagenmann M, Wang Y, Wallace D, Waserman S, Wickman M, Yorgancioglu A, Zhang L, Zhong N, Zidarn M, Zuberbier T; Mobile Airways Sentinel Network (MASK) Study Group. Allergic Rhinitis and its Impact on Asthma (ARIA) Phase 4 (2018): Change management in allergic rhinitis and asthma multimorbidity using mobile technology. J Allergy Clin Immunol. 2019 Mar;143(3):864-879. Doi: 10.1016/j.jaci.2018.08.049.
Burden M. Using a change model to reduce the risk of surgical site infection. Br J Nurs. 2016 Sep 22;25(17):949-955. Doi: 10.12968/bjon.2016.25.17.949.
Carman AL, Vanderpool RC, Stradtman LR, Edmiston EA. A Change-Management Approach to Closing Care Gaps in a Federally Qualified Health Center: A Rural Kentucky Case Study. Prev Chronic Dis 2019;16:180589. Doi: http://dx.doi.org/10.5888/pcd16.180589.
Champion C, Sadek J, Moloo H. Strategic Change in Surgical Quality Improvement: The Ottawa Hospital (TOH) Comprehensive Unit-Based Safety Program (CUSP) Experience. Healthc Q. 2017;20(2):69-71. Doi: 10.12927/hcq.2017.25231.
Diaz Alonso I. Navigating triage to meet targets for waiting times. Emerg Nurse. 2013 Jun;21(3):20-6. Doi: 10.7748/en2013.06.21.3.20.e1145.
Dort JC, Sauro KM, Schrag C. Designing and integrating a quality management program for patients undergoing head and neck resection with free-flap reconstruction. J of Otolaryngol - Head & Neck Surg 49, 41; 2020. Doi: 10.1186/s40463-020-00436-3.
Dredge A, Oates L, Gregory H, King S. Effective change management within an Australian community palliative care service. Br J Community Nurs. 2017 Nov 2;22(11):536-541. Doi: 10.12968/bjcn.2017.22.11.536.
Henry LS, Christine Hansson M, Haughton VC, Waite AL, Bowers M, Siegrist V, Thompson EJ. Application of Kotter's Theory of Change to Achieve Baby-Friendly Designation. Nurs Womens Health. 2017 Oct-Nov;21(5):372-382. Doi: 10.1016/j.nwh.2017.07.007.
Hopkins S, Surpin J, Stanowski A. Lessons learned from implementation of gainsharing. Healthc Financ Manage. 2015 Mar;69(3):78-83.
John T. Setting up recovery clinics and promoting service user involvement. Br J Nurs. 2017 Jun 22;26(12):671-676. Doi: 10.12968/bjon.2017.26.12.671.
Mørk A, Krupp A, Hankwitz J, Malec A. Using Kotter's Change Framework to Implement and Sustain Multiple Complementary ICU Initiatives. J Nurs Care Qual. 2018 Jan/Mar;33(1):38-45. Doi: 10.1097/NCQ.0000000000000263.
Pollack J, Pollack, R. Using Kotter’s eight stage process to manage an organisational change program: presentation and practice. Systematic and Action Research. 2014. Doi: 10.1007/s11213-014-9317-0
Rafman H, Lim SN, Quek SC, Mahadevan M, Lim C, Lim A. Using systematic change management to improve emergency patients' access to specialist care: the Big Squeeze. Emerg Med J. 2013 Jun;30(6):447-53. Doi: 10.1136/emermed-2012-201096.
Reddeman L, Foxcroft S, Gutierrez E, Hart M, Lockhart E, Mendelsohn M, Ang M, Sharpe M, Warde P, Brundage M, Reddeman L, Foxcroft S, Gutierrez E, Hart M, Lockhart E, Mendelsohn M, Ang M, Sharpe M, Warde P, Brundage M. Improving the Quality of Radiation Treatment for Patients in Ontario: Increasing Peer Review Activities on a Jurisdictional Level Using a Change Management Approach. J Oncol Pract. 2016 Jan;12(1):81-2, e61-70. Doi: 10.1200/JOP.2015.006882.
Small A, Gist D, Souza D, Dalton J, Magny-Normilus C, David D. Using Kotter's Change Model for Implementing Bedside Handoff: A Quality Improvement Project. J Nurs Care Qual. 2016 Oct-Dec;31(4):304-9. Doi: 10.1097/NCQ.0000000000000212.
Sorensen TD, Pestka D, Sorge LA, Wallace ML, Schommer J. A qualitative evaluation of medication management services in six Minnesota health systems. Am J Health Syst Pharm. 2016 Mar 1;73(5):307-14. Doi: 10.2146/ajhp150212.
Townsend AB, Valle-Ortiz M, Sansweet T. A Successful ED Fall Risk Program Using the KINDER 1 Fall RiskAssessment Tool. J Emerg Nurs. 2016 Nov;42(6):492-497. Doi: 10.1016/j.jen.2016.03.028.
Kuhlman J, Moorhead D, Kerpchar J, Peach DJ, Ahmad S, O'Brien PB. Clinical Transformation Through Change Management Case Study: Chest Pain in the Emergency Department. EClinicalMedicine. 2019 May 26;10:78-83. Doi: 10.1016/j.eclinm.2019.04.010.
Lewin K. Frontiers in Group Dynamics: Concept, Method and Reality in Social Science; Social Equilibria and Social Change. Human Relations, 1947; 1(1), 5–41. Doi: 10.1177/001872674700100103.
Abd El-Shafy I, Zapke J, Sargeant D, Prince JM, Christopherson NAM. Decreased Pediatric Trauma Length of Stay and Improved Disposition With Implementation of Lewin's Change Model. J Trauma Nurs. 2019 Mar/Apr;26(2):84-88. Doi: 10.1097/JTN.0000000000000426.
Bowers B. Managing change by empowering staff. Nurs Times. 2011 Aug 16-29;107(32-33):19-21.
Bradley S, Mott S. Adopting a patient-centred approach: an investigation into the introduction of bedside handover to three rural hospitals. J Clin Nurs. 2014 Jul;23(13-14):1927-36. Doi: 10.1111/jocn.12403.
Burnes B. Kurt Lewin and complexity theories: back to the future? Journal of Change Management. 2004;4(4):309-325. Doi:10.1080/1469701042000303811.
Chaboyer W, McMurray A, Johnson J, Hardy L, Wallis M, Sylvia Chu FY. Bedside handover: quality improvement strategy to "transform care at the bedside". J Nurs Care Qual. 2009 Apr-Jun;24(2):136-42. Doi: 10.1097/01.NCQ.0000347450.90676.d9.
Jacelon CS, Furman E, Rea A, Macdonald B, Donoghue LC. Creating a professional practice model for postacute care: adapting the Chronic Care Model for long-term care. J Gerontol Nurs. 2011 Mar;37(3):53-60. Doi: 10.3928/00989134-20100831-02.
Kritsonis A. Comparison of change theories. International Journal of Scholarly Academic Intellectual Diversity, Vol. 8 No. 1, pp. 1-7. 2004.
Manchester J, Gray-Miceli DL, Metcalf JA, Paolini CA, Napier AH, Coogle CL, Owens MG. Facilitating Lewin's change model with collaborative evaluation in promoting evidence based practices of health professionals. Eval Program Plann. 2014 Dec;47:82-90. Doi: 10.1016/j.evalprogplan.2014.08.007.
Radtke K. Improving patient satisfaction with nursing communication using bedside shift report. Clin Nurse Spec. 2013 Jan-Feb;27(1):19-25. Doi: 10.1097/NUR.0b013e3182777011.
Sokol R, Schuman-Olivier Z, Batalden M, Sullivan L, Shaughnessy AF. A Change Management Case Study for Safe Opioid Prescribing and Opioid Use Disorder Treatment. J Am Board Fam Med. 2020 Jan-Feb;33(1):129-137. Doi: 10.3122/jabfm.2020.01.190223.
Tetef S. Successful Implementation of New Technology Using an Interdepartmental Collaborative Approach. J Perianesth Nurs. 2017 Jun;32(3):225-230. Doi: 10.1016/j.jopan.2015.05.118.
Lippitt R, Watson J, Westley B. The Dynamics of Planned Change. New York: Harcourt, Brace and World. 1958.
Luecke R. Harvard Business Essentials. Managing Change and Transition, Harvard Business School Press, Boston, MA. 2003.
Pettigrew A. The awakening giant, change and continuity in ICI. Context and Action in the Transformation of the Firm. Journal of Management Studies, 1985. 24(6): p. 649-70. Doi: 10.1111/j.1467-6486.2012.01054.x.
Byers V. The challenges of leading change in health-care delivery from the front-line. Journal of Nursing Management. 2017;25(6):449-456. Doi: 10.1111/jonm.12342.
Pettigrew A, Woodman R, Cameron K. Studying organisational change and development: challenges for future research. Academy of Management Journal. 2001;44(4):697-713. Doi: 10.2307/3069411.
Phelan D. Best Practice Change Management Guidelines. National Health Service. 2010.
Prochaska JO, DiClemente CC. Stages and processes of self-change of smoking: Toward an integrative model of change. Journal of Consulting and Clinical Psychology, 51(3), 390–395. 1983. Doi: 10.1037//0022-006x.51.3.390.
Riches A. The four emotional stages of change. 2009.
Sale C, Page D, Penniment M. Change management for radiation therapists - transitioning to the new Royal Adelaide Hospital. J Med Radiat Sci. 2019 Sep;66(3):212-217. doi: 10.1002/jmrs.345.
Rogers EM. Diffusion of Innovations. Free Press, New York. 1962.
Silversin J, Kornacki MJ. Leading physicians through change. Tampa, Florida: ACPE; 2000.
Westerlund A, Garvare R, Höög E, Nyström M. Facilitating system-wide organizational change in health care. International Journal of Quality and Service Sciences. 2015;7(1), 72–89. ISBN-13: 978-0978730659.
Montgomery DC, Woodall WH. An Overview of Six Sigma. International Statistical Review / Revue Internationale de Statistique. 2008;76(3):329-346. Doi: 10.1111/j.1751-5823.2008.00061.x.
Waterman R. The seven elements of strategic fit. Journal of Business Strategy, 3, 68–72. 1982. ISSN: 2052-1197.
Womack JP, Jones DI. Lean Thinking: Banish Waste and Create Wealth in Your Corporation. Productivity Press. 1996. ISBN-13: 978-0743231640.
Young M. A meta-model of change. Journal of Organisational Change 22 (5), 524–548. 2009. Doi: 10.1108/09534810910983488.
Hennerby C, Joyce P. Implementation of a competency assessment tool for agency nurses working in an acute paediatric setting. J Nurs Manag. 2011;19(2):237–245. Doi: 10.1111/j.1365-2834.2011.01223.x.
Basu JK. Evaluation of the effects of a district clinical specialist team on maternal and women’s health services in the Ekurhuleni district. A thesis submitted to the Faculty of Health Sciences, University of the Witwatersrand, Johannesburg, in fulfilment of the requirements for the degree of Doctor of Philosophy. September 2021.