Original article

How can the results of Health Technology Assessment (HTA) evaluations applied to vaccinations be communicated to decision-makers and stakeholders?

The ISPOR Rome Chapter Project

1. Gasparini1, F.s. Mennini2, D.Panatto1, P. Bonanni3, A.Bechini3, W. Ricciardi4, C. De WauRe4,

   1. Marcellusi1, A. Cicchetti5, M. Ruggeri5, s. Boccalini3

1 Department of health sciences, university of Genoa, italy; 2 Faculty of economics centre for economic and international studies (ceis) -economic evaluation and hta (eehta), university of Rome, italy; 3 Department of health sciences, university of Florence, italy; 4 institute of public health, catholic university of sacred heart, Rome, italy; 5 institute of health economics and Management, catholic university of sacred heart, Rome, italy

Key words

Vaccination • Prevention • HTA

Summary

HTA is considered the most comprehensive and transparent method of supporting decision-makers in their choices in Public Health.

HTA on vaccines is being performed by many experts. However, they often present their studies to colleagues, but not to decision- makers, who should be the main target and current users. It is therefore crucial to improve the transfer of scientific data to deci- sion-makers and all stakeholders.

The aims of the present project are: 1) to set up a team of experts to collect economic evaluations and HTA studies on vaccines and assess their actual use in decision-making processes; 2) to constitute regional working groups in order to identify the criti- cal aspects of the communication process and identify the most appropriate method of data transfer.

Systematic reviews of economic evaluations and HTA on vaccines and their actual use in decision-making will be used to draw up the basic documents for discussion by the 3 regional working boards. The working groups will discuss the current scientific evidence and communication methods and will try to implement a model of technology assessment with well-defined and objective criteria, in order to better fit pharmaco-economic and HTA methods to the field of vac- cinations.

Improving the transfer of HTA results to stakeholders, particu- larly decision-makers, will enable decisions to be taken on the basis of scientific evidence, and appropriate, sustainable actions to be undertaken.

Introduction

In accordance with the recommendations of the World Health Organization (WHO) (2005) [1], the current Italian National Plan for Vaccination Prevention 2012- 2014 (PNPV) [2] specifies that the choices made in the sector of prevention, such as those concerning vaccina- tion, should be based on clear, robust, shared criteria. This need is due to the increasing availability of new vaccines, the introduction of new vaccination indica- tions and the limited economic resources of health sys- tems, even in developed countries. Only by prioritizing all possible preventive interventions can we rational- ize the use of limited resources and maximize results in terms of health. As Health Technology Assessment (HTA) meets the above-mentioned criteria, it may con- stitute the best approach to this issue.

HTA is regarded as the most comprehensive and trans- parent method of supporting decision-makers in their choices concerning health technologies. This approach is even more important in the Public Health sector, par- ticularly with regard to vaccine prevention [3]. As vac- cination targets healthy individuals, its benefits (such as

absence of disease, reduced disease burden etc.) are often unapparent to both the population and decision-makers. Consequently, preventive interventions are viewed only as a considerable cost to the health system, rather than as fundamental investments that generate benefits in the short and long terms. These issues are even more evi- dent today, in the current critical period of spending re- view in Italy. Indeed, the most debated issue related to the introduction of a new vaccine is that of economic sustainability. In order to verify economic sustainability, pharmaco-economic evaluations are needed. The first step in this process is to evaluate the costs that a disease generates for the National Health Service (point of view of the third-party payer) and the community (point of view of society). Pharmaco-economics offers several ap- proaches. In the field of vaccinations, the most frequently used approach is cost-effectiveness analysis, whereby the cost of vaccination is compared with its clinical benefit (e.g. the number of cases avoided or the years of sur- vival gained). Among cost-effectiveness analyses, cost- utility analysis is preferentially adopted, as benefits are measured in QALYs (quality-adjusted life-years). When comparing two or more alternatives which have different

costs and degrees of efficacy/effectiveness, it is important to obtain information in a single summary measure, i.e. considering both cost and effectiveness. The Incremental Cost-effectiveness Ratio (ICER) provides this information and expresses the additional cost of each unit of a health outcome (e.g. one QALY) obtained by one strategy com- pared with another. The ICER is a fundamental parameter for decision-makers. However, decision-makers must also consider other domains: the epidemiology of the disease in question; vaccine efficacy/effectiveness; the predicted clinical impact on the population, as assessed through mathematical modelling of possible vaccination strate- gies; ethical, social and legal aspects, and the impact of introducing a new vaccine on health organizations. HTA deals with all these aspects.

In Italy, as in other countries, the application of HTA to vaccines has increased in recent years. Many HTA reports and pharmaco-economic studies, including several in the Italian context, have been published [4-24]. Although the data from these studies are widely available, they are often underused by decision-makers, who may lack the knowledge and ability necessary to exploit them fully. In- deed, decision-makers often evaluate the implementation of new vaccines only on the basis of vaccination costs, without considering the clinical and economic benefits derived from the avoidance of cases of disease.

It is therefore essential to improve the transfer of scien- tific data to decision-makers and all stakeholders, in order to promote evidence-based decisions in the area of immu- nization. The introduction of a new vaccine can only be based on Evidence-Based Medicine (EBM), or rather Evi- dence-Based Prevention (EBP) [25]. To achieve this goal, it is necessary to create a communication network linking all subjects involved in the decisional process: research- ers, decision-makers and stakeholders. In this perspective, the project “HTA for public health decision-makers in the area of vaccination” has been planned and endorsed by the ISPOR Rome Chapter.

The International Society for Pharmacoeconomics and Outcomes Research (ISPOR), founded in 1995, is a pub- lic non-profit educational and scientific association. It promotes pharmaco-economic and outcome research and facilitates the translation of the results of that re- search into useful information for decision-makers in order to encourage efficiency, effectiveness and equity in health and to improve the health of the population. The ISPOR Italy-Rome Chapter is a working group af- filiated to ISPOR and sharing its mission and objectives. It involves healthcare professionals, providers of health- care technologies, decision-makers and other pertinent subjects in issues of pharmaco-economics and outcome research in the Italian context.

Objectives

The objectives of the project are:

1. to organize a multidisciplinary working group com- posed of experts (the Project’s founding group) in order to:

   • carry out systematic reviews of economic evalu- ations and HTA reports on vaccines and vaccina- tion strategies;

   • assess the current use of HTA and economic eval- uations in decision-making processes;

   • implement a model of technology assessment with well-defined and objective criteria, in order to better fit pharmaco-economic and HTA meth- ods to the field of vaccinations.

2. to constitute regional working groups composed of experts, decision-makers and stakeholders in order to:

• identify and define critical points in communica- tion from/to decision-makers and stakeholders and in data transfer processes, in order to identify the most appropriate method of data transfer;

• increase decisions taken on the basis of scientific evidence in the field of vaccinations;

• improve the culture of vaccination in the Italian population and counteract the spread of errone- ous, confusing and outdated information.

Achievement of these objectives will lead to the identi- fication of the best strategies for creating a “data bridge” between researchers, decision-makers and stakeholders.

Materials and methods

Two different main activities will be performed: sys- tematic reviews of economic and HTA studies on vac- cine/vaccination strategies, and organization of working boards. Table I shows the main activities of the ISPOR Rome Chapter Project.

The following specific activities will be carried out:

• systematic reviews of economic and HTA evalua- tions of vaccination strategies or of vaccines already included in the Italian vaccination schedule or still under discussion for inclusion in the current regional or national vaccination programs: for example, HPV vaccination in females and males, meningococcal C vaccine, pneumococcal vaccine in children and the elderly, varicella vaccine, quadrivalent conjugate meningococcal vaccine, meningococcal B vaccine, rotavirus vaccine, and herpes zoster vaccine. This systematic review will be performed on PubMed, Scopus and NIHR HTA databases; articles published at any time up to the end of 2015 will be included. PubMed and Scopus will be queried by means of a combination of MESH terms and keywords referring to vaccines/vaccinations and HTA/economic evalu- ations, while the search on NIHR HTA will be per- formed through the use of keywords related only to vaccines/vaccinations. Furthermore, a hand-search of the following journals will be carried out: Global

& Regional Health Technology Assessment, Phar- maco-Economics Italian Research Articles, Giornale Italiano di HTA, Politiche Sanitarie, HTA Focus – Pills of Clinical Governance, Pillole di Farmaco- economia, Giornale Italiano di Farmacoeconomia e Farmacoutilizzazione, Italian Journal of Public

Tab. I. The main activities of ISpOr rome Chapter project.

Health and Quaderni dell’Italian Journal of Public Health. Eligible articles will be identified through a two-step approach: screening of titles/abstracts and reading of full texts. Articles will be considered eli- gible if they report the results of an economic evalu- ation or of an HTA performed in Italy or one or more Italian Region;

• evaluation of the real use of economic and HTA studies in the decision-making process in Italy in recent years. This evaluation will be performed by comparing the results of the studies collected with the decisions taken at the national and regional levels in recent years, with regard to the inclusion of new vaccines or vaccination strategies in immunization programmes;

• some vaccination programmes will be compared with other health interventions (therapeutic interven- tions) by means of mathematical models, in order to increase decision-makers’ awareness of the fact that investments in the field of vaccines generate signifi- cant benefits and are not only a cost for the health system. For example, HPV vaccination in females will be compared with therapeutic interventions in women with HPV-related lesions/cancer.

These activities will be carried out by the Project’s “founding group”, made up of researchers working on these subjects at the Universities of Florence, Genoa and Rome (Catholic University and Tor Vergata Universi- ty). The founding group will also implement a model of technology assessment with well-defined and objective criteria, in order to better fit pharmaco-economic and HTA methods to the field of vaccinations.

Data acquired from these activities will be used to draw up the basic documents for discussion by the working boards that will be organized. The working boards will be composed of all relevant subjects involved in the decision-making process: researchers, decision makers and stakeholders. (Tab. II). The parties that have an in- terest are: citizens and their associations, health profes- sionals and their associations, scientific societies, those

elected by citizens to the various levels of government, businesses and no-profit partners, academics, and volun- teers and their associations [26].

The importance of involving as many stakeholders as possible stems from the need to improve the culture of vaccination in the Italian population and to counteract the spread of erroneous, confusing and outdated informa- tion. Indeed, the success of a vaccination campaign de- pends not only on the supply of a vaccine free of charge, but also on the acceptance of vaccination on the part of the target population. The acceptability of vaccination strongly influences vaccine coverage rates, and only high vaccine coverage enables the incidence of disease to be reduced, thereby achieving considerable savings in terms of both healthcare and socioeconomic costs. Opin- ion leaders and journalists will be involved in the work- ing groups, on account of their significant influence on the choices of the population and decision-makers. In particular, journalists can support the improvement of communication between researchers and decision-mak- ers by identifying the most appropriate method of data transfer. Journalists can also help to spread the culture of vaccination in the population and increase public aware- ness of the importance of prevention activities.

Tab. II. multidisciplinary working groups of ISpOr rome Chapter project.

Expected results and discussion

Two systematic reviews will be published: the first will focus on economic and HTA evaluations of vaccination strategies or vaccines already included in vaccination schedules in Italy and Europe; the second will focus on economic and HTA evaluations of vaccination strategies or vaccines that are as yet under discussion for inclusion in current regional or national vaccination programs in Italy and Europe.

A report on the real use of economic and HTA studies in the decision-making process in Italy in recent years will be made.

Three permanent regional working boards will be set up in Northern, Central and Southern Italy, coordinated by the Project’s “founding group”. These will discuss the current scientific evidence of cost-effectiveness and the cost-benefit profiles of vaccinations and will also inves- tigate other domains relevant to the decisional process (such as ethical, social and legal aspects and the impact of introducing a new vaccine on health organizations). They will also identify and analyse critical points in the different kinds of communication, in order to pick out the most appropriate methods of communication and da- ta transfer. Furthermore, they will discern the informa- tion needs of each subject involved and work out how to improve the transfer of knowledge from researchers to decision-makers and stakeholders. The information ob- tained by these permanent regional boards may be vali- dated in other Italian Regions. Lastly, a national event will be organized in order to extend the indications and information obtained at the regional level to the national level.

The feasibility of the project is guaranteed by the partici- pation of academics and researchers in the permanent re- gional working boards. However, the achievement of the above-mentioned objectives might be jeopardised by the potentially scant participation of decision-makers and stakeholders in the communication network. To avoid this eventuality, every effort will be made to convince decision-makers and stakeholders of the importance of developing a communication network with scientific experts in order to foster evidence-based decisions that meet the needs highlighted by the decision-makers and stakeholders themselves.

Finally, individuation of a model of technology assess- ment with well-defined and objective criteria could con- tribute to the development of new HTA reports accord- ing to the requirements and needs evinced by the deci- sion-makers and stakeholders themselves in the future.

Conclusions

The success of the project will pave the way towards an interactive dialogue among all subjects involved in the decision-making process. In this way, decisions can be taken on the basis of scientific evidence, and appro- priate, sustainable actions can be undertaken. Indeed, healthcare priorities can only be established through

broadly based, shared evaluations of health interven- tions. This approach will ensure a more appropriate use of limited resources and enable preventive activities that generate many benefits and not only costs.

References

[1] World Health Organization (WHO). Vaccine introduction guidelines. Adding a vaccine to the national immunizaiton pro- gramme: Decision and implementation. 2005. Available at: http://www.who.int/immunization/hpv/plan/vaccine_introduc- tion_guidelines_who_2005.pdf

[2] Ministero della Salute. Piano Nazionale Prevenzione Vaccinale (PNPV) 2012-14. Gazzetta Ufficiale n. 47 del 12/03/2012 (Sup- plemento ordinario). Available at: http://www.salute.gov.it/ imgs/C_17_pubblicazioni_1721_allegato.pdf .

[3] La Torre G, de Waure C, Chiaradia G, et al. The future of best investing in vaccines: the Health Technology Assessment ap- proach. Vaccine 2008;26:1609-10.

[4] Panatto D, Bragazzi NL, Rizzitelli E, et al. Evaluation of the economic burden of Herpes Zoster (HZ) infection. Hum Vaccin Immunother 2015;11:245-62.

[5] Unim B, Saulle R, Boccalini S, et al. Economic evaluation of Varicella vaccination: results of a systematic review. Hum Vac- cin Immunother 2013;9:1932-42.

[6] Boccalini S, Taddei C, Ceccherini V, et al. Economic analysis of the first 20 years of universal hepatitis B vaccination program in Italy: an a posteriori evaluation and forecast of future benefits. Hum Vaccin Immunother 2013;9:1119-28.

[7] Boccalini S, Bechini A, Levi M, et al. Cost-effectiveness of new adult pneumococcal vaccination strategies in Italy. Hum Vaccin Immunother 2013;9:699-706.

[8] Boccalini S, Azzari C, Resti M, et al. Economic and clinical evaluation of a catch-up dose of 13-valent pneumococcal conju- gate vaccine in children already immunized with three doses of the 7-valent vaccine in Italy. Vaccine 2011;29:9521-8.

[9] Bonanni P, Boccalini S, Bechini A, et al. Economic evaluation of varicella vaccination in Italian children and adolescents ac- cording to different intervention strategies: the burden of un- complicated hospitalised cases. Vaccine 2008;26:5619-26.

[10] La Torre G, de Waure C, Chiaradia G, et al. The Health Tech- nology Assessment of bivalent HPV vaccine Cervarix in Italy. Vaccine 2010;28:3379-84.

[11] La Torre G, de Waure C, Chiaradia G, et al. Guidance for fu- ture HTA applications to vaccines: the HPV lesson. Hum Vaccin 2011;7:900-4.

[12] Damiani G, Federico B, Visca M, et al. The impact of socioeco- nomic level on influenza vaccination among Italian adults and elderly: a cross-sectional study. Prev Med 2007;45:373-9.

[13] de Waure C, Veneziano MA, Cadeddu C, et al. Economic value of influenza vaccination. Hum Vaccin Immunother 2012;8:119-29.

[14] Cadeddu C, De Waure C, Gualano MR, et al. 23-valent pneu- mococcal polysaccharide vaccine (PPV23) for the prevention of invasive pneumococcal diseases (IPDs) in the elderly: is it re- ally effective? J Prev Med Hyg 2012;53:101-3.

[15] Panatto D, Amicizia D, Lai PL, et al. New versus old meningo- coccal group B vaccines: how the new ones may benefit infants

& toddlers. Indian J Med Res 2013;138:835-46.

[16] Gasparini R, Amicizia D, Lai PL, et al. Clinical and socioeco- nomic impact of seasonal and pandemic influenza in adults and the elderly. Hum Vaccin Immunother 2012;8:21-8.

[17] Sindoni D, La Fauci V, Squeri R, et al. Comparison between a conventional subunit vaccine and the MF59-adjuvanted subunit influenza vaccine in the elderly: an evaluation of the safety, tol- erability and immunogenicity. J Prev Med Hyg 2009;50:121-6.

[18] Panatto D, Amicizia D, Ansaldi F, et al. Burden of rotavirus

disease and cost-effectiveness of universal vaccination in the Province of Genoa (Northern Italy). Vaccine 2009;27:3450-3.

[19] Aballéa S, Chancellor J, Martin M, et al. The cost-effectiveness of influenza vaccination for people aged 50 to 64 years: an in- ternational model. Value Health 2007;10:98-116.

[20] Esposito S, Gasparini R, Bosis S, et al. Clinical and socio-eco- nomic impact of influenza and respiratory syncytial virus infec- tion on healthy children and their households. Clin Microbiol Infect 2005;11:933-6.

[21] Principi N, Esposito S, Marchisio P, et al. Socioeconomic impact of influenza on healthy children and their families. Pediatr Infect Dis J 2003;22(Suppl. 10):S207-10.

[22] Tafuri S, Fortunato F, Cappelli MG, et al. Effectiveness of vac- cination against varicella in children under 5 years in Puglia,

Italy 2006-2012. Hum Vaccin Immunother 2015;11:214-9.

[23] Bechini A, Boccalini S, Baldo V. et al. Impact of universal vac- cination against varicella in Italy. Hum Vaccin Immunother 2015;11:63-71.

[24] Martinelli D, Pedalino B, Cappelli MG, et al. Towards the 13-valent pneumococcal conjugate universal vaccination: effec- tiveness in the transition era between PCV7 and PCV13 in Italy, 2010-2013. Hum Vaccin Immunother 2014;10:33-9.

[25] Sackett DL, Rosenberg WM, Gray JA, et al. Evidence based medicine: what it is and what it is not. BMJ 1996;312:71-2.

[26] Ricciardi W, La Torre G. Health Technology Assessment. Principles dimensions and tools. SEEd. First Edition, Turin 2010.

n Received on September 23, 2015. Accepted on October 20, 2015.

n Correspondence: Sara Boccalini, Department of Health Sciences, University of Florence, viale Morgagni 48, 50134 Florence, Italy - E-mail: sara.boccalini@unifi.it