What email address or phone number would you like to use to sign in to Docs.com?
If you already have an account that you use with Office or other Microsoft services, enter it here.
Or sign in with:
Signing in allows you to download and like content, and it provides the authors analytical data about your interactions with their content.
Embed code for: Europe Needs a Central, Transparent, and Evidence-Based Approval Process for Behavioural Prevention Interventions
Select a size
Policy Forum Europe Needs a Central, Transparent, and Evidence- Based Approval Process for Behavioural Prevention Interventions Fabrizio Faggiano1*, Elias Allara1,2, Fabrizia Giannotta3,4, Roberta Molinar1, Harry Sumnall5, Reinout Wiers6, Susan Michie7, Linda Collins8, Patricia Conrod9,10 1Department of Translational Medicine, Universita ` del Piemonte Orientale Amedeo Avogadro, Novara, Italy, 2School of Public Health, University of Turin, Torino, Italy, 3Child and Baby Lab, Department of Psychology, Uppsala University, Uppsala, Sweden, 4Department of Public Health Sciences, Karolinska Institutet, Stockholm, Sweden, 5Centre for Public Health, Liverpool John Moores University, Liverpool, United Kingdom, 6Department of Psychology, University of Amsterdam, Amsterdam, Netherlands, 7Department of Clinical, Educational and Health Psychology, University College London, London, United Kingdom, 8The Methodology Center and Department of Human Development and Family Studies, Pennsylvania State University, State College, United States of America, 9Addictions Department Institute of Psychiatry, King’s College London, London, United Kingdom, 10Department of Psychiatry, University of Montreal, Montreal, Que ´bec, Canada Introduction Seven risk factors account for 56.1% of the attributable disability-adjusted life years (DALYs) in western Europe: dietary risks, smoking, high blood pressure, high body mass index (BMI), physical inactivity, excessive alcohol consumption, and high fasting plasma glucose . Although such a figure reflects the predominant burden of noncommunicable diseases (NCDs) in high-income countries, it is becoming a priority also in middle-income and low- income countries . By addressing such risk factors, prevention and health promo- tion can play a major role in reducing the burden of NCDs. The crucial function of prevention in tackling the NCDs epidemic is shared globally, as highlighted by the WHO programme ‘‘Gaining Health’’ and, more recently, by the United Nations High-Level Meeting on NCDs—in which prevention has been included among the five priority actions needed globally and nationally to respond to the NCDs epi- demic [3,4]. What distinguishes prevention of NCDs from the more traditional prevention activities of communicable diseases is the aim to avoid or change health-compro- mising behaviours or to promote healthy behaviours. Prevention of NCDs includes individual and environmental interven- tion, e.g., family-based interventions tack- ling alcohol misuse, national policies prohibiting indoor smoking, school-based education to foster correct eating behav- iour, walking groups for children or adults, taxation of tobacco or alcohol products, and policies to limit junk food in vending machines on school premises. This aim is particularly critical and requires much more caution than traditional prevention practices, for example, those intended to Policy Forum articles provide a platform for health policy makers from around the world to discuss the challenges and opportunities in improving health care to their constituencies. Citation: Faggiano F, Allara E, Giannotta F, Molinar R, Sumnall H, et al. (2014) Europe Needs a Central, Transparent, and Evidence-Based Approval Process for Behavioural Prevention Interventions. PLoS Med 11(10): e1001740. doi:10.1371/journal.pmed.1001740 Published October 7, 2014 Copyright: 2014 Faggiano et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Funding: The research leading to these findings has received funding from the European Community’s Seventh Framework Programme (FP7/2007-2013), under Grant Agreement n. 266813-Addictions and Lifestyle in Contemporary Europe-Reframing Addictions Project (ALICE RAP). Participant organizations in ALICE RAP can be seen at http://www.alicerap.eu/about-alice-rap/partners.html. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Competing Interests: The authors have declared that no competing interests exist. * Email: email@example.com Summary Points N Prevention interventions tackling health-compromising behaviours have the potential to play a major role in reducing the burden of noncommunicable diseases in Europe and other areas of the world. However, in Europe, no prior evaluation is required for the implementation of prevention interventions, thus leading to widespread dissemination of potentially ineffective or harmful interventions. N A central, transparent, evidence-based, context-aware, and research-oriented approval process for behavioural prevention interventions is likely to foster the implementation and dissemination of effective interventions in Europe. N Similarly to medicine approval systems, such a new approval process could be based on four consequential phases evaluating the effect of the following: single components (phase 1); combinations of components (phase 2); the final intervention—comprising only components found effective in the previous phases—via large, multicentre, randomized trials whenever possible (phase 3); and the long-term effects as well as the effects in different contexts (phase 4). N Once phase 3 shows convincing results, the intervention would be approved for delivery to its target population. N An approval process for behavioural prevention interventions is likely to lead to positive consequences both for practice, by strengthening the role and impact of prevention in times of limited economic resources, and for research, by promoting the robust evaluation of all promising prevention interventions. PLOS Medicine | www.plosmedicine.org 1 October 2014 | Volume 11 | Issue 10 | e1001740 control environmental pollution and in- fectious diseases. In Europe, a number of official docu- ments, both at the regional and country level, promote an evidence-based ap- proach to prevention [3,5,6]. However, there is no regulatory system for the implementation of behavioural prevention interventions. This contrasts with the situation in clinical medicine, in which there is a long-standing culture of using robust evidence to inform commissioning and clinical decisions. The European Medicines Agency (EMA) and European national authorities manage a well-estab- lished, although not perfect , system for the assessment of safety and effectiveness of drugs. With this contribution, we aim to initiate a debate about the need for a unique European evaluation and approval system of prevention interventions for health-compromising behaviours. Need for a Rigorous Evaluation of Behavioural Prevention Interventions In Europe, interventions for preventing health-compromising behaviours can be implemented and disseminated without any preliminary authorisation, whatever setting (school, family, and community), professional, or type of method and technology involved. This is of concern for both ethical and economic reasons. First—and contrary to common belief— prevention interventions are not just harmless or ineffective in the worst-case scenario. They may also be harmful. Iatrogenic effects have been observed in interventions tackling risky behaviours such as physical inactivity, substance misuse, early sexual intercourse, and juvenile delinquency [8–12]. It is ethically unacceptable that a prevention interven- tion could significantly increase BMI, or tobacco or alcohol use, or frequency of cannabis use, or pregnancies and sexually transmitted diseases. Quoting the ‘‘father’’ of evidence-based medicine, David Sack- ett, ‘‘[…] the presumption that justifies the aggressive assertiveness with which we go after the unsuspecting healthy must be based on the highest level of randomized evidence that our preventive manoeuvre will, in fact, do more good than harm’’ . Second, resources are likely to be wasted if evidence of effectiveness is missing or not sought. Cochrane reviews on the prevention of risky behaviours [14– 16] show that effective interventions are in the minority of those evaluated by ran- domized studies. There is no reason to presume that non-evaluated interventions may be more effective than those that underwent rigorous evaluation. The re- source allocation in the development and delivery of ineffective interventions is of particular concern in these times, given Europe’s overstretched health systems. Need for Improving the Analysis and Description of Mechanisms of Behavioural Prevention Interventions Prevention interventions for health- compromising behaviours usually target psychological, social, and organisational factors hypothesised to mediate the asso- ciations between intervention and behav- ioural outcomes. Although theories should play a crucial role in the design and evaluation of prevention interventions, there is a lack of awareness and consensus as to which theories should be applied and what method should be used [17,18]. Many interventions are an amalgam of approaches and contents that do not explicitly draw on formal theories; others mention theory but are not truly theory- driven and do not always adhere consis- tently to a theory’s tenets, being driven by implicit common sense models of behav- iour [19,20]. Moreover, interventions are usually delivered as a complex combination of components (‘‘active ingredients’’ target- ing different mediators), both in terms of contents, activities, techniques, and modes of delivery. However, the interventions are usually poorly described. Less than 30% of reports of randomized studies present a detailed description of the intervention allowing accurate replication and imple- mentation, and fewer include descriptions of mechanisms of action [19,21]. In addition, complex interventions, com- posed of several components, are usually evaluated together in randomized studies, which makes it difficult to disentangle the effect of a single ingredient on mediators and behavioural outcomes. The failure to conceptualize, define, and describe inter- vention components and mediators re- stricts the potential for evaluation to add evidence about effective interventions and mechanisms of action. In addition, the effects of context are rarely recognized, reported, or analysed. Not knowing why, how, and where prevention interventions work limits knowl- edge about generalizability and optimiza- tion of interventions. It also increases the cost of implementation, as non-essential mediators might be inappropriately tar- geted and non-essential components may be inadvertently included. If mediators of the target behaviour are identified, it is easier to design intervention components that are more likely to be effective. If the intervention components most strongly associated with effectiveness are known, more accessible, practical, and lower-cost, yet still effective, prevention interventions can be elaborated and dis- seminated. Moreover, they can be adapted to meet local needs and implemented in situations that are less ideal than research circumstances. The complexity of behavioural preven- tion interventions, together with the lack of accurate reporting of mechanisms of action and analysis of the effects of components and their interactions, has serious consequences for prevention sci- ence: new interventions and evaluations occur in relative isolation, limiting the possibility of building an incremental technology of prevention . Identifying and Selecting Evidence-Based Behavioural Prevention Interventions: Current Situation Prevention guidelines are uncommon and usually of mixed quality, and no national or international systems exist for the regulation of effective interventions. Prevention professionals usually have to search and appraise the literature by themselves if they want to select evi- dence-based interventions to transfer into practice. There are some local experiences of public registries of evidence-based inter- ventions in some areas of prevention [22– 24]. However, at least two reasons suggest that these registries may not be enough to guide practice. First, they have a weak level of global authority; thus, they cannot limit the proliferation of unevaluated or harmful interventions. Secondly, they present a great variability in the level of evidence required to define an interven- tion as effective, and in the way they help dissemination. This is obviously a potential cause of uncertainty for decision-makers and implementers. Table 1 compares the criteria for intervention classification adopted by seven registries considered by Gandhi et al. , to which we added two European resources, the European Mon- itoring Centre for Drugs and Drug Abuse (EMCDDA) ’s Best Practice Portal and the Dutch Recognition System [23,24]. Al- though evidence of efficacy and quality of evaluation are considered by all registries, aspects such as quality of programme PLOS Medicine | www.plosmedicine.org 2 October 2014 | Volume 11 | Issue 10 | e1001740 contents, programme implementation methods, and programme replicability are considered only in four out of nine registries. In this panorama the attempts to define standards of quality of prevention intervention, for example, from the Soci- ety for Prevention Research (see at www. preventionresearch.org) and from the EMCDDA (see at www.emcdda.europa. eu), do not appear to have had any visible effects. Existing Frameworks for the Regulation of Interventions Improving the regulation of prevention interventions for health-compromising be- haviours to ensure that effective interven- tions are implemented and disseminated is likely to be challenging. In clinical practice, authorization agen- cies such as the United States Food and Drug Administration (FDA) and the Eu- ropean Medicine Agency (EMA) are appointed to manage an evidence-based evaluation process intended to guarantee that only safe and effective drugs will be approved for marketing. Although formal pathways are slightly different, for both agencies the process is based on a four-step evaluation: small trials to test pharmaco- dynamics, pharmacokinetics, and dosage (phase 1); medium trials for assessing efficacy and short-term effects (phase 2); large, randomized trials to evaluate effec- tiveness and side effects (phase 3); and post-marketing surveillance and additional studies for specific subgroups of patients and assessment of rare side effects (phase 4) . Pharmaceutical companies apply for EMA and/or FDA approval by transmitting all the preclinical and clinical information obtained during the first three phases . Approval is a necessary prerequisite for marketing a drug in Europe and in the United States. A systematic approach to developing and evaluating complex prevention inter- ventions, as the majority of prevention interventions are, has been developed by the United Kingdom’s Medical Research Council (MRC) [27,28]. The first set of guidance proposed a process for the evaluation of complex interventions, which is logically consistent with the sequential phases of the drug approval process. The second set was based on a more sophisticated understanding of com- plexity and called for the defining of relevant intervention components, as well as underlying mechanisms and theories (modelling phase), testing acceptability and feasibility (pilot phase), evaluating effectiveness in an experimental study Table1.Criteriausedinmostwidespreadregistriesofevidence-basedpreventioninterventions. Criteria Listofregistries Evidenceof efficacy Qualityof evaluation Qualityof programmegoals Qualityof programme rationale Qualityofprogramme contentand appropriateness Qualityofprogramme implementationmethods Educational significancea Usefulnessand replicability BlueprintsYesYesYesN/AN/AN/AN/AYes Drugstrategies: MakingtheGrade YesYesYesN/AN/AN/AN/AN/A EDListYesYesYesYesYesYesYesYes MarylandReportYesYesN/AN/AN/AN/AN/AN/A NIDAGuideYesYesN/AN/AN/AN/AN/AN/A SAMHSANationalRegistry ofEvidence-BasedPrograms andPractices YesYesYesYesYesYesNoYes YouthViolence:AReport oftheSurgeonGeneral YesYesYesN/AN/AN/AN/AYes EMCDDABest PracticePortal YesYesYesNoYesYesNoNo DutchRecognitionSystemYesYesYesYesYesYesNoYes ThistableispartlybasedontheworkbyGandhietal.,withtheadditionoftheEMCDDABestPracticePortalandtheDutchRecognitionSystem. aTheapplicationdescribeshowtheinterventionisintegratedintoschools’educationalmission. Abbreviations:EMCDDA,EuropeanMonitoringCentreforDrugsandDrugAbuse;NIDA,NationalInstituteonDrugAbuse;SAMHSA,SubstanceAbuseandMentalHealthServicesAdministration;ED,USDepartmentofEducation;N/ A,notavailable. doi:10.1371/journal.pmed.1001740.t001 PLOS Medicine | www.plosmedicine.org 3 October 2014 | Volume 11 | Issue 10 | e1001740 (evaluation phase), and assessing long-term effects in uncontrolled settings (implemen- tation phase). The updated guidance in 2008 conceptualised the process as a cycle, emphasising the importance of considering implementation right at the beginning of the intervention development process. Collins and colleagues addressed anoth- er issue that is not shared by drug registration systems: the complexity of interventions [29,30]. In order to evaluate the role of each single component of prevention interventions, they suggest adopting a multiphase optimization strat- egy, which may involve the application of a factorial design in order to assess the independent role of each component (see at http://methodology.psu.edu/ra/most). These approaches, no matter how innovative, however, are not applicable to policy evaluation, a strong component of preventive strategies. In order to keep the same level of validity of the assessment, this requires tailored approaches to eval- uation , as those developed for tobac- co control . A Proposal for a System of Evaluation and Approval of Behavioural Prevention Interventions To tackle the overuse of interventions without scientific evidence and the under- use of effective interventions, Europe needs an approval system for prevention of health-compromising behaviours. This system would allow decision-makers and implementers to access the necessary information and materials to select the best prevention intervention for any spe- cific need (e.g., target behaviour, popula- tion, setting, available resources, etc.). This system should be: N Based on evidence. It should rely on the most valid evaluation approach for the specific intervention to assess. If randomized controlled trial would not be a feasible option, for example, for policy evaluation, the system should include alternative research designs that allow for relatively strong causal inferences (e.g., cohort design or inter- rupted time series design). N Aware of context. Contextual moder- ators are of great importance for prevention of health-compromising behaviours and should be an essential part of the evaluation, as they may explain variations of effects across different contexts. They can help to describe how prevention interventions work and should be accurately identified and reported. Moreover, replications of evaluation studies in different contexts should be promoted and considered as an element of quality. N Research-oriented. It should require an accurate reporting of underpinning theories, contents, mechanisms of ac- tion, and effects of single components on target behaviours to support the advancement of prevention science. N Transparent and open access. All steps of evaluation should be transparently reported; descriptive information and complete data about evidence, bene- fits, risks, and variations related to different populations and contexts should be publicly available. The level of descriptive information must be sufficient to allow replications across different contexts with a high level of fidelity. N Based on international cooperation. An international consensus on stan- dards for releasing the certification of effectiveness is required to ensure widespread acceptance of this system in the scientific community. Therefore, a collaborative action of an extensive range of researchers, policy-makers, and health professionals is needed, as well as an extraordinary effort and mobilisation of resources. In light of existing experiences, and taking into account the key characteristics described above, a four-phase evaluation and approval process could be proposed (Figure 1): N Phase 1 should be aimed at evaluating the effect of single components on mediators and short-term outcomes through experimental or observational studies. This phase should also assess dosage features (e.g., delivery frequen- cy, duration, etc.) and other delivery characteristics such as the appropriate age group. N Phase 2 should be aimed at evaluating the effect of combinations of single components which passed phase 1 on short-term outcomes in the target population through a pilot experimen- tal study. N Phase 3 should be aimed at evaluating the effectiveness of the whole interven- tion, once individual components have shown evidence of effectiveness on short- and medium-term outcomes in phase 2. Whenever possible, an ade- quately powered, randomized, con- trolled design should be used to allocate individuals or target groups (e.g., schools, families) to study arms. But, since environmental interventions can hardly be evaluated by a random- ized study, and they constitute a cornerstone of any comprehensive prevention strategy, such as smoking bans or taxation of sugar-sweetened beverage, they should be assessed with other studies of high validity, as for example, cohort studies or interrupted time series. N Interventions found to be effective in this phase should be approved for implementation and dissemination. N Phase 4 should be aimed at evaluating the effectiveness of approved interven- Figure 1. Proposal for a four-step evaluation and approval process of prevention interventions for health-compromising behaviours. doi:10.1371/journal.pmed.1001740.g001 PLOS Medicine | www.plosmedicine.org 4 October 2014 | Volume 11 | Issue 10 | e1001740 tion in real-world settings (e.g., when delivered by a school team rather than a research team), the sustainability of effects on outcomes over a longer period of time and the long-term safety, and the replicability of effects on outcomes in different sociocultural contexts and populations, for which an adapted version of the intervention is usually needed. Such a centralized system could be managed by a new public body, similar to the European Medicines Agency (EMA). Alternatively, an extended mandate to carry out such a process could be given to an existing and recognized public interna- tional agency or organization or to a network of research institutions coordinat- ed by an international agency. The struc- tural dimension of the proposed system cannot be easily estimated, but would be small. To make a rough estimation, an elaboration from the Cochrane Library can be of help: in 2012 the Library contained altogether 30 systematic reviews on primary prevention interventions; out of 503 inter- ventions evaluated, only 171 (34.0%) showed at least one outcome favouring intervention . Since Cochrane Li- brary covers studies published in the last several decades and only studies showing positive results are expected to be submitted to such an approval process, these data suggest a few dozen interven- tions to be reviewed per year. The funding requirements are a critical point: the amount depends too much on the ambition of the project, and cannot be estimated, even crudely. In any case, in analogy with a scientific journal, all the processes could be managed by a central editorial unit, supported by a network of referees, which would considerably con- tain costs. Once an intervention has been ap- proved, it should be included in a repository of effective interventions. The system would provide all needed materials and contacts with developers and trainers, together with the necessary information to select the intervention fitting the prevention needs (such as target behaviour, population, and set- ting), and contextual constraints (e.g., availability of human resources, time, and funding) of practitioners, decision- makers, and policymakers. The approval of a specific intervention can be nothing else than a strong recommendation to use the intervention. Nevertheless, with the progress of the project, and once the repository is populated sufficiently to be useful for all major conditions, we could expect that, at a country level, specific policies could be elaborated in order to promote the adoption of approved interventions. Conclusions Prevention research has made consid- erable methodological advances in the past decades. This is not reflected in a parallel improvement of practice, largely due to a lack of regulatory systems for transferring evidence into practice. A possible exception is the Framework Convention on Tobacco Control (www. who.int/fctc), with which WHO produced a strong frame of effective actions for tobacco control. However, such a conven- tion still remains an exception and can be hardly expected to be reproduced for other risk behaviours. The need to address the overall deficit in rigorous evaluation of prevention interventions for health-com- promising behaviours is thus pressing in all other fields of prevention in Europe and beyond. This paper aims to initiate a debate about how best to develop a central, transparent, public, and evidence-based system of evaluation and approval of prevention interventions for health-com- promising behaviours in Europe. A four- phase approval process is outlined and is intended to foster further discussion. This approval process would result in a repository of effective prevention in- terventions to be recommended to Eu- ropean Union member states for adop- tion, in order to base prevention strategies on scientific evaluations. Poli- cy-makers and people working in the prevention field would find in this repository interventions and programmes to address the prevention needs of the target populations, together with all documents and materials useful to apply them. Furthermore, the repository would be even more useful for non-European and developing countries having similar health problems, for which the building of any systematic evaluation system for prevention is not foreseen for obvious economic reasons. To steer the evaluation activities of prevention interventions in a transparent approval system would be a great progress not only for prevention practice but also for prevention science: the approval system would encourage evalu- ation, without which an intervention would not be included; would contribute to the standardization of evaluation methods; and would make available to the scientific community all the reports of the assessments, including component evaluation and mediation analysis. This could have the power to strongly im- prove research and give a contribution towards progressive learning on how prevention works. Finally, the supply of effective and efficient behavioural interventions to pre- vention practice and policy making, in Europe but also elsewhere, would likely be a cost-effective initiative with a large expected impact on population health. Author Contributions Conceived and designed the experiments: FF EA RM. Wrote the first draft of the manuscript: FF EA RM. Wrote the paper: FF EA RM FG HS RW SM LC PC. ICMJE criteria for authorship read and met: FF EA RM FG HS RW SM LC PC. Agree with manuscript results and conclusions: FF EA RM FG HS RW SM LC PC. References 1. Institute for Health Metrics and Evaluation (2013) GBD Compare. Available: http://viz. healthmetricsandevaluation.org/gbd-compare/. Accessed 4 March 2014. 2. Beaglehole R, Bonita R, Horton R, Adams C, Alleyne G, et al. (2011) Priority actions for the non- communicable disease crisis. Lancet 377: 1438– 1447. Available: http://www.ncbi.nlm.nih.gov/ pubmed/21474174. Accessed 12 March 2012. 3. WHO Europe (2006) Gaining Health The European Strategy for the Prevention and Control of Noncommunicable Diseases. Copen- hagen, Denmark: WHO Regional Office for Europe. 4. Beaglehole R, Bonita R, Alleyne G, Horton R, Li L, et al. (2011) UN High-Level Meeting on Non- Communicable Diseases: addressing four questions. Lancet 378: 449–455. Available: http://www.ncbi. nlm.nih.gov/pubmed/21665266. Accessed 12 March 2012. 5. EMCDDA (2013) European Drug Report. Lux- embourg: Publications Office of the European Union. Available: http://www.emcdda.europa. eu/attachements.cfm/att_213154_EN_ TDAT13001ENN1.pdf. Accessed 4 March 2014. 6. WHO Regional Office for Europe (2012) Health 2020: a European policy framework supporting action across government and society for health and well-being. Copenhagen, Denmark: WHO Regional Office for Europe. 7. Wieseler B, McGauran N, Kaiser T (2012) We need access to data on all clinical trials, not just some. BMJ 345: e8001. Available: http://www.ncbi.nlm.nih. gov/pubmed/23183067. Accessed 26 June 2014. 8. Werch CE, Owen DM (2002) Iatrogenic effects of alcoholanddrugprevention programs.J StudAlcohol 63: 581–590. Available: http://www.ncbi.nlm.nih. gov/pubmed/12380855. Accessed 16 July 2012. 9. Kirby D, Korpi M, Barth RP, Cagampang HH (1997) The impact of the Postponing Sexual Involvement curriculum among youths in Cali- fornia. Fam Plann Perspect 29: 100–108. Avail- PLOS Medicine | www.plosmedicine.org 5 October 2014 | Volume 11 | Issue 10 | e1001740 able: http://www.ncbi.nlm.nih. gov/pubmed/9179578. Accessed 3 June 2012. 10. Petrosino A, Turpin Petrosino C, John B (2004) ‘‘Scared Straight’’ and Other Juvenile Awareness Programs for Preventing Juvenile Delinquency. Campbell Syst Rev 2004.2. doi:10.4073/csr.2004.2. 11. Sallis JF, McKenzie TL, Alcaraz JE, Kolody B, Hovell MF, et al. (1993) Project SPARK. Effects of physical education on adiposity in children. Ann N Y Acad Sci 699: 127–136. Available: http://www.ncbi.nlm.nih.gov/pubmed/ 8267303. Accessed 2 July 2012. 12. Sloboda Z, Stephens RC, Stephens PC, Grey SF, Teasdale B, et al. (2009) The Adolescent Substance Abuse Prevention Study: A random- ized field trial of a universal substance abuse prevention program. Drug Alcohol Depend 102: 1–10. Available: http://www.ncbi.nlm.nih.gov/ pubmed/19332365. Accessed 19 April 2012. 13. Sackett DL (2002) The arrogance of preventive medicine. CMAJ 167: 363–364. Available: http: //www.pubmedcentral.nih.gov/articlerender. fcgi?artid=117852&tool=pmcentrez&rendertype= abstract. Accessed 13 June 2012. 14. Faggiano F, Vigna-Taglianti FD, Versino E, Zambon A, Borraccino A, et al. (2005) School- based prevention for illicit drugs’ use. Cochrane Database Syst Rev: CD003020. Available: http://www.ncbi.nlm.nih.gov/pubmed/ 15846647. Accessed 11 November 2013. 15. Foxcroft DR, Tsertsvadze A (2011) Universal multi-component prevention programs for alco- hol misuse in young people. Cochrane Database Syst Rev: CD009307. Available: http://www. ncbi.nlm.nih.gov/pubmed/21901732. Accessed 11 November 2013. 16. Waters E, de Silva-Sanigorski A, Hall BJ, Brown T, Campbell KJ, et al. (2011) Interventions for preventing obesity in children. Cochrane data- base Syst Rev: CD001871. Available: http:// www.ncbi.nlm.nih.gov/pubmed/22161367. Ac- cessed 11 November 2013. 17. Michie S, van Stralen MM, West R (2011) The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci 6: 42. Available: http://www.pubmedcentral.nih.gov/articlerender. fcgi?artid=3096582&tool=pmcentrez&rendertype =abstract. Accessed 11 November 2013. 18. Noar SM, Zimmerman RS (2005) Health Behav- ior Theory and cumulative knowledge regarding health behaviors: are we moving in the right direction? Health Educ Res 20: 275–290. Avail- able: http://www.ncbi.nlm.nih.gov/pubmed/ 15632099. Accessed 26 July 2011. 19. Michie S, Fixsen D, Grimshaw JM, Eccles MP (2009) Specifying and reporting complex behav- iour change interventions: the need for a scientific method. Implement Sci 4: 40. Available: http:// www.pubmedcentral.nih.gov/articlerender.fcgi? artid=2717906&tool=pmcentrez&rendertype= abstract. Accessed 11 November 2013. 20. Hansen WB, Dusenbury L, Bishop D, Derzon JH (2007) Substance abuse prevention program con- tent: systematizing the classification of what pro- grams target for change. Health Educ Res 22: 351– 360. Available: http://www.ncbi.nlm.nih.gov/ pubmed/16963725. Accessed 31 August 2011. 21. Riley BL, MacDonald J, Mansi O, Kothari A, Kurtz D, et al. (2008) Is reporting on interven- tions a weak link in understanding how and why they work? A preliminary exploration using community heart health exemplars. Implement Sci 3: 27. Available: http://www.pubmedcentral. nih.gov/articlerender.fcgi?artid=2413262&tool= pmcentrez&rendertype=abstract. Accessed 11 November 2013. 22. Gandhi AG, Murphy-Graham E, Petrosino A, Chrismer SS, Weiss CH (2007) The devil is in the details: examining the evidence for ‘‘proven’’ school- based drug abuse prevention programs. Eval Rev 31: 43–74. Available: http://www.ncbi.nlm.nih. gov/pubmed/17259575. Accessed 26 June 2012. 23. Bo A, Allara E, Ferri M (2011) Scientific evidence and practice: bridging the gap. A European Monitoring Center for Drugs and Drug Addiction (EMCDDA) project to promote Best Practice in Drug Addiction field. 19th Cochrane Colloqui- um; 20 October 2011; Madrid, Spain. Available: http://2011.colloquium.cochrane.org/abstracts/ a1o4-scientific-evidence-and-practice-bridging- gap-european-monitoring-center-drugs-and-dr. Accessed 8 September 2014. 24. Brug J, van Dale D, Lanting L, Kremers S, Veenhof C, et al. (2010) Towards evidence-based, quality-controlled health promotion: the Dutch recognition system for health promotion inter- ventions. Health Educ Res 25: 1100–1106. Available: http://www.pubmedcentral.nih.gov/ articlerender.fcgi?artid=2974836&tool=pmcent rez&rendertype=abstract. Accessed 23 March 2012. 25. Pharmaceutical Research and Manufacturers of America (n.d.) Drug Discovery And Develop- ment. Available: http://www.phrma.org/sites/ default/files/pdf/PhRMA%20Profile%202013. pdf. Accessed 4 August 2011. 26. Lipsky MS, Sharp LK (2001) From idea to market: the drug approval process. J Am Board Fam Pract 14: 362–367. Available: http://www. ncbi.nlm.nih.gov/pubmed/11572541. Accessed 21 July 2011. 27. Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, et al. (2000) Framework for design and evaluation of complex interventions to improve health. BMJ 321: 694–696. Available: http://www.pubmedcentral.nih.gov/articleren der.fcgi?artid=1118564&tool=pmcentrez&ren dertype=abstract. Accessed 17 July 2012. 28. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, et al. (2008) Developing and evalu- ating complex interventions: the new Medical Research Council guidance. BMJ 337: a1655– a1655. Available: http://www.bmj.com/cgi/doi/ 10.1136/bmj.a1655. Accessed 15 March 2012. 29. Collins LM, Murphy S a, Nair VN, Strecher VJ (2005) A strategy for optimizing and evaluating behavioral interventions. Ann Behav Med 30: 65– 73. Available: http://www.ncbi.nlm.nih.gov/ pubmed/16097907. 30. Collins LM, Baker TB, Mermelstein RJ, Piper ME, Jorenby DE, et al. (2011) The multiphase optimization strategy for engineering effective tobacco use interventions. Ann Behav Med 41: 208–226. Available: http://www.pubmedcentral. nih.gov/articlerender.fcgi?artid=3053423&tool= pmcentrez&rendertype=abstract. Accessed 11 November 2013. 31. Henry Rossi P, Lipsey MW, Freeman HE (2004) Evaluation: a systematic approach. New York: SAGE. 32. International Agency for Research on Cancer (2008) IARC Handbooks of Cancer Prevention in Tobacco Control. Volume 12. Lyon. Available: http://www.iarc.fr/en/publications/pdfs-online/ prev/handbook14/handbook14.pdf. 33. Diego Concina (2012) An overview of Cochrane Systematic Reviews on NCD prevention - prelim- inary results [Thesis]. Alessandria, Italy: Universita ` del Piemonte Orientale Amedeo Avogadro. PLOS Medicine | www.plosmedicine.org 6 October 2014 | Volume 11 | Issue 10 | e1001740 eed for a scientific method. Implement Sci 4: 40. Available: http:// www.pubmedcentral.nih.gov/articlerender.fcgi? artid=2717906&tool=pmcentrez&rendertype= abstract. Accessed 11 November 2013. 20. Hansen WB, Dusenbury L, Bishop D, Derzon JH (2007) Substance abuse prevention program con- tent: systematizing the classification of what pro- grams target for change. Health Educ Res 22: 351– 360. Available: http://www.ncbi.nlm.nih.gov/ pubmed/16963725. Accessed 31 August 2011. 21. Riley BL, MacDonald J, Mansi O, Kothari A, Kurtz D, et al. (2008) Is reporting on interven- tions a weak link in understanding how and why th