Academy Evidence Analysis Manual

How to Use This Manual

Evidence analysis is a complex process. This manual breaks the process down into concrete parts. A distinction is made between the general steps of the project, and the more concrete actions within each step.

Table 1 presents the major phases in the Academy's evidence analysis process.

Table 1. Steps of the Academy's Evidence Analysis Project

Steps of the Evidence Analysis Process	Brief Description	Tools
Chapter 1 Step 1 - Formulate Evidence Analysis Question	Specify a question in a defined area of practice; or state a tentative conclusion or recommendation that is being considered. Include the patient type and special needs of the target population involved, the alternatives under consideration, and the outcomes of interest (PICO format).	Appendix 1: Question Formulation Template Appendix 2: The PICO Chart
Chapter 2 Step 2 - Gather and Classify Evidence	Conduct a systematic search of the literature to find evidence related to the question, gather studies and reports, and classify them by type of evidence. Classes differentiate primary reports of new data according to study design, and distinguish them from secondary reports that include systematic and/or narrative review. (Classes are: A, B, C, D, M, R, and X.)	Appendix 3: Search Plan & Results Table Appendix 4: Classes of Evidence Reports Appendix 5: Algorithm for Classifying Research Design Appendix 6: Glossary of Research Design Terms
Chapter 3 Step 3 - Critically Appraise Each Article	Review each article for relevance to the question and use the checklist of questions to evaluate the research design and implementation. Abstract key information from the report.	Appendix 7: Evidence Abstract Worksheet Template Appendix 8:Quality Criteria Checklist: Primary Research Appendix 9: Quality Criteria Checklist: Primary Research Non-human subjects Appendix 10: Quality Criteria Checklist: Review Article Appendix 11: Important Considerations (from checklist) by Study Design Appendix 12: Tally of Primary Research Ratings Appendix 13: Tally Sheet Example
Chapte 4 Step 4 - Summarize Evidence	Synthesize the reports into an overview table and summarize the research relevant to the question.	Appendix 14: Overview Table Appendix15: Overview Table Example
Chapter 5 Step 5 - Write and Grade the Conclusion Statement	Develop a concise conclusion statement (the answer to the question). Assign a grade to indicate the overall strength or weakness of evidence informing the conclusion statement. (The Academy uses Grades I, II, III, IV, and V for strong, fair, weak, expert opinion only, and no evidence, respectively.)	Appendix16: Conclusion Statement and Grade Appendix17: Grade Definitions for Strength of Evidence for Conclusion Appendix 18: Grade Definition Table

The manual is set up in two main parts:

1. The main text: contains a description of each step along with examples from other evidence analysis projects. These examples will help you see how the process was carried out successfully.
   
2. Appendices: contains templates (worksheets, checklists, and other tools) of formsused in an online web-based format.

Return to Main . . . . . Proceed to Overview of Steps

ADA Research and Strategic Business Development

© 2011 American Dietetic Association