CHAPTER 8 Epidemiology
Like the field of equine medicine, the discipline of epidemiology is diverse. The previous edition of this textbook contains an excellent review of important epidemiologic concepts and principles relevant to equine medicine, including diagnostic testing, measures of disease association, causality, sample design and size, and basic statistical constructs. Those topics will not be revisited in this chapter, and readers interested in those aspects of epidemiology are directed to Chapter 21 in the previous edition. This chapter is devoted to the introduction of principles, techniques, and limitations of evidence-based medicine (EBM) and its essential and underlying role in epidemiology.
EVIDENCE-BASED MEDICINE
The concept of EBM was developed by clinical epidemiologists more than 20 years ago.1 Since then, EBM has become very popular. Whereas a Medline search of EBM in 1993 yielded only six citations,2 a search in early 2008 yielded more than 29,000 citations. The Equine Veterinary Journal currently dedicates a section to EBM, and the term EBM is increasingly used in presentations and publications. Recently, EBM has been described as “the integration of the best research evidence with our clinical expertise and our patient’s unique values and circumstances.”3 The emphasis of EBM is on acquiring, assessing, and utilizing evidence to improve clinical decision making. A fundamental principle of EBM is that, whenever possible, evidence for clinical activities should be derived from well-designed studies of patients with spontaneous disease (i.e., epidemiologic studies).
The practice of equine medicine has traditionally been empiric and driven by the knowledge, wisdom, and experience of experts. The field has depended largely on combining an understanding of the pathogenesis and mechanisms of disease with authority, theory, logical deduction, and intuition. The human medical profession has moved away from these traditions toward a medical practice that is based on clinically relevant evidence.2,3 The principle of EBM is to base all clinical decisions regarding prevention, diagnosis, treatment, and prognosis of disease on the use of the best existing evidence. It is difficult to dispute the value of this approach, which aims to discourage a reliance on authority (“I treat horses with equine protozoal myeloencepalitis [EPM] this way because that is what I was told” by a textbook or expert) and promote instead a reliance on the best available evidence (“Why do I treat EPM this way?” and “What is the most successful approach to treating EPM?”). Currently, EBM refers not only to this laudable principle but also to a methodology by which the principle is realized.
Methodology
The methodology of EBM consists of five steps: (1) defining, or asking, a clinical question; (2) searching for evidence to answer the question; (3) critically appraising the evidence gathered; (4) applying the results of answering the question; and (5) auditing the outcome of applying the results (i.e., how well did the EBM-derived answer work?).2 Each of these steps is considered in turn. As will be discussed later, the state of development of the methodology is highly variable among steps.
STEP 1: ASKING THE QUESTION(S)
Any clinical encounter will generate a number of questions pertaining to signalment and history (e.g., “Does the signalment suggest that certain disorders will be more common?” “Does the herd history help eliminate certain causes?”), clinical examination findings (e.g., “How do I interpret a head tilt and signs of facial nerve paralysis in this horse?”), etiology and differential diagnosis (e.g., “What might cause these signs?”; “What is the cause of these signs?”), diagnosis (e.g., “What tests are most meaningful in a patient with this clinical complaint?”), treatment (e.g., “What is the best way to treat temporohyoid osteoarthropathy?”), prognosis (e.g., “What is the probability that this horse will return to use?”), prevention (e.g., “What can be done to prevent recurrence?”), experiences and meanings (e.g., “Have I effectively communicated with the clients?”; “Does the client perceive that I empathize?”), and improvement (e.g., “Have I learned new information about managing this case from the experience?”; “Did my patient benefit?”).
STEP 2: SEARCHING FOR EVIDENCE
In human medicine a hierarchy of resources for EBM has been proposed (note that this is a hierarchy of resources, not of evidence).2 The highest tier of this hierarchy is a computerized decision support system (CDDS) in which clinical information from a patient’s records is automatically linked to all relevant, important research findings pertaining to the patient’s circumstances. The next highest-level resource is synopses of individual studies or reviews. These synopses are designed to be concise and precise distillations of the important facts needed by busy clinicians. The next level is syntheses of reports based on exhaustive searches for evidence, implementation of explicit scientific criteria for review, and systematic assembly of the evidence. Syntheses are epitomized by the Cochrane Reviews (www.Cochranelibrary.com/). At the bottom of this hierarchy are individual scientific reports.
Equine practitioners currently operate primarily at the level of individual reports. Although a veterinary CDDS will likely be developed in the future, it is not clear when. Synopses of numerous studies on a given topic are not likely to be available soon, primarily because numerous studies for a given topic do not yet exist. The same problem arises for systematic reviews: Although there are examples,4 they are exceedingly rare. The advantage of relying on individual reports is that the information is generally current (whereas it can take many months or years to develop the evidence on which synopses and systematic reviews are based). The disadvantage is that the evidence is weaker from individual studies, and it puts the onus on the reader to critically appraise each study. Critical appraisal is discussed in greater detail in the next section, but first it is important to consider resources for finding information.
Those practitioners who are fortunate to work at institutions with appropriate licenses for digital publications will find that a great deal of information can be retrieved electronically with little effort, and librarians are generally available to assist. In settings without such licenses, it may still be possible to gain access to the necessary resources through colleges or universities. Regardless, veterinarians will find a considerable amount of high-quality information on the Internet through resources such as PubMed (http://wwwncbi.nlm.gov/PubMed/) and BioMed Central (http://www.biomedcentral.com). It is important to remember, however, that the Internet also offers much in the way of low-quality information. Relying on subscription journals is generally inefficient: There are simply too many journals with too many articles appearing each month that are relevant to the daily activities of equine specialists. Moreover, important articles are often published in journals to which few veterinarians subscribe. For example, not many veterinarians subscribe to the journal Genomics, but many would be interested in reading about the mutation that causes polysaccharide storage myopathy.5
STEP 3: CRITICAL APPRAISAL
Introduction
Although the first two steps, formally stating questions and searching for the evidence, are fairly straightforward, the third step, critical appraisal, is more complex. It is also vitally important in equine EBM because the evidence for much of what equine practitioners do is sparse and primarily derived from observational (epidemiologic) studies or experiments (using horses or other animal species) from which practitioners must then extrapolate results to the clinical setting. These sources of evidence are not only low in terms of the hierarchy of resources for searching but also relatively low in the hierarchy of evidence that has been proposed for EBM.6 Before further discussion of this hierarchy, it is necessary to briefly review these epidemiologic (patient- or population-based) study designs.
Study Designs
EBM places a premium on information derived from patient-based epidemiologic studies. Epidemiologic study designs have been summarized in the previous edition, and a full discussion of all possible study designs and their strengths and limitations is beyond the scope of this chapter. Thus designs are reviewed briefly herein. Epidemiologic study designs can be defined as either experimental or observational (Box 8-1).
Experimental epidemiologic studies are ones in which the investigators control the exposure (e.g., a treatment group) to which patients are assigned. Assignment is most often at the level of the individual but may occasionally be at the level of population (e.g., fluoride added to the water of some communities but not others to evaluate effects on dental caries). Assignment of exposure should be randomized in an effort to render the treatment groups as similar as possible for both measured and unmeasured factors that may be independently associated with the outcome of interest. Randomization, however, does not ensure that there will not be significant differences among groups that occur by chance alone, and the chance of differences occurring is greater when the study population is small. In general, the randomized, controlled clinical trial (RCT) is considered the highest form of evidence from an individual study because of the extent to which biases are reduced through the processes of randomization, a priori specification of primary study outcomes, and so-called blinding of patients and clinicians assessing primary study outcomes. An example of an RCT is the report by Smith et al. regarding incisional complications after celiotomy.7 It is worth noting that the term RCT is often used in equine medicine to refer to experimental studies involving research horses, rather than patients. At the time of this writing, a PubMed search for the term “randomized controlled trials and horses” yielded 518 results, of which fewer than a score were patient-based studies. The term RCT should be reserved for patient-based clinical studies to avoid imprecision in professional communications.
A modification of the RCT is the N of 1 RCT design. The N of 1 RCT design is one in which individual patients are assigned to pairs of treatment periods: They receive a target treatment in one period and an alternative treatment (or placebo) during the other period. The approach continues until both patient and clinician are convinced that a given treatment (whose identity to which they may be blinded) is deemed to be effective for that patient.2,6