Optimal search strategies for detecting health services research studies in MEDLINE

Background

Evidence from health services research (HSR) is currently thinly spread through many journals, making it difficult for health services researchers, managers and policy-makers to find research on clinical practice guidelines and the appropriateness, process, outcomes, cost and economics of health care services. We undertook to develop and test search terms to retrieve from the MEDLINE database HSR articles meeting minimum quality standards.

Methods

The retrieval performance of 7445 methodologic search terms and phrases in MEDLINE (the test) were compared with a hand search of the literature (the gold standard) for each issue of 68 journal titles for the year 2000 (a total of 25 936 articles). We determined sensitivity, specificity and precision (the positive predictive value) of the MEDLINE search strategies.

Results

A majority of the articles that were classified as outcome assessment, but fewer than half of those in the other categories, were considered methodologically acceptable (no methodologic criteria were applied for cost studies). Combining individual search terms to maximize sensitivity, while keeping specificity at 50% or more, led to sensitivities in the range of 88.1% to 100% for several categories (specificities ranged from 52.9% to 97.4%). When terms were combined to maximize specificity while keeping sensitivity at 50% or more, specificities of 88.8% to 99.8% were achieved. When terms were combined to maximize sensitivity and specificity while minimizing the differences between the 2 measurements, most strategies for HSR categories achieved sensitivity and specificity of at least 80%.

Interpretation

Sensitive and specific search strategies were validated for retrieval of HSR literature from MEDLINE. These strategies have been made available for public use by the US National Library of Medicine at www.nlm.nih.gov/nichsr/hedges/search.html.With the increasing emphasis on “using evidence” and “value for money” in health services, it is essential that researchers, clinicians, health system managers and public policy-makers be able to retrieve relevant, high-quality reports of health services research (HSR). Efficiently retrieved research evidence can aid in decision-making about which services to provide and in the resource allocation decisions to support those services, reducing the need for arbitrary decisions and aiding collaboration with clinicians and consumers.¹ MEDLINE is a huge and expanding bibliographic resource that is freely available to all with Internet access. Yet the volume of the literature often overwhelms both clinicians and health system decision-makers.^2,3 End-users of MEDLINE and other large bibliographic databases have difficulty executing precise searches^2,3 and are often unaware of what kind of information to seek, where to find it^3,4 and how to judge its quality.³HSR has been defined as the scientific study of the effect of health care delivery; the organization and management of health care access, quality, cost and financing; and the evaluation of the impact of health services and technology (Allmang NA, Koonce TY. Health services research topic searches. Bethesda [MD]: National Library of Medicine; 2000. Unpublished report). More recently, HSR has been defined as the multidisciplinary field of scientific investigation that studies how social factors, financing systems, organizational structures and processes, health technologies and personal behaviours affect access to health care, the quality and cost of health care and, ultimately, health and well-being.⁵ HSR articles constitute only a tiny fraction of the MEDLINE database and are spread through a large number of journals; hence, MEDLINE searching is challenging. Conversely, journal browsing is impractical as a means of retrieving all relevant studies for a given question or staying abreast of the literature. Our aim was to develop methodologic search filters for MEDLINE to enable end-users to efficiently retrieve articles of relevance to clinical practice guidelines (CPGs) and the appropriateness, process, outcomes, cost and economics of health services.     

Recognizing the Symptoms of Mental Illness following Concussions in the Sports Community: A Need for Improvement

Objective

To evaluate the awareness of concussion-related symptoms amongst members of the sports community in Canada.

Methods

A cross-sectional national electronic survey was conducted. Youth athletes, parents, coaches and medical professionals across Canada were recruited through mailing lists from sports-related opt-in marketing databases. Participants were asked to identify, from a list of options, the symptoms of a concussion. The proportion of identified symptoms (categorized as physical, cognitive, mental health-related and overall) as well as participant factors associated with symptom recognition were analyzed.

Results

The survey elicited 6,937 responses. Most of the respondents (92.1%) completed the English language survey, were male (57.7%), 35–54 years of age (61.7%), with post-secondary education (58.2%), or high reported yearly household income (>$80,000; 53.0%). There were respondents from all provinces and territories with the majority of respondents from Ontario (35.2%) or British Columbia (19.1%). While participants identified most of the physical (mean = 84.2% of symptoms) and cognitive (mean = 91.2% of symptoms), they on average only identified 53.5% of the mental health-related symptoms of concussions. Respondents who were older, with higher education and household income, or resided in the Northwest Territories or Alberta identified significantly more of the mental health-related symptoms listed.

Interpretation

While Canadian youth athletes, parents, coaches and medical professionals are able to identify most of the physical and cognitive symptoms associated with concussion, identification of mental health-related symptoms of concussion is still lagging.     

Individual wealth rank, community wealth inequality, and self-reported adult poor health: a test of hypotheses with panel data (2002-2006) from native Amazonians, Bolivia

Growing evidence suggests that economic inequality in a community harms the health of a person. Using panel data from a small-scale, preindustrial rural society, we test whether individual wealth rank and village wealth inequality affects self-reported poor health in a foraging-farming native Amazonian society. A person's wealth rank was negatively but weakly associated with self-reported morbidity. Each step up/year in the village wealth hierarchy reduced total self-reported days ill by 0.4 percent. The Gini coefficient of village wealth inequality bore a positive association with self-reported poor health that was large in size, but not statistically significant. We found small village wealth inequality, and evidence that individual economic rank did not change. The modest effects may have to do with having used subjective rather than objective measures of health, having small village wealth inequality, and with the possibly true modest effect of a person's wealth rank on health in a small-scale, kin-based society. Finally, we also found that an increase in mean individual wealth by village was related to worse self-reported health. As the Tsimane' integrate into the market economy, their possibilities of wealth accumulation rise, which may affect their well-being. Our work contributes to recent efforts in biocultural anthropology to link the study of social inequalities, human biology, and human-environment interactions.     

Fluidity of HIV-1-Specific T-Cell Responses during Acute and Early Subtype C HIV-1 Infection and Associations with Early Disease Progression

Deciphering immune events during early stages of human immunodeficiency virus type 1 (HIV-1) infection is critical for understanding the course of disease. We characterized the hierarchy of HIV-1-specific T-cell gamma interferon (IFN-γ) enzyme-linked immunospot (ELISPOT) assay responses during acute subtype C infection in 53 individuals and associated temporal patterns of responses with disease progression in the first 12 months. There was a diverse pattern of T-cell recognition across the proteome, with the recognition of Nef being immunodominant as early as 3 weeks postinfection. Over the first 6 months, we found that there was a 23% chance of an increased response to Nef for every week postinfection (P = 0.0024), followed by a nonsignificant increase to Pol (4.6%) and Gag (3.2%). Responses to Env and regulatory proteins appeared to remain stable. Three temporal patterns of HIV-specific T-cell responses could be distinguished: persistent, lost, or new. The proportion of persistent T-cell responses was significantly lower (P = 0.0037) in individuals defined as rapid progressors than in those progressing slowly and who controlled viremia. Almost 90% of lost T-cell responses were coincidental with autologous viral epitope escape. Regression analysis between the time to fixed viral escape and lost T-cell responses (r = 0.61; P = 0.019) showed a mean delay of 14 weeks after viral escape. Collectively, T-cell epitope recognition is not a static event, and temporal patterns of IFN-γ-based responses exist. This is due partly to viral sequence variation but also to the recognition of invariant viral epitopes that leads to waves of persistent T-cell immunity, which appears to associate with slower disease progression in the first year of infection.For more than a decade, there has been a wealth of evidence to show that human immunodeficiency virus (HIV)-specific cytotoxic T-cell (CTL) responses play a role in the control of HIV-1 and simian immunodeficiency virus (SIV) infection. In humans, the first appearance of CTL in primary HIV-1 infection coincides with the decline of peak viremia (7, 27), while depletion of CD8⁺ T cells in SIV infection resulted in elevated viremia (45). Additionally, polymorphisms in HLA class I-restricted CTL responses are associated with differential HIV-1 disease outcomes (25), and the emergence of viral escape within CTL epitopes during acute and chronic SIV or HIV-1 infection demonstrates the effectiveness of CD8⁺ T cells to exert viral selection pressure (21). Dissecting the specificity of HIV-1-specific CD8⁺ T-cell responses that associate with the control of viral replication during acute/early infection is thought to be critical for the design of vaccines and potential immunotherapeutic strategies aimed at stimulating these responses.Preferential targeting of class I-restricted CTL epitopes in Gag during early and chronic HIV-1 infection has been associated with lower viral loads (15, 25, 34, 48, 55), whereas Env- and Nef-specific CD8⁺ T-cell responses have been associated with higher viremia (15, 34, 55). Increasing evidence suggests that patterns of immunodominant HIV-specific CD8⁺ T-cell responses restricted by specific HLA alleles are major determinants of the viral set point (47). In addition, Goonetilleke et al. (17) have provided insight into the rapidity of early escape and the contribution of the first HIV-specific CD8⁺ T-cell responses to the transmitted/founder virus in control of acute viremia. The restriction of CTL epitopes by HLA-B*5801, for example, has also been associated with better viral control (16, 24). However, the temporal nature of epitope-specific responses that associate with viral control has not been explored. Recently, we found no association between the magnitude and breadth of gamma interferon (IFN-γ) enzyme-linked immunospot (ELISPOT) assay responses at a static 3-month time point with the viral set point at 12 months (22). The unpredictability of early T-cell responses with later viral control could be a result of HIV variability resulting in epitope escape from humoral and T-cell pressure (1, 8). For example, the impact of CTL pressure on shaping viral diversity at a human population level has been observed through HLA imprinting (6, 9, 44), and several studies have shown that certain selected escape mutations can compromise viral fitness (10, 29, 33, 39). Other studies have also demonstrated that the selection of escape variants in chronic HIV-1 and SIV infection can result in the loss of immune control and disease progression (3, 20). Assessing the nature of T-cell responses longitudinally and relating the patterns of contemporaneous viral recognition with viral diversity may represent alternative insights into factors associated with set point and disease progression.As the global AIDS epidemic continues to expand in sub-Saharan Africa, and South Africa in particular, the need to implement a preventive vaccine through the public health sector remains paramount. To date, several prototype antibody and T-cell-based candidate vaccine trials have been completed worldwide (37), and the recent failure of a phase IIb Ad5-Gag-Pol-Nef HIV-1 vaccine trial has emphasized the challenge of producing an effective T-cell-based vaccine against HIV. Data from the recent ALVAC and AIDSVAX (RV144) trials in Thailand have provided modest efficacy of a vaccine regimen in reducing HIV infection (42), and while the immune mechanisms for this are as yet unclear, these findings have created a platform for identifying immune responses that correlate with protection.The identification of the earliest targets of T cells during acute HIV-1 infection would be helpful in understanding the evolution of immunity when a host first encounters the virus and also would provide insight into the host-pathogen interplay when there is a rapidly changing target. We describe some of the earliest T-cell responses that occur during acute subtype C HIV-1 infection, how these change over time and associate with early disease progression, as well as the kinetics of these changes in relation to autologous viral escape.     

Leishmaniasis worldwide and global estimates of its incidence

As part of a World Health Organization-led effort to update the empirical evidence base for the leishmaniases, national experts provided leishmaniasis case data for the last 5 years and information regarding treatment and control in their respective countries and a comprehensive literature review was conducted covering publications on leishmaniasis in 98 countries and three territories (see 'Leishmaniasis Country Profiles Text S1, S2, S3, S4, S5, S6, S7, S8, S9, S10, S11, S12, S13, S14, S15, S16, S17, S18, S19, S20, S21, S22, S23, S24, S25, S26, S27, S28, S29, S30, S31, S32, S33, S34, S35, S36, S37, S38, S39, S40, S41, S42, S43, S44, S45, S46, S47, S48, S49, S50, S51, S52, S53, S54, S55, S56, S57, S58, S59, S60, S61, S62, S63, S64, S65, S66, S67, S68, S69, S70, S71, S72, S73, S74, S75, S76, S77, S78, S79, S80, S81, S82, S83, S84, S85, S86, S87, S88, S89, S90, S91, S92, S93, S94, S95, S96, S97, S98, S99, S100, S101'). Additional information was collated during meetings conducted at WHO regional level between 2007 and 2011. Two questionnaires regarding epidemiology and drug access were completed by experts and national program managers. Visceral and cutaneous leishmaniasis incidence ranges were estimated by country and epidemiological region based on reported incidence, underreporting rates if available, and the judgment of national and international experts. Based on these estimates, approximately 0.2 to 0.4 cases and 0.7 to 1.2 million VL and CL cases, respectively, occur each year. More than 90% of global VL cases occur in six countries: India, Bangladesh, Sudan, South Sudan, Ethiopia and Brazil. Cutaneous leishmaniasis is more widely distributed, with about one-third of cases occurring in each of three epidemiological regions, the Americas, the Mediterranean basin, and western Asia from the Middle East to Central Asia. The ten countries with the highest estimated case counts, Afghanistan, Algeria, Colombia, Brazil, Iran, Syria, Ethiopia, North Sudan, Costa Rica and Peru, together account for 70 to 75% of global estimated CL incidence. Mortality data were extremely sparse and generally represent hospital-based deaths only. Using an overall case-fatality rate of 10%, we reach a tentative estimate of 20,000 to 40,000 leishmaniasis deaths per year. Although the information is very poor in a number of countries, this is the first in-depth exercise to better estimate the real impact of leishmaniasis. These data should help to define control strategies and reinforce leishmaniasis advocacy.