Content analysis of oncology-related pharmaceutical advertising in a peer-reviewed medical journal

Background

The oncology market represents one of the largest pharmaceutical markets in any medical field, and printed advertising in medical journals is an important channel by which pharmaceutical companies communicate with healthcare professionals. The aim of the present study was to analyze the volume and content of and trends and changes in oncology-related advertising intended for healthcare professionals in a peer-reviewed medical journal. Information that could be included in advertisements to promote drug development and improve treatment strategies for cancer patients is discussed on the basis of the results of the analysis.

Methods/Principal Findings

Overall, 6,720 advertisements covering 13,039 pages in a leading oncology medical journal published (by the American Society of Clinical Oncology) between January 2005 and December 2009 were analyzed. The advertisements targeting pharmaceuticals and clinical trials, in particular, were reviewed. A total of 6,720 advertisements covering 13,039 pages were included in the analysis. For the years 2005–2009, the percentages of total journal pages dedicated to advertising were 24.0%, 45.7%, 49.8%, 46.8%, and 49.8%, respectively. Package insert information and efficacy and safety explanations appeared in more than 80% of advertisements intended for pharmaceutical promotion. From 2005 to 2009, the overall quantity of drug advertisements decreased by approximately 13%, whereas advertisements calling for the enrollment of patients into registration trials increased by approximately 11%.

Conclusion/Significance

Throughout the study period, oncology-related pharmaceutical advertisements occupied a considerable number of pages relative to other journal content. The proportion of advertisements on ongoing clinical trials increased progressively throughout the study period.     

Adherence of pharmaceutical advertisements in medical journals to FDA guidelines and content for safe prescribing

Background

Physician-directed pharmaceutical advertising is regulated in the United States by the Food and Drug Administration (FDA); adherence to current FDA guidelines is unknown. Our objective was to determine adherence rates of physician-directed print advertisements in biomedical journals to FDA guidelines and describe content important for safe prescribing.

Methods and Findings

Cross-sectional analysis of November 2008 pharmaceutical advertisements within top U.S.-based biomedical journals publishing original research. We excluded advertisements for devices, over the counter medications, and disease awareness. We utilized FDA guideline items identifying unique forms of advertisement bias to categorize advertisements as adherent to FDA guidelines, possibly non-adherent to at least 1 item, or non-adherent to at least 1 item. We also evaluated advertisement content important for safe prescribing, including benefit quantification, risk information and verifiable references. All advertisements were evaluated by 2 or more investigators, with differences resolved by discussion. Twelve journals met inclusion criteria. Nine contained pharmaceutical advertisements, including 192 advertisements for 82 unique products; median 2 per product (range 1–14). Six “teaser” advertisements presented only drug names, leaving 83 full unique advertisements. Fifteen advertisements (18.1%) adhered to all FDA guidelines, 41 (49.4%) were non-adherent with at least one form of FDA-described bias, and 27 (32.5%) were possibly non-adherent due to incomplete information. Content important for safe prescribing was often incomplete; 57.8% of advertisements did not quantify serious risks, 48.2% lacked verifiable references and 28.9% failed to present adequate efficacy quantification. Study limitations included its focus on advertisements from a single month, the subjectivity of FDA guidelines themselves, and the necessary subjectivity of determinations of adherence.

Conclusions

Few physician-directed print pharmaceutical advertisements adhere to all FDA guidelines; over half fail to quantify serious risks. The FDA could better protect public health by creating new more objective advertisement guidelines requiring transparent presentation of basic safety and efficacy information.     

Publication Bias in Recent Meta-Analyses

Introduction

Positive results have a greater chance of being published and outcomes that are statistically significant have a greater chance of being fully reported. One consequence of research underreporting is that it may influence the sample of studies that is available for a meta-analysis. Smaller studies are often characterized by larger effects in published meta-analyses, which can be possibly explained by publication bias. We investigated the association between the statistical significance of the results and the probability of being included in recent meta-analyses.

Methods

For meta-analyses of clinical trials, we defined the relative risk as the ratio of the probability of including statistically significant results favoring the treatment to the probability of including other results. For meta-analyses of other studies, we defined the relative risk as the ratio of the probability of including biologically plausible statistically significant results to the probability of including other results. We applied a Bayesian selection model for meta-analyses that included at least 30 studies and were published in four major general medical journals (BMJ, JAMA, Lancet, and PLOS Medicine) between 2008 and 2012.

Results

We identified 49 meta-analyses. The estimate of the relative risk was greater than one in 42 meta-analyses, greater than two in 16 meta-analyses, greater than three in eight meta-analyses, and greater than five in four meta-analyses. In 10 out of 28 meta-analyses of clinical trials, there was strong evidence that statistically significant results favoring the treatment were more likely to be included. In 4 out of 19 meta-analyses of observational studies, there was strong evidence that plausible statistically significant outcomes had a higher probability of being included.

Conclusions

Publication bias was present in a substantial proportion of large meta-analyses that were recently published in four major medical journals.     

Assessment of the Reporting Quality of Randomized Controlled Trials on the Treatment of Diabetes Mellitus with Traditional Chinese Medicine: A Systematic Review

Background

After the publication of the CONSORT 2010 statement, few studies have been conducted to assess the reporting quality of randomized clinical trials (RCTs) on treatment of diabetes mellitus with Traditional Chinese Medicine (TCM) published in Chinese journals.

Objective

To investigate the current situation of the reporting quality of RCTs in leading medical journals in China with the CONSORT 2010 statement as criteria.

Methods

The China National Knowledge Infrastructure (CNKI) electronic database was searched for RCTs on the treatment of diabetes mellitus with TCM published in the Journal of Traditional Chinese Medicine, Chinese Journal of Integrated Traditional & Western Medicine, and the China Journal of Chinese Materia Medica from January to December 2011. We excluded trials reported as “animal studies”, “in vitro studies”, “case studies”, or “systematic reviews”. The CONSORT checklist was applied by two independent raters to evaluate the reporting quality of all eligible trials after discussing and comprehending the items thoroughly. Each item in the checklist was graded as either “yes” or “no” depending on whether it had been reported by the authors.

Results

We identified 27 RCTs. According to the 37 items in the CONSORT checklist, the average reporting percentage was 45.0%, in which the average reporting percentage for the “title and abstract”, the “introduction”, the “methods”, the “results”, the “discussion” and the “other information” was 33.3%, 88.9%, 36.4%, 54.4%, 71.6% and 14.8%, respectively. In the Journal of Traditional Chinese Medicine, Chinese Journal of Integrated Traditional & Western Medicine, and the China Journal of Chinese Materia Medica the average reporting percentage was 42.2%, 56.8%, and 46.0%, respectively.

Conclusions

The reporting quality of RCTs in these three journals was insufficient to allow readers to assess the validity of the trials. We recommend that editors require authors to use the CONSORT statement when reporting their trial results as a condition of publication.     

Potential misinterpretation of treatment effects due to use of odds ratios and logistic regression in randomized controlled trials

Background

In randomized controlled trials (RCTs), the odds ratio (OR) can substantially overestimate the risk ratio (RR) if the incidence of the outcome is over 10%. This study determined the frequency of use of ORs, the frequency of overestimation of the OR as compared with its accompanying RR in published RCTs, and we assessed how often regression models that calculate RRs were used.

Methods

We included 288 RCTs published in 2008 in five major general medical journals (Annals of Internal Medicine, British Medical Journal, Journal of the American Medical Association, Lancet, New England Journal of Medicine). If an OR was reported, we calculated the corresponding RR, and we calculated the percentage of overestimation by using the formula .

Results

Of 193 RCTs with a dichotomous primary outcome, 24 (12.4%) presented a crude and/or adjusted OR for the primary outcome. In five RCTs (2.6%), the OR differed more than 100% from its accompanying RR on the log scale. Forty-one of all included RCTs (n = 288; 14.2%) presented ORs for other outcomes, or for subgroup analyses. Nineteen of these RCTs (6.6%) had at least one OR that deviated more than 100% from its accompanying RR on the log scale. Of 53 RCTs that adjusted for baseline variables, 15 used logistic regression. Alternative methods to estimate RRs were only used in four RCTs.

Conclusion

ORs and logistic regression are often used in RCTs and in many articles the OR did not approximate the RR. Although the authors did not explicitly misinterpret these ORs as RRs, misinterpretation by readers can seriously affect treatment decisions and policy making.     

Temporal trends in the impact factor of European versus USA biomedical journals

Background

The impact factors of biomedical journals tend to rise over time. We sought to assess the trend in the impact factor, during the past decade, of journals published on behalf of United States (US) and European scientific societies, in four select biomedical subject categories (Biology, Cell Biology, Critical Care Medicine, and Infectious Diseases).

Methods

We identified all journals included in the above-mentioned subject categories of Thomson Reuters Journal Citation Reports® for the years 1999, 2002, 2005, and 2008. We selected those that were published on behalf of US or European scientific societies, as documented in journal websites.

Results

We included 167 journals (35 in the subject category of Biology, 79 in Cell Biology, 27 in Critical Care Medicine, and 26 in Infectious Diseases). Between 1999 and 2008, the percentage increase in the impact factor of the European journals was higher than for the US journals (73.7±110.0% compared with 39.7±70.0%, p = 0.049). Regarding specific subject categories, the percentage change in the factor of the European journals tended to be higher than the respective US journals for Cell Biology (61.7% versus 16.3%), Critical Care Medicine (212.4% versus 65.4%), Infectious Diseases (88.3% versus 48.7%), whereas the opposite was observed for journals in Biology (41.0% versus 62.5%).

Conclusion

Journals published on behalf of European scientific societies, in select biomedical fields, may tend to close the “gap” in impact factor compared with those of US societies.

What''s Already Known About This Topic?

The impact factors of biomedical journals tend to rise through years. The leading positions in productivity in biomedical research are held by developed countries, including those from North America and Western Europe.

What Does This Article Add?

The journals from European biomedical scientific societies tended, over the past decade, to increase their impact factor more than the respective US journals.     

Misconduct Policies in High-Impact Biomedical Journals

Background

It is not clear which research misconduct policies are adopted by biomedical journals. This study assessed the prevalence and content policies of the most influential biomedical journals on misconduct and procedures for handling and responding to allegations of misconduct.

Methods

We conducted a cross-sectional study of misconduct policies of 399 high-impact biomedical journals in 27 biomedical categories of the Journal Citation Reports in December 2011. Journal websites were reviewed for information relevant to misconduct policies.

Results

Of 399 journals, 140 (35.1%) provided explicit definitions of misconduct. Falsification was explicitly mentioned by 113 (28.3%) journals, fabrication by 104 (26.1%), plagiarism by 224 (56.1%), duplication by 242 (60.7%) and image manipulation by 154 (38.6%). Procedures for responding to misconduct were described in 179 (44.9%) websites, including retraction, (30.8%) and expression of concern (16.3%). Plagiarism-checking services were used by 112 (28.1%) journals. The prevalences of all types of misconduct policies were higher in journals that endorsed any policy from editors’ associations, Office of Research Integrity or professional societies compared to those that did not state adherence to these policy-producing bodies. Elsevier and Wiley-Blackwell had the most journals included (22.6% and 14.8%, respectively), with Wiley journals having greater a prevalence of misconduct definition and policies on falsification, fabrication and expression of concern and Elsevier of plagiarism-checking services.

Conclusions

Only a third of top-ranking peer-reviewed journals had publicly-available definitions of misconduct and less than a half described procedures for handling allegations of misconduct. As endorsement of international policies from policy-producing bodies was positively associated with implementation of policies and procedures, journals and their publishers should standardize their policies globally in order to increase public trust in the integrity of the published record in biomedicine.     

Fifty-Year Fate and Impact of General Medical Journals

Background

Influential medical journals shape medical science and practice and their prestige is usually appraised by citation impact metrics, such as the journal impact factor. However, how permanent are medical journals and how stable is their impact over time?

Methods and Results

We evaluated what happened to general medical journals that were publishing papers half a century ago, in 1959. Data were retrieved from ISI Web of Science for citations and PubMed (Journals function) for journal history. Of 27 eligible journals publishing in 1959, 4 have stopped circulation (including two of the most prestigious journals in 1959) and another 7 changed name between 1959 and 2009. Only 6 of these 27 journals have been published continuously with their initial name since they started circulation. The citation impact of papers published in 1959 gives a very different picture from the current journal impact factor; the correlation between the two is non-significant and very close to zero. Only 13 of the 5,223 papers published in 1959 received at least 5 citations in 2009.

Conclusions

Journals are more permanent entities than single papers, but they are also subject to major change and their relative prominence can change markedly over time.     

Impact of GDP,Spending on R&D,Number of Universities and Scientific Journals on Research Publications among Asian Countries

Objectives

This study aimed to compare the impact of Gross Domestic Product (GDP) per capita, spending on Research and Development (R&D), number of universities, and Indexed Scientific Journals on total number of research documents (papers), citations per document and Hirsch index (H-index) in various science and social science subjects among Asian countries.

Materials and Methods

In this study, 40 Asian countries were included. The information regarding Asian countries, their GDP per capita, spending on R&D, total number of universities and indexed scientific journals were collected. We recorded the bibliometric indicators, including total number of research documents, citations per document and H-index in various science and social sciences subjects during the period 1996–2011. The main sources for information were World Bank, SCI-mago/Scopus and Web of Science; Thomson Reuters.

Results

The mean per capita GDP for all the Asian countries is 14448.31±2854.40 US$, yearly per capita spending on R&D 0.64±0.16 US$, number of universities 72.37±18.32 and mean number of ISI indexed journal per country is 17.97±7.35. The mean of research documents published in various science and social science subjects among all the Asian countries during the period 1996–2011 is 158086.92±69204.09; citations per document 8.67±0.48; and H-index 122.8±19.21. Spending on R&D, number of universities and indexed journals have a positive correlation with number of published documents, citations per document and H-index in various science and social science subjects. However, there was no association between the per capita GDP and research outcomes.

Conclusion

The Asian countries who spend more on R&D have a large number of universities and scientific indexed journals produced more in research outcomes including total number of research publication, citations per documents and H-index in various science and social science subjects.     

The Evolution of Academic Performance in Nine Subspecialties of Internal Medicine: An Analysis of Journal Citation Reports from 1998 to 2010

Background

Internal medicine includes several subspecialties. This study aimed to describe change trend of impact factors in different subspecialties of internal medicine during the past 12 years, as well as the developmental differences among each subspecialty, and the possible influencing factors behind these changes and differences.

Methods

Nine subspecialties of internal medicine were chosen for comparison. All data were collected from the Science Citation Index Expanded and Journal Citation Reports database.

Results

(1) Journal numbers in nine subspecialties increased significantly from 1998 to 2010, with an average increment of 80.23%, in which cardiac and cardiovascular system diseases increased 131.2% rank the first; hematology increased 45% rank the least. (2) Impact Factor in subspecialties of infectious disease, cardiac and cardiovascular system diseases, gastroenterology and hepatology, hematology, endocrinology and metabolism increased significantly (p<0.05), in which gastroenterology and hepatology had the largest increase of 65.4%. (3) Journal impact factor of 0–2 had the largest proportion in all subspecialties. Among the journals with high impact factor (IF>6), hematology had the maximum proportion of 10%, nephrology and respiratory system disease had the minimum of 4%. Among the journal with low impact factor (IF<2), journal in nephrology and allergy had the most (60%), while endocrinology and metabolism had the least (40%). There were differences in median number of IF among the different subspecialties (p<0.05), in which endocrinology and metabolism had the highest, nephrology had the lowest. (4) The highest IF had a correlation with journal numbers and total paper numbers in each field.

Conclusion

The IF of internal medicine journals showed an increasingly positive trend, in which gastroenterology and hepatology increase the most. Hematology had more high IF journals. Endocrinology and metabolism had higher average IF. Nephrology remained the lowest position. Numbers of journals and total papers were associated with the highest IF.     

Too Few,Too Weak: Conflict of Interest Policies at Canadian Medical Schools

Introduction

The education of medical students should be based on the best clinical information available, rather than on commercial interests. Previous research looking at university-wide conflict of interest (COI) policies used in Canadian medical schools has shown very poor regulation. An analysis of COI policies was undertaken to document the current policy environment in all 17 Canadian medical schools.

Methods

A web search was used to initially locate COI policies supplemented by additional information from the deans of each medical school. Strength of policies was rated on a scale of 0 to 2 in 12 categories and also on the presence of enforcement measures. For each school, we report scores for all 12 categories, enforcement measures, and summative scores.

Results

COI policies received summative scores that ranged from 0 to 19, with 0 the lowest possible score obtainable and 24 the maximum. The highest mean scores per category were for disclosure and ghostwriting (0.9) and for gifts and scholarships (0.8).

Discussion

This study provides the first comprehensive evaluation of all 17 Canadian medical school-specific COI policies. Our results suggest that the COI policy environment at Canadian medical schools is generally permissive. Policy development is a dynamic process. We therefore encourage all Canadian medical schools to develop restrictive COI policies to ensure that their medical students are educated based on the best clinical evidence available, free of industry biases and COI relationships that may influence the future medical thinking and prescribing practices of medical students in Canada once they graduate.     

Reporting Quality of Systematic Reviews/Meta-Analyses of Acupuncture

Background

The QUOROM and PRISMA statements were published in 1999 and 2009, respectively, to improve the consistency of reporting systematic reviews (SRs)/meta-analyses (MAs) of clinical trials. However, not all SRs/MAs adhere completely to these important standards. In particular, it is not clear how well SRs/MAs of acupuncture studies adhere to reporting standards and which reporting criteria are generally ignored in these analyses.

Objectives

To evaluate reporting quality in SRs/MAs of acupuncture studies.

Methods

We performed a literature search for studies published prior to 2014 using the following public archives: PubMed, EMBASE, Web of Science, the Cochrane Database of Systematic Reviews (CDSR), the Chinese Biomedical Literature Database (CBM), the Traditional Chinese Medicine (TCM) database, the Chinese Journal Full-text Database (CJFD), the Chinese Scientific Journal Full-text Database (CSJD), and the Wanfang database. Data were extracted into pre-prepared Excel data-extraction forms. Reporting quality was assessed based on the PRISMA checklist (27 items).

Results

Of 476 appropriate SRs/MAs identified in our search, 203, 227, and 46 were published in Chinese journals, international journals, and the Cochrane Database, respectively. In 476 SRs/MAs, only 3 reported the information completely. By contrast, approximately 4.93% (1/203), 8.81% (2/227) and 0.00% (0/46) SRs/Mas reported less than 10 items in Chinese journals, international journals and CDSR, respectively. In general, the least frequently reported items (reported≤50%) in SRs/MAs were “protocol and registration”, “risk of bias across studies”, and “additional analyses” in both methods and results sections.

Conclusions

SRs/MAs of acupuncture studies have not comprehensively reported information recommended in the PRISMA statement. Our study underscores that, in addition to focusing on careful study design and performance, attention should be paid to comprehensive reporting standards in SRs/MAs on acupuncture studies.