共查询到20条相似文献，搜索用时 15 毫秒
1.
Hendy Abdoul Christophe Perrey Philippe Amiel Florence Tubach Serge Gottot Isabelle Durand-Zaleski Corinne Alberti 《PloS one》2012,7(9)
Background
Peer review of grant applications has been criticized as lacking reliability. Studies showing poor agreement among reviewers supported this possibility but usually focused on reviewers’ scores and failed to investigate reasons for disagreement. Here, our goal was to determine how reviewers rate applications, by investigating reviewer practices and grant assessment criteria.Methods and Findings
We first collected and analyzed a convenience sample of French and international calls for proposals and assessment guidelines, from which we created an overall typology of assessment criteria comprising nine domains relevance to the call for proposals, usefulness, originality, innovativeness, methodology, feasibility, funding, ethical aspects, and writing of the grant application. We then performed a qualitative study of reviewer practices, particularly regarding the use of assessment criteria, among reviewers of the French Academic Hospital Research Grant Agencies (Programmes Hospitaliers de Recherche Clinique, PHRCs). Semi-structured interviews and observation sessions were conducted. Both the time spent assessing each grant application and the assessment methods varied across reviewers. The assessment criteria recommended by the PHRCs were listed by all reviewers as frequently evaluated and useful. However, use of the PHRC criteria was subjective and varied across reviewers. Some reviewers gave the same weight to each assessment criterion, whereas others considered originality to be the most important criterion (12/34), followed by methodology (10/34) and feasibility (4/34). Conceivably, this variability might adversely affect the reliability of the review process, and studies evaluating this hypothesis would be of interest.Conclusions
Variability across reviewers may result in mistrust among grant applicants about the review process. Consequently, ensuring transparency is of the utmost importance. Consistency in the review process could also be improved by providing common definitions for each assessment criterion and uniform requirements for grant application submissions. Further research is needed to assess the feasibility and acceptability of these measures. 相似文献2.
Reviewers’ Ratings and Bibliometric Indicators: Hand in Hand When Assessing Over Research Proposals?
álvaro Cabezas-Clavijo Nicolás Robinson-García Manuel Escabias Evaristo Jiménez-Contreras 《PloS one》2013,8(6)
Background
The peer review system has been traditionally challenged due to its many limitations especially for allocating funding. Bibliometric indicators may well present themselves as a complement.Objective
We analyze the relationship between peers’ ratings and bibliometric indicators for Spanish researchers in the 2007 National R&D Plan for 23 research fields.Methods and Materials
We analyze peers’ ratings for 2333 applications. We also gathered principal investigators’ research output and impact and studied the differences between accepted and rejected applications. We used the Web of Science database and focused on the 2002-2006 period. First, we analyzed the distribution of granted and rejected proposals considering a given set of bibliometric indicators to test if there are significant differences. Then, we applied a multiple logistic regression analysis to determine if bibliometric indicators can explain by themselves the concession of grant proposals.Results
63.4% of the applications were funded. Bibliometric indicators for accepted proposals showed a better previous performance than for those rejected; however the correlation between peer review and bibliometric indicators is very heterogeneous among most areas. The logistic regression analysis showed that the main bibliometric indicators that explain the granting of research proposals in most cases are the output (number of published articles) and the number of papers published in journals that belong to the first quartile ranking of the Journal Citations Report.Discussion
Bibliometric indicators predict the concession of grant proposals at least as well as peer ratings. Social Sciences and Education are the only areas where no relation was found, although this may be due to the limitations of the Web of Science’s coverage. These findings encourage the use of bibliometric indicators as a complement to peer review in most of the analyzed areas. 相似文献3.
4.
5.
6.
7.
Background
Medical studies are more likely to report favorable findings when a conflict of interest is declared. We aim to quantify and determine the effect of author disclosure of conflict of interest on scientific reporting.Methods
Abstracts from an international spine research meeting (North American Spine Society 2010) were selected that specifically evaluated a device, biologic, or proprietary procedure. They were then made anonymous to reviewers. An item of interest was established in each of the abstracts in order to standardize evaluation. Next, three blinded reviewers independently rated the abstracts as favorable, neutral, or unfavorable with regard to the item of interest. Additionally, the blinded reviewers attempted to predict whether a related disclosure was made. The meeting disclosure index was used to tabulate the minimum US dollar value attributable to disclosures.Results
Of the 344 total abstracts, 76 met inclusion criteria. In 79%, a related conflict of interest was reported. The amount of the disclosure was incompletely reported in 30% of cases. Where available, it averaged a cumulative minimum of $219,634 USD per abstract. The results of the abstracts were judged to be favorable, neutral, and unfavorable in 63%, 32% and 5% of abstracts, respectively. There was no correlation between the presence of a related disclosure and the findings of the studies (p = 0.81), although interpretation of this is limited by a small sample size and an overall apparent bias to report favorable studies. Additionally, the blinded reviewers were unable to predict whether a related disclosure was made (p = 0.40).Conclusion
No association existed between the presence of a related disclosure and the results of the studies. While the actual compliance with reporting a potential conflict of interest is unable to be determined, the value amount related to the disclosures made was inadequately reported according to meeting guidelines. 相似文献8.
Objective
To compare expert assessment with bibliometric indicators as tools to assess the quality and importance of scientific research papers.Methods and Materials
Shortly after their publication in 2005, the quality and importance of a cohort of nearly 700 Wellcome Trust (WT) associated research papers were assessed by expert reviewers; each paper was reviewed by two WT expert reviewers. After 3 years, we compared this initial assessment with other measures of paper impact.Results
Shortly after publication, 62 (9%) of the 687 research papers were determined to describe at least a ‘major addition to knowledge’ –6 were thought to be ‘landmark’ papers. At an aggregate level, after 3 years, there was a strong positive association between expert assessment and impact as measured by number of citations and F1000 rating. However, there were some important exceptions indicating that bibliometric measures may not be sufficient in isolation as measures of research quality and importance, and especially not for assessing single papers or small groups of research publications.Conclusion
When attempting to assess the quality and importance of research papers, we found that sole reliance on bibliometric indicators would have led us to miss papers containing important results as judged by expert review. In particular, some papers that were highly rated by experts were not highly cited during the first three years after publication. Tools that link expert peer reviews of research paper quality and importance to more quantitative indicators, such as citation analysis would be valuable additions to the field of research assessment and evaluation. 相似文献9.
All the opinions in this article are those of the authors and should not be construed to reflect, in any way, those of the Department of Veterans Affairs.
Background
Our study purpose was to assess the predictive validity of reviewer quality ratings and editorial decisions in a general medicine journal.Methods
Submissions to the Journal of General Internal Medicine (JGIM) between July 2004 and June 2005 were included. We abstracted JGIM peer review quality ratings, verified the publication status of all articles and calculated an impact factor for published articles (Rw) by dividing the 3-year citation rate by the average for this group of papers; an Rw>1 indicates a greater than average impact.Results
Of 507 submissions, 128 (25%) were published in JGIM, 331 rejected (128 with review) and 48 were either not resubmitted after revision was requested or were withdrawn by the author. Of 331 rejections, 243 were published elsewhere. Articles published in JGIM had a higher citation rate than those published elsewhere (Rw: 1.6 vs. 1.1, p = 0.002). Reviewer quality ratings of article quality had good internal consistency and reviewer recommendations markedly influenced publication decisions. There was no quality rating cutpoint that accurately distinguished high from low impact articles. There was a stepwise increase in Rw for articles rejected without review, rejected after review or accepted by JGIM (Rw 0.60 vs. 0.87 vs. 1.56, p<0.0005). However, there was low agreement between reviewers for quality ratings and publication recommendations. The editorial publication decision accurately discriminated high and low impact articles in 68% of submissions. We found evidence of better accuracy with a greater number of reviewers.Conclusions
The peer review process largely succeeds in selecting high impact articles and dispatching lower impact ones, but the process is far from perfect. While the inter-rater reliability between individual reviewers is low, the accuracy of sorting is improved with a greater number of reviewers. 相似文献10.
11.
Khameer K. Kidia Zivai Mupambireyi Lucie Cluver Chiratidzo E. Ndhlovu Margaret Borok Rashida A. Ferrand 《PloS one》2014,9(1)
Introduction & Objectives
Due to the scale up of antiretroviral therapy, increasing numbers of HIV-infected children are living into adolescence. As these children grow and surpass the immediate threat of death, the issue of informing them of their HIV status arises. This study aimed to understand how perinatally-infected adolescents learn about their HIV-status as well as to examine their preferences for the disclosure process.Methods
In-depth interviews were conducted with 31 (14 male, 17 female) perinatally-infected adolescents aged 16–20 at an HIV clinic in Harare, Zimbabwe, and focused on adolescents'' experiences of disclosure. In addition, 15 (1 male, 14 female) healthcare workers participated in two focus groups that were centred on healthcare workers'' practices surrounding disclosure in the clinic. Purposive sampling was used to recruit participants. A coding frame was developed and major themes were extracted using grounded theory methods.Results
Healthcare workers encouraged caregivers to initiate disclosure in the home environment. However, many adolescents preferred disclosure to take place in the presence of healthcare workers at the clinic because it gave them access to accurate information as well as an environment that made test results seem more credible. Adolescents learned more specific information about living with an HIV-positive status and the meaning of that status from shared experiences among peers at the clinic.Conclusions
HIV-status disclosure to adolescents is distinct from disclosure to younger children and requires tailored, age-appropriate guidelines. Disclosure to this age group in a healthcare setting may help overcome some of the barriers associated with caregivers disclosing in the home environment and make the HIV status seem more credible to an adolescent. The study also highlights the value of peer support among adolescents, which could help reduce the burden of psychosocial care on caregivers and healthcare workers. 相似文献12.
Background
Research on adolescent substance use has consistently identified a strong relationship between adolescent behavior and the behavior of their peers. However, peer effects are difficult to estimate and causal interpretations must be undertaken with caution since individuals in most cases choose with whom to associate. In this paper we seek to empirically quantify the causal role of peer social networks in explaining marijuana usage among adolescents.Methods and Findings
Using data from a nationally representative sample of adolescents we utilize a multivariate structural model with school-level fixed effects to account for the problems of contextual effects, correlated effects and peer selections to purge the potential biases from the estimates of peer influence. Our peer group measures are drawn not only from the nomination of close friends (N = 6,377), but also from classmates (N = 19,335). Marijuana usage among the peer groups were constructed using the peers'' own report of their marijuana consumption. Controlling for parent level characteristics, and other demographic parameters, we find that a 10% increase in the proportion of close friends and classmates who use marijuana increases the probability that an individual chooses to use marijuana by 5%.Conclusion
Our findings indicate that peer effects are important determinants of marijuana use even after controlling for potential biases We also found evidence to show that the influence of close friends and the more exogenous classmates are quite similar in magnitude under our preferred specification, supporting theory predicting the importance of peer influence. Effective policy aimed at reducing marijuana usage among adolescents would consider these significant peer effects. 相似文献13.
Background
Patient decisions are influenced by their personal values. However, there is a lack of clarity and attention on the concept of patient values in the clinical context despite clear emphasis on patient values in evidence-based medicine and shared decision making. The aim of the study was to explore the concept of patient values in the context of making decisions about insulin initiation among people with type 2 diabetes.Methods and Findings
We conducted individual in-depth interviews with people with type 2 diabetes who were making decisions about insulin treatment. Participants were selected purposively to achieve maximum variation. A semi-structured topic guide was used to guide the interviews which were audio-recorded and analysed using a thematic approach. We interviewed 21 participants between January 2011 and March 2012. The age range of participants was 28–67 years old. Our sample comprised 9 women and 12 men. Three main themes, ‘treatment-specific values’, ‘life goals and philosophies’, and ‘personal and social background’, emerged from the analysis. The patients reported a variety of insulin-specific values, which were negative and/or positive beliefs about insulin. They framed insulin according to their priorities and philosophies in life. Patients’ decisions were influenced by sociocultural (e.g. religious background) and personal backgrounds (e.g. family situations).Conclusions
This study highlighted the need for expanding the current concept of patient values in medical decision making. Clinicians should address more than just values related to treatment options. Patient values should include patients’ priorities, life philosophy and their background. Current decision support tools, such as patient decision aids, should consider these new dimensions when clarifying patient values. 相似文献14.
Introduction
HIV stigma is a contributing factor to poor patient outcomes. Although HIV stigma has been documented, its impact on patient well-being in the southern US is not well understood.Methods
Thirty-two adults participated in cognitive interviews after completing the Berger HIV or the Van Rie stigma scale. Participant responses were probed to ensure the scales accurately measured stigma and to assess the impact stigma had on behavior.Results
Three main themes emerged regarding HIV stigma: (1) negative attitudes, fear of contagion, and misperceptions about transmission; (2) acts of discrimination by families, friends, health care providers, and within the workplace; and (3) participants’ use of self-isolation as a coping mechanism. Overwhelming reluctance to disclose a person’s HIV status made identifying enacted stigma with a quantitative scale difficult.Discussion
Fear of discrimination resulted in participants isolating themselves from friends or experiences to avoid disclosure. Participant unwillingness to disclose their HIV status to friends and family could lead to an underestimation of enacted HIV stigma in quantitative scales. 相似文献15.
Kate Daine Keith Hawton Vinod Singaravelu Anne Stewart Sue Simkin Paul Montgomery 《PloS one》2013,8(10)
Background
There is concern that the internet is playing an increasing role in self-harm and suicide. In this study we systematically review and analyse research literature to determine whether there is evidence that the internet influences the risk of self-harm or suicide in young people.Methods
An electronic literature search was conducted using the PsycINFO, MEDLINE, EMBASE, Scopus, and CINAHL databases. Articles of interest were those that included empirical data on the internet, self-harm or suicide, and young people. The articles were initially screened based on titles and abstracts, then by review of the full publications, after which those included in the review were subjected to data extraction, thematic analysis and quality rating.Results
Youth who self-harm or are suicidal often make use of the internet. It is most commonly used for constructive reasons such as seeking support and coping strategies, but may exert a negative influence, normalising self-harm and potentially discouraging disclosure or professional help-seeking. The internet has created channels of communication that can be misused to ‘cyber-bully’ peers; both cyber-bullying and general internet use have been found to correlate with increased risk of self-harm, suicidal ideation, and depression. Correlations have also been found between internet exposure and violent methods of self-harm.Conclusions
Internet use may exert both positive and negative effects on young people at risk of self-harm or suicide. Careful high quality research is needed to better understand how internet media may exert negative influences and should also focus on how the internet might be utilised to intervene with vulnerable young people. 相似文献16.
Introduction
The National Institute for Health and Clinical Excellence guidelines recommend acupuncture as a clinically effective treatment for chronic back pain. However, there is insufficient knowledge of what factors contribute to patients’ positive and negative experiences of acupuncture, and how those factors interact in terms of the acceptability of treatment. This study used patient interviews following acupuncture treatment for back pain to identify, understand and describe the elements that contribute or detract from acceptability of treatment.Methods
The study used semi-structured interviews. Twelve patients were interviewed using an interview schedule as a sub-study nested within a randomised controlled trial of acupuncture for chronic back pain. The interviews were analysed using thematic analysis.Results and Discussion
Three over-arching themes emerged from the analysis. The first entitled facilitators of acceptability contained five subthemes; experience of pain relief, improvements in physical activity, relaxation, psychological benefit, reduced reliance on medication. The second over-arching theme identified barriers to acceptability, which included needle-related discomfort and temporary worsening of symptoms, pressure to continue treatment and financial cost. The third over-arching theme comprised mediators of acceptability, which included pre-treatment mediators such as expectation and previous experience, and treatment-related mediators of time, therapeutic alliance, lifestyle advice and the patient’s active involvement in recovery. These themes inform our understanding of the acceptability of acupuncture to patients with low back pain.Conclusion
The acceptability of acupuncture treatment for low back pain is complex and multifaceted. The therapeutic relationship between the practitioner and patient emerged as a strong driver for acceptability, and as a useful vehicle to develop the patients’ self-efficacy in pain management in the longer term. Unpleasant treatment related effects do not necessarily detract from patients’ overall perception of acceptability. 相似文献17.
18.
Virginie Muller-Juge Stéphane Cullati Katherine S. Blondon Patricia Hudelson Fabienne Ma?tre Nu V. Vu Georges L. Savoldelli Mathieu R. Nendaz 《PloS one》2013,8(2)
Background
Effective interprofessional collaboration requires that team members share common perceptions and expectations of each other''s roles.Objective
Describe and compare residents’ and nurses’ perceptions and expectations of their own and each other’s professional roles in the context of an Internal Medicine ward.Methods
A convenience sample of 14 residents and 14 nurses volunteers from the General Internal Medicine Division at the University Hospitals of Geneva, Switzerland, were interviewed to explore their perceptions and expectations of residents’ and nurses’ professional roles, for their own and the other profession. Interviews were analysed using thematic content analysis. The same respondents also filled a questionnaire asking their own intended actions and the expected actions from the other professional in response to 11 clinical scenarios.Results
Three main themes emerged from the interviews: patient management, clinical reasoning and decision-making processes, and roles in the team. Nurses and residents shared general perceptions about patient management. However, there was a lack of shared perceptions and expectations regarding nurses’ autonomy in patient management, nurses’ participation in the decision-making process, professional interdependence, and residents’ implication in teamwork. Results from the clinical scenarios showed that nurses’ intended actions differed from residents’ expectations mainly regarding autonomy in patient management. Correlation between residents’ expectations and nurses’ intended actions was 0.56 (p = 0.08), while correlation between nurses’ expectations and residents’ intended actions was 0.80 (p<0.001).Conclusions
There are discordant perceptions and unmet expectations among nurses and residents about each other’s roles, including several aspects related to the decision-making process. Interprofessional education should foster a shared vision of each other’s roles and clarify the boundaries of autonomy of each profession. 相似文献19.
Objectives
To identify and understand, through data from multiple sources, some of the factors that affect authors’ and editors’ decisions to use reporting guidelines in the publication of health research.Design
Mixed methods study comprising an online survey and semi-structured interviews with a sample of authors (online survey: n = 56; response rate = 32%; semi-structured interviews: n = 5) and journal editors (online survey: n = 43; response rate = 27%; semi-structured interviews: n = 6) involved in publishing health and medical research. Participants were recruited from an earlier study examining the effectiveness of the TREND reporting guideline.Results
Four types of factors interacted to affect authors’ and editors’ likelihood of reporting guideline use; individual (e.g. having multiple reasons for use of reporting guidelines); the professional culture in which people work; environmental (e.g. policies of journals); and, practical (e.g. having time to use reporting guidelines). Having multiple reasons for using reporting guidelines was a particularly salient factor in facilitating reporting guidelines use for both groups of participants.Conclusions
Improving the completeness and consistency of reporting of research studies is critical to the integrity and synthesis of health research. The use of reporting guidelines offers one potentially efficient and effective means for achieving this, but decisions to use (or not use) reporting guidelines take many factors into account. These findings could be used to inform future studies that might, for example, test the factors that we have identified within a wider theoretical framework for understanding changes in professional practices. The use of reporting guidelines by senior professionals appears to shape the expectations of what constitutes best practice and can be assimilated into the culture of a field or discipline. Without evidence of effectiveness of reporting guidelines, and sustained, multifaceted efforts to improve reporting, little progress seems likely to be made. 相似文献20.