Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation

The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger’s Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss’ Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts’ opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0.087 and 0.083, respectively). Scholars in technology design, foresight research and future(s) studies might consider these new findings in strategic planning of Delphi studies, for example, in rational choice of consensus indices and sample size, or accounting for confounding factors such as experts’ variable degrees of conformity (stubbornness/flexibility) in modifying their opinions.     

Development and Preliminary Face and Content Validation of the “Which Health Approaches and Treatments Are You Using?” (WHAT) Questionnaires Assessing Complementary and Alternative Medicine Use in Pediatric Rheumatology

Objective

Complementary and alternative medicine (CAM) is commonly used by children with juvenile idiopathic arthritis (JIA), yet no validated questionnaires assess that use. The objective of this study was to develop child self- and parent proxy-report questionnaires assessing CAM use and to determine the face and content validity of the “Which Health Approaches and Treatments are you using?” (WHAT) questionnaires in pediatric rheumatology.

Methods

A sequential phased mixed methods approach was used to develop the questionnaires. A Delphi Survey of 126 experts followed by an interdisciplinary consensus conference of 14 stakeholders in CAM, general pediatrics and pediatric rheumatology was held to develop consensus on the content of the questionnaires using a nominal group technique. To determine face and content validity of the questionnaires, two groups, including (a) a purposive sample of 22 children with JIA 8 to 18 years and their parents from the Children’s Hospital of Eastern Ontario and the Hospital for Sick Children, and (b) 21 Canadian pediatric rheumatology experts, participated in interviews. Participants were independently asked about the goal, understandability and comprehensiveness of the WHAT questionnaires, as well as the relevance of items.

Results

Consensus was reached on 17 items of the WHAT questionnaires. The domains found to be relevant were child’s CAM use, factors associated with CAM use, perceived impact of CAM use, and communication about CAM. A total of 15 items in the parent proxy-report questionnaire and 13 items in the child report questionnaire showed adequate content validity.

Conclusions

Consensus was reached by experts on the content of a pediatric CAM questionnaire. Face and content validity testing and modifications made to the WHAT questionnaires have helped ensure adequate preliminary validity for use in pediatric rheumatology. This constitutes the basis for further testing of these questionnaires in pediatric rheumatology and for adaptation to other chronic diseases.     

International Multispecialty Consensus on How to Evaluate Ultrasound Competence: A Delphi Consensus Survey

Objectives

To achieve international consensus across multiple specialties on a generic ultrasound rating scale using a Delphi technique.

Methods

Ultrasound experts from Obstetrics-Gynaecology, Surgery, Urology, Radiology, Rheumatology, Emergency Medicine, and Gastro-Enterology representing North America, Australia, and Europe were identified. A multi-round survey was conducted to obtain consensus between these experts. Of 60 invited experts, 44 experts agreed to participate in the first Delphi round, 41 remained in the second round, and 37 completed the third Delphi round. Seven key elements of the ultrasound examination were identified from existing literature and recommendations from international ultrasound societies. All experts rated the importance of these seven elements on a five-point Likert scale in the first round and suggested potential new elements for the assessment of ultrasound skills. In the second round, the experts re-rated all elements and a third round was conducted to allow final comments. Agreement on which elements to include in the final rating scale was pre-defined as more than 80% of the experts rating an element four or five, on importance to the ultrasound examination.

Results

Two additional elements were suggested by more than 10% of the experts in the first Delphi round. Consensus was obtained to include these two new elements along with five of the original elements in the final assessment instrument: 1) Indication for the examination 2) Applied knowledge of ultrasound equipment 3) Image optimization 4) Systematic examination 5) Interpretation of images 6) Documentation of examination and 7) Medical decision making.

Conclusion

International multispecialty consensus was achieved on the content of a generic ultrasound rating scale. This is the first step to ensure valid assessment of clinicians in different medical specialties using ultrasound.     

Establishing the Stages and Processes of Change for Weight Loss by Consensus of Experts

The present study aimed to establish, by a consensus of experts, the stages and processes of change for weight management in overweight and obese people. The first step involved developing two questionnaires aimed at assessing stages and processes of change for weight loss in overweight and obese people. The processes‐of‐change questionnaire consisted of 12 subscales, and contained 107 items. A three‐round Delphi study was carried out through a website, where participants were asked to give their opinion about the representativeness and clarity of the scale items. The stages‐of‐change questionnaire consisted of five items and was presented in the final round of the study. A team of 66 experts in the obesity field from 29 countries participated in the study. They were selected either because they belonged to the organizing committee of international associations related to obesity, or because of their research career. The required changes in the questionnaire were made according to the opinions of the participants. Some of these were the result of the group statistical response, whereas others were due to the suggestions made by the participants. A final version of the questionnaire consisting of 63 items was eventually obtained. The present study produced two questionnaires to assess stages and processes of change for weight management. The strength of the study lies in the consensus reached by the panel of experts in order to establish the required content of the questionnaires. The two measures provide useful tools for practitioners who wish to tailor weight‐management interventions according to transtheoretical model constructs.     

Development and Validation of a Questionnaire Assessing Fears and Beliefs of Patients with Knee Osteoarthritis: The Knee Osteoarthritis Fears and Beliefs Questionnaire (KOFBeQ)

Objective

We aimed to develop a questionnaire assessing fears and beliefs of patients with knee OA.

Design

We sent a detailed document reporting on a qualitative analysis of interviews of patients with knee OA to experts, and a Delphi procedure was adopted for item generation. Then, 80 physicians recruited 566 patients with knee OA to test the provisional questionnaire. Items were reduced according to their metric properties and exploratory factor analysis. Reliability was tested by the Cronbach α coefficient. Construct validity was tested by divergent validity and confirmatory factor analysis. Test–retest reliability was assessed by the intra-class correlation coefficient (ICC) and the Bland and Altman technique.

Results

137 items were extracted from analysis of the interview data. Three Delphi rounds were needed to obtain consensus on a 25-item provisional questionnaire. The item-reduction process resulted in an 11-item questionnaire. Selected items represented fears and beliefs about daily living activities (3 items), fears and beliefs about physicians (4 items), fears and beliefs about the disease (2 items), and fears and beliefs about sports and leisure activities (2 items). The Cronbach α coefficient of global score was 0.85. We observed expected divergent validity. Confirmation factor analyses confirmed higher intra-factor than inter-factor correlations. Test–retest reliability was good, with an ICC of 0.81, and Bland and Altman analysis did not reveal a systematic trend.

Conclusions

We propose an 11-item questionnaire assessing patients'' fears and beliefs concerning knee OA with good content and construct validity.     

Delphi-consensus weights for ischemic and bleeding events to be included in a composite outcome for RCTs in thrombosis prevention

Background and Objectives

To weight ischemic and bleeding events according to their severity to be used in a composite outcome in RCTs in the field of thrombosis prevention.

Method

Using a Delphi consensus method, a panel of anaesthesiology and cardiology experts rated the severity of thrombotic and bleeding clinical events. The ratings were expressed on a 10-point scale. The median and quartiles of the ratings of each item were returned to the experts. Then, the panel members evaluated the events a second time with knowledge of the group responses from the first round. Cronbach''s a was used as a measure of homogeneity for the ratings. The final rating for each event corresponded to the median rating obtained at the last Delphi round.

Results

Of 70 experts invited, 32 (46%) accepted to participate. Consensus was reached at the second round as indicated by Cronbach''s a value (0.99 (95% CI 0.98-1.00)) so the Delphi was stopped. Severity ranged from under-popliteal venous thrombosis (median = 3, Q1 = 2; Q3 = 3) to ischemic stroke or intracerebral hemorrhage with severe disability at 7 days and massive pulmonary embolism (median = 9, Q1 = 9; Q3 = 9). Ratings did not differ according to the medical specialty of experts.

Conclusions

These ratings could be used to weight ischemic and bleeding events of various severity comprising a composite outcome in the field of thrombosis prevention.     

Development of Self-Management Indicators for Chronic Hepatitis B Patients on Antiviral Therapy: Results of a Chinese Delphi Panel Survey

ObjectiveThis study aimed to develop a set of indicators that could be used to measure and monitor the self-management performance for chronic hepatitis B (CHB) patients on antiviral therapy in China.MethodsA two-round Delphi study via e-mail correspondence was conducted, with a group of 30 Chinese experts. The Delphi questionnaire consisted of 53 indicators identified from a literature review. Experts rated and scored the importance of indicators on a five-point Likert scale. Consensus was considered to be reached if a median score in the top tertile (4-5) and ≥80% of panel ratings in the top tertile (4-5) after Round 2. The included indicators were validated with a group of 106 CHB patients.ResultsThe response rates for the first and second rounds were 90.9% (n=30) and 86.7% (n=26), respectively. Three new indicators were suggested in the first round. 55 indicators were included in the second round after modified. 45 (81.8%) indicators achieved on the level of consensus, all of which had an inter-quartile range of 1 or below. The final set included 4 domains and 45 indicators which were well accepted and understandable by CHB patients.ConclusionThis Delphi study produced a set of 45 self-management indicators for CHB patients on antiviral therapy in China. These indicators could be used to measure and monitor the patients’ self-management performance, with the goal of improving the quality of life in this population.     

How to select outcome measurement instruments for outcomes included in a “Core Outcome Set” – a practical guideline

BackgroundIn cooperation with the Core Outcome Measures in Effectiveness Trials (COMET) initiative, the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) initiative aimed to develop a guideline on how to select outcome measurement instruments for outcomes (i.e., constructs or domains) included in a “Core Outcome Set” (COS). A COS is an agreed minimum set of outcomes that should be measured and reported in all clinical trials of a specific disease or trial population.MethodsInformed by a literature review to identify potentially relevant tasks on outcome measurement instrument selection, a Delphi study was performed among a panel of international experts, representing diverse stakeholders. In three consecutive rounds, panelists were asked to rate the importance of different tasks in the selection of outcome measurement instruments, to justify their choices, and to add other relevant tasks. Consensus was defined as being achieved when 70 % or more of the panelists agreed and when fewer than 15 % of the panelists disagreed.ResultsOf the 481 invited experts, 120 agreed to participate of whom 95 (79 %) completed the first Delphi questionnaire. We reached consensus on four main steps in the selection of outcome measurement instruments for COS: Step 1, conceptual considerations; Step 2, finding existing outcome measurement instruments, by means of a systematic review and/or a literature search; Step 3, quality assessment of outcome measurement instruments, by means of the evaluation of the measurement properties and feasibility aspects of outcome measurement instruments; and Step 4, generic recommendations on the selection of outcome measurement instruments for outcomes included in a COS (consensus ranged from 70 to 99 %).ConclusionsThis study resulted in a consensus-based guideline on the methods for selecting outcome measurement instruments for outcomes included in a COS. This guideline can be used by COS developers in defining how to measure core outcomes.

Electronic supplementary material

The online version of this article (doi:10.1186/s13063-016-1555-2) contains supplementary material, which is available to authorized users.     

Expert Opinions on Improving Femicide Data Collection across Europe: A Concept Mapping Study

Femicide, defined as the killings of females by males because they are females, is becoming recognized worldwide as an important ongoing manifestation of gender inequality. Despite its high prevalence or widespread prevalence, only a few countries have specific registries about this issue. This study aims to assemble expert opinion regarding the strategies which might feasibly be employed to promote, develop and implement an integrated and differentiated femicide data collection system in Europe at both the national and international levels. Concept mapping methodology was followed, involving 28 experts from 16 countries in generating strategies, sorting and rating them with respect to relevance and feasibility. The experts involved were all members of the EU-Cost-Action on femicide, which is a scientific network of experts on femicide and violence against women across Europe. As a result, a conceptual map emerged, consisting of 69 strategies organized in 10 clusters, which fit into two domains: “Political action” and “Technical steps”. There was consensus among participants regarding the high relevance of strategies to institutionalize national databases and raise public awareness through different stakeholders, while strategies to promote media involvement were identified as the most feasible. Differences in perceived priorities according to the level of human development index of the experts’ countries were also observed.     

A Delphi Technology Foresight Study: Mapping Social Construction of Scientific Evidence on Metagenomics Tests for Water Safety

Access to clean water is a grand challenge in the 21^st century. Water safety testing for pathogens currently depends on surrogate measures such as fecal indicator bacteria (e.g., E. coli). Metagenomics concerns high-throughput, culture-independent, unbiased shotgun sequencing of DNA from environmental samples that might transform water safety by detecting waterborne pathogens directly instead of their surrogates. Yet emerging innovations such as metagenomics are often fiercely contested. Innovations are subject to shaping/construction not only by technology but also social systems/values in which they are embedded, such as experts’ attitudes towards new scientific evidence. We conducted a classic three-round Delphi survey, comprised of 107 questions. A multidisciplinary expert panel (n = 24) representing the continuum of discovery scientists and policymakers evaluated the emergence of metagenomics tests. To the best of our knowledge, we report here the first Delphi foresight study of experts’ attitudes on (1) the top 10 priority evidentiary criteria for adoption of metagenomics tests for water safety, (2) the specific issues critical to governance of metagenomics innovation trajectory where there is consensus or dissensus among experts, (3) the anticipated time lapse from discovery to practice of metagenomics tests, and (4) the role and timing of public engagement in development of metagenomics tests. The ability of a test to distinguish between harmful and benign waterborne organisms, analytical/clinical sensitivity, and reproducibility were the top three evidentiary criteria for adoption of metagenomics. Experts agree that metagenomic testing will provide novel information but there is dissensus on whether metagenomics will replace the current water safety testing methods or impact the public health end points (e.g., reduction in boil water advisories). Interestingly, experts view the publics relevant in a “downstream capacity” for adoption of metagenomics rather than a co-productionist role at the “upstream” scientific design stage of metagenomics tests. In summary, these findings offer strategic foresight to govern metagenomics innovations symmetrically: by identifying areas where acceleration (e.g., consensus areas) and deceleration/reconsideration (e.g., dissensus areas) of the innovation trajectory might be warranted. Additionally, we show how scientific evidence is subject to potential social construction by experts’ value systems and the need for greater upstream public engagement on metagenomics innovations.     

Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review

OBJECTIVE: Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. METHODOLOGY AND MAIN FINDING: Three electronic data bases were searched over a 30 years period (1978-2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. CONCLUSION: The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys.     

A Web-Based Delphi Study for Eliciting Helpful Criteria in the Positive Diagnosis of Hemophagocytic Syndrome in Adult Patients

The diagnosis of the reactive form of hemophagocytic syndrome in adults remains particularly difficult since none of the clinical or laboratory manifestations are specific. We undertook a study in order to elicit which features constitute helpful criteria for a positive diagnosis. In this Delphi study, the features investigated in the questionnaire and the experts invited to participate in the survey were issued from a bibliographic search. The questionnaire was iteratively proposed to experts via a web-based application with a feedback of the results observed at the preceding Delphi round. Experts were asked to label each investigated criterion in one of the following categories: absolutely required, important, of minor interest, or not assessable in the routine practice environment. A positive consensus was a priori defined as at least 75% answers observed in the categories absolutely required and important. The questionnaire investigated 26 criteria and 24 experts originating from 13 countries participated in the second and final Delphi round. A positive consensus was reached for the nine following criteria: unilineage cytopenia, bicytopenia, pancytopenia, presence of hemophagocytosis pictures on a bone marrow aspirate or on a tissue biopsy, high ferritin level, fever, organomegaly, presence of a predisposing underlying disease, and high level of lactate dehydrogenase. A negative consensus was reached for 13 criteria, and an absence of consensus was observed for 4 criteria. The study constitutes the first initiative to date for defining international guidelines devoted to the positive diagnosis of the reactive form of hemophagocytic syndrome.     

What Are Priorities for Deprescribing for Elderly Patients? Capturing the Voice of Practitioners: A Modified Delphi Process

Polypharmacy and inappropriate medication use among older adults contribute to adverse drug reactions, falls, cognitive impairment, noncompliance, hospitalization and mortality. While deprescribing - tapering, reducing or stopping a medication - is feasible and relatively safe, clinicians find it difficult to carry out. Deprescribing guidelines would facilitate this process. The aim of this paper is to identify and prioritize medication classes where evidence-based deprescribing guidelines would be of benefit to clinicians. A modified Delphi approach included a literature review to identify potentially inappropriate medications for the elderly, an expert panel to develop survey content and three survey rounds to seek consensus on priorities. Panel participants included three pharmacists, two family physicians and one social scientist. Sixty-five Canadian geriatrics experts (36 pharmacists, 19 physicians and 10 nurse practitioners) participated in the survey. Twenty-nine drugs/drug classes were included in the first survey with 14 reaching the required (≥ 70%) level of consensus, and 2 new drug classes added from qualitative comments. Fifty-three participants completed round two, and 47 participants completed round three. The final five priorities were benzodiazepines, atypical antipsychotics, statins, tricyclic antidepressants, and proton pump inhibitors; nine other drug classes were also identified as being in need of evidence-based deprescribing guidelines. The Delphi consensus process identified five priority drug classes for which expert clinicians felt guidance is needed for deprescribing. The classes of drugs that emerged strongly from the rankings dealt with mental health, cardiovascular, gastroenterological, and neurological conditions. The results suggest that deprescribing and overtreatment occurs through the full spectrum of primary care, and that evidence-based deprescribing guidelines are a priority in the care of the elderly.     

Thermographic imaging in sports and exercise medicine: A Delphi study and consensus statement on the measurement of human skin temperature

The importance of using infrared thermography (IRT) to assess skin temperature (t_sk) is increasing in clinical settings. Recently, its use has been increasing in sports and exercise medicine; however, no consensus guideline exists to address the methods for collecting data in such situations. The aim of this study was to develop a checklist for the collection of t_sk using IRT in sports and exercise medicine. We carried out a Delphi study to set a checklist based on consensus agreement from leading experts in the field. Panelists (n  =  24) representing the areas of sport science (n = 8; 33%), physiology (n = 7; 29%), physiotherapy (n = 3; 13%) and medicine (n = 6; 25%), from 13 different countries completed the Delphi process. An initial list of 16 points was proposed which was rated and commented on by panelists in three rounds of anonymous surveys following a standard Delphi procedure. The panel reached consensus on 15 items which encompassed the participants’ demographic information, camera/room or environment setup and recording/analysis of t_sk using IRT. The results of the Delphi produced the checklist entitled “Thermographic Imaging in Sports and Exercise Medicine (TISEM)” which is a proposal to standardize the collection and analysis of t_sk data using IRT. It is intended that the TISEM can also be applied to evaluate bias in thermographic studies and to guide practitioners in the use of this technique.     

Methodological Deficits in Diagnostic Research Using ‘-Omics’ Technologies: Evaluation of the QUADOMICS Tool and Quality of Recently Published Studies

Background

QUADOMICS is an adaptation of QUADAS (a quality assessment tool for use in systematic reviews of diagnostic accuracy studies), which takes into account the particular challenges presented by ‘-omics’ based technologies. Our primary objective was to evaluate the applicability and consistency of QUADOMICS. Subsequently we evaluated and describe the methodological quality of a sample of recently published studies using the tool.

Methodology/Principal Findings

45‘-omics’- based diagnostic studies were identified by systematic search of Pubmed using suitable MeSH terms (“Genomics”, “Sensitivity and specificity”, “Diagnosis”). Three investigators independently assessed the quality of the articles using QUADOMICS and met to compare observations and generate a consensus. Consistency and applicability was assessed by comparing each reviewer''s original rating with the consensus. Methodological quality was described using the consensus rating. Agreement was above 80% for all three reviewers. Four items presented difficulties with application, mostly due to the lack of a clearly defined gold standard. Methodological quality of our sample was poor; studies met roughly half of the applied criteria (mean ± sd, 54.7±18.4%). Few studies were carried out in a population that mirrored the clinical situation in which the test would be used in practice, (6, 13.3%); none described patient recruitment sufficiently; and less than half described clinical and physiological factors that might influence the biomarker profile (20, 44.4%).

Conclusions

The QUADOMICS tool can consistently be applied to diagnostic ‘-omics’ studies presently published in biomedical journals. A substantial proportion of reports in this research field fail to address design issues that are fundamental to make inferences relevant for patient care.     

Determining Possible Professionals and Respective Roles and Responsibilities for a Model Comprehensive Elder Abuse Intervention: A Delphi Consensus Survey

Objective

We have undertaken a multi-phase, multi-method program of research to develop, implement, and evaluate a comprehensive hospital-based nurse examiner elder abuse intervention that addresses the complex functional, social, forensic, and medical needs of older women and men. In this study, we determined the importance of possible participating professionals and respective roles and responsibilities within the intervention.

Methods

Using a modified Delphi methodology, recommended professionals and their associated roles and responsibilities were generated from a systematic scoping review of relevant scholarly and grey literatures. These items were reviewed, new items added for review, and rated/re-rated for their importance to the intervention on a 5-point Likert scale by an expert panel during a one day in-person meeting. Items that did not achieve consensus were subsequently re-rated in an online survey.

Analysis

Those items that achieved a mean Likert rating of 4+ (rated important to very important), and an interquartile range<1 in the first or second round, and/or for which 80% of ratings were 4+ in the second round were retained for the model elder abuse intervention.

Results

Twenty-two of 31 recommended professionals and 192 of 229 recommended roles and responsibilities rated were retained for our model elder abuse intervention. Retained professionals were: public guardian and trustee (mean rating = 4.88), geriatrician (4.87), police officer (4.87), GEM (geriatric emergency management) nurse (4.80), GEM social worker (4.78), community health worker (4.76), social worker/counsellor (4.74), family physician in community (4.71), paramedic (4.65), financial worker (4.59), lawyer (4.59), pharmacist (4.59), emergency physician (4.57), geriatric psychiatrist (4.33), occupational therapist (4.29), family physician in hospital (4.28), Crown prosecutor (4.24), neuropsychologist (4.24), bioethicist (4.18), caregiver advocate (4.18), victim support worker (4.18), and respite care worker (4.12).

Conclusion

A large and diverse group of multidisciplinary, intersectoral collaborators was deemed necessary to address the complex needs of abused older adults, each having important roles and responsibilities to fulfill within a model comprehensive elder abuse intervention.     

Establishing a minimum dataset for prospective registration of systematic reviews: an international consultation

Background

In response to growing recognition of the value of prospective registration of systematic review protocols, we planned to develop a web-based open access international register. In order for the register to fulfil its aims of reducing unplanned duplication, reducing publication bias, and providing greater transparency, it was important to ensure the appropriate data were collected. We therefore undertook a consultation process with experts in the field to identify a minimum dataset for registration.

Methods and Findings

A two-round electronic modified Delphi survey design was used. The international panel surveyed included experts from areas relevant to systematic review including commissioners, clinical and academic researchers, methodologists, statisticians, information specialists, journal editors and users of systematic reviews. Direct invitations to participate were sent out to 315 people in the first round and 322 in the second round. Responses to an open invitation to participate were collected separately. There were 194 (143 invited and 51 open) respondents with a 100% completion rate in the first round and 209 (169 invited and 40 open) respondents with a 91% completion rate in the second round. In the second round, 113 (54%) of the participants reported having previously taken part in the first round. Participants were asked to indicate whether a series of potential items should be designated as optional or required registration items, or should not be included in the register. After the second round, a 70% or greater agreement was reached on the designation of 30 of 36 items.

Conclusions

The results of the Delphi exercise have established a dataset of 22 required items for the prospective registration of systematic reviews, and 18 optional items. The dataset captures the key attributes of review design as well as the administrative details necessary for registration.     

Development and Validation of the Behavioral Tendencies Questionnaire

At a fundamental level, taxonomy of behavior and behavioral tendencies can be described in terms of approach, avoid, or equivocate (i.e., neither approach nor avoid). While there are numerous theories of personality, temperament, and character, few seem to take advantage of parsimonious taxonomy. The present study sought to implement this taxonomy by creating a questionnaire based on a categorization of behavioral temperaments/tendencies first identified in Buddhist accounts over fifteen hundred years ago. Items were developed using historical and contemporary texts of the behavioral temperaments, described as “Greedy/Faithful”, “Aversive/Discerning”, and “Deluded/Speculative”. To both maintain this categorical typology and benefit from the advantageous properties of forced-choice response format (e.g., reduction of response biases), binary pairwise preferences for items were modeled using Latent Class Analysis (LCA). One sample (n₁ = 394) was used to estimate the item parameters, and the second sample (n₂ = 504) was used to classify the participants using the established parameters and cross-validate the classification against multiple other measures. The cross-validated measure exhibited good nomothetic span (construct-consistent relationships with related measures) that seemed to corroborate the ideas present in the original Buddhist source documents. The final 13-block questionnaire created from the best performing items (the Behavioral Tendencies Questionnaire or BTQ) is a psychometrically valid questionnaire that is historically consistent, based in behavioral tendencies, and promises practical and clinical utility particularly in settings that teach and study meditation practices such as Mindfulness Based Stress Reduction (MBSR).