Valid and reliable authentic assessment of culminating student performance in the biomedical sciences

There is increasing pressure, both from institutions central to the national scientific mission and from regional and national accrediting agencies, on natural sciences faculty to move beyond course examinations as measures of student performance and to instead develop and use reliable and valid authentic assessment measures for both individual courses and for degree-granting programs. We report here on a capstone course developed by two natural sciences departments, Biological Sciences and Chemistry/Biochemistry, which engages students in an important culminating experience, requiring synthesis of skills and knowledge developed throughout the program while providing the departments with important assessment information for use in program improvement. The student work products produced in the course, a written grant proposal, and an oral summary of the proposal, provide a rich source of data regarding student performance on an authentic assessment task. The validity and reliability of the instruments and the resulting student performance data were demonstrated by collaborative review by content experts and a variety of statistical measures of interrater reliability, including percentage agreement, intraclass correlations, and generalizability coefficients. The high interrater reliability reported when the assessment instruments were used for the first time by a group of external evaluators suggests that the assessment process and instruments reported here will be easily adopted by other natural science faculty.     

Growth assessment in children with Williams-Beuren syndrome: a systematic review

Journal of Applied Genetics - Williams-Beuren syndrome (WBS) is a rare genetic disease caused by a sporadic heterozygous microdeletion in 7q11.23. It is characterized by distinctive facial...     

Anticancer activity of monoterpenes: a systematic review

Molecular Biology Reports - Secondary metabolites have been recognized for centuries as medicinal agents, in particular monoterpenes which have been the target of research in the discovery of...     

Methods for assessment of trunk stabilization,a systematic review

Trunk stabilization is achieved differently in patients with low back pain compared to healthy controls. Many methods exist to assess trunk stabilization but not all measure the contributions of intrinsic stiffness and reflexes simultaneously. This may pose a threat to the quality/validity of the study and might lead to misinterpretation of the results. The aim of this study was to provide a critical review of previously published methods for studying trunk stabilization in relation to low back pain (LBP). We primarily aimed to assess their construct validity to which end we defined a theoretical framework operationalized in a set of methodological criteria which would allow to identify the contributions of intrinsic stiffness and reflexes simultaneously. In addition, the clinimetric properties of the methods were evaluated. A total of 133 articles were included from which four main categories of methods were defined; upper limb (un)loading, moving platform, unloading and loading. Fifty of the 133 selected articles complied with all the criteria of the theoretical framework, but only four articles provided information about reliability and/or measurement error of methods to assess trunk stabilization with test–retest reliability ranging from poor (ICC 0) to moderate (ICC 0.72). When aiming to assess trunk stabilization with system identification, we propose a perturbation method where the trunk is studied in isolation, the perturbation is unpredictable, force controlled, directly applied to the upper body, completely known and results in small fluctuations around the working point.     

Safety assessment of l-lysine oral intake: a systematic review

Amino Acids - Currently, the use of amino acids in supplements and functional foods is increasing globally. However, there are no guidelines for the upper limit of ingestion for the safe use of...     

Motor training programs of arm and hand in patients with MS according to different levels of the ICF: a systematic review

Background

Breast cancer survivors, particularly those treated with chemotherapy, are at significantly increased risk for long-term cognitive and neurobiologic impairments. These deficits tend to involve skills that are subserved by distributed brain networks. Additionally, neuroimaging studies have shown a diffuse pattern of brain structure changes in chemotherapy-treated breast cancer survivors that might impact large-scale brain networks.

Methods

We therefore applied graph theoretical analysis to compare the gray matter structural networks of female breast cancer survivors with a history of chemotherapy treatment and healthy age and education matched female controls.

Results

Results revealed reduced clustering coefficient and small-world index in the brain network of the breast cancer patients across a range of network densities. In addition, the network of the breast cancer group had less highly interactive nodes and reduced degree/centrality in the frontotemporal regions compared to controls, which may help explain the common impairments of memory and executive functioning among these patients.

Conclusions

These results suggest that breast cancer and chemotherapy may decrease regional connectivity as well as global network organization and integration, reducing efficiency of the network. To our knowledge, this is the first report of altered large-scale brain networks associated with breast cancer and chemotherapy.     

Wearable technology for spine movement assessment: A systematic review

Continuous monitoring of spine movement function could enhance our understanding of low back pain development. Wearable technologies have gained popularity as promising alternative to laboratory systems in allowing ambulatory movement analysis. This paper aims to review the state of art of current use of wearable technology to assess spine kinematics and kinetics.Four electronic databases and reference lists of relevant articles were searched to find studies employing wearable technologies to assess the spine in adults performing dynamic movements. Two reviewers independently identified relevant papers. Customised data extraction and quality appraisal form were developed to extrapolate key details and identify risk of biases of each study. Twenty-two articles were retrieved that met the inclusion criteria: 12 were deemed of medium quality (score 33.4–66.7%), and 10 of high quality (score >66.8%). The majority of articles (19/22) reported validation type studies. Only 6 reported data collection in real-life environments. Multiple sensors type were used: electrogoniometers (3/22), strain gauges based sensors (3/22), textile piezoresistive sensor (1/22) and accelerometers often used with gyroscopes and magnetometers (15/22). Two sensors units were mainly used and placing was commonly reported on the spine lumbar and sacral regions. The sensors were often wired to data transmitter/logger resulting in cumbersome systems. Outcomes were mostly reported relative to the lumbar segment and in the sagittal plane, including angles, range of motion, angular velocity, joint moments and forces.This review demonstrates the applicability of wearable technology to assess the spine, although this technique is still at an early stage of development.     

Clinical value of prognostic instruments to identify patients with an increased risk for osteoporotic fractures: systematic review

Background

With the broad availability of effective medications, identifying individuals bearing a higher risk for osteoporotic fractures has become an issue of major concern in modern medicine. In recent years various prognostic instruments have become available showing conflicting results regarding estimated risks for individual patients.

Objective

To provide an overview of current evidence and of opportunities for further research.

Methodology/Principal Findings

Systematic Review: We identified studies describing the development of instruments and all subsequent validations in electronic databases and reference lists of included studies. We screened for inclusion, read full papers and extracted data on salient clinical features, performance characteristics and quality in duplicate. Searches retrieved 5,275 records of which full texts of 167 papers were obtained after screening titles and abstract. We included 35 studies enrolling a total of 609,969 patients (median 2546) reporting on 31 derivations and 12 validations after assessing full texts. Median follow-up time was 4.1 years (IQR 3 to 7.7). Only four studies validated an instrument that was developed by another group. None of the existing instruments was validated more than once. The five most frequent included variables in the final model were age, body mass index, bone mass index, past history of falls, and maternal history of fractures. The methodological quality of the studies was moderate.

Conclusion

There is a plethora of evidence available studying the association of risk profiles and the development of osteoporotic fractures. The small number of out-of-sample validations, the large variety of study characteristics, outcomes and follow-up periods impedes from deriving robust summaries and from conclusions regarding the clinical performance of many tools. First and foremost, future activity in this field should aim at reaching a consensus among clinical experts in respect to the existing instruments. Then we call for careful validations and expedient adaptations for local circumstances of the most promising candidates.     

ICF syndrome: a new case and review of the literature

Patients with ICF syndrome can be recognized by the presence of a variable immunodeficiency, instability of the pericentromeric heterochromatin of, in particular, chromosomes 1, 9, and 16 in cultured peripheral lymphocytes, and a number of facial anomalies. Recently, aberrations at the molecular level have been described, consisting of alterations in the methylation pattern of classical satellite DNA, in a number of patients. ICF syndrome is considered to be inherited in an autosomal recessive manner and may be rare, as only 14 patients have been described thus far. We present a new case, a boy with agammaglobulinemia, who was extensively studied by means of classical cytogenetics and fluorescent in situ hybridization. All patients previously reported in the literature are reviewed.     

Diagnostic accuracy of level 3 portable sleep tests versus level 1 polysomnography for sleep-disordered breathing: a systematic review and meta-analysis

Background:

Greater awareness of sleep-disordered breathing and rising obesity rates have fueled demand for sleep studies. Sleep testing using level 3 portable devices may expedite diagnosis and reduce the costs associated with level 1 in-laboratory polysomnography. We sought to assess the diagnostic accuracy of level 3 testing compared with level 1 testing and to identify the appropriate patient population for each test.

Methods:

We conducted a systematic review and meta-analysis of comparative studies of level 3 versus level 1 sleep tests in adults with suspected sleep-disordered breathing. We searched 3 research databases and grey literature sources for studies that reported on diagnostic accuracy parameters or disease management after diagnosis. Two reviewers screened the search results, selected potentially relevant studies and extracted data. We used a bivariate mixed-effects binary regression model to estimate summary diagnostic accuracy parameters.

Results:

We included 59 studies involving a total of 5026 evaluable patients (mostly patients suspected of having obstructive sleep apnea). Of these, 19 studies were included in the meta-analysis. The estimated area under the receiver operating characteristics curve was high, ranging between 0.85 and 0.99 across different levels of disease severity. Summary sensitivity ranged between 0.79 and 0.97, and summary specificity ranged between 0.60 and 0.93 across different apnea–hypopnea cut-offs. We saw no significant difference in the clinical management parameters between patients who underwent either test to receive their diagnosis.

Interpretation:

Level 3 portable devices showed good diagnostic performance compared with level 1 sleep tests in adult patients with a high pretest probability of moderate to severe obstructive sleep apnea and no unstable comorbidities. For patients suspected of having other types of sleep-disordered breathing or sleep disorders not related to breathing, level 1 testing remains the reference standard.Undiagnosed sleep-disordered breathing places a substantial burden on patients, families, health care systems and society.¹ Sleep fragmentation and recurrent hypoxemia cause daytime sleepiness and impaired concentration, which increase the risk of motor vehicle collisions and occupational accidents.^2–7 In addition, sleep-disordered breathing is associated with hypertension, stroke, cardiovascular disease, obesity and type 2 diabetes,^8–12 all of which involve greater use of health care resources.^13–17Obstructive sleep apnea is the most common type of sleep-disordered breathing. Narrowing of the upper airway during inspiration results in episodes of apnea (breathing cessation for at least 10 seconds), hypopnea (reduced airflow), oxygen desaturation and arousal from sleep due to respiratory effort.¹⁸ Clinical signs and symptoms include snoring, reports of nocturnal apnea, gasping or choking witnessed by a partner, daytime sleepiness, morning headaches and inability to concentrate. Patients with obesity or cardiovascular disease are at increased risk.¹⁹The severity of obstructive sleep apnea is usually graded using the apnea–hypopnea index (the mean number of apneas and hypopneas per hour of sleep) as follows: mild (5–14), moderate (15–29) and severe (≥ 30).^18,20Other, less common types of sleep-disordered breathing include upper airway resistance syndrome, obesity hyperventilation syndrome, central sleep apnea, and nocturnal hypoventilation/hypoxemia secondary to cardiopulmonary or neuromuscular disease. It is not uncommon for patients to have more than 1 type of sleep-disordered breathing.Estimates of the prevalence of sleep-disordered breathing vary depending on the population (e.g., by sex, age and comorbidities).²¹ According to the Wisconsin Sleep Cohort Study, values in American adults (aged 30–60 yr) are 24% for men and 9% for women.¹ A Canadian survey found a self-reported prevalence of sleep apnea of 3% among adults more than 18 years of age, and 5% among those more than 45 years of age.²² As the population ages and rates of obesity increase, the prevalence of sleep-disordered breathing is climbing.^1,19,23,24 Given its clinical implications, accurate diagnosis and treatment of the condition are critical.Level 1 sleep testing, or polysomnography, requires an overnight stay in a sleep laboratory with a technician in attendance. It captures a minimum of 7 channels of data (but typically ≥ 16), including respiratory, cardiovascular and neurologic parameters, to produce a comprehensive picture of sleep architecture. Level 1 is considered the reference standard for diagnosing all types of sleep-disordered breathing and sleep disorders.^19,25–27 However, limited facilities and the growing demand for sleep studies have resulted in long wait times.²⁸ Level 2 sleep testing uses level 1 equipment, but is performed without a technician in attendance.Level 3 testing uses portable monitors that allow sleep studies to be done at the patient’s home or elsewhere. This option was introduced as a more accessible and less expensive alternative to in-laboratory polysomnography. Level 3 devices record at least 3 channels of data (e.g., oximetry, airflow, respiratory effort). Unlike level 1, level 3 testing cannot measure the duration of sleep, the number of arousals or sleep stages, nor can it detect nonrespiratory sleep disorders.^27,29 Level 4 devices are also portable, but they capture less data — usually only 1 or 2 channels.^27,30We conducted a systematic review and meta-analysis to compare the diagnostic accuracy of the widely used level 3 portable monitors to in-laboratory polysomnography, and to determine the subpopulations of patients whose conditions might be most appropriately diagnosed with each test.     

Future scenarios and life cycle assessment: systematic review and recommendations

The International Journal of Life Cycle Assessment - Future scenarios and life cycle assessment (LCA) are powerful tools that can provide early sustainability assessments of novel products,...     

Interventions aimed at increasing research use in nursing: a systematic review

Background

There has been considerable interest recently in developing and evaluating interventions to increase research use by clinicians. However, most work has focused on medical practices; and nursing is not well represented in existing systematic reviews. The purpose of this article is to report findings from a systematic review of interventions aimed at increasing research use in nursing.

Objective

To assess the evidence on interventions aimed at increasing research use in nursing.

Methods

A systematic review of research use in nursing was conducted using databases (Medline, CINAHL, Healthstar, ERIC, Cochrane Central Register of Controlled Trials, and Psychinfo), grey literature, ancestry searching (Cochrane Database of Systematic Reviews), key informants, and manual searching of journals. Randomized controlled trials and controlled before- and after-studies were included if they included nurses, if the intervention was explicitly aimed at increasing research use or evidence-based practice, and if there was an explicit outcome to research use. Methodological quality was assessed using pre-existing tools. Data on interventions and outcomes were extracted and categorized using a pre-established taxonomy.

Results

Over 8,000 titles were screened. Three randomized controlled trials and one controlled before- and after-study met the inclusion criteria. The methodological quality of included studies was generally low. Three investigators evaluated single interventions. The most common intervention was education. Investigators measured research use using a combination of surveys (three studies) and compliance with guidelines (one study). Researcher-led educational meetings were ineffective in two studies. Educational meetings led by a local opinion leader (one study) and the formation of multidisciplinary committees (one study) were both effective at increasing research use.

Conclusion

Little is known about how to increase research use in nursing, and the evidence to support or refute specific interventions is inconclusive. To advance the field, we recommend that investigators: (1) use theoretically informed interventions to increase research use, (2) measure research use longitudinally using theoretically informed and psychometrically sound measures of research use, as well as, measuring patient outcomes relevant to the intervention, and (3) use more robust and methodologically sound study designs to evaluate interventions. If investigators aim to establish a link between using research and improved patient outcomes they must first identify those interventions that are effective at increasing research use.     

Serum level of antioxidant vitamins and minerals in patients with vitiligo,a systematic review and meta-analysis

BackgroundAntioxidant status is considered as important factor in the pathogenesis of vitiligo. However, there are controversial findings about serum status of antioxidants in vitiligo patients. The purpose of this study was to systematically review the evidences comparing the serum levels of antioxidant vitamins and minerals between vitiligo patients and controls, and performing meta-analysis of the results.MethodsA comprehensive search was performed for studies comparing the serum status of antioxidant vitamins and minerals using following databases since inception up to 30 April 2020; PubMed, EMBASE, Scopus, and Web of Science. Data extraction was done by two independent reviewers. The data was pooled for serum level of each antioxidant comparing between vitiligo and control groups.ResultsThirteen studies were included in this systematic review. The serum level of vitamin A, C, E, selenium, zinc and copper were compared between vitiligo patients and controls in these studies. Eleven studies including 570 vitiligo cases and 580 controls were included in the meta-analysis. Serum vitamin A and copper level in vitiligo patients were only evaluated in single studies and not included in meta-analysis. Based on fixed effect model, there were no statistical difference between two groups regarding serum vitamin C (OR = 1.17, 95 % CI, 0.74–1.84, P = 0.495), and vitamin E (OR = 0.61, 95 % CI, 0.30–1.25, P = 0.180). Higher serum zinc can decrease the risk of vitiligo based on sensitivity analysis of the results. (OR = 0.29, 95 % CI 0.15−0.54, P < 0.001). Higher serum selenium level significantly increased the risk of vitiligo (OR = 4.31, 95 % CI, 2.72–6.81, P < 0.001). Vitamin A was not significantly different in two reported groups (6.35 ± 1.53 vs 6.77 ± 1.46 μg/mL, P > 0.05). Copper was significantly higher in vitiligo patients compared to controls (129 ± 33 vs 99 ± 19 μg /100 mL, P = 0.002).ConclusionThe current meta-analysis of data on serum level of most studied antioxidants (vitamin C, vitamin E, zinc and selenium) in patients suffering vitiligo showed that higher serum selenium (OR = 4.31) and lower zinc level (OR = 0.29) can increased the risk of vitiligo. Potential mechanism associated with preventive effects of zinc and the depigmentation effect of selenium should be more elucidated in further studies.     

Comprehensive geriatric assessment for older women with early breast cancer - a systematic review of literature

ABSTRACT: BACKGROUND: The Comprehensive Geriatric Assessment (CGA) is an analytical tool increasingly implemented in clinical practice. Breast cancer is primarily a disease of older people; however, most evidence-based research is aimed at younger patients. METHODS: A systematic review of literature was carried out to assess the use of CGA in older breast cancer patients for clinical decision making. The PubMed, Embase and Cochrane databases were searched. RESULTS: A total of nine useful full text article results were found. Only five of these were exclusively concerned with early breast cancer; thus, studies involving a variety of cancer types, stages and treatments were accepted, as long as they included early breast cancer. The results comprised a series of low sources of evidence. However, all results shared a common theme: the CGA has a use in determining patient suitability for different types of cancer treatment and subsequently maximizing the patient's quality of life. CONCLUSIONS: There is not yet sufficient high level evidence to instate CGA guidelines as a mandatory practice in the management of breast cancer, due to the heterogeneity of available studies. More studies need to be conducted to cement current work on the benefits of the CGA. An area of particular interest is with regard to treatment options, especially surgery and chemotherapy, and identifying patients who may be suitable for these treatments.     

Evaluating attention-deficit/hyperactivity disorder using ecological momentary assessment: a systematic review

Ecological momentary assessment is an excellent tool for the measurement of different day-to-day domains in patients and capturing real-world and real-time data. The purpose of this review is to evaluate feasibility in current ecological momentary assessment studies on emotional and behavioral functioning, functional impairments, and quality of life patients with an attention-deficit/hyperactivity disorder diagnosis. This systematic review follows the recommendation of Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines selecting articles published from January 1, 1990, up to the latest access on May 2018, identifying a pool of 23 eligible studies. Twenty-three studies demonstrate the validity of ecological momentary assessment methodology in evaluating different aspects of patients with attention-deficit/hyperactivity disorder. Fifteen studies focus on the child’s or adolescent’s daily behavior, while eight studies only focus on adults. The studies presented in this review monitored patients and their families over a maximum period of 28 days. We can conclude that ecological momentary assessment can be successfully implemented with attention-deficit/hyperactivity disorder patients to evaluate diverse backgrounds. However, more studies are needed with a longer monitoring period, especially in adolescents, to determine the effectiveness of ecological momentary assessment on patients with attention-deficit/hyperactivity disorder.     

Test-retest reliability of isometric mid-thigh pull maximum strength assessment: a systematic review

The aim of this systematic review was to explore the test-retest reliability of isometric mid-thigh pull maximum strength assessment. We searched through five databases to find studies that examined the test-retest reliability of peak force in the isometric mid-thigh pull exercise. From each included study, we extracted intra-class correlation coefficients (ICC) and/or coefficient of variation (CV). The methodological quality of the included studies was evaluated using the COSMIN checklist. A total of 16 good-to-excellent quality studies were included in the review. When considering results from all included studies, ICCs ranged from 0.73 to 0.99 (median ICC = 0.96), where 78% of ICCs were ≥ 0.90, and 98% of ICCs were ≥ 0.75. The range of reported CVs was from 0.7% to 11.1% (median CV = 4.9%), where 58% of CVs were ≤ 5%. Reliability was also good-to-excellent for both relative and absolute peak force and for both bilateral and unilateral isometric mid-thigh pull tests. The majority of studies did not find significant differences between testing sessions. It can be concluded that the isometric mid-thigh pull maximum strength assessment has good-to-excellent test-retest reliability. The isometric mid-thigh pull maximum strength assessment can be used as a reliable test in sports practice and for research purposes.