Effect of the Learning Climate of Residency Programs on Faculty’s Teaching Performance as Evaluated by Residents

Background

To understand teaching performance of individual faculty, the climate in which residents’ learning takes place, the learning climate, may be important. There is emerging evidence that specific climates do predict specific outcomes. Until now, the effect of learning climate on the performance of the individual faculty who actually do the teaching was unknown.

Objectives

This study: (i) tested the hypothesis that a positive learning climate was associated with better teaching performance of individual faculty as evaluated by residents, and (ii) explored which dimensions of learning climate were associated with faculty’s teaching performance.

Methods and Materials

We conducted two cross-sectional questionnaire surveys amongst residents from 45 residency training programs and multiple specialties in 17 hospitals in the Netherlands. Residents evaluated the teaching performance of individual faculty using the robust System for Evaluating Teaching Qualities (SETQ) and evaluated the learning climate of residency programs using the Dutch Residency Educational Climate Test (D-RECT). The validated D-RECT questionnaire consisted of 11 subscales of learning climate. Main outcome measure was faculty’s overall teaching (SETQ) score. We used multivariable adjusted linear mixed models to estimate the separate associations of overall learning climate and each of its subscales with faculty’s teaching performance.

Results

In total 451 residents completed 3569 SETQ evaluations of 502 faculty. Residents also evaluated the learning climate of 45 residency programs in 17 hospitals in the Netherlands. Overall learning climate was positively associated with faculty’s teaching performance (regression coefficient 0.54, 95% confidence interval: 0.37 to 0.71; P<0.001). Three out of 11 learning climate subscales were substantially associated with better teaching performance: ‘coaching and assessment’, ‘work is adapted to residents’ competence’, and ‘formal education’.

Conclusions

Individual faculty’s teaching performance evaluations are positively affected by better learning climate of residency programs.     

Good clinical teachers likely to be specialist role models: results from a multicenter cross-sectional survey

Context

Medical educational reform includes enhancing role modelling of clinical teachers. This requires faculty being aware of their role model status and performance. We developed the System for Evaluation of Teaching Qualities (SETQ) to generate individualized feedback on previously defined teaching qualities and role model status for faculty in (non) academic hospitals.

Objectives

(i) To examine whether teaching qualities of faculty were associated with their being seen as a specialist role model by residents, and (ii) to investigate whether those associations differed across residency years and specialties.

Methods & Materials

Cross-sectional questionnaire survey amongst 549 Residents of 36 teaching programs in 15 hospitals in the Netherlands. The main outcome measure was faculty being seen as specialist role models by residents. Statistical analyses included (i) Pearson''s correlation coefficients and (ii) multivariable logistic generalized estimating equations to assess the (adjusted) associations between each of five teaching qualities and ‘being seen as a role model’.

Results

407 residents completed a total of 4123 evaluations of 662 faculty. All teaching qualities were positively correlated with ‘being seen as a role model’ with correlation coefficients ranging from 0.49 for ‘evaluation of residents’ to 0.64 for ‘learning climate’ (P<0.001). Faculty most likely to be seen as good role models were those rated highly on ‘feedback’ (odds ratio 2.91, 95% CI: 2.41–3.51), ‘a professional attitude towards residents’ (OR 2.70, 95% CI: 2.34–3.10) and ‘creating a positive learning climate’ (OR 2.45, 95% CI: 1.97–3.04). Results did not seem to vary much across residency years. The relative strength of associations between teaching qualities and being seen as a role model were more distinct when comparing specialties.

Conclusions

Good clinical educators are more likely to be seen as specialist role models for most residents.     

The teacher, the physician and the person: how faculty's teaching performance influences their role modelling

Objective

Previous studies identified different typologies of role models (as teacher/supervisor, physician and person) and explored which of faculty''s characteristics could distinguish good role models. The aim of this study was to explore how and to which extent clinical faculty''s teaching performance influences residents'' evaluations of faculty''s different role modelling statuses, especially across different specialties.

Methods

In a prospective multicenter multispecialty study of faculty''s teaching performance, we used web-based questionnaires to gather empirical data from residents. The main outcome measures were the different typologies of role modelling. The predictors were faculty''s overall teaching performance and faculty''s teaching performance on specific domains of teaching. The data were analyzed using multilevel regression equations.

Results

In total 219 (69% response rate) residents filled out 2111 questionnaires about 423 (96% response rate) faculty. Faculty''s overall teaching performance influenced all role model typologies (OR: from 8.0 to 166.2). For the specific domains of teaching, overall, all three role model typologies were strongly associated with “professional attitude towards residents” (OR: 3.28 for teacher/supervisor, 2.72 for physician and 7.20 for the person role). Further, the teacher/supervisor role was strongly associated with “feedback” and “learning climate” (OR: 3.23 and 2.70). However, the associations of the specific domains of teaching with faculty''s role modelling varied widely across specialties.

Conclusion

This study suggests that faculty can substantially enhance their role modelling by improving their teaching performance. The amount of influence that the specific domains of teaching have on role modelling differs across specialties.     

Addressing Dichotomous Data for Participants Excluded from Trial Analysis: A Guide for Systematic Reviewers

Introduction

Systematic reviewer authors intending to include all randomized participants in their meta-analyses need to make assumptions about the outcomes of participants with missing data.

Objective

The objective of this paper is to provide systematic reviewer authors with a relatively simple guidance for addressing dichotomous data for participants excluded from analyses of randomized trials.

Methods

This guide is based on a review of the Cochrane handbook and published methodological research. The guide deals with participants excluded from the analysis who were considered ‘non-adherent to the protocol’ but for whom data are available, and participants with missing data.

Results

Systematic reviewer authors should include data from ‘non-adherent’ participants excluded from the primary study authors'' analysis but for whom data are available. For missing, unavailable participant data, authors may conduct a complete case analysis (excluding those with missing data) as the primary analysis. Alternatively, they may conduct a primary analysis that makes plausible assumptions about the outcomes of participants with missing data. When the primary analysis suggests important benefit, sensitivity meta-analyses using relatively extreme assumptions that may vary in plausibility can inform the extent to which risk of bias impacts the confidence in the results of the primary analysis. The more plausible assumptions draw on the outcome event rates within the trial or in all trials included in the meta-analysis. The proposed guide does not take into account the uncertainty associated with assumed events.

Conclusions

This guide proposes methods for handling participants excluded from analyses of randomized trials. These methods can help in establishing the extent to which risk of bias impacts meta-analysis results.     

Effect of emotional arousal on inter-temporal decision-making: an fMRI study

Background

Previous research has shown that emotion can significantly impact decision-making in humans. The current study examined whether or not and how situationally induced emotion influences people to make inter-temporal choices.

Methods

Affective pictures were used as experiment stimuli to provoke emotion, immediately followed by subjects’ performance of a delay-discounting task to measure impulsivity during functional magnetic resonance imaging.

Results

Results demonstrate a subsequent process of increased impulsive decision-making following a prior exposure to both high positive and negative arousal stimuli, compared to the experiment subjects’ experiences with neutral stimuli. Findings indicate that increased impulsive decision-making behaviors can occur with high arousal and can be characterized by decreased activities in the cognitive control regions such as prefronto-parietal regions.

Conclusions

These results suggest that ‘stabilization of high emotional arousal’ may facilitate a reduction of impulsive decision-making and implementation of longer term goals.     

Graduate entry medicine: selection criteria and student performance

Background

Graduate entry medicine raises new questions about the suitability of students with different backgrounds. We examine this, and the broader issue of effectiveness of selection and assessment procedures.

Methods

The data included background characteristics, academic record, interview score and performance in pre-clinical modular assessment for two years intake of graduate entry medical students. Exploratory factor analysis is a powerful method for reducing a large number of measures to a smaller group of underlying factors. It was used here to identify patterns within and between the selection and performance data.

Principal Findings

Basic background characteristics were of little importance in predicting exam success. However, easily interpreted components were detected within variables comprising the ‘selection’ and ‘assessment’ criteria. Three selection components were identified (‘Academic’, ‘GAMSAT’, ‘Interview’) and four assessment components (‘General Exam’, ‘Oncology’, ‘OSCE’, ‘Family Case Study’). There was a striking lack of relationships between most selection and performance factors. Only ‘General Exam’ and ‘Academic’ showed a correlation (Pearson''s r = 0.55, p<0.001).

Conclusions

This study raises questions about methods of student selection and their effectiveness in predicting performance and assessing suitability for a medical career. Admissions tests and most exams only confirmed previous academic achievement, while interview scores were not correlated with any consequent assessment.     

Losing the ability in activities of daily living in the oldest old: a hierarchic disability scale from the Newcastle 85+ study

Objectives

To investigate the order in which 85 year olds develop difficulty in performing a wide range of daily activities covering basic personal care, household care and mobility.

Design

Cross-sectional analysis of baseline data from a cohort study.

Setting

Newcastle upon Tyne and North Tyneside, UK.

Participants

Individuals born in 1921, registered with participating general practices.

Measurements

Detailed health assessment including 17 activities of daily living related to basic personal care, household care and mobility. Questions were of the form ‘Can you …’ rather than ‘Do you…’ Principal Component Analysis (PCA) was used to confirm a single underlying dimension for the items and Mokken Scaling was used to determine a subsequent hierarchy. Validity of the hierarchical scale was assessed by its associations with known predictors of disability.

Results

839 people within the Newcastle 85+ study for whom complete information was available on self-reported Activities of Daily Living (ADL). PCA confirmed a single underlying dimension; Mokken scaling confirmed a hierarchic scale where ‘Cutting toenails’ was the first item with which participants had difficulty and ‘feeding’ the last. The ordering of loss differed between men and women. Difficulty with ‘shopping’ and ‘heavy housework’ were reported earlier by women whilst men reported ‘walking 400 yards’ earlier. Items formed clusters corresponding to strength, balance, lower and upper body involvement and domains specifically required for balance and upper/lower limb functional integrity.

Conclusion

This comprehensive investigation of ordering of ability in activities in 85 year olds will inform researchers and practitioners assessing older people for onset of disability and subsequent care needs.     

Effects of Core Self-Evaluations on the Job Burnout of Nurses: The Mediator of Organizational Commitment

Objective

To explore the impact of Core self-evaluations on job burnout of nurses, and especially to test and verify the mediator role of organizational commitment between the two variables.

Method

Random cluster sampling was used to pick up participants sample, which consisted of 445 nurses of a hospital in Shanghai. Core self-evaluations questionnaire, job burnout scale and organizational commitment scale were administrated to the study participants.

Results

There are significant relationships between Core self-evaluations and dimensions of job burnout and organizational commitment. There is a significant mediation effect of organizational commitment between Core self-evaluations and job burnout.

Conclusions

To enhance nurses’ Core self-evaluations can reduce the incidence of job burnout.     

Causes,Coping, and Culture: A Comparative Survey Study on Representation of Back Pain in Three Swiss Language Regions

Introduction

This study intends to contribute to a research tradition that asks how causal attributions of illnesses affect coping behavior. Causal attributions are understood as the most important element of illness representations and coping as a means to preserve quality of life. The issue is applied to a condition so far often neglected in research on illness representations–back pain–and a third concept is added to the picture: culture.

Aim

The aim of this study is (a) to explore the causal factors to which persons with back pain attribute the further course of their illness, (b) to find out whether the attributed causes are predictors of coping maxims, and (c) to find out whether cultural factors affect attributions and coping and moderate the relationship between the two.

Methods

A total of 1259 gainfully employed or self-employed persons with recent episodes of back pain were recruited in the three language regions of Switzerland. They were asked to complete a structured online interview, measuring among many other variables attributed causes, coping maxims, and affiliation to one of the Swiss micro-cultures (German-, French- or Italian-speaking).

Results

Attributed causes of the illness that can be influenced by a patient go along with more active coping styles. Cultural affiliation impacts on coping maxims independently, but culture moderates the relationship of attributed causes and coping maxims only in two of twenty possible cases.

Implications

The results show that cultural differences can be analytically incorporated in the models of illness representations. Results may help to improve healthcare providers’ communication with patients and plan public health campaigns. The approach to micro-cultural differences and the substantive relationships between alterability of causes and activity in coping may help the further development of models of illness representations.     

Development and inter-rater reliability of the Liverpool adverse drug reaction causality assessment tool

Aim

To develop and test a new adverse drug reaction (ADR) causality assessment tool (CAT).

Methods

A comparison between seven assessors of a new CAT, formulated by an expert focus group, compared with the Naranjo CAT in 80 cases from a prospective observational study and 37 published ADR case reports (819 causality assessments in total).

Main Outcome Measures

Utilisation of causality categories, measure of disagreements, inter-rater reliability (IRR).

Results

The Liverpool ADR CAT, using 40 cases from an observational study, showed causality categories of 1 unlikely, 62 possible, 92 probable and 125 definite (1, 62, 92, 125) and ‘moderate’ IRR (kappa 0.48), compared to Naranjo (0, 100, 172, 8) with ‘moderate’ IRR (kappa 0.45). In a further 40 cases, the Liverpool tool (0, 66, 81, 133) showed ‘good’ IRR (kappa 0.6) while Naranjo (1, 90, 185, 4) remained ‘moderate’.

Conclusion

The Liverpool tool assigns the full range of causality categories and shows good IRR. Further assessment by different investigators in different settings is needed to fully assess the utility of this tool.     

A Survey to Assess Family Physicians’ Motivation to Teach Undergraduates in Their Practices

Background

In Germany, family physicians (FPs) are increasingly needed to participate in undergraduate medical education. Knowledge of FPs’ motivation to teach medical students in their practices is lacking.

Purpose

To describe a novel questionnaire that assesses the motivation of FPs to teach undergraduates in their practices and to show the results of a subsequent survey using this instrument.

Methods

The questionnaire was developed based on a review of the literature. Previously used empirical instruments assessing occupational values and motivation were included. A preliminary version was pretested in a pilot study. The resulting 68-item questionnaire was sent to 691 FPs involved in undergraduate medical education. Reliability was assessed and subgroups were analyzed with regard to differences in motivation.

Results

A total of 523 physicians in n = 458 teaching practices participated (response rate 75.7%). ‘Helping others’ and ‘interest’ were revealed as the predominant motives. Responses showed a predominantly intrinsic motivation of the participating FPs. Their main incentives were an ambition to work as a medical preceptor, to generally improve undergraduate education and to share knowledge. Material compensation was of minor importance. Time restraints were indicated as a barrier by some FPs, but were not a general concern.

Conclusion

German FPs involved in medical education have altruistic attitudes towards teaching medical students in their practices. Motivational features give an important insight for the recruitment of FP preceptors as well as for their training in instructional methods.     

Dentists’ Dietary Perception and Practice Patterns in a Dental Practice-Based Research Network

Background

Dental caries are largely preventable, and epidemiological evidence for a relationship between diet and oral health is abundant. To date, however, dentists’ perceptions about the role of diet and dentists’ practice patterns regarding diet counseling have not been clarified.

Objective

The purposes of this study were to: (1) examine discordance between dentists’ perception of the importance of diet in caries treatment planning and their actual provision of diet counseling to patients, and (2) identify dentists’ characteristics associated with their provision of diet counseling.

Design

The study used a cross-sectional study design consisting of a questionnaire survey in Japan.

Participants

The study queried dentists working in outpatient dental practices who were affiliated with the Dental Practice-Based Research Network Japan (JDPBRN), which aims to allow dentists to investigate research questions and share experiences and expertise (n = 282).

Measurement

Dentists were asked about their perceptions on the importance of diet and their practice patterns regarding diet counseling, as well as patient, practice, and dentist background data.

Results

The majority of participants (n = 116, 63%) recognized that diet is “more important” to oral health. However, among participants who think diet is “more important” (n = 116), only 48% (n = 56) provide diet counseling to more than 20% of their patients. Multiple logistic regression analysis suggested that several variables were associated with providing diet counseling; dentist gender, practice busyness, percentage of patients interested in caries prevention, caries risk assessment, and percentage of patients who receive blood pressure screening.

Conclusions

Some discordance exists between dentists’ perception of the importance of diet in caries treatment planning and their actual practice pattern regarding diet counseling to patients. Reducing this discordance may require additional dentist education, including nutritional and systemic disease concepts; patient education to increase perception of the importance of caries prevention; or removing barriers to practices’ implementation of counseling.

Trial Registration

ClinicalTrials.gov {"type":"clinical-trial","attrs":{"text":"NCT01680848","term_id":"NCT01680848"}}NCT01680848     

Association between delayed bedtime and sleep-related problems among community-dwelling 2-year-old children in Japan

Background

Although delayed sleep timing causes many socio-psycho-biological problems such as sleep loss, excessive daytime sleepiness, obesity, and impaired daytime neurocognitive performance in adults, there are insufficient data showing the clinical significance of a ‘night owl lifestyle’ in early life. This study examined the association between habitual delayed bedtime and sleep-related problems among community-dwelling 2-year-old children in Japan.

Methods

Parents/caregivers of 708 community-dwelling 2-year-old children in Nishitokyo City, Tokyo, participated in the study. The participants answered a questionnaire to evaluate their child’s sleep habits and sleep-related problems for the past 1 month.

Results

Of the 425 children for whom complete data were collected, 90 (21.2%) went to bed at 22:00 or later. Children with delayed bedtime showed significantly more irregular bedtime, delayed wake time, shorter total sleep time, and difficulty in initiating and terminating sleep. Although this relationship indicated the presence of sleep debt in children with delayed bedtime, sleep onset latency did not differ between children with earlier bedtime and those with delayed bedtime. Rather, delayed bedtime was significantly associated with bedtime resistance and problems in the morning even when adjusting for nighttime and daytime sleep time.

Conclusions

Even in 2-year-old children, delayed bedtime was associated with various sleep-related problems. The causal factors may include diminished homeostatic sleep drive due to prolonged daytime nap as well as diurnal preference (morning or night type) regulated by the biological clock.     

Prognostic role of c-met expression in breast cancer patients

Background

Hepatocyte growth factor plays an important role in tumor growth, metastasis and angiogenesis. C-met is HGF''s high affinity receptor.

Aim

The aim of the study was to assess the correlations between c-met expression and clinic-pathological factors in breast cancer tissues. Furthermore, the purpose of the study was to evaluate the prognostic value of the hepatocyte growth factor receptor (HGFR, c-met) expressions in homogenous group of breast cancer patients.

Materials and methods

Tumor samples were collected from 302 patients with breast carcinoma treated with primary surgery. We have assessed the percentage of tumor cells with c-met expression, the intensity of reaction and the ratio of these two factors—immunoreactivity according to the Remmele score.

Results

We have observed no correlations between HGFR immunoreactivities and clinical parameters (tumor size, grade, axillary lymph node status, age). In 5-year observation we have found prognostic value of assessing c-met immunoreactivity in primary tumor.

Conclusion

Our study has revealed prognostic value of c-met. Unlike in other authors’ studies, our patients’ group is very homogenous which might contribute to obtained results.     

The Facilitating Role of Chemotherapy in the Palliative Phase of Cancer: Qualitative Interviews with Advanced Cancer Patients

Objective

To explore the extent to which patients have a directing role in decisions about chemotherapy in the palliative phase of cancer and (want to) anticipate on the last stage of life.

Design

Qualitative interview study.

Methods

In depth-interviews with 15 patients with advanced colorectal or breast cancer at the medical oncology department in a Dutch teaching hospital; interviews were analysed following the principles of thematic content-analysis.

Results

All patients reported to know that the chemotherapy they received was with palliative intent. Most of them did not express the wish for information about (other) treatment options and put great trust in their physicians’ treatment advice. The more patients were aware of the severity of their disease, the more they seemed to ‘live their life’ in the present and enjoy things besides having cancer. Such living in the present seemed to be facilitated by the use of chemotherapy. Patients often considered the ‘chemotherapy-free period’ more stressful than periods when receiving chemotherapy despite their generally improved physical condition. Chemotherapy (regardless of side-effects) seemed to shift patients’ attention away from the approaching last stage of life. Interestingly, although patients often discussed advance care planning, they were reluctant to bring on end-of-life issues that bothered them at that specific moment. Expressing real interest in people ‘as a person’ was considered an important element of appropriate care.

Conclusions

Fearing their approaching death, patients deliberately focus on living in the present. Active (chemotherapy) treatment facilitates this focus, regardless of the perceived side-effects. However, if anxiety for what lies ahead is the underlying reason for treatment, efforts should be made in assisting patients to find other ways to cope with this fear. Simultaneously, such an approach may reduce the use of burdensome and sometimes costly treatment in the last stage of life.     

Cohen’s h for detection of disease association with rare genetic variants

Background

The power of the genome wide association studies starts to go down when the minor allele frequency (MAF) is below 0.05. Here, we proposed the use of Cohen’s h in detecting disease associated rare variants. The variance stabilizing effect based on the arcsine square root transformation of MAFs to generate Cohen’s h contributed to the statistical power for rare variants analysis. We re-analyzed published datasets, one microarray and one sequencing based, and used simulation to compare the performance of Cohen’s h with the risk difference (RD) and odds ratio (OR).

Results

The analysis showed that the type 1 error rate of Cohen’s h was as expected and Cohen’s h and RD were both less biased and had higher power than OR. The advantage of Cohen’s h was more obvious when MAF was less than 0.01.

Conclusions

Cohen’s h can increase the power to find genetic association of rare variants and diseases, especially when MAF is less than 0.01.

Electronic supplementary material

The online version of this article (doi:10.1186/1471-2164-15-875) contains supplementary material, which is available to authorized users.     

Physical Aggression and Language Ability from 17 to 72 Months: Cross-Lagged Effects in a Population Sample

Background

Does poor language ability in early childhood increase the likelihood of physical aggression or is language ability delayed by frequent physical aggression? This study examined the longitudinal associations between physical aggression and language ability from toddlerhood to early childhood in a population sample while controlling for parenting behaviours, non-verbal intellectual functioning, and children’s sex.

Methods

Children enrolled in the Quebec Longitudinal Study of Child Development (QLSCD) (N = 2, 057) were assessed longitudinally from 17 to 72 months via parent reports and standardized assessments.

Results

The cross-lagged models revealed modest reciprocal associations between physical aggression and language performance from 17 to 41 months but not thereafter.

Conclusions

Significant associations between physical aggression and poor language ability are minimal and limited to the period when physical aggression and language performance are both substantially increasing. During that period parenting behaviours may play an important role in supporting language ability while reducing the frequency of physical aggression. Further studies are needed that utilize multiple assessments of physical aggression, assess multiple domains of language abilities, and that examine the potential mediating role of parenting behaviours between 12 and 48 months.     

Earlier Development of Analytical than Holistic Object Recognition in Adolescence

Background

Previous research has shown that object recognition may develop well into late childhood and adolescence. The present study extends that research and reveals novel differences in holistic and analytic recognition performance in 7–12 year olds compared to that seen in adults. We interpret our data within a hybrid model of object recognition that proposes two parallel routes for recognition (analytic vs. holistic) modulated by attention.

Methodology/Principal Findings

Using a repetition-priming paradigm, we found in Experiment 1 that children showed no holistic priming, but only analytic priming. Given that holistic priming might be thought to be more ‘primitive’, we confirmed in Experiment 2 that our surprising finding was not because children’s analytic recognition was merely a result of name repetition.

Conclusions/Significance

Our results suggest a developmental primacy of analytic object recognition. By contrast, holistic object recognition skills appear to emerge with a much more protracted trajectory extending into late adolescence.