Measurement Invariance of the WHODAS 2.0 in a Population-Based Sample of Youth

The World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0) is a brief measure of global disability originally developed for adults, which has since been implemented among samples of children and youth. However, evidence of its validity for use among youth, particularly measurement invariance, is lacking. Investigations of measurement invariance assess the extent to which the psychometric properties of observed items in a measure are generalizable across samples. Satisfying the assumption of measurement invariance is critical for any inferences about between-group differences. The objective of this paper was to empirically assess the measurement invariance of the 12-item interview version of the WHODAS 2.0 measure in an epidemiological sample of youth (15 to 17 years) and adults (≥ 18 years) in Canada. Multiple-group confirmatory factor analysis using a categorical variable framework allowed for the sequential testing of increasingly restrictive models to evaluate measurement invariance of the WHODAS 2.0 between adults and youth. Findings provided evidence for full measurement invariance of the WHODAS 2.0 in youth aged 15 to 17 years. The final model fit the data well: χ²(159) = 769.04, p < .001; CFI = 0.950, TLI = 0.958, RMSEA (90% CI) = 0.055 [0.051, 0.059]. Results from this study build on previous work supporting the validity of the WHODAS 2.0. Findings indicate that the WHODAS 2.0 is valid for making substantive comparisons of disability among youth as young as 15 years of age.     

Testing multidimensional models of youth civic engagement: Model comparisons,measurement invariance,and age differences

Despite recognition that youth civic engagement is multidimensional, different modeling approaches are rarely compared or tested for measurement invariance. Using a diverse sample of 2,467 elementary, middle, and high school-aged youth, we measured eight dimensions of civic engagement: social responsibility values, informal helping, political beliefs, civic skills, environmental behavior, volunteering, voting intentions, and news consumption. We compared correlated unidimensional factors, higher-order factor, and bifactor models and tested for measurement invariance and latent mean differences by age. The correlated unidimensional factors model best fit the data, yet higher-order and bifactor models fit adequately. Metric and scalar invariance was found across models. Latent means varied depending on the dimension of civic engagement and the multidimensional model examined. Findings favored the correlated unidimensional factors model; implications of each model are discussed. This study informs future research on youth civic engagement and has broad relevance for any developmental scientist studying a multidimensional construct.     

Cross-cultural validity of Morningness-Eveningness Stability Scale improved (MESSi) in Iran,Spain and Germany

Morningness-Eveningness Stability Scale improved (MESSi) is a newly constructed measure to assess circadian types and amplitude. In this study, we applied this measure to participants from three different countries: Germany, Spain and Iran. Confirmatory factorial analysis (CFA) of MESSi displayed mediocre fit in the three countries. Comparing increasingly stringent models using multigroup confirmatory factor analyses indicated at least partial measurement invariance (metric invariance) by country for Morning Affect and Distinctness subscales. Age was positively related to Morning Affect (MA), and negatively related to Eveningness (EV) and Distinctness (DI). Men reported higher MA than women, whereas women reported higher DI than men. Regarding country effect, Iranian participants reported highest MA compared to Spaniards and Germans, whereas Germans reported higher DI compared to Iranians and Spaniards. As a conclusion, our study corroborated the validity and reliability of MESSi across three different countries with different geographical and cultural characteristics.     

Pygmalion in the Program: The Role of Teenage Peer Mentors' Attitudes in Shaping Their Mentees' Outcomes

Cross-age peer mentoring programs, in which teenagers mentor younger children, have proliferated in recent years, yet there is disagreement about the effectiveness of such programs. This study tested whether teen mentors' attitudes about children interact with their mentees' characteristics to moderate outcomes of cross-age peer mentoring. The sample included 221 high school volunteers, 205 mentees, and 182 control group youth. Latent profile analyses yielded two profiles of students who were labeled “academically connected” or “disconnected.” Analyses revealed that the academically disconnected mentees who were paired with mentors holding relatively positive attitudes toward youth were more emotionally engaged in the mentoring relationship (than disconnected mentees with more negative mentors) and, subsequently, reported stronger relationships with their teachers at year's end (than did the similarly disconnected children in the control group). Conversely, there was evidence of iatrogenic effects of matching negative mentors with academically connected mentees. Implications for mentor selection and training are discussed.     

Extending Tests of Random Effects to Assess for Measurement Invariance in Factor Models

Factor analysis models are widely used in health research to summarize hard-to-measure predictor or outcome variable constructs. For example, in the ELEMENT study, factor models are used to summarize lead exposure biomarkers which are thought to indirectly measure prenatal exposure to lead. Classic latent factor models are fitted assuming that factor loadings are constant across all covariate levels (e.g., maternal age in ELEMENT); that is, measurement invariance (MI) is assumed. When the MI is not met, measurement bias is introduced. Traditionally, MI is examined by defining subgroups of the data based on covariates, fitting multi-group factor analysis, and testing differences in factor loadings across covariate groups. In this paper, we develop novel tests of measurement invariance by modeling the factor loadings as varying coefficients, i.e., letting the factor loading vary across continuous covariate values instead of groups. These varying coefficients are estimated using penalized splines, where spline coefficients are penalized by treating them as random coefficients. The test of MI is then carried out by conducting a likelihood ratio test for the null hypothesis that the variance of the random spline coefficients equals zero. We use a Monte Carlo EM algorithm for estimation, and obtain the likelihood using Monte Carlo integration. Using simulations, we compare the Type I error and power of our testing approach and the multi-group testing method. We apply the proposed methods to summarize data on prenatal biomarkers of lead exposure from the ELEMENT study and find violations of MI due to maternal age.     

Factor Structure and Longitudinal Measurement Invariance of the Demand Control Support Model: An Evidence from the Swedish Longitudinal Occupational Survey of Health (SLOSH)

Objectives

To examine the factor structure and to evaluate the longitudinal measurement invariance of the demand-control-support questionnaire (DCSQ), using the Swedish Longitudinal Occupational Survey of Health (SLOSH).

Methods

A confirmatory factor analysis (CFA) and multi-group confirmatory factor analysis (MGCFA) models within the framework of structural equation modeling (SEM) have been used to examine the factor structure and invariance across time.

Results

Four factors: psychological demand, skill discretion, decision authority and social support, were confirmed by CFA at baseline, with the best fit obtained by removing the item repetitive work of skill discretion. A measurement error correlation (0.42) between work fast and work intensively for psychological demands was also detected. Acceptable composite reliability measures were obtained except for skill discretion (0.68). The invariance of the same factor structure was established, but caution in comparing mean levels of factors over time is warranted as lack of intercept invariance was evident. However, partial intercept invariance was established for work intensively.

Conclusion

Our findings indicate that skill discretion and decision authority represent two distinct constructs in the retained model. However removing the item repetitive work along with either work fast or work intensively would improve model fit. Care should also be taken while making comparisons in the constructs across time. Further research should investigate invariance across occupations or socio-economic classes.     

Substance Use and Depression Symptomatology: Measurement Invariance of the Beck Depression Inventory (BDI-II) among Non-Users and Frequent-Users of Alcohol,Nicotine and Cannabis

Depression is a highly heterogeneous condition, and identifying how symptoms present in various groups may greatly increase our understanding of its etiology. Importantly, Major Depressive Disorder is strongly linked with Substance Use Disorders, which may ameliorate or exacerbate specific depression symptoms. It is therefore quite plausible that depression may present with different symptom profiles depending on an individual’s substance use status. Given these observations, it is important to examine the underlying construct of depression in groups of substance users compared to non-users. In this study we use a non-clinical sample to examine the measurement structure of the Beck Depression Inventory (BDI-II) in non-users and frequent-users of various substances. Specifically, measurement invariance was examined across those who do vs. do not use alcohol, nicotine, and cannabis. Results indicate strict factorial invariance across non-users and frequent-users of alcohol and cannabis, and metric invariance across non-users and frequent-users of nicotine. This implies that the factor structure of the BDI-II is similar across all substance use groups     

Spirituality as a Scientific Construct: Testing Its Universality across Cultures and Languages

Using data obtained from 4004 participants across eight countries (Canada, India, Japan, Korea, Poland, Slovakia, Uganda, and the U.S.), the factorial reliability, validity and structural/measurement invariance of a 30-item version of Expressions of Spirituality Inventory (ESI-R) was evaluated. The ESI-R measures a five factor model of spirituality developed through the conjoint factor analysis of several extant measures of spiritual constructs. Exploratory factor analyses of pooled data provided evidence that the five ESI-R factors are reliable. Confirmatory analyses comparing four and five factor models revealed that the five dimensional model demonstrates superior goodness-of-fit with all cultural samples and suggest that the ESI-R may be viewed as structurally invariant. Measurement invariance, however, was not supported as manifested in significant differences in item and dimension scores and in significantly poorer fit when factor loadings were constrained to equality across all samples. Exploratory analyses with a second adjective measure of spirituality using American, Indian, and Ugandan samples identified three replicable factors which correlated with ESI-R dimensions in a manner supportive of convergent validity. The paper concludes with a discussion of the meaning of the findings and directions needed for future research.     

Optimizing Cross-Sectional Prediction of Social Functioning in Youth Referred for Neuropsychological Testing

The current study aimed to establish a fine-grained, efficient characterization of the concurrent neuropsychological contributions to social functioning in neuropsychologically-referred youth. A secondary aim was to demonstrate a useful statistic approach for such investigations (Partial Least Squares Regression; PLSR), which is underutilized in this field. Forty-five participants (70 – 164 months; M_age = 110.89; 34 male) were recruited from a large neuropsychological assessment clinic. Participants completed subtests from the NEPSY-II focusing on neuropsychological constructs that have been linked to social functioning (affect decoding, social memory, motor skills, visuomotor skills, response inhibition, attention and set-shifting, and verbal comprehension). Mothers completed the BASC-2, from which Atypicality and Social Skills scales were analyzed. PLSR revealed that difficulty with social memory, sensorimotor integration, and the ability to attend to and accurately discriminate auditory stimuli combine to best predict atypical or “odd” behavior. In terms of social skills, two factors emerged. The first factor indicated that, counterintuitively, greater emotional perception, visuospatial perception, ability to attend to and accurately discriminate auditory stimuli, and understand instructions was related to poorer social skills. The second factor indicated that a pattern of better facial memory, and sensorimotor ability (execution & integration) characterized a distinct profile of greater social ability. PLSR results were compared to traditional OLS and Backwards Stepwise regression approaches to demonstrate utility. Results also suggested that these findings were consistent across age, gender, and diagnostic group, indicating common neuropsychological substrates of social functioning in this sample of referred youth. Overall, this study provides the first characterization of optimized combinations of neuropsychological variables in predicting social functioning in assessment clinic-referred youth, and introduces to this literature a valuable statistical approach for obtaining such characterizations.     

Seeking Social Inventions to Improve the Transition to Adulthood

Social inventions are new ways of solving human problems. This article reports on an action research project designed to find social inventions to reduce structural lag in four programs that support the transition to adulthood of marginalized youth in Latin America. The investigators engaged youth and staff members in identifying important questions, collecting and interpreting data, and using findings to improve their practices. Their issues aligned with social setting features: activities, resources, roles, and norms. Among their social inventions were “the life project,” the role of mentor, youth responsibility, and new norms of reflection introduced by action research, which not only revealed social inventions but generated them as well. Interaction with external parties contributed to this process: the investigators, “local researchers” engaged as part of the project, participants in conferences convened for participants. Rather than recommending social inventions for adoption in other locations, we recommend using action research to generate local social inventions.     

The Quest for Comparability: Studying the Invariance of the Teachers’ Sense of Self-Efficacy (TSES) Measure across Countries

Teachers’ self-efficacy is an important motivational construct that is positively related to a variety of outcomes for both the teachers and their students. This study addresses challenges associated with the commonly used ‘Teachers’ Sense of Self-Efficacy (TSES)’ measure across countries and provides a synergism between substantive research on teachers’ self-efficacy and the novel methodological approach of exploratory structural equation modeling (ESEM). These challenges include adequately representing the conceptual overlap between the facets of self-efficacy in a measurement model (cross-loadings) and comparing means and factor structures across countries (measurement invariance). On the basis of the OECD Teaching and Learning International Survey (TALIS) 2013 data set comprising 32 countries (N = 164,687), we investigate the effects of cross-loadings in the TSES measurement model on the results of measurement invariance testing and the estimation of relations to external constructs (i.e., working experience, job satisfaction). To further test the robustness of our results, we replicate the 32-countries analyses for three selected sub-groups of countries (i.e., Nordic, East and South-East Asian, and Anglo-Saxon country clusters). For each of the TALIS 2013 participating countries, we found that the factor structure of the self-efficacy measure is better represented by ESEM than by confirmatory factor analysis (CFA) models that do not allow for cross-loadings. For both ESEM and CFA, only metric invariance could be achieved. Nevertheless, invariance levels beyond metric invariance are better achieved with ESEM within selected country clusters. Moreover, the existence of cross-loadings did not affect the relations between the dimensions of teachers’ self-efficacy and external constructs. Overall, this study shows that a conceptual overlap between the facets of self-efficacy exists and can be well-represented by ESEM. We further argue for the cross-cultural generalizability of the corresponding measurement model.     

The rise of creative youth development

ABSTRACT

Creative youth development (CYD) is a dynamic area of community arts education that successfully bridges youth development and arts education. CYD is an intentional, holistic practice that combines hands-on artmaking and skill building in the arts with development of life skills to support young people in successfully participating in adolescence and navigating into adulthood. Young people in CYD programs exhibit high levels of artistic skill and accomplishment along with increased self-esteem and sense of belonging. CYD participants are immersed in a broad array of rigorous artistic endeavors, including creating documentary films, researching and reporting on community issues through radio broadcasts, writing and staging new theatrical works, and engaging in thoughtful critique of one another's visual art work. The impact for youth of program participation extends beyond pride in artistic accomplishment. Throughout the United States, teen participants in CYD programs assert that the programs saved their lives, putting them on positive trajectories and away from gangs, drug use, crime, and ennui. This article provides a definition for the term creative youth development, describes core characteristics of CYD programs, and briefly describes four CYD programs. It provides background on the origins and history of creative youth development, including current advances in the field and signs the field is coalescing. The article describes creative youth development in the larger contexts of arts education and of education reform. Lastly, the article discusses policy, funding, and research needs and opportunities and provides questions for consideration.     

Positive youth development profiles of cross-age peer mentors

To engage more youth in service, we require further research on the characteristics of youth who serve, particularly disadvantaged youth with limited access to formal service opportunities. This study investigated the positive youth development characteristics of New Zealand youth who decided to mentor younger peers in the Stars program for the first time (n = 109), those who returned to mentor for a subsequent year (n = 48), and similar youth not involved in Stars (n = 51) to determine what characteristics differentiate these groups. Returning mentors had the highest levels of social competency and involvement and a strong leadership orientation. New mentors had the second highest levels of leadership orientation but the lowest levels of social competency and involvement. The propensity for leadership in mentors was associated with having many positive adult role models. Strategies to engage more young people in service as cross-age peer mentors are discussed.     

Aging and Repeated Thought Suppression Success

Intrusive thoughts and attempts to suppress them are common, but while suppression may be effective in the short-term, it can increase thought recurrence in the long-term. Because intentional suppression involves controlled processing, and many aspects of controlled processing decline with age, age differences in thought suppression outcomes may emerge, especially over repeated thought suppression attempts as cognitive resources are expended. Using multilevel modeling, we examined age differences in reactions to thought suppression attempts across four thought suppression sequences in 40 older and 42 younger adults. As expected, age differences were more prevalent during suppression than during free monitoring periods, with younger adults indicating longer, more frequent thought recurrences and greater suppression difficulty. Further, younger adults’ thought suppression outcomes changed over time, while trajectories for older adults’ were relatively stable. Results are discussed in terms of older adults’ reduced thought recurrence, which was potentially afforded by age-related changes in reactive control and distractibility.     

Promotion as Prevention: Positive Youth Development as Protective against Tobacco,Alcohol, Illicit Drug,and Sex Initiation

The present study was designed to examine the association of positive youth development with the likelihood of tobacco, alcohol, marijuana, hard drug, and sex initiation between 5th and 10th grades. A national, largely middle-class sample of 5,305 adolescents, participating in a longitudinal study funded by the National 4-H Council (although not all participants were enrolled in 4-H or other after-school programs), completed measures of positive youth development (PYD) constructs and of tobacco, alcohol, marijuana, and hard drug use once per year between 5th and 10th grades. At the 9th and 10th grade assessments, adolescents were asked whether they had initiated sexual intercourse and, if so, at what age they had first engaged in intercourse. Although the present sample was somewhat lower risk compared to national averages, survival analysis models indicated that PYD was significantly and negatively associated with the initiation hazards for tobacco use, marijuana use, and sex initiation for girls only, and with hard drug use for both genders. PYD was also positively associated with the odds of condom use across genders. Results are discussed with regard to PYD as a preventive process.     

Assessing core manipulative skills in a large, first-year laboratory

Responding to the concern from our faculty that undergraduate students do not have robust laboratory skills, we designed and implemented a strategy to individually teach and assess the manipulative skills of students in first-year laboratories. Five core laboratory skills were selected for the course entitled Human Biology, a large, first-year class of students, most of whom were enrolled in Bachelor of Pharmacy and Human Movement Studies. Here, we report details for the 365 students enrolled primarily in Pharmacy and Human Movement Studies bachelor degree programs in semester 1 of 2006. We designed a specific strategy to assess five core laboratory skills: 1) accurate and precise use of a micropipette, 2) calculation of dilutions and preparation of diluted samples of saline, 3) accurate representation of data using a graph, 4) use of a light microscope, and 5) acquisition of digital data by measuring the latent period for the Achilles reflex. Graduate tutors were trained to teach and assess each student on each skill. The development of competency was tracked for all students across all five skills. Most students demonstrated proficiency on their first attempt. The development of proficiency across the core skills depended on both the skill and degree program. In semester 2 of 2006, 854 students mostly enrolled in the Bachelor of Science degree program and were similarly taught and assessed on the same five core skills. This approach was an effective teaching and assessment strategy that, when applied beyond first year, should increase the level of laboratory skills across undergraduate programs in physiology.     

A Variable- and Person-Oriented Investigation of Preschool Competencies and Head Start Children's Transition to Kindergarten and First Grade

There is a widespread belief that youth drop out of youth development programs during the middle school years. Alternative explanations for the smaller number of adolescent program participants have yet to be explored. We examine age trends in program enrollment using data from over 221,000 youth enrolled in the California 4-H Youth Development Program from 1992 to 2002. We include sex, race/ethnicity, rural/urban residence, and project participation as predictors of dropout. Our results indicate that the peak in enrollment in early adolescence that is observable from annual enrollment data can be accounted for by stable and high enrollment turnover before age 11, followed by increased program dropout and fewer new enrollments. These findings have implications for explanations of youth program participation and for youth development program enrollment strategies, both for the 4-H Youth Development program and for youth programs in general.     

Measuring discomfort in patients with dementia. Validity of a Dutch version of the Discomfort Scale--dementia of Alzheimer type (DS-DAT)

The Discomfort Scale--Dementia of Alzheimer Type (DS-DAT) is an instrument to assess discomfort in patients with severe dementia by observing patients' behaviour during five minutes. Trained nursing home physicians collected data of 662 pneumonia patients with dementia. The data were used to test the validity of a Dutch translation of the DS-DAT as a measure of discomfort. Internal consistency of the nine-item instrument was favourable (Cronbach's alpha ranged between 0.82 and 0.84 for different times during and following the pneumonia), and factor analyses indicated measurement of a single concept. Furthermore, as hypothesised, discomfort appeared moderately associated with acute illness. Nursing home physicians' assessment of DS-DAT scores therefore appeared a suitable method to assess discomfort in severely demented psychogeriatric nursing home patients for research purposes. For use in individual patients, results are probably too strongly affected by the chosen time fluctuations of assessment. For this purpose, the current rater assessment instructions should be adapted and tested.     

Further Psychometric Evaluation of the Self-Stigma Scale-Short: Measurement Invariance across Mental Illness and Gender

BackgroundThis study cross-validated the factor structure of the Self-Stigma Scale-Short (SSS-S) in a cohort of patients with mental illness in southern Taiwan. The measurement invariance of the SSS-S factor structure across mental illness and gender was also examined.MethodsThe sample consisted of 161 patients with schizophrenia (51.6% males; mean age ± SD = 40.53 ± 10.38 years) and 189 patients with other mental illnesses (34.9% males; mean age = 46.52 ± 11.29 years).ResultsThe internal reliability (total score: α = 0.948) and concurrent validity (r = 0.335 to 0.457 with Depression and Somatic Symptoms Scale; r = −0.447 to −0.556 with WHOQOL-BREF) of the SSS-S were both satisfactory, and the results verified that the factor structure in our Taiwan sample (RMSEA = 0.0796, CFA = 0.992) was the same as that of the Hong Kong population. In addition, the results supported the measurement invariance of the SSS-S across mental illness (ΔRMSEAs = −0.0082 to −0.0037, ΔCFAs = 0.000) and gender (ΔRMSEAs = −0.0054 to −0.0008, ΔCFAs = −0.001 to 0.000).ConclusionFuture studies can use the SSS-S to compare self-stigma between genders and between patients with different kinds of mental illnesses.     

Immigrant Civic Engagement: New Translations

This study used a mixed methods methodology to investigate the reliability and validity of the Ounce Scale, an authentic, observational assessment of infants' and toddlers' development from birth through 42 months of age. Quantitative cross-sectional data were collected from 287 children and 124 teachers in seven urban Early Head Start programs; qualitative data were derived from interviews with 21 teachers and seven supervisors. Data were collected across eight age groups. Results showed moderate reliability of the Ounce Scale and provided evidence of agreement with criterion measures for concurrent validity. Receiver operating characteristic curve (ROC) analyses demonstrated very good levels of accuracy in predicting which children were at-risk or not at-risk. Hierarchical regression analyses indicated that, after controlling for child and family variables, the Ounce Scale contributed significantly to explaining the variance in children's performance on the criterion measures. Analysis of qualitative interview data elaborates on these findings in terms of the strength-based philosophy of the caregivers, the binary structure of the scale, the cultural context in which the scale was used, and the need for additional professional development. Discussion also centers on the relationship between norm-referenced and performance-based assessments in early childhood.