Strengthening Community-Based Vital Events Reporting for Real-Time Monitoring of Under-Five Mortality: Lessons Learned from the Balaka and Salima Districts in Malawi

Background

Malawi ratified a compulsory birth and death registration system in 2009. Until it captures complete coverage of vital events, Malawi relies on other data sources to calculate mortality estimates. We tested a community-based method to estimate annual under-five mortality rates (U5MR) through the Real-Time Monitoring of Under-Five Mortality (RMM) project in Malawi. We implemented RMM in two phases, and conducted an independent evaluation of phase one after 21 months of implementation. We present results of the phase two validation that covers the full project time span, and compare the results to those of the phase one validation.

Methods and Findings

We assessed the completeness of the counts of births and deaths and the accuracy of disaggregated U5MR from the community-based method against a retrospective full pregnancy history for rolling twelve-month periods after the independent evaluation. We used full pregnancy histories collected through household interviews carried out between November 2013 and January 2014 as the validation data source. Health Surveillance Agents (HSAs) across the 160 catchment areas submitted routine reports on pregnancies, births, and deaths consistently. However, for the 15-month implementation period post-evaluation, average completeness of birth event reporting was 76%, whereas average completeness of death event reporting was 67% relative to that expected from a comparable pregnancy history. HSAs underestimated the U5MR by an average of 21% relative to that estimated from a comparable pregnancy history.

Conclusions

On a medium scale, the community-based RMM method in Malawi produced substantial underestimates of annualized U5MR relative to those obtained from a full pregnancy history, despite the additional incentives and quality-control activities. We were not able to achieve an optimum level of incentive and support to make the system work while ensuring sustainability. Lessons learned from the implementation of RMM can inform programs supporting community-based interventions through HSAs in Malawi.     

Can Community Health Workers Report Accurately on Births and Deaths? Results of Field Assessments in Ethiopia,Malawi and Mali

Introduction

Most low-income countries lack complete and accurate vital registration systems. As a result, measures of under-five mortality rates rely mostly on household surveys. In collaboration with partners in Ethiopia, Ghana, Malawi, and Mali, we assessed the completeness and accuracy of reporting of births and deaths by community-based health workers, and the accuracy of annualized under-five mortality rate estimates derived from these data. Here we report on results from Ethiopia, Malawi and Mali.

Method

In all three countries, community health workers (CHWs) were trained, equipped and supported to report pregnancies, births and deaths within defined geographic areas over a period of at least fifteen months. In-country institutions collected these data every month. At each study site, we administered a full birth history (FBH) or full pregnancy history (FPH), to women of reproductive age via a census of households in Mali and via household surveys in Ethiopia and Malawi. Using these FBHs/FPHs as a validation data source, we assessed the completeness of the counts of births and deaths and the accuracy of under-five, infant, and neonatal mortality rates from the community-based method against the retrospective FBH/FPH for rolling twelve-month periods. For each method we calculated total cost, average annual cost per 1,000 population, and average cost per vital event reported.

Results

On average, CHWs submitted monthly vital event reports for over 95 percent of catchment areas in Ethiopia and Malawi, and for 100 percent of catchment areas in Mali. The completeness of vital events reporting by CHWs varied: we estimated that 30%-90% of annualized expected births (i.e. the number of births estimated using a FPH) were documented by CHWs and 22%-91% of annualized expected under-five deaths were documented by CHWs. Resulting annualized under-five mortality rates based on the CHW vital events reporting were, on average, under-estimated by 28% in Ethiopia, 32% in Malawi, and 9% in Mali relative to comparable FPHs. Costs per vital event reported ranged from $21 in Malawi to $149 in Mali.

Discussion

Our findings in Mali suggest that CHWs can collect complete and high-quality vital events data useful for monitoring annual changes in under-five mortality rates. Both the supervision of CHWs in Mali and the rigor of the associated field-based data quality checks were of a high standard, and the size of the pilot area in Mali was small (comprising of approximately 53,205 residents in 4,200 households). Hence, there are remaining questions about whether this level of vital events reporting completeness and data quality could be maintained if the approach was implemented at scale. Our experience in Malawi and Ethiopia suggests that, in some settings, establishing and maintaining the completeness and quality of vital events reporting by CHWs over time is challenging. In this sense, our evaluation in Mali falls closer to that of an efficacy study, whereas our evaluations in Ethiopia and Malawi are more akin to an effectiveness study. Our overall findings suggest that no one-size-fits-all approach will be successful in guaranteeing complete and accurate reporting of vital events by CHWs.     

Antagonistic properties of two recombinant strains of Streptomyces melanosporofaciens obtained by intraspecific protoplast fusion

Intraspecific protoplast fusion was used to produce stable prototrophic recombinants of Streptomyces melanosporofaciens EF-76, a biocontrol agent of plant disease producing geldanamycin. Two recombinant strains (FP-54 and FP-60) that differed with regard to their antagonistic properties against Bacillus cereus ATCC 14579, Streptomyces scabies EF-35 and Phytophthora fragariae var. rubi 390 were characterized. FP-60 lost the ability to inhibit the in vitro growth of these microbial strains while FP-54 exhibited higher antagonistic activities against them. FP-60 was deficient in geldanamycin biosynthesis whereas FP-54 was shown to produce, in addition to geldanamycin, at least two other antimicrobial compounds that were absent in the culture supernatants of strain EF-76. Like the wild-type strain EF-76, strain FP-54 reduced common scab symptoms on potato tuber but no significant difference was observed between the disease index attributed to tubers treated with strain EF-76 or with strain FP-54. Strain FP-60 showed no protective effect against common scab. The disease index of tubers treated with this recombinant was worse than the index associated with potato tubers from control treatments.     

Monitoring Change in Child Mortality through Household Surveys

Background

Most low- and middle-income countries lack fully functional civil registration systems. Measures of under-five mortality are typically derived from periodic household surveys collecting detailed information from women on births and child deaths. However, such surveys are expensive and are not appropriate for monitoring short-term changes in child mortality. We explored and tested the validity of two new analysis methods for less-expensive summary histories of births and child deaths for such monitoring in five African countries.

Methods and Findings

The first method we explored uses individual-level survey data on births and child deaths to impute full birth histories from an earlier survey onto summary histories from a more recent survey. The second method uses cohort changes between two surveys in the average number of children born and the number of children dead by single year of age to estimate under-five mortality for the inter-survey period. The first method produces acceptable annual estimates of under-five mortality for two out of six applications to available data sets; the second method produced an acceptable estimate in only one of five applications, though none of the applications used ideal data sets.

Conclusions

The methods we tested were not able to produce consistently good quality estimates of annual under-five mortality from summary birth history data. The key problem we identified was not with the methods themselves, but with the underlying quality of the summary birth histories. If summary birth histories are to be included in general household surveys, considerable emphasis must be placed on quality control.     

Evaluation of a mHealth Data Quality Intervention to Improve Documentation of Pregnancy Outcomes by Health Surveillance Assistants in Malawi: A Cluster Randomized Trial

Background

While community health workers are being recognized as an integral work force with growing responsibilities, increased demands can potentially affect motivation and performance. The ubiquity of mobile phones, even in hard-to-reach communities, has facilitated the pursuit of novel approaches to support community health workers beyond traditional modes of supervision, job aids, in-service training, and material compensation. We tested whether supportive short message services (SMS) could improve reporting of pregnancies and pregnancy outcomes among community health workers (Health Surveillance Assistants, or HSAs) in Malawi.

Methods and Findings

We designed a set of one-way SMS that were sent to HSAs on a regular basis during a 12-month period. We tested the effectiveness of the cluster-randomized intervention in improving the complete documentation of a pregnancy. We defined complete documentation as a pregnancy for which a specific outcome was recorded. HSAs in the treatment group received motivational and data quality SMS. HSAs in the control group received only motivational SMS. During baseline and intervention periods, we matched reported pregnancies to reported outcomes to determine if reporting of matched pregnancies differed between groups and by period. The trial is registered as ISCTRN24785657.

Conclusions

Study results show that the mHealth intervention improved the documentation of matched pregnancies in both the treatment (OR 1.31, 95% CI: 1.10–1.55, p<0.01) and control (OR 1.46, 95% CI: 1.11–1.91, p = 0.01) groups relative to the baseline period, despite differences in SMS content between groups. The results should be interpreted with caution given that the study was underpowered. We did not find a statistically significant difference in matched pregnancy documentation between groups during the intervention period (OR 0.94, 95% CI: 0.63–1.38, p = 0.74). mHealth applications have the potential to improve the tracking and data quality of pregnancies and pregnancy outcomes, particularly in low-resource settings.     

Using Health Extension Workers for Monitoring Child Mortality in Real-Time: Validation against Household Survey Data in Rural Ethiopia

Background

Ethiopia has scaled up its community-based programs over the past decade by training and deploying health extension workers (HEWs) in rural communities throughout the country. Consequently, child mortality has declined substantially, placing Ethiopia among the few countries that have achieved the United Nations’ fourth Millennium Development Goal. As Ethiopia continues its efforts, results must be assessed regularly to provide timely feedback for improvement and to generate further support for programs. More specifically the expansion of HEWs at the community level provides a unique opportunity to build a system for real-time monitoring of births and deaths, linked to a civil registration and vital statistics system that Ethiopia is also developing. We tested the accuracy and completeness of births and deaths reported by trained HEWs for monitoring child mortality over 15 -month periods.

Methods and Findings

HEWs were trained in 93 randomly selected rural kebeles in Jimma and West Hararghe zones of the Oromia region to report births and deaths over a 15-month period from January, 2012 to March, 2013. Completeness of number of births and deaths, age distribution of deaths, and accuracy of resulting under-five, infant, and neonatal mortality rates were assessed against data from a large household survey with full birth history from women aged 15–49. Although, in general HEWs, were able to accurately report events that they identified, the completeness of number of births and deaths reported over twelve-month periods was very low and variable across the two zones. Compared to household survey estimates, HEWs reported only about 30% of births and 21% of under-five deaths occurring in their communities over a twelve-month period. The under-five mortality rate was under-estimated by around 30%, infant mortality rate by 23% and neonatal mortality by 17%. HEWs reported disproportionately higher number of deaths among the very young infants than among the older children.

Conclusion

Birth and death data reported by HEWs are not complete enough to support the monitoring of changes in childhood mortality. HEWs can significantly contribute to the success of a CRVS in Ethiopia, but cannot be relied upon as the sole source for identification of vital events. Further studies are needed to understand how to increase the level of completeness.