Review of Published Evidence for Impact of Emergency Feeding Programmes
Summary of unpublished paper1
The ENN have recently completed a review with funding from CIDA of the published evidence for the impact and cost-effectiveness of 6 key humanitarian interventions commonly implemented in emergencies (general rations, supplementary feeding, therapeutic feeding, measles vaccination, vitamin A supplementation and bednet distributions). The overall aims of the review were to identify gaps in the literature and develop methodologies and institutional mechanisms for filling these gaps.
The review has focused on a narrow definition of impact - it is measured as a change in population nutrition prevalence or mortality rates due to an intervention.
A hierarchy of study types is generally recognised in clinical medicine with the randomised control trial considered to be the 'gold standard' method providing the highest level of evidence. Observational studies and case-series data provide the weakest level of evidence. Given the practical difficulties of conducting an RCT in an emergency situation this report uses a framework (adapted from Habicht et al, 19992) with which to assess the strength of the different studies reviewed. All types of economic evaluation information were included in the review.
Standard methods to collate and appraise the literature for a systematic review were employed. The method involved
- a search of the 5 most relevant databases,
- a secondary reference search,
- a hand search of the main journals, and
- expert advice on the literature.
The quality of each study was assessed using standard critical appraisal techniques.
|The number of published impact and economic evaluation studies undertaken in emergencies located by the search|
|Type of intervention||Impact assessment||Economic evaluation|
|General ration distribution (GFD)||9||0|
|Supplementary feeding programme (SFP)||15||1|
|Therapeutic feeding programme (TFP)||16||1|
|Vitamin A supplementation||0||0|
|Measles immunisation programme||0||0|
The most important finding of the review is that very few studies assessing the impact of any of the interventions in an emergency context have been published. There is virtually no publicly available information on the cost-effectiveness of different nutrition-related interventions commonly implemented in emergencies.
The number of published impact and economic evaluation studies undertaken in emergencies located by the search are shown below.
A limited number of studies assessed the impact of GFD and SFP in emergencies, however the majority of these were observational and do not provide very plausible evidence of impact. The evidence base for TFPs is somewhat stronger.
The lack of published impact and cost effectiveness information - particularly in relation to emergency feeding and food security support programmes is of enormous concern. There are key areas of uncertainty regarding both the utility of certain types of intervention, e.g. SFP or GFD versus cash transfer, and over issues of design within programme types, e.g. community versus administrative targeting in general ration programmes. There are also rapidly emerging new types of programming at the interface of HIV and nutrition for which impact and cost information is urgently needed. This lack of impact and cost-effectiveness information militates against cross-sectoral comparison of interventions in relation to nutrition and mortality impact.
There are a number of understandable reasons for the dearth of published information, e.g. the ethical difficulties of undertaking research in emergencies and the fact that there are far fewer epidemiologists involved in emergency feeding than in more medically oriented interventions like measles vaccination. However, one overarching key factor is the absence of an agency with responsibility for taking an overview of the effectiveness of different types of intervention and intervention design. This lack of corporate accountability has allowed the institutional status quo to prevail. Thus agencies which have built up expertise and mandates around certain types of intervention (or intervention design) will continue to practice these in emergencies without serious examination or challenge.
This review argues that one way to address the gap in information on impact and cost-effectiveness is to make greater use of the so called 'grey literature' (unpublished information held mainly by implementing agencies which may be in a variety of forms, e.g. project reports, annual audits, monitoring forms, etc). Greater standardisation of agency reporting will enhance capacity to use this type of information. However, it is also probable that much of this grey literature could be used retrospectively to answer a number of questions. The review discusses how to increase access to, and use of, the grey literature. In conjunction with this, specialised impact studies could also be commissioned to address key questions. The review examines how these studies may be carried out for each of the 6 interventions by identifying the most ethically feasible and methodologically robust approach.
The review also explores the gap in information on costs of interventions and methodologies for obtaining such information. It is recognised that this is not a straightforward discipline and that methodologies need to be developed, and reporting standardised.
Given the multiplicity of stakeholders and (vested interests) in this sector the review argues the case for creation of an independent body/institutional mechanism with responsibility for increasing information on impact and costeffectiveness in this sector. Without establishing such a body it is likely that little will change. This body would take responsibility for identifying key gaps in knowledge regarding impact and cost-effectiveness. It will develop and co-ordinate mechanisms for making greater use of the grey literature and promoting impact studies. The agency would also have an advocacy role where emerging evidence indicates a need for change in implementation practice.
In the event that there is insufficient support for establishing such a body a more piecemeal and potentially realisable alternative may be for donors (individually or as a group) to take more responsibility and fund/help establish research/implementing agency partnerships which aim to address specific questions in particular programme areas where impact and costeffectiveness information are urgently needed.
For more information contact; J. Shoham at firstname.lastname@example.org
1Duffield.A et al (2004): Review of the published literature for the impact and cost-effectiveness of six nutrition related emergency interventions. Paper prepared by the ENN.
2Habicht, JP, Victora, CG and Vaughan, JP (1999) Evaluation designs for adequacy, plausibility and probability of public health programme performance and impact. International Journal of Epidemiology 28: 10-18.
3The economic evaluation of bednets was a cost-effectiveness study which included a measure of impact so this study could be classified in either column.
More like this
FEX: Issue 23 Editorial
This edition of Field Exchange carries a number of articles which challenge the effectiveness of our standard responses to food and nutrition emergencies. A review undertaken...
FEX: The current state of evidence and thinking on wasting prevention
Summary of research1 Background ENN produced a report, through the MQSUN+ programme, that synthesises existing evidence and stakeholder opinion on what works to prevent...
FEX: Treatment of SAM and MAM in low- and middle-income settings: a systematic review
Summary of research1 Location: Global What we know: Worldwide, 33 million children under 5 years are moderately malnourished and 19 million are severely malnourished. The...
Review of the efficacy and impact of emergency programmes
Donor: CIDA Collaborators: SCUK and Westminster University ENN Project Lead: Jeremy Shoham Timeframe: Project completed in 2011 Background This project was undertaken in...
FEX: Research gaps and priorities in nutrition in emergencies
View this article as a pdf Eilise Brennan is a Nutritionist at Emergency Nutrition Network (ENN) Natalie Sessions is a Senior Nutritionist at ENN This views piece summarises...
Resource: The Current State of Evidence and Thinking on Wasting Prevention
A synthesis of published, grey literature and stakeholder opinion on what works to prevent wasting produced by the ENN, through the MQSUN+ project. This report compliments...
en-net: Request for contributions of grey literature on wasting prevention
Dear all, ENN is currently conducting a review on behalf of DFID (via MQSUN+) on the prevention of wasting. Nutrition-specific and nutrition-sensitive activities to prevent...
FEX: ENN/SC UK investigation of impact and effectiveness of SFPs
A SFP as part of a community therapeutic care programme in Niger The ENN and Save the Children UK (SC UK) have just begun a joint research study to assess the impact and...
FEX: Food aid for nutrition: A landscape review of current research and implications for future studies
View this article as a pdf Lisez cet article en français ici By Maria Wrabel, Kristine Caiafa, Beatrice Lorge Rogers and Patrick Webb All authors are affiliated with...
FEX: The impact of in-kind food assistance on pastoralist livelihoods in humanitarian crises
Summary of research1 Location: Global What we know: External threats to food security of pastoralist populations in recent years have increased the need for humanitarian...
FEX: Difficulties of impact assessment in ‘semi-emergencies’
By Tayech Yimer, Anne Marie Mayer and Arabella Duffield Tayech Yimer is a nutritionist with SC UK in Ethiopia. Anne-Marie Mayer has worked with SC UK for nine months in...
FEX: Relaxation interventions for maternal and neonatal outcomes: A systematic review
View this article as a pdf This is a summary of the following paper: Abera M, Hanlon C, Daniel B et al (2022) Effect of relaxation interventions in pregnant women on maternal...
FEX: From the editor
Queing for cash transfer Four of the six field articles in this issue of Field Exchange endeavour to demonstrate some form of intervention impact. The programmes are all very...
Resource: Optimal breastfeeding practices and infant and child mortality
A Systematic Review and Meta-analysis Breastfeeding is one of the few interventions where the survival benefits span the entire continuum of childhood: newborn, infancy and...
FEX: A systematic review of nutrition interventions for mobile pastoralists
View this article as a pdf By Natasha Lelijveld and Emily Mates Natasha Lelijveld is a Senior Nutritionist at Emergency Nutrition Network (ENN). She previously worked at the...
FEX: Impacts of WASH on acute malnutrition: from available scientific evidence to informed action
View this article as a pdf Research snapshot1 Many of the 4.5 billion people who do not have access to improved sanitation or the 2.1 billion people who do not have access to...
FEX: Nutrition-sensitive agriculture: What have we learned and where do we go from here?
Summary of research1 Location: Global What we know: Agriculture has strong potential to improve nutrition outcomes through improving food availability and access and through...
FEX: Summary of Lancet Series on Maternal and Child Undernutrition
Below are short summaries of the recently launched Lancet series of papers on Maternal and Child Undernutrition1. This high profile series focuses on the disease burden...
FEX: Letter on inadequate coverage of SAM in Lancet Undernutrition Series, by Susan Shepherd
SAM inadequately addressed in the Lancet Undernutrition Series Dear Editor, In 2003, The Lancet captured and focused attention on saving children’s lives with the publication...
FEX: Agricultural interventions to improve nutritional status of children
Summary of review1 A summary of a recent systematic review on the effectiveness of agricultural interventions that aim to improve nutritional status of children has recently...
Reference this page
Review of Published Evidence for Impact of Emergency Feeding Programmes. Field Exchange 24, March 2005. p10. www.ennonline.net/fex/24/published