Menu ENN Search

Review of Published Evidence for Impact of Emergency Feeding Programmes

Summary of unpublished paper1

The ENN have recently completed a review with funding from CIDA of the published evidence for the impact and cost-effectiveness of 6 key humanitarian interventions commonly implemented in emergencies (general rations, supplementary feeding, therapeutic feeding, measles vaccination, vitamin A supplementation and bednet distributions). The overall aims of the review were to identify gaps in the literature and develop methodologies and institutional mechanisms for filling these gaps.

The review has focused on a narrow definition of impact - it is measured as a change in population nutrition prevalence or mortality rates due to an intervention.

A hierarchy of study types is generally recognised in clinical medicine with the randomised control trial considered to be the 'gold standard' method providing the highest level of evidence. Observational studies and case-series data provide the weakest level of evidence. Given the practical difficulties of conducting an RCT in an emergency situation this report uses a framework (adapted from Habicht et al, 19992) with which to assess the strength of the different studies reviewed. All types of economic evaluation information were included in the review.

Standard methods to collate and appraise the literature for a systematic review were employed. The method involved

  1. a search of the 5 most relevant databases,
  2. a secondary reference search,
  3. a hand search of the main journals, and
  4. expert advice on the literature.

The quality of each study was assessed using standard critical appraisal techniques.

The number of published impact and economic evaluation studies undertaken in emergencies located by the search
Type of intervention Impact assessment Economic evaluation
General ration distribution (GFD) 9 0
Supplementary feeding programme (SFP) 15 1
Therapeutic feeding programme (TFP) 16 1
Vitamin A supplementation 0 0
Bednets programmes 0 13
Measles immunisation programme 0 0

 

The most important finding of the review is that very few studies assessing the impact of any of the interventions in an emergency context have been published. There is virtually no publicly available information on the cost-effectiveness of different nutrition-related interventions commonly implemented in emergencies.

The number of published impact and economic evaluation studies undertaken in emergencies located by the search are shown below.

A limited number of studies assessed the impact of GFD and SFP in emergencies, however the majority of these were observational and do not provide very plausible evidence of impact. The evidence base for TFPs is somewhat stronger.
The lack of published impact and cost effectiveness information - particularly in relation to emergency feeding and food security support programmes is of enormous concern. There are key areas of uncertainty regarding both the utility of certain types of intervention, e.g. SFP or GFD versus cash transfer, and over issues of design within programme types, e.g. community versus administrative targeting in general ration programmes. There are also rapidly emerging new types of programming at the interface of HIV and nutrition for which impact and cost information is urgently needed. This lack of impact and cost-effectiveness information militates against cross-sectoral comparison of interventions in relation to nutrition and mortality impact.

There are a number of understandable reasons for the dearth of published information, e.g. the ethical difficulties of undertaking research in emergencies and the fact that there are far fewer epidemiologists involved in emergency feeding than in more medically oriented interventions like measles vaccination. However, one overarching key factor is the absence of an agency with responsibility for taking an overview of the effectiveness of different types of intervention and intervention design. This lack of corporate accountability has allowed the institutional status quo to prevail. Thus agencies which have built up expertise and mandates around certain types of intervention (or intervention design) will continue to practice these in emergencies without serious examination or challenge.

This review argues that one way to address the gap in information on impact and cost-effectiveness is to make greater use of the so called 'grey literature' (unpublished information held mainly by implementing agencies which may be in a variety of forms, e.g. project reports, annual audits, monitoring forms, etc). Greater standardisation of agency reporting will enhance capacity to use this type of information. However, it is also probable that much of this grey literature could be used retrospectively to answer a number of questions. The review discusses how to increase access to, and use of, the grey literature. In conjunction with this, specialised impact studies could also be commissioned to address key questions. The review examines how these studies may be carried out for each of the 6 interventions by identifying the most ethically feasible and methodologically robust approach.

The review also explores the gap in information on costs of interventions and methodologies for obtaining such information. It is recognised that this is not a straightforward discipline and that methodologies need to be developed, and reporting standardised.

Given the multiplicity of stakeholders and (vested interests) in this sector the review argues the case for creation of an independent body/institutional mechanism with responsibility for increasing information on impact and costeffectiveness in this sector. Without establishing such a body it is likely that little will change. This body would take responsibility for identifying key gaps in knowledge regarding impact and cost-effectiveness. It will develop and co-ordinate mechanisms for making greater use of the grey literature and promoting impact studies. The agency would also have an advocacy role where emerging evidence indicates a need for change in implementation practice.

In the event that there is insufficient support for establishing such a body a more piecemeal and potentially realisable alternative may be for donors (individually or as a group) to take more responsibility and fund/help establish research/implementing agency partnerships which aim to address specific questions in particular programme areas where impact and costeffectiveness information are urgently needed.

For more information contact; J. Shoham at jshoham@easynet.co.uk

Show footnotes

1Duffield.A et al (2004): Review of the published literature for the impact and cost-effectiveness of six nutrition related emergency interventions. Paper prepared by the ENN.

2Habicht, JP, Victora, CG and Vaughan, JP (1999) Evaluation designs for adequacy, plausibility and probability of public health programme performance and impact. International Journal of Epidemiology 28: 10-18.

3The economic evaluation of bednets was a cost-effectiveness study which included a measure of impact so this study could be classified in either column.

More like this

FEX: Issue 23 Editorial

This edition of Field Exchange carries a number of articles which challenge the effectiveness of our standard responses to food and nutrition emergencies. A review undertaken...

FEX: The current state of evidence and thinking on wasting prevention

Summary of research1 Background ENN produced a report, through the MQSUN+ programme, that synthesises existing evidence and stakeholder opinion on what works to prevent...

FEX: Treatment of SAM and MAM in low- and middle-income settings: a systematic review

Summary of research1 Location: Global What we know: Worldwide, 33 million children under 5 years are moderately malnourished and 19 million are severely malnourished. The...

Review of the efficacy and impact of emergency programmes

Donor: CIDA Collaborators: SCUK and Westminster University ENN Project Lead: Jeremy Shoham Timeframe: Project completed in 2011 Background This project was undertaken in...

en-net: Request for contributions of grey literature on wasting prevention

Dear all,

ENN is currently conducting a review on behalf of DFID (via MQSUN+) on the prevention of wasting. Nutrition-specific and nutrition-sensitive activities to...

FEX: The impact of in-kind food assistance on pastoralist livelihoods in humanitarian crises

Summary of research1 Location: Global What we know: External threats to food security of pastoralist populations in recent years have increased the need for humanitarian...

FEX: ENN/SC UK investigation of impact and effectiveness of SFPs

A SFP as part of a community therapeutic care programme in Niger The ENN and Save the Children UK (SC UK) have just begun a joint research study to assess the impact and...

FEX: Difficulties of impact assessment in ‘semi-emergencies’

By Tayech Yimer, Anne Marie Mayer and Arabella Duffield Tayech Yimer is a nutritionist with SC UK in Ethiopia. Anne-Marie Mayer has worked with SC UK for nine months in...

FEX: From the editor

Queing for cash transfer Four of the six field articles in this issue of Field Exchange endeavour to demonstrate some form of intervention impact. The programmes are all very...

Resource: Optimal breastfeeding practices and infant and child mortality

A Systematic Review and Meta-analysis Breastfeeding is one of the few interventions where the survival benefits span the entire continuum of childhood: newborn, infancy and...

FEX: Nutrition-sensitive agriculture: What have we learned and where do we go from here?

Summary of research1 Location: Global What we know: Agriculture has strong potential to improve nutrition outcomes through improving food availability and access and through...

FEX: Letter on inadequate coverage of SAM in Lancet Undernutrition Series, by Susan Shepherd

SAM inadequately addressed in the Lancet Undernutrition Series Dear Editor, In 2003, The Lancet captured and focused attention on saving children’s lives with the publication...

FEX: Summary of Lancet Series on Maternal and Child Undernutrition

Below are short summaries of the recently launched Lancet series of papers on Maternal and Child Undernutrition1. This high profile series focuses on the disease burden...

FEX: Is reliable water access the solution to undernutrition?

Summary of research1 Location: Global What we know: Irrigation interventions have the potential to reduce undernutrition by impacting food security, nutrition and...

FEX: Anthropometric cut-off points for older children and adolescents in Syria

By Paluku Bahwere View this article as a pdf Paluku Bahwere is a paediatrician with over 25 years of experience in operational research and programming in the fields of...

FEX: Literature review on impact of cash transfers on nutritional outcomes

By Bridget Fenn and Ellyn Yakowenko Bridget Fenn is an epidemiologist with a background in nutrition. She is currently a consultant for the Emergency Nutrition Network (ENN)...

FEX: Agricultural interventions to improve nutritional status of children

Summary of review1 A summary of a recent systematic review on the effectiveness of agricultural interventions that aim to improve nutritional status of children has recently...

FEX: Issue 33 Editorial

This issue of Field Exchange is published in the 'after-glow' of the high profile and long-awaited Lancet series on 'Maternal and Child Undernutrition.' The series of five...

Research on Food Assistance for Nutritional Impact (REFANI)

Bridget Fenn, the REFANI Pakistan Principal Investigator, talks about the results of REFANI at the ACF hosted Research for Nutrition Conference 2017. What is REFANI? The...

FEX: Introduction to the special issue

The most recent Lancet series on maternal and child undernutrition (Bhutta et al, 2013) calculated that even with 90% coverage of specific nutrition interventions (addressing...

Close

Reference this page

Review of Published Evidence for Impact of Emergency Feeding Programmes. Field Exchange 24, March 2005. p10. www.ennonline.net/fex/24/published