Measuring the Impact of Humanitarian Aid
Summary of published paper1

A recent HPG Briefing Paper reports on research into how the humanitarian community measures and analyses the impact of humanitarian assistance. The study is based on a review of the published and grey literature within the humanitarian sector and more broadly, interviews with aid agency staff and two commissioned papers covering impact measurement in the food and nutrition and health sectors.
The review concludes that the humanitarian system has been poor at analysing impact though promising approaches are now starting to be developed. It states that a major constraint has been the lack of an accepted definition of impact within the humanitarian sector and that the definitions current within the development field may not fully capture the particular nature of humanitarian work. In particular, the concept of positive change is central in developmental definitions of impact, but in humanitarian aid the aim is often to avert negative change (for example to prevent famine). The review also points out that analysing the impact of a humanitarian intervention is not straightforward, particularly in the dynamic and chaotic environments of complex emergencies. The difficulties of the operating environment, the need to act quickly in situations of immediate crisis, an organisational culture that values action over analysis and the fact that there is little consensus around the core objectives of humanitarian aid - all make analysing impact difficult. Techniques that are standard in the social science community, such as the use of control groups, are not widely used, and humanitarian practitioners tend to lack the skills needed to gather and interpret information.
Key findings of the research are as follows;
Moving beyond the project level
- Concern for the impact of humanitarian aid should not be narrowly restricted to the project level. There is a need for greater investment in research, sector and system-wide evaluations that can ask difficult and important questions about; the overall impact and coverage of the humanitarian enterprise, roles and responsibilities for humanitarian outcomes, and the broader political dimensions within which the humanitarian system operates.
- Project-based approaches that focus on determining the impact of a particular inter vention through a causal pathway from inputs to impact should be complemented by approaches that start with changes in people's lives and that situate change in the broader external environment.
- Questions of impact should not be limited to the evaluation process. In the humanitarian sphere, a concern with change in the short term implies a need for impact to be consid ered in ongoing monitoring processes, and through techniques such as real-time evaluation.
Measuring impact: skills, capacity and resources
- Impact in any context is difficult to measure and attribute; this difficulty is exacerbated in the dynamic and chaotic environments of complex emergencies. This does not mean, however that it is impossible, and greater efforts could be made.
- The humanitarian system often lacks the skills and capacity to successfully measure or analyse impact. Greater investment there fore needs to be made in human resources and research and evaluation capacity if the desire to focus more on results is to be realised.
Measuring impact: science and participation
- The humanitarian system has been consistently poor at ensuring the participation of affected populations. Much could be learnt from innovations in participatory approaches in the development sphere, and possibly from customer-focused approaches in the private sphere.
- There is a place for both art and science in impact measurement: scientific, analytical and participatory approaches can often be complementary.
Indicators and objectives
- Analysis and impact could be improved through greater clarity about the objectives of humanitarian assistance, and by more consistent assessment of needs.
- Process indicators can sometimes be used as proxies for impact when there is strong evidence of a link between the action being monitored and an expected impact. There is a need for greater investment in strengthening the evidence base for how activities, such as supplementary feeding or support to health clinics, relate to humanitarian out comes such as reductions in mortality or malnutrition.
Results-based management; potential and dangers
- Results based management systems (focus ing on outcomes and impact rather than outputs and activities) are being introduced in a number of humanitarian organisations. However it is too early to say whether they will significantly improve the measurement and analysis of impact. Experience from elsewhere suggests that there will be a need for caution; in particular, measurement may remain largely focused on outputs and not impact.
- The increased focus on results which comes with such systems carries a risk that the harder-to-measure aspects of humanitarian action such as protection could be neglected.
The way forward
The study suggests that sufficient and appropriate tools and methods exist to provide reliable analysis of the impact of humanitarian aid whatever the context. It is the appropriate use and adaptation of these tools to the particular context and constraints that is lacking as a consequence of insufficient investment in skills and capacity development within the humanitarian sector. The study suggests that addressing this gap would have implications beyond the improved practice of impact assessment but would also lead to clearer objectives for aid, more robust risk and needs assessments, better research into what works and what doesn't and greater emphasis on community participation.
1Hofmann. Charles-Antoinne et al (2004): Measuring the impact of humanitarian aid. A review of current practice. HPG Research briefing, no 15, June 2004
More like this
FEX: The Changing Role of Aid Policy in Protracted Crises
Published paper1 A recent HPG research briefing paper provides an overview of the changing role of aid policy in protracted crises. It starts with the premise that there has...
FEX: Cash and Vouchers in Emergencies
Summary of published paper1 Women have not been found to be disadvantaged by cash for work programmes A recently published discussion paper examines the use of cash and...
en-net: How fair and accurate was the media coverage of the Haiti crisis? Should we, as a sector, try to hold the media to greater account? How could we do this?
During the early phase of the recent Haiti crisis, the ENN became increasingly exasperated by many aspects of the media coverage. Key points of contention were; inaccuracy of...
FEX: ALNAP review of humanitarian system
Summary of published report1 A recently published report, commissioned under ALNAPs2 Humanitarian Performance Project, set out to chart the performance and progress of the...
FEX: Importance of non-DAC donors in humanitarian aid
The bulk of humanitarian financing comes from a set of wealthy industrialised countries, a group best represented by the Development Assistance Committee (DAC) of the...
FEX: Donors in humanitarian action: changing roles, trends and issues
changing roles, trends and issues Summary of a published review1 The changing role of donor governments in the management of humanitarian assistance is the subject of a...
FEX: Critical gaps in drought response in Greater Horn of Africa
Summary of published research1 The drought currently affecting an estimated 11 million people in the Greater Horn of Africa is said to be the worst in more than a decade, with...
FEX: HIV/AIDS and Humanitarian Action
Summary of published report1 The Humanitarian Policy Group (HPG) have just published a report which examines the implications of HIV/AIDS for understanding crisis and the role...
FEX: Cash-based responses in emergencies
Summary of published research1 A recent study explores the suitability of cash and vouchers in the full range of emergency contexts and finds that such responses are possible,...
FEX: Dependency and Humanitarian Relief
Summary of research report1 In many emergency contexts, aid agencies hesitate to provide food and other aid for extended periods because of fears that this may create...
FEX: Improving the assessment and attribution of effects of development assistance for health
Summary of research1 Location: Global What we know: It is difficult to relate Overseas Development Assistance for health (DAH) and health outcomes; there are multiple funding...
FEX: References for Special Supplement 3
Beatrice, a beneficiary of the CRS seed voucher scheme in Burundi 1. Abdulai A., Barret, C., Hoddinott, J. (2004, June). Does food aid really have disincentive effects? new...
FEX: Issue 27 Editorial
Every emergency has a habit of throwing up fresh challenges which force us to re-examine our understanding of vulnerability and how best to respond. However, as shown in this...
FEX: Accelerating the scale-up of treatment for severe acute malnutrition
News By Saul Guerrero, Erin Boyd, Claire Harbron, Diane Holland, Abi Perry and Sophie Whitney Saul Guerrero is the Director of Nutrition at Action Against Hunger UK (ACF UK)....
FEX: Market Analysis and Emergency Needs Assessment
Summary of background technical paper1 Rice bowls in rural market An issues paper on market analysis and emergency needs assessment was prepared as a background document for...
FEX: HIV/AIDS and Food Security
Summary of meeting Child-headed households benefiting from a home based care project Action Against Hunger (AAH) and Oxfam GB hosted an inter-agency meeting in London on Food...
FEX: Remittances during crises
Summary of published paper1 In disasters, remittances can play an important part in how people survive and recover. A recent Humanitarian Practice Group (HPG) briefing paper...
FEX: The state of the humanitarian system
Summary of report1 A recent report by ALNAP presents a system-level mapping and analysis of the performance of international humanitarian assistance between 2009 and 2011...
en-net: Re: Impact of food aid on agricultural labour supply and productivity
Dear en-net, There are so many arguments on the merits of food aid-short and long term. This appears rather a new topic in the forum. May some one link me to a web or provide...
FEX: Needs Assessment and Decision Making in Emergencies
Summary of published report1 Sorghhum plant hit by drought Researchers from the Humanitarian Policy Group (HPG) at the Overseas Development Institute (ODI) recently undertook...
Reference this page
Measuring the Impact of Humanitarian Aid. Field Exchange 23, November 2004. p5. www.ennonline.net/fex/23/measuring
(ENN_2445)