Beyond the indicators - Assessing project impact on children’s lives

By Holly Welcome Radice, Maria Ruiz-Bascaran, Abebe Zewdu, Oumar Mohamud, Mekdes Asfaw, and Mahlet Bezu

Pictures from top to bottom: Holly is the Head of Livelihoods & Nutrition Information Systems. Maria is the Senior Programme Manager of the RAIN project and former programme manager for PILLAR II. Abebe is the DRR Coordinatorm Oumar is Project Coordination-Somali and Mekdes is Project Coordinator- Afar. All work for the PILLAR PLUS project and with Save the Children UK Ethiopia. Mahlet was previously interned with Save the Children UK Ethiopia and currently is pursuing a masters at Lund University.

Save the Children UK would like to thank the families in the Afar and Somali Regions that participated in these interviews and ECHO (European Commission Humanitarian Aid Department) for funding this project.

In humanitarian work, how do we know that we are positively reaching distinct members of a community? When we calculate beneficiary households, can we be sure that everyone in the household is really benefiting? And is it clear to what extent they are benefiting? These are questions that all nongovernmental organisations (NGOs) struggle with in programme evaluation. Save the Children UK Ethiopia recently sought to find answers to some of these questions in one of its projects.

For nearly 20 years, Save the Children UK has been providing support to pastoral communities in Ethiopia, with current programmes in the Somali and Afar regions. One project is a drought preparedness and risk reduction project, called PILLAR (Preparedness Improves Livelihoods and Resilience), funded by ECHO's Regional Drought Decision (RDD). The project was implemented in two phases between April 2008 and June 2010 in selected drought districts of the Afar and Somali Regions. PILLAR seeks to contribute to community level drought risk reduction through prevention, mitigation, preparedness and response through a range of activities focusing on the three pillars of pastoralism- people, livestock and natural resources.

PILLAR has performed well against its objectives and indicators, with some 18,000 households reached across two regions. This is good news for the community, the NGO, and the donor. Being a child focused NGO, Save the Children UK wanted to understand and document to what extent PILLAR has impacted the lives of children.

Impact assessment involving children

Internationally, Save the Children UK aims to ensure that child participation-informed and willing involvement of children-is meaningfully incorporated into all its work. Some direct benefits for children had already been revealed in the communities. A local teacher in Afamana Tibedha in Afar had mentioned that since the construction of a water point in the village, students were attending classes more regularly and enrolment had increased by 40%. To get a sense of some of PILLAR's impacts on children, Save the Children UK conducted a rapid field assessment in six beneficiary communities and case studies of six beneficiary children were completed. The case studies were based on focus group discussions and individual interviews with selected beneficiaries and discussions held separately with adult beneficiaries and their children.

Children who were interviewed belonged to families that were involved in water point construction, small scale irrigation and income generating activity micro-projects. According to those children and their caregivers, project impacts were seen similarly. Broadly the answers of the interviewed children were centred on two categories, household and personal for children, as shown in Table 1.

These findings show that the interventions went well beyond what was measured in the indicators-availability of water in the dry season and protected / diversifying livelihoods- and that the interventions had layers of effect. Immediate results such as better nutrition, access to basic needs, access to clean water were valued by the children. Most heartening were the reports of increased school attendance and reduction in time spent on chores and even more time to play. These indirect benefits are positive and encouraging for long term community resilience as education is a key component to improving livelihoods.

A fodder production group has decreased Sead's time looking for pasture

Children as direct beneficiaries

Such an assessment is not scientific by any means, but the value is obvious. It serves as a singular opportunity to 'ground truth' the effect of interventions on different groups within a population. For Save the Children UK's implementation team, this exercise was helpful to see the layers of impact that the project has had. Children in the interviewed beneficiary households clearly directly benefited from the interventions on personal, household and community levels.

Table 1: Project impact as seen by children
Household Personal for children
    Increased food consumption
    Increased food diversity
    Increased access to basic needs (e.g. school supplies, medical)
    Increased food and milk production
    Availability of items for purchase
    Access to clean water
More leisure time
More time with parents
Less time with chores
Regular attendance at school
Punctuality at school
More time for studies

 

Women targeted by income generation activities in Fik, Somali region

In a project focusing on community resilience, children may normally be viewed as indirect beneficiaries. Additionally, the humanitarian nature of the project could be mistakenly viewed as only providing short term insurance against shocks. However, this rapid assessment has discounted both of these theories. Children in these communities have received direct, immediate benefits. If these benefits identified are maintained, the investment will surely have a profound affect on the future of individual children's lives and ultimately on community resilience.

Ultimately, the assessment gave some ideas regarding what interventions to build on, better to target children in disaster risk management (DRM). The next phase of PILLAR will work directly with the children in Alternative Basic Education schools. This scheme will pilot children- led DRM committees that will look to build the capacity of children and their caregivers to be better able to reduce disaster risks within their own communities.

Finally, such an assessment is an opportunity to listen to and learn from children. Fostering the practice of voicing opinions and contributing to community matters can be an empowering process. In pastoral communities, such as those targeted in PILLAR, being able to speak on behalf of one's community is an essential tool in reduction of vulnerability to drought. It can encourage a generation to be proactively contributing to their own community's involvement in early warning, early response and community preparedness.

For more information, contact: Holly Welcome Radice, email: Holly.R@scuk.org.et

More like this

FEX: From the editor

Ethiopia is a diverse country where a significant proportion of the population live on or below the poverty line, where food insecurity is widespread and rates of acute...

FEX: Sectoral integration ‘on the cheap’ with cash based programming

By Holly Welcome Radice Holly Welcome Radice has worked for 15 years in food security programming in Africa and Latin America. She was the Head of Food Security and...

FEX: Impact of livestock support on animal milksupply and child nutrition in Ethiopia

Summary by Kate Sadler and Emily Mitchard Dry riverbed in Shinile Kate Sadler is an Assistant Professor of Nutrition at the Feinstein International Centre, Tufts University...

FEX: Oxfam’s Somaliland-Ethiopia Cross Border Drought Preparedness Project

By Abay Bekele Abay Bekele works for Oxfam GB as Senior Pastoral Programme Manager. He has over nine years of technical and managerial experience in pastoral development and...

FEX: Dangerous delay in responding to Horn of Africa early warnings of drought

Summary of briefing paper1 According to a briefing paper just released by Oxfam and Save the Children UK (SC UK), the 2011 crisis in the Horn of Africa has been the most severe...

FEX: Emergency Food Security and Livelihoods Project in Amhara and Oromia regions

By Sarah Coll-Black and Matt Hobson Sarah Coll-Black is a Social Protection Specialist working with the World Bank in Ethiopia and Kenya. She has been involved with Ethiopia's...

FEX: Food insecurity and mental health among community health volunteers in Ethiopia

By Sarah Coll-Black and Matt Hobson Sarah Coll-Black is a Social Protection Specialist working with the World Bank in Ethiopia and Kenya. She has been involved with Ethiopia's...

FEX: Post-drought restocking Can its impact be sustainable?

By Ahmed Alkadir Mohammed Ahmed Alkadir Mohammed is currently a Disaster Risk Management Specialist with the World Bank, Productive Safety Net Programme (PSNP) Team. Prevously...

FEX: The Targeted Supplementary Feeding Programme (TSF)

By Jutta Neitzel TSF distribution in Degehabur, Somali Region Jutta Neitzel is the Head of the Nutrition and Education Section at WFP Ethiopia. She has worked for the...

FEX: Linking early warning system information to response

The emergency livestock off-take programme, Isiolo district 1996-7 By Helen Bushell and Mike Wekesa Isiolo - A trader admires the animals he has purchased Helen Bushell is a...

en-net: Save the Children seeks an IYCF Adviser for Strengthening Nutrition Security Consortium, Somalia (Nairobi base)

JOB TITLE: Technical Adviser - Infant and Young Child Feeding (IYCF) Strengthening Nutrition Security Consortium Somalia (Nairobi base) LOCATION: Nairobi with some travel to...

FEX: Rapid response and long-term solutions: Christian Aid and food security in Ethiopia

By Antoinette Powell Antoinette Powell is the Communications and Information Officer, Africa with Christian Aid since 2007. Previously she worked as Advocacy Officer, The...

FEX: Milk Matters: Improving Health and Nutritional Status of Children in Pastoralist Communities

By Dr Kate Sadler and Dr Andy Catley Kate Sadler is a nutritionist and currently senior researcher with a focus on nutrition in emergencies at the Feinstein International...

FEX: Baseline Report: Africa Community Resilience Project

The Feinstein International Centre has recently released the first of three reports under the Livelihoods Change over Time research programme. The Baseline Report: Africa...

FEX: 2011 famine in South Somalia: the role of the early warning information System

By Abukar Yusuf Nur – Nutrition Analyst, Ahono Busili – Nutrition Team Manager, Elijah Odundo – Nutrition Data Analyst, Joseph Waweru – Nutrition Analyst, Louise Masese –...

FEX: Livestock Feeding Support as Drought Response

Summary of research1 A sick cow and a shepherd boy in Ab'Ala Afar Region A livelihoods-based drought response in pastoralist areas could aim to protect key livestock assets...

FEX: Community based approaches to managing severe malnutrition: case study from Ethiopia

Summary of report1 A mother attends the CTC programme A recent published paper describes Save the Children US's (SC US) experience of setting up a community therapeutic care...

FEX: British Red Cross urban learning scoping study

Summary of report1 The British Red Cross has undertaken a scoping study to better understand the challenges posed by humanitarian action in urban areas, and how the Red Cross...

FEX: Decentralisation and scale up of outpatient management of SAM in Ethiopia (2008-2010)

By Sylvie Chamois Sylvie Chamois has been a Nutrition specialist with UNICEF Ethiopia and Burundi for the past 9 years. Before joining UNICEF, she spent 6 years working as a...

en-net: Nutrition Consultant need-Very urgent

TERMS OF REFERENCE Turkana Health and Nutrition Project Evaluation and Impact analysis 1. Context The greater Turkana district composed of 6 districts has a total of 17...

Close

Reference this page

Holly Welcome Radice, Maria Ruiz-Bascaran, Abebe Zewdu, Oumar Mohamud, Mekdes Asfaw, and Mahlet Bezu (2011). Beyond the indicators - Assessing project impact on children’s lives. Field Exchange 40, February 2011. p31. www.ennonline.net/fex/40/beyond