Impact evaluation of a nutrition-sensitive social protection programme in northern Nigeria
By Caroline Antoine, Stella Esedunme, Céline Sinitzky Billard, Sabi’u Suleiman Shehu and Gladys Esther Ahuwan
Caroline Antoine is a health referant for Action Contre La Faim (ACF), in charge of the development and deployment of the organisation’s health strategy. She has a decade of experience working in health in the humanitarian sector.
Stella Esedunme is the Action Against Hunger (AAH) Project Manager of the Child Development Grant Programme (CDGP) in Nigeria. She has expertise in community engagement, development, management of malnutrition and strengthening government capacity.
Céline Sinitzky Billard is Cash and Voucher Assistance and Social Protection Advisor for ACF. She is an agronomist with a Master’s degree in agro-economy and has extensive humanitarian experience across in Africa, Asia and the Middle East.
Sabi’u Suleiman Shehu was the Advocacy and Communications Officer for phase one of the CDGP. He has eight years’ experience in advocacy and communications and is currently Advocacy and Communications Manager for AAH Nigeria.
Gladys Esther Ahuwan is Nutrition and Health Manager for the CDGP who worked to implement the social behaviour change communication strategy in Jigawa.
The authors would like to acknowledge the e-Pact consortium and Oxford Policy Management, the UK Department for International Development (DFID), Jigawa State Government in Nigeria, and the Save the Children Nigeria Country Office for their roles in the evaluation of the CDGP programme.
This article presents the summary findings of the endline evaluation of the Child Development Grant Programme (CDGP) conducted by the e-Pact consortium1 and led by Oxford Policy Management. It summarises information from the evaluation report, authored by the e-pact consortium, which can be accessed at www.opml.co.uk/projects/evaluation-child-development-grant-programme-cdgp
Location: Northern Nigeria
What we know: There is strong evidence that cash transfers can have a positive impact on food security, but the evidence of impact on nutrition is weaker.
What this article adds: The Child Development Grant Programme (CDGP) was implemented in Zamfara and Jigawa states in northern Nigeria between 2013 and 2019 to address widespread poverty and undernutrition. Pregnant women received monthly cash transfers until their offspring turned two years of age. Low-intensity or high-intensity social behaviour change communication (SBCC) was implemented to randomly selected programme areas. The programme was evaluated through a quantitative survey undertaken at baseline, midline and endline; a process evaluation; and a qualitative survey of key informants. Findings show that the programme reached its intended audience with cash transfers and SBCC interventions (with some spillover). Endline results show increased use of antenatal care services and facility-based births, and improvements in infant and young child feeding beliefs, attitudes and practices, especially in immediate, exclusive and appropriate breastfeeding and improved dietary diversity in infants aged 6-23 months. Indicators of child health improved, including uptake of vaccinations and incidence of diarrhoea and illness, some of which can be linked to improved water, health and sanitation practices. The prevalence of stunting in children under five years old declined by 5.4% at endline in CDGP areas, but no improvements were seen in indicators of wasting or underweight. Results show that cash plus SBCC can reduce child malnutrition and improve child health outcomes, although challenges remain in substantially improving anthropometric outcomes.
The Child Development Grant Programme (CDGP) was a six-year, UK Department for International Development-funded programme that was implemented in northern Nigeria in Zamfara State by Save the Children and in Jigawa State by Action Against Hunger between 2013 and 2019. The programme targeted five local government authorities (LGAs); Anka and Tsafe in Zamfara, and Buji, Gagarawa and Kiri Kasama in Jigawa. The programme was implemented in a rural setting, where agricultural activities form the main source of livelihoods. Households are typically large (with an average household size of nine members recorded at endline) and organised around a male household head, living with one or more of his wives and their children. Rates of poverty and deprivation are high in northern Nigeria, with an estimated 64 million of the country’s extreme poor living in the region.2 The significant burden of poverty, coupled with gaps in health-service provision, have contributed to extremely high prevalence of undernutrition. Around 37% of children under five years of age are stunted in Nigeria as a whole; in Northern Nigeria nearly half of all children are stunted, one third of children under five years old are underweight and one fifth are wasted.3
The programme aimed to address widespread poverty and undernutrition by providing an unconditional cash transfer of Nigerian Naira (NGN)3,500 per month (around US$10) to over 90,000 pregnant women. The transfer value was revised upwards in January 2017 to NGN4,0004 due to an average increase of 44% in the cost of a healthy nutritious diet in the programme area reported in 20165 and subsequent advocacy efforts among stakeholders to adjust the transfer accordingly. Transfers were scheduled to begin once pregnancy was detected and last until the child turned two years old, thereby targeting the first 1,000 days of the child’s life. Alongside the cash transfer, communities in the programme were provided with education and advice about nutrition and health through a social and behaviour change communication (SBCC) component (cash+).
Figure 1: Locations where the CDGP was implemented
The programmes tested two SBCC approaches:
1. Low-intensity SBCC, delivered through posters, radio messaging, text messaging, health talks and food demonstrations;
2. High-intensity SBCC, delivered through support groups and one-to-one counselling for women receiving the transfer, in addition to all of the components of low-intensity SBCC.
The cash + approach was expected to contribute to improved food security and the adoption of positive practices and behaviours to support maternal and child health through the pathways illustrated in Figure 2. The programme aimed to protect 42,000 people from hunger and extreme poverty, and specifically to reduce stunting among 94,000 children in target households (by an increase in height-for-age z-score (HAZ) of 1 standard deviation by endline) and under-five child mortality by 3-5%.
Figure 2: The CDGP theory of change
Methodology of the impact evaluation
There is strong evidence from elsewhere that cash transfers have an impact on food security, but the evidence of impact on nutrition is weaker. The programme was therefore designed with an independent evaluation and research component to generate evidence of nutrition impact. The evaluation, conducted by Oxford Policy Management (OPM), aimed to describe the impact of the programme on intended outcomes using quantitative, process and qualitative evaluation methods.
The quantitative evaluation was based on a household survey carried out before the programme started (baseline; August to October 2014), two years later (midline; October to December 2016) and towards the end of the programme (endline; August to October 2018). This survey aimed to measure the effect of the programme on child nutrition; knowledge and practices regarding healthy behaviours and nutrition; and livelihoods activities. This component was set up as a cluster randomised controlled trial (RCT) in which communities were randomly assigned to groups either receiving CDGP interventions (treatment groups; both receiving cash transfer with one receiving low-intensity SBCC and the other high-intensity SBCC) or none (control group).
An evaluation of the processes of the programme combined analysis of programme data with interviews with programme implementers and other stakeholders to understand how the programme worked, challenges faced during implementation, and factors influencing its impact. A longitudinal qualitative study was also undertaken that followed a small group of households that received the programme over three rounds of data collection. Through individual discussions, this component explored household members’ views about the programme and its impact on their lives, including those relating to culture, behaviour and power relations. Detailed methodology of the qualitative and quantitative components of the evaluation can be found in the full report.6
The CDGP was successful in reaching its intended recipients of women who were pregnant up to the second birthday of child; nine out of every 10 women who were pregnant during the baseline period reported having received cash transfers from the programme by endline. On average, beneficiaries stopped receiving transfers when the child was 24 months of age, as intended. The level of exposure to SBCC channels was relatively high, with the majority of men and women in CDGP communities reporting having accessed at least one of the low-intensity channels. Many men and women assigned to receive the low-intensity version reporting having accessed some of the high-intensity channels, suggesting little differentiation between the two versions in practice. For women, the SBCC channels most frequently reported were posters, followed by food demonstrations. For their husbands, radio and posters were most frequently reported.
Impact on knowledge, attitudes and practices related to maternal health and infant and young child feeding (IYCF)
Maternal health and antenatal care (ANC) services
The CDGP led to significant increases in the use of ANC services in CDGP communities for women who were pregnant at endline. Fifty-one per cent of women who were pregnant when interviewed in CDGP communities reported utilising ANC services, compared with 36% of pregnant women in non-CDGP communities. Children born in CDGP communities were 11 percentage points more likely to have been delivered at health facilities compared with children in non-CDGP communities. This is similar to the findings at midline, indicating a continuation of these positive impacts over time. Nevertheless, only one in every four children who were born after the CDGP midline survey were delivered at a health facility. This may be due to limited availability of skilled staff at health facilities in the evaluation communities; delivery of children was only possible in around 60% of facilities in evaluation areas. The qualitative study also found that the costs of accessing health facilities (for example, cost of transport) were a key influence on attendance.
Knowledge of healthy breastfeeding and IYCF practices
Findings reveal improvements in beliefs and attitudes regarding a range of health issues, including early initiation of breastfeeding, exclusive breastfeeding, the benefits of colostrum, and the fact that it is not advisable to give water to a baby under six months of age. These improvements were observed for both men and women at midline and endline, indicating a positive persistent shift across all household members. Findings also show improvements in breastfeeding practices (immediate, exclusive and appropriate breastfeeding) and improved dietary diversity for children aged 6-23 months (53% of this age group had foods from the recommended number of food groups in CDGP areas compared to 37% in non-CDGP areas).
Table 1: IYCF practices for endline children (born after the midline, before the endline)
The qualitative research revealed enablers and barriers to exclusive breastfeeding. Uptake of exclusive breastfeeding was enabled by seeing other women and members of the community adopting this practice, especially since it went against tradition. This snowball effect was felt by non-beneficiaries of the CDGP, as well as those directly involved in the SBCC activities. Engagement of husbands in SBCC channels was also found to be an important factor in the uptake of messages, according to beneficiaries and local key informants. The role of the CDGP’s community volunteers in providing continuous support, answering questions and showing women the best ways to breastfeed (not only “telling us what to do”) was also found to be a deciding factor for many. Barriers to the adoption of exclusive breastfeeding in CDGP communities included traditional beliefs (such as the view that the first milk, or colostrum, is harmful), the religious practice of giving rubutu (prayer water) to the baby after birth, and the opposition of other influential people, especially older women. To overcome this, traditional birth attendants, female preachers and male religious leaders were urged to encourage women to practice health-seeking behaviours and to help counsel women on IYCF practices in their communities. Overall, many respondents in all research communities reported having adopted the new breastfeeding practices themselves, supporting their wives to do so, or that they would advise other women to do so, because they believed it was better for the baby’s health and nutrition.
Maternal and child nutritional status and health
The ultimate goal of the CDGP was to improve maternal and child health and nutrition. Findings show that the CDGP led to investments in child health, corresponding to the broad set of SBCC messages delivered. Considering the sample of ‘midline’ children first (which includes children who would have been directly exposed to the CDGP), at endline we find a continuation of many of the impacts first observed at midline. So, for children born after the baseline and before the midline, impacts were seen on the uptake of vaccinations (76% of children received the measles vaccination in CDGP areas versus 64% in non-CDGP areas); reduction in the incidence of diarrhoea (22% in CDGP communities versus 32% in non-CDGP communities) and reduction in the proportion of children who had recently suffered an illness or injury (61% in CDGP areas versus 73% in non-CDGP areas); and the proportion of children given deworming medication in the last six months prior to the endline survey (49% in CDGP communities and 37% in non-CDGP communities). Similar impacts also arise for the ‘endline child’ (children born after the baseline, before the midline) demonstrating that the programme had a sustained effect in increasing the uptake of immunisations and other positive health outcomes. This shows that investments in health were sustained for the younger siblings of children initially exposed to the programme, even once the transfers ended. This points to a sustained programme effect.
The impact of the CDGP on reducing the incidence of diarrhoea is consistent with other findings, including improvements in households having access to an improved water source and increases in the uptake of exclusive breastfeeding among children aged under six months. A link between exclusive breastfeeding and diarrhoea was also noticed by respondents in the qualitative midline and endline studies, who reported observing fewer episodes of diarrhoea in their children after introducing exclusive breastfeeding. General improvements in hygiene practices around the home may also be part of the explanation. The qualitative results show increased adoption of a number of positive practices, including hand-washing, covering food, keeping utensils clean and draining stagnant water around the house, and respondents (qualitative endline) reported these are low-cost, sustainable behaviours. This may help explain why the quantitative results show reduced diarrhoea for the ‘endline’ child, for whom households in CDGP communities are mostly no longer receiving transfers.
Regarding the impact of the CDGP on children’s nutritional status, measured by anthropometric indicators, at midline the quantitative results showed a positive impact of the CDGP on child height-for-age. Figure 3 reports impacts on these indicators at endline for the sample ‘midline’ children, who are aged between 21 and 49 months at the time of the endline survey. The CDGP has also successfully achieved a positive impact on reducing the prevalence of stunting among this sample of children (figure 3).
There was no impact on wasting (weight-for-height) or the proportion of children who are underweight (low weight-for-age). This is in contrast to the results of the midline evaluation, where a small increase was found in wasting associated with the CDGP. It is possible that early improvements in nutrition may have contributed to an increase in a child’s height, but were not sufficient to overcome continued lack of access to adequate nutrition, even in CDGP communities. This may then have prevented children’s weight gains from keeping up with their height gains.
Figure 3: Effect of the CDGP on stunted, wasted and underweight for midline children (born after the baseline, before the midline)
Source: CDGP baseline, midline and endline survey data.
Notes: 1. The sample is women who were pregnant at the time of the baseline survey in 2014. The same people were interviewed at midline and endline.
2. The left panel shows unweighted estimates of mean levels in non-CDGP and CDGP communities, by wave. The right panel shows the effect of the CDGP, where the number and square are the point estimates and the line is the 95% confidence interval. The effect is estimated by OLS regression with LGA and tranche fixed effects, adjusted for baseline characteristics of the household and of the woman. In addition, we control for child gender. SEs are clustered at the village level. The effect of the CDGP is statistically significant at the 5% level if the confidence interval does not overlap with the vertical line. The line indicates zero effect.
3. Means, effects and differences are measured in percentage points (PP) for binary and categorical indicators. For continuous indicators, they are measured in the relevant unit of measurement.
4. All Z-scores are computed using 2006 WHO growth charts and cleaned by the standards described therein (WHO, 2006).
The sample of ‘endline’ children (born after the midline and before the endline), aged between 0 and 30 months during the endline survey, primarily consists of indirect-beneficiary children; i.e., younger siblings of those children directly exposed to the intervention. The CDGP was not explicitly designed to have a continued impact on the nutritional status of successive children born into the household after the transfers had ended. There were no impacts in anthropometric outcomes for this sub-sample in stunting, wasting or underweight measures. The findings indicate that direct exposure to CDGP transfers may be required to achieve improvements in anthropometric measurements. This is not altogether surprising, since the outcomes of younger siblings are not directly included in the CDGP theory of change. It is nonetheless interesting that the considerable improvements in IYCF practices and positive health behaviours that we saw for this sample of younger siblings do not translate into improved anthropometrics.
On the whole, there was little evidence of any effect of the CDGP on women’s nutritional status, as measured by height, weight, body mass index and mid-upper arm circumference. An impact was not expected, given that the core impact objectives focused on the health and nutrition of children.
Findings of the evaluation demonstrate that a cash transfer targeted to the 1,000-days window alongside SBCC in the context of the CDGP programme in Nigeria had important positive impacts on health and nutrition practices, some of which had lasting impact beyond the duration of the project and on younger siblings. The project was associated with a reduction in stunting prevalence; however, there was no observed impact on underweight or wasting. Sustained improvements in feeding practices, dietary diversity and child illness should facilitate more healthy children, yet this was not captured in anthropometric measures. This needs closer examination. It could be that raising the amount of cash transfer beyond 10% of monthly income (towards the generally accepted level of transfer of between 15% and 30%) leads to increased impact on nutrition outcomes, as well as changing how transfers are delivered, for example transferring less money more frequently. A broader set of complementary interventions, including longer programme duration, systems strengthening and water, sanitation and hygiene (WASH) interventions, may also be necessary to effect anthropometric change. The programme is currently being transferred to government ownership for continuation and scale-up.
1 The e-Pact consortium is made up of Oxford Policy Management, Itad and the Institute for Fiscal Studies. It is funded by DFID. For further information, visit www.opml.co.uk
2Calculated using 2004 Nigerian Living Standards Survey and 2010 UN Population Division population projections.
3Calculated as a weighted average of the prevalence in the northeast and northwest zones using Nigeria DHS 2008 and Census 2006 data.
4On the local market, NGN 4,000 covers 10kg of maize (NGN1,300), 10kg of sorghum (NGN1,200), 2l of palm oil (NGN1,000) and 1kg of chicken (NGN500) and equates to around 10% of monthly income.
5Rapid Market Analysis to update the CDGP Cost of the Diet Report (2015), Save the Children under DFID funding, September 2016.
6Full methodology of the RCT component is described here: www.opml.co.uk/projects/evaluation-child-development-grant-programme-cdgp
More like this
FEX: Child Development Grant Programme (CDGP) in northern Nigeria: influencing nutrition-sensitive social policy programming in Jigawa State
By Fatima Adamu, Maureen Gallagher and Paul Xavier Thangarasa Lisez cet article en français ici Fatima Adamu is the Communication Officer for Action Against Hunger...
en-net: Consultancy to Assess the Barriers and Enablers for Access to the Cash Transfer and SBCC Interventions in the CDGP Programme in Northern Nigeria
Consultancy to Assess the Barriers and Enablers for Access to the Cash Transfer and SBCC Interventions in the CDGP Programme in Northern Nigeria
The purpose of...
By Oxford Policy Management (OPM) India Oxford Policy Management (OPM) is a development and research based consultancy company that has 30 years' experience is providing...
FEX: Improving nutritional outcomes of rural households through a community-based approach in Ethiopia
View this article as a pdf By Haimanot Abebe, Lioul Berhanu, Wossen Assefa Negash and Daniel Abbott Haimanot Abebe is a Communication and Reporting Specialist working for...
FEX: MAM and SAM cases reduced through a stunting prevention programme in Malawi and the associated costs averted
View this article as a pdf By Jackson Mason-Mackay, Arghanoon Farhikhtah, Mica Jenkins, Trust Takudzwa Mlambo, Emma Lefu and Nancy Aburto Jackson Mason-Mackay is a Programme...
Summary of evaluation1 Location: Lebanon What we know: Cash assistance is increasingly used in humanitarian response to complement in-kind assistance. What this article...
By Mustafa Ghulam and Mohammed H Alshama'a Lisez cet article en français ici Mustafa Ghulam is a Food Security and Livelihoods Progamme Manger with Save the Children,...
FEX: Effectiveness of a community-based infant and young child feeding support group programme among ethnic minorities in Vietnam
By Md Masud Rana, Huan Nguyen Van and Thach Nguyen Ngoc View this article as a pdf Md Masud Rana is a Nutrition Advisor with Save the Children with a particular focus on...
By Rosie Jackson Rosie Jackson currently works for Save the Children UK as an Emergency Food Security & Livelihoods Advisor. Based in London, she provides technical support to...
FEX: Impact evaluation of a DFID programme to accelerate improved nutrition for the extreme poor in Bangladesh
Summary of evaluation1 Location: Bangladesh What we know: There is little evidence of the impact of integrated livelihoods and nutrition programmes. What this article adds:...
By Alix Harou, Marjolein Moreaux and Leanne Dougherty View this article as a pdf Alix Harou has a background in national and international public health and currently works...
At the ACF research conference, November 6th, 2016, experiences were shared from a number of studies where final results will be made available in 2017. A snapshot of what to...
FEX: The REFANI Project in Pakistan: adapting research to a multi-sectoral programme for impact measurement
By Zvia Shwirtz, Bridget Fenn, Riccardo Mioli, Ghulam Murtaza Sangrasi and Maureen Gallagher Zvia Shwirtz is currently the REFANI Communications and Research Uptake Officer,...
FEX: Integrated food security programming and acute malnutrition prevention in the Central African Republic
By Amanda Lewis, Food Security and Livelihoods Head of Department, ACF Central African Republic Lisez cet article en français ici Amanda Lewis is the Head of...
By Ali Dino Kunbher, Shafqat Ullah and Dr Mazhar Alam View this article as a pdf Click here to listen to an interview with the authors on the ENN podcast channel Ali Dino...
FEX: Impact evaluation of cash, food vouchers, and food transfers among Colombian refugees and poor Ecuadorians in urban Ecuador
Summary of evaluation1 Evaluation headlines: Levels of food insecurity and associated anaemia are high amongst Columbian refugees and poor Ecuadorians in the northern...
FEX: Building the ‘enabling environment’ via a multi-sector nutrition platform to scale up micronutrient supplementation
By Paula Quigley, Emmanuel Sokpo and Kate Godden Dr Paula Quigley is a public health professional with over 25 years of international experience in health programme design,...
By Ellyn Yakowenko and Silke Pietzsch View this article as a pdf Lisez cet article en français ici Ellyn Yakowenko is the Associate Director of Research at Action...
Editorial note: As discussed in the editorial of this issue of Field Exchange, there is a lack of clarity and resulting confusion as to what actually constitutes a...
Summary of research1 Location: Cambodia What we know: Food-based strategies such as homestead food production have the potential to increase micronutrient intake and improve...
Reference this page
Caroline Antoine, Stella Esedunme, Céline Sinitzky Billard, Sabi’u Suleiman Shehu and Gladys Esther Ahuwan (2020). Impact evaluation of a nutrition-sensitive social protection programme in northern Nigeria. Field Exchange 62, April 2020. p60. www.ennonline.net/fex/62/nutritionsensitivesocialprotectionprogramme