# How many lives do our CMAM programmes save? Statistical commentary

*By Max O Bachmann*

*Max Bachmann is Professor of Health Services Research at Norwich Medical School, University of East Anglia, UK*

The authors of this study aimed to answer this question by estimating how many children who received CMAM in Nigeria died, then estimating how many of them would have died if they had not received CMAM, then subtracting the first estimate from the second. They then go on to estimate how much CMAM cost for every death averted.

Some readers may be put off by the equations and graphs in the article, but the basic principles are quite simple. The calculations are all based on just seven sets of numbers (called “inputs” or “parameters” in this type of modelling study). The six parameters used to estimate deaths averted are listed in the first column of Table 2. The seventh parameter is the total cost of the CMAM programme.

The results of such a study are uncertain, partly because of uncertainty about the true values of the parameters. Much of the paper - in the section headed “Accounting for uncertainty – A sampling-based approach” - is about how the authors dealt with this “parameter uncertainty”. This method is what health economists call a “probabilistic sensitivity analysis”. In other words, if we don’t know the true value of some parameters, we change their values many times, each time repeating the calculations, then seeing how much the final results vary with repeated sampling. We get a computer to do this, each time sampling from a frequency distribution which we have assumed for each parameter. We can then report the uncertainty about each estimate, conventionally using the 5^{th} and 95^{th} percentiles.

The third column of Table 2, and Figures 2-4, describe the frequency distributions used in this study. As the figures illustrate, the computer will mostly sample numbers near the middle of the distribution, which is where the average or mostly likely value of the parameter lies. Values further away from the middle are sampled less often, because there is reason to believe they are less likely to be true. The only exception is for the proportion of defaulters cured, which for some reason the authors assume has an equal probability of being anywhere between 5% and 20%, but zero probability of being less than 5% or more than 20%. There is no statistical uncertainty about the number treated. The statistical uncertainty about the proportions discharged as cured or defaulting are tiny because of the enormous sample size (almost a million children). I don’t understand the reasoning behind the uncertainties for background mortality and mortality in untreated cases (called σ in Table 2), which does not seem to be based on any statistical principle that I am aware of.^{1} In any case, although there is little or no uncertainty about six of the seven parameters used to estimate the numbers of deaths averted, when they are all combined through the various calculations in the model, the confidence interval around the number of deaths averted is quite large, that is, plus or minus 20% of the central estimate.

Commercially available software programmes commonly used by health economists, such as TreeAge, make it easy to do probabilistic sensitivity analyses like this, with the assistance of graphics and menus. However they can be expensive and are more than is really needed for an analysis such as this. The advantages of using open access software such as *R* are that is free^{2} and, as Box 1 shows, quite simple and transparent to anyone who is not put off by simple programming language.

^{1}A footnote marked ** was subsequently added to Table 2 of the article by the authors to explain the basis of their reasoning.

^{2}**R**? is a programming language and software environment for statistical computing and graphics. R is a GNU project (a free software, mass collaboration project). http://en.wikipedia.org/wiki/GNU_Project

## More like this

### FEX: How many lives do our CMAM programmes save? A sampling-based approach to estimating the number of deaths averted by the Nigerian CMAM programme

By Assaye Bulti (UNICEF), Stanley Chitekwe (UNICEF), Chloe Puett (ACF), and Mark Myatt (Brixton Health) Assaye Bulti is responsible for managing routine nutrition programme...

### en-net: Détermination de la taille de l'échantillon

Greetings,

I am about to begin a research on dietary intake of micro nutrients in children aged 6-59 months in two distinct ago-ecological areas in Ethiopia. Could you...

### FEX: A single coverage estimator for use in SQUEAC, SLEAC, and other CMAM coverage assessments

By Safari Balegamire (VALID International), Katja Siling (World Food Programme), Jose Luis Alvarez Moran (Coverage Monitoring Network), Ernest Guevarra (VALID International),...

### FEX: Costs, cost-effectiveness, and financial sustainability of CMAM in Northern Nigeria

By Sasha Frankel, Mark Roland and Marty Makinen Sasha Frankel worked for the Results for Development Institute as a Senior Programme Associate focusing on health financing and...

### en-net: Impact of CMAM

I am working as Provincial Coordinator Nutrition Cell Government of Balochistan (Pakistan). We have been implementing CMAM in food insecure districts of our province from the...

### FEX: Interpreting results of field surveys using probability calculators

By Oleg O Bilukha and Curtis Blanton Dr. Oleg Bilukha is a Medical Epidemiologist with the International Emergency and Refugee Health Branch (IERHB), Centers for Disease...

### en-net: Coverage survey using Blocked Weighted Bootstrap

I want to see the coverage of micro-nutrient powder in different areas of Bangladesh. For this I am using two stage sampling. For analyzing purpose I want to use block weighted...

### en-net: Intervale of confidence

Hi, We just finish a SQUEAC in Haiti region. Our food security coordinator asking a excellent question (we had the same question in Mali) and we don’t have any answer for now...

### en-net: Cost per DALY averted for CMAM programs

I am just looking at cost per DALY averted for a CTC/CMAM program. I have a few questions: (1) Has anyone here done that? What advice do you have? What are the pratfalls? What...

### en-net: Estimating prevalence using health records

We want to estimate the prevalence of malnutrition in TB patients using health records from different clinics. The initial plan was to extract the information from health...

### en-net: SQUEAC Coverage survey

We did 2 SQUEAC coverage assessments recently and I have confused with something with in it 1. What is the difference between Alpha and Beta prior ? What is Alpha and Beta...

### FEX: The cost of implementing the C-MAMI tool to treat nutritionally vulnerable infants in Bangladesh

By Natasha Lelijveld, Mostofa Sarwar, Golam Mothabbir, Sarah Butler and Nicki Connell View this article as a pdf Natasha Lelijveld is a Research Fellow at the Centre for...

### en-net: Digit preference

I'm just back from Ethiopia and speaking with some key people in the relevant government departments noticed a great emphasis being place on posterior (i.e. after survey)...

### FEX: RAM-OP: A rapid assessment method for assessing the nutritional status, vulnerabilities, and needs of older people in emergency and development settings

By Pascale Fritsch (HelpAge International), Katja Siling (VALID International), and Mark Myatt (Brixton Health) Dr Pascale Fritsch is an experienced public health specialist....

### FEX: Use of a two-stage approach to identify intervention priorities for reduction of acute undernutrition in Abaya district of Ethiopia

By Katja Siling, Asrat Dibaba and Mark Myatt Katja Siling is an independent consultant helping organisations increase their learning capability and fulfil their mandate...

### FEX: IYCF assessment with small-sample surveys - A proposal for a simplified and structured approach

By Ernest Guevarra (VALID International), Katja Siling (VALID International), Faraja Chiwile (UNICEF Sierra Leone), Mueni Mutunga (UNICEF Sierra Leone UNICEF Sudan), Joseph...

### en-net: Determine carers willingness to walk to access services

In Myatt, Mark et al. 2012. Semi-Quantitative Evaluation of Access and Coverage (SQUEAC)/Simplified Lot Quality Assurance Sampling Evaluation of Access and Coverage (SLEAC)...

### en-net: producing HAZ distribution

I am using DHS datasets, say, DHS 2000, DHS 2007, DHS 2014 to check the trends in child nutritional status. Can anyone suggest me a statistical sofware that will help me to...

### en-net: SMART surveys and interpretation of quality

Few questions 1. To what extent should the results of ENA plausibility tests be used to reject surveys which collect more than anthropometric data,in the first place was...

### en-net: Guidance around post emergency micronutrient supplementation

Does anyone have any guidance info' or links to documents outlining how population groups should be treated for micronutrient deficiencies with non-clinical...

### Reference this page

Max O Bachmann (2015). How many lives do our CMAM programmes save? Statistical commentary. Field Exchange 50, August 2015. p47. www.ennonline.net/fex/50/cmamnumberlivessaved