New Method for Estimating Programme Coverage

By Mark Myatt

Mark Myatt is a consultant epidemiologist and senior research fellow at the Division of Epidemiology, Institute of Opthalmology, University College London. His areas of expertise include infectious disease, nutrition, and survey design.

This article gives an overview of the coverage estimation method developed for the Community Therapeutic Care (CTC) Research Programme in Malawi1.

Coverage is becoming an important indicator for monitoring and evaluating humanitarian interventions. Coverage indicators for selective feeding programmes were included in the SPHERE project's humanitarian guidelines for the first time in 20032. Current approaches to estimating therapeutic feeding programme coverage rely on the use of nutritional anthropometry surveys that commonly employ a two-stage cluster sampling strategy. Such surveys will be familiar to many humanitarian practitioners as 'thirty-by-thirty' surveys. Coverage is calculated either directly using survey data or indirectly using survey data, programme enrolment data, and population estimates. Both methods assume that coverage is similar throughout the entire survey area and both can provide only a single wide-area coverage estimate.

 

 

The two-stage cluster-sampling approach uses population proportional sampling (PPS) in the first stage to select cluster locations and proximity sampling in the second stage to select households and children.

The PPS approach is unsatisfactory because:

The proximity sampling approach is unsatisfactory because:

The sample size available to estimate coverage at each cluster location is likely to be only one or two cases.

These problems are not important if the assumption that coverage is similar throughout the entire survey area is true. Such as assumption is, however, unlikely to be true of many centre-based programmes or during the start-up phase of a programme, where coverage is likely to be better in the areas closest to feeding centres. If coverage is uneven, the ability to identify areas with poor coverage is an essential first step towards improving program coverage and, hence, program impact. Current methods do not provide this.

The method outlined here allows an estimation of coverage in the usual way, but also allows identification of areas with poor coverage within a programme area.

Step 1 : Find a Map

The first step in the new coverage estimation method is to find a map of the program area. Try to find a map showing the location of town and villages. A map of 1:50,000 scale is ideal.

Step 2 : Draw a grid

The next step is to draw a grid over the map. The size of each square should be small enough for it to be reasonable to assume that coverage will be similar throughout the square. A square of 10km by 10km will probably be small enough in most circumstances.

Step 3 : Select the squares to sample

Select the squares with about 50% or more of their area inside the program area.

Step 4 : Select the communities to sample

Select the community closest to the centre of each square. If prevalence is low then you might need to select more than one community from each square. Select the communities closest to the centre of each square. Select the communities to be sampled and the order in which they should be sampled in advance of visiting the square.

Step 5 : Case-finding

When you visit a community find cases using an active case-finding method. It is usually sufficient to ask community health workers, traditional birth attendants, traditional healers or other key informants to take you to see "children who are sick, thin, or have swollen legs or feet" and then ask mothers of confirmed cases to help you find more cases. You could also use door-to-door screening. It is important that the case-finding method that you use finds all, or nearly all, cases in the sampled communities. Each case is confirmed by applying the program's entry criteria (e.g. < 70% of the median weight-for-height from the NCHS reference population and /or bilateral pitting oedema). When you find a confirmed case you should then find out whether that child is in the programme. Remember to follow-up on children reported to be in a therapeutic feeding centre or at a distribution point on the day of the survey.

Step 6 : Record the data

You need only record the number of cases found and the number of those that are in the program for each sampled square.

Step 7 : Calculate coverage

Coverage is calculated as the number of cases that you found that are in the program divided by the number of cases that you found. You should calculate this separately for each square as well as for all of the squares together. You could use a weighted method to calculate the coverage for all of the squares combined but this is not essential.

Step 8 : Plot the data

Coverage data is plotted as a mesh map and as a histogram. The length of the sides of the filled squares on the mesh map reflects the level of coverage found in each square (calculated in step 7). The small open squares indicate quadrats (squares of approximately equal area) with zero coverage. You might find it helpful to mark the location of feeding centres, distribution points, health posts, and roads on the map. This will help you interpret the results of the coverage survey.

For further information on this method, contact Mark Myatt, email: mark@brixtonhealth.com

Show footnotes

1Coverage method presented at CTC meeting in Dublin, 8-10th October, 2003. See this issue for meeting summary.

2http://www.sphereproject.org/handbook/index.htm

3A number of formulae are used for direct coverage estimation. The simplest and most intuitive variant is shown here.

More like this

FEX: New Method for Estimating Programme Coverage (Special Supplement 2)

By Mark Myatt This article gives an overview of the coverage estimation method developed for the Community Therapeutic Care (CTC) Research Programme in Malawi1. Coverage is...

FEX: GPS assisted coverage survey in DRC

By David Rizzi David Rizzi graduated in Pharmacy and later took an MSc in Development at the Rome University La Sapienza, Italy. He holds a second MSc in Public Health...

FEX: Using SLEAC as a wide-area survey method

By Ernest Guevarra, Saul Guerrero, and Mark Myatt Ernest Guevarra leads Valid International's coverage assessment team. He has formal training as a physician and a public...

en-net: Nutrition assessment in small pieces livelihood zones

Unfortunately, our nutrition program fall under three livelihood area. The total program catchment population is about 120,000. The proportion of population in the three...

en-net: S3M

In looking at materials on CSAS, there are several references to S3M but I can't find anything that actually explains it. Does anyone have any resources for that? Hi Mark, I...

en-net: Modified EPI vs Segmentation in Urban Settings

Hello, Id like to know what is the best recommended methodology for SMART Survey in Urban Setting with large population (total population: 500,000p, pop/cluster >2000...

en-net: Confidence Intervals for Complex Sampling

Can you calculate confidence intervals for cluster sampling in Open Epi? As I wrote before above ... "The term 'complex sampling' is very broad covering both stratified and...

en-net: Can stratified random sampling be an option in IYCF study in arid area?

I am nutrition student looking to do a study on CF practices in an arid area (predominant pastoralist). Cluster sampling seems to be the main method in use. However, the...

FEX: New method for assessing acute malnutrition in nomadic pastoralist populations

By Anne-Marie Mayer, Mark Myatt, Myriam Ait Aissa and Nuria Salse Anne-Marie Mayer is a technical consultant for this project and carried out the first field test in Mali with...

en-net: CSAS survey for TSFP only

Dear Sir, We are planing to determine the coverage of a TSFP program that has been runing quite a while. Hence, according to the CSAS sampling, we calculated that we have to...

FEX: The Challenge of Applying CSAS in DRC

By Jason Stobbs, AAH-USA Jason Stobbs is a long-serving member of Action Against Hunger - USA, volunteering over the past four years in diverse contexts such as Afghanistan,...

FEX: SQUEAC: Low resource method to evaluate access and coverage of programmes

By Mark Myatt Mark Myatt is a consultant epidemiologist and senior research fellow at the Division of Ophthalmology, Institute of Ophthalmology, University College London....

en-net: Random sampling without a proper map

Dear all, I am a pediatrician and Master Student of International Health and I am quite new in the field of nutrition. I am preparing a survey of IYCF practices in Haiti. This...

en-net: How to Maintain the Quality of CSAS Method

As we all know, coverage is an internationally recognized indicator of performance for selective feeding program (SFP) and CSAS is the current gold standard for assessing...

en-net: Nutrition survey analysis- Associations

I want to analyze associations between wasting and (morbidity, sex and age groups.... etc) in a nutrition survey - 30X24 two stage cluster sampling. I have tried different...

en-net: Advice on how much SQUEAC and LQAS coverage surveys cost and how long they take

Hi, We'd like to do a coverage survey in Darfur. We have 8 OTP sites with a total of 6,300 children under 5 in mainly rural areas and we hope to have at least 50% coverage....

en-net: Sample size for rapid nutritional assessment of U5 using MUAC

Hi all, We would like to conduct a rapid nutritional assessment in an area affected by flood three times in the last quarter. Could anyone suggest about the size of the...

en-net: LQAS types

I have a chance to read number of assessment reports using LQAS but they used different terminologies/methods regarding LQAS. these are the conventional LQAS, cluster LQAS and...

en-net: Single two-stage cluster survey in multiple livelihood zones

The current approach is to have single two-stage cluster survey by agro-ecology. If a given district has two agro-ecological zone, this means there should be two independent...

en-net: Stage 3 - Sample size issue - Help

Dear all, We are currently conducting a SQUEAC investigation in two townships of the Northern Rakhine State in Myanmar. We have been doing well so far but we are now facing a...

Close

Reference this page

Mark Myatt (2004). New Method for Estimating Programme Coverage. Field Exchange 21, March 2004. p10. www.ennonline.net/fex/21/coverage