Community weighting of barriers and boosters in Democratic Republic of Congo
By Lenka Blanárová, Sophie Woodhead and Mark Myatt
Lenka Blanárová is a Community Mobilisation Advisor at ACF-UK, supporting nutrition programmes in Burkina Faso, Chad, Democratic Republic of Congo and Pakistan in the implementation of coverage assessments and the development of evidence-based community engagement strategies to boost their uptake and coverage.
Based within the ACF-UK Operations Team, Sophie Woodhead coordinates all activities and research projects under the Coverage Monitoring Network. She has supported a number of coverage trainings in west, east and central Africa as well as in Asia.
Mark Myatt is a consultant epidemiologist. His areas of expertise include surveillance of communicable diseases, epidemiology of communicable diseases, nutritional epidemiology, spatial epidemiology and survey design. He is currently based in the UK.
Location: Democratic Republic of the Congo
What we know: Perceptions of the relative importance of boosters and barriers to Community Management of Acute Malnutrition (CMAM) services access and coverage may differ between assessment teams and the community.
What this article adds: A recent case study examines the feasibility of involving community members in the weighting of barriers and boosters found using barriers-boosters-questions (BBQ) analyses in a SQUEAC assessment of programme coverage. Flash cards were used to present barriers and boosters to community members, followed by a ranking exercise and a weighting exercise (personal ballot of selected representatives and collective ranking). Weights were summarised for each barrier and booster using the median vote. Weightings given to barriers and boosters by the SQUEAC team and by community members did not always coincide; differences may not greatly affect the position of the prior mode but may, for example, influence programme reform. The method has potential but requires further development.
Previous experience has shown that the Semi-Quantitative Evaluation of Access and Coverage (SQUEAC) assessment team’s perceptions of the relative importance of individual factors with a positive impact (boosters) and negative impact (barriers) on access and coverage may differ from the community’s assessment of the same factors. The input of community members is, therefore, potentially useful when weighting barriers and boosters for use in SQUEAC stage III assessments and for their translation into meaningful recommendations for programme reform. This case study examines the feasibility of involving community members in the weighting of barriers and boosters found using barriers-boosters-questions (BBQ) analyses in a SQUEAC assessment of programme coverage in Kirotshe health district, North Kivu Province, Democratic Republic of the Congo (DRC).
Methods and results
Following SQUEAC stage I qualitative data collection involving the daily organisation of barriers, boosters and questions using the BBQ tool, a small team of experienced SQUEAC assessment team members set out to test the feasibility of using community members to weight barriers and boosters. The work reported here took place in a single, purposively selected, exemplar community. The exemplar community was deemed to be broadly representative of the entire health district and chosen to be neither too close nor too far from the centre of the health district.
In preparation for the exercise, a set of large (i.e. A4 size) flashcards each depicting a single barrier or booster were prepared. Flashcards were put together electronically using copyright-free images available online. Figure 1 and Figure 2 show examples of flashcards for two barriers.
Multiple sets of voting cards displaying weights 1, 2, 3, 4, 5 and 6 were also prepared. These were designed and printed using different colours for each weight in order to facilitate the weighting process for participants with weak basic numeracy skills (see Figure 3).
The selected exemplar community was informed about the purpose and organisation of the exercise in advance and participation agreed. A group of five men and five women took part in the exercise. Only three persons of each sex voted.
Following an introduction, during which participants were encouraged to speak for the whole health district rather than focus on the needs of their own family or community, the team presented the identified barriers and boosters one by one using the set of flash cards and adding relevant descriptive and narrative detail gathered during stage I of the SQUEAC investigation.
After each barrier and booster had been presented and explained, the relevant flash card was placed on the ground for all participants to see and ask questions (see Figure 4). When all uncertainties were clarified, participants were asked to discuss and rank barriers in order of importance, starting with those likely to have had the biggest impact on coverage and access to treatment. This exercise was repeated for boosters. Table 1 presents results of the ranking exercise for both barriers and boosters.
A colour-blind-safe palette of colours was created using colorbrewer2 for these cards.
Upon completion of the ranking exercise, the team explained the weighting exercise.
Three men and three women were selected and each received a complete set of voting cards (see Figure 3). The planned weights ranged between one (lowest impact on coverage) and six (highest impact on coverage). Given the large number of barriers and boosters identified during stage I of the SQUEAC investigation, it was decided that participants needed to vote on a scale ranged between one and seven. A weight of seven was achieved using two voting cards (e.g. a weight of seven was formed from 6 + 1 or 5 + 2 or 4 + 3).
When ready, participants were asked to turn their backs on the other participants in order to limit the influence on their voting. Women tended to shuffle voting cards under their garments to prevent others from peeking.
The team reviewed each barrier separately and participants voted by raising voting cards displaying a number of points reflecting the perceived importance of a particular barrier on coverage or access to treatment (see Figure 5). This process was repeated for boosters.
Table 2 shows the results of the weighting exercise for barriers and boosters. The weighting of barriers and boosters did not always coincide with their collective ranking or with the rankings of the SQUEAC team (see Table 3). The discrepancies between the collective ranks and the ranks from voting show that ‘consensus’ approaches may yield different results from ‘private ballot’ approaches and this can form the basis for further discussions with the group.
Results (i.e. Table 2 and Table 3) were presented to the group. Group members were invited to voice additional opinions and suggest recommendations for the improvement of the provided Community based Management of Acute Malnutrition (CMAM) services.
The ‘private ballot’ results were combined with other results from other sources and methods (i.e. using a simple average) to decide an appropriate prior mode for uses in the SQUEAC stage III survey (see Table 4).
The work presented in this case study demonstrates that it is feasible to use members of the community to weight barriers and boosters and provide input into the development of the prior for the SQUEAC stage III surveys. Such a prior would follow the SQUEAC principles of triangulation by source and method.
The finding that weightings given to barriers and boosters by the SQUEAC team and by community members did not always coincide suggests that the approach has value. Such differences may not greatly affect the position of the prior mode used in the SQUEAC stage III survey. In the work reported here, the position of the prior mode from the SQUEAC team alone (i.e. mean of the four methods used) was 34.0% and the position of the prior mode with community weighting added was 35.7%. The differences may, however, be useful to inform the priority given to different programme reforms. For example, the discrepancy between the SQUEAC team’s weightings and the community weightings with regard to the efficiency of the Community Health Worker (CHW) network found in the work reported here suggests that more data should be collected to inform reforms of the CHW network.
It is important to note that the work presented in this case study is not intended as a complete model of what should be done in SQUEAC assessments. If the community-weighting method is to be applied, it may prove useful to increase the range of sources used for community-based weighting to include, for example, all ethnic and religious groups, communities near to and distant from programme sites, community health workers/community-based volunteers, clinical and other programme staff and carers of children attending the program. The use of a diverse set of sources would follow the SQUEAC principle of triangulation by source.
Combining results from different sources and methods could follow a hierarchical method in which the prior modes from related sources are averaged and then the prior modes from all sources are averaged. This process is outlined graphically in Figure 7. In the hypothetical example here, the prior mode is 40.1%. The width of the prior mode could be calculated as:
Figure 8 shows a suitable prior for the example shown in Figure 7 created with the BayesSQUEAC calculator. Care should be exercised not to specify an overly strong prior. It is probably not a good idea to specify a range narrower than ± 15%.
The work presented here shows promise. The method does, however, require further development before it can be recommended for use as a standard component of SQUEAC assessments.
Programme implementers and SQUEAC practitioners are encouraged to use community-feedback mechanisms (such as those described in this case study) in order to improve service delivery. These may be integrated into SQUEAC assessments or done as separate programme activities. Experiments, developments and findings could be submitted to Field Exchange for publication or presented and discussed on the en-net coverage assessment forum: www.en-net.org/forum/16.aspx.
For more information, contact: Sophie Woodhead
More like this
en-net: SQUEAC - Weighted boosters and barriers
I have tried to check different SQUEAC investigation reports. I am observing inconsistencies in weighing and scoring system. Regardless of the number of boosters and barriers,...
en-net: Low OTP Coverage
I have just concluded a SQUEAC Coverage Assessment in one of the Districts in Marsabit County, Kenya and found an OTP Coverage of 20.2%. This is quite low and even below the...
FEX: Is there a systematic bias in estimates of programme coverage returned by SQUEAC coverage assessments?
Lisez cet article en français ici This is a poscript for research article 'Is there a systematic bias in estimates of programme coverage returned by SQUEAC coverage...
FEX: Is there a systematic bias in estimates of programme coverage returned by SQUEAC coverage assessments?
View this article as a pdf Lisez cet article en français ici By Mark Myatt and Ernest Gueverra Mark Myatt is a consultant epidemiologist. His areas of expertise...
FEX: Boosters, Barriers, Questions: an approach to organising and analysing SQUEAC data
By Andrew Prentice (VALID), Balegamire Safari Joseph (VALID), Esther Ogonda McOyoo (Concern), Faith Manee Nzidka (ACF), Hassan Ali Ahmed (Mercy USA), Jackson N Chege (Islamic...
en-net: Geeting the alpha and beta values
Hi. Im new to squeac assessment. I needed a guidance of knowing how to set the alpha and beta values in the BayeSQUAC. Lets say the assessment team feels the program is between...
en-net: SQUEAC Coverage survey
We did 2 SQUEAC coverage assessments recently and I have confused with something with in it 1. What is the difference between Alpha and Beta prior ? What is Alpha and Beta...
en-net: 2nd SQUEAC Planning
Hi, We are planning to conduct SQUEAC investigation of CMAM program which is about to end in Dec 2016. Last SQUEAC survey was conducted in 2015 for which the results are Point...
FEX: Something for everyone: three perspectives from a recent coverage assessment in Pakistan
Summary of review1 Lady Health Worker and her husband (teacher) working as volunteers Interview by Saul Guerrero, ACF Action Against Hunger, in collaboration with...
en-net: SQUEAC, when CMAM program ends
Dear All, 1. Just want to know & guidance please, can we conduct SQUEAC in a district where program ended few months ago? though all program records are available. 2. If...
en-net: un weighting of Barriers and Boosters
I have tried to read about how to weight and unweight barriers and boosters but am confused with the part of un weighting. How exactly is Un weighting done? Dear...
en-net: Cox's Bazar Refugee Settlements: Coverage assessment methodology
Hello, I am supporting partners with assessing the coverage of OTP and TSFP in the Rohingya camps in Cox's Bazar, Bangladesh. In August 2018, the camps (35 in total) were...
FEX: Transforming awareness and training into effective CMAM Performance
By Maureen Gallagher and Armelle Sacher Maureen Gallagher is the Senior Nutrition & Health Advisor ACF USA based in New York. She has worked for the last 10 years in nutrition...
en-net: SLEAC and SQUEAC
Between the SLEAC and SQUEAC, which one should be done first and can SLEAC be done in a SMALL Area, say a district with a population of around 30,000 and geographically the...
FEX: The Coverage Project: a national partnership for evaluating CMAM services in Nigeria
By Maureen Gallagher, Saúl Guerrero, Ifeanyi Maduanusi and Diego Macías Maureen Gallagher is the Senior Nutrition & Health Advisor Action Against Hunger US based...
FEX: en-net update, August to October 2012
By Tamsin Walters, en-net moderator Forty-seven questions were posted on en-net in the three months August to October 2012 inclusive, eliciting 152 replies. In addition, 18...
en-net: SQUEAC survey consultant - Concern Worldwide - South Sudan
Concern Worldwide is looking for a consultant to carry out a SQUEAC survey in Aweil West and North in South Sudan. Terms of Reference 1. Background The SQUEAC Survey is to...
FEX: Causal analysis and the SQUEAC toolbox
By Mara Nwayo and Mark Myatt Mara Nyawo is a nutritionist specialising in nutrition surveys and surveillance. She has nine years experience working in emergency and chronic...
en-net: Geographical area for coverage survey
I am planning a SQUEAC survey in Haiti. Our PTAs are spread through 5 Communes (Provinces) which are relatively close together. The problem is that in the middle of this 5...
FEX: Measuring coverage at the national level in Mali
By Sophie Woodhead, Jose Luis Alvarez Moran, Anne Leavens, Modibo Traore, Anna Horner, Saul Guerrero Based within the ACF-UK Operations Team, Sophie Woodhead coordinates all...
Reference this page
Lenka Blanárová, Sophie Woodhead and Mark Myatt (). Community weighting of barriers and boosters in Democratic Republic of Congo. Field Exchange 52, June 2016. p44. www.ennonline.net/fex/52/barriersandboostersdrc