Home Today's Paper Most Popular Video Gallery Photo Gallery
Subscription Blog Signin Register
Monday, July 22, 2019 08:27:46 AM
Follow Us On: Facebook Twitter Twitter Twitter Twitter

Measuring Poverty Impacts

More Difficult Than Simply Using Score Cards

Share your thought
Post a comment »
Read all () »

Utz Pape :
Ending poverty is not only one of the twin goals of the World Bank, but also one of the Sustainable Development Goals. To design and optimise projects for poverty reduction, we need to measure their impact on poverty. This is quite difficult because changes in the poverty rate might take some time, and it is usually hard to attribute the impact to a particular project, especially without conducting a randomized controlled trial (RCT). But even if we manage to overcome these challenges, we need to measure poverty before the start of the project - as a baseline and to understand whether the project adequately targets the poor - and at the end of the project to assess its impact. And that is also not easy.
Poverty measures are derived from indicators that are captured at the household level (which comes with its own problems). Usually, we administer household questionnaires asking how much of which items the household members consumed in the past week(s) or month(s). As such, an interview usually takes several hours, which is often not feasible for assessing the impact of a project. Alternative methods have therefore been developed using just a handful of questions to estimate poverty. The Poverty Probability Index (PPI) invented by Grameen and taken forward by Innovations for Poverty Action (IPA) is a good example.
Based on a statistical model (calibrated with data from the last consumption survey), a score is assigned to each question. Once the scores from all questions are summed up, a predefined table is used to look up the probability of a specific household to be poor. While this sounds easy and is promised to be very cost-efficient, the scorecard suffers from several short-comings that will critically bias the results, even after the scorecard is tested and optimized. Here, I will focus on two of them.
The first problem is that the answers to some of those questions usually depend more on the location of the household or the time of the interview than on whether the household is actually poor. Simply put:  it is hard to come up with a short list of proxy poverty indicators that work well everywhere in a country at any time of the year. Let us look at question 6 which asks whether the household either purchased, consumed or acquired any ripe bananas in the past 7 days. Consumption of this item varies considerably within Kenya. For example, almost 75 percent of households in Mombasa compared to only less than 40 percent in Narok consume ripe bananas even though both counties have a comparable poverty rate of about 17 percent.
Based on the scoring system, households consuming ripe bananas will have a reduced probability of being identified as poor. Thus, the PPI-estimated poverty rate does not always fit the real poverty rate (measured with a representative household consumption survey). The population in Narok consumes less ripe bananas than is expected for households at a poverty rate of 17 percent. Therefore, the PPI-estimated poverty rate over-states the real or official poverty rate by almost 10 percentage points at 27 percent. Another example is Busia where the official poverty rate of 60 percent is underestimated by 15 percentage points at 45 percent. To put this into relation, Kenya needed 10 years to reduce its poverty rate by 7 percentage points. Thus, such a strong bias will make it impossible to measure any realistic changes in poverty.
These are conservative examples because, in addition, the scorecard system increases or reduces the score of households by a certain amount according to their location or county of interview. Thus, the PPI could have - theoretically - been calibrated to perfectly reproduce poverty estimates at the county level (but for statistical reasons related to overfitting this is not necessarily desirable). While I use the county-level as an example here, the problem with the system is more general: There will always be subpopulations for which the poverty estimate is going to be biased - with potentially critical consequences from excluding groups of people or locations from programs.
However, the scorecard (and other methods based on this principle) suffer from an even more fundamental problem, especially if used to evaluate the impact of a program on poverty. It is based on a so-called structural model, which relates responses to the questionnaire with poverty based on observed linkages - for example, between ripe bananas and poverty - at the time of the last household consumption survey. These relationships, however, can change over time, especially if the population is subject to shocks or beneficiaries of projects.
Kenya exports a good proportion of its bananas. If South Africa, for example, suffers a drought reducing its own banana production, it can compensate for this shock by importing more bananas from Kenya. This will increase the price of bananas in Kenya. In turn, producers of bananas will make higher profits, while consumers might substitute bananas in their diet for another fruit or product. This will reduce consumption of ripe bananas in Kenya. If - as an extreme example - no more bananas were to be consumed, the PPI would estimate an increase in poverty by up to 13 percentage points. On average, the estimated increase would be 8 percentage points which is more than the 10-year progress in poverty observed between 2005/6 and 2015/16. However, it's unlikely that such a positive economic shock would actually increase poverty at all.
Here is another example: Imagine we are using the PPI to estimate the impact of an agricultural project. Assume the project works well and improves agricultural productivity for more desirable staple foods than ripe bananas. Therefore, prices of other staple foods will drop, and households would substitute ripe bananas with the now affordable and more desirable staple foods. Thus, consumption of bananas will drop such that the PPI will estimate an increase in poverty as in the previous example, while in reality poverty is likely to have dropped due to the higher incomes of farmers and the decrease in prices.
This is not a specific characteristic of the question on bananas. One can see similar biases for almost all other questions. A project distributing towels to households will lead to a PPI-estimated poverty rate that is lower by up to 14 percentage points (on average: 9 percentage points), even though the real reduction in poverty - if any - is surely less impressive. Similarly, a project that trains beneficiaries to become tailors while distributing sewing machines will increase towels in an area, but probably with a much lower reduction in poverty than estimated by the PPI.
Of course, the PPI scorecard can be adjusted for specific groups or locations, as well as for specific projects to ensure that it is less susceptible to such spurious effects. Given the appeal of the general scorecard to non-technical users, however, many users will not know about the caveats and, thus, may not bother to adjust the card. Even if adapted though, the system will always be subject to biases, which often cannot be foreseen, especially if a project is evaluated over a longer time. Instead of a scoring card-like methodology, new consumption measurement approaches (e.g. the rapid consumption methodology) should be considered as they produce more accurate estimates, so that we can trust the measured poverty impact of a project, and correctly decide, for example, if it should be scaled up.

(Utz Pape, Economist).

Add Rate

News Archive

Inside The New Nation

Editorial »

Taking law in own hand is an ominous sign

MOBS beat to death five people, including two women, and injured 10 others on suspicion of being child kidnappers across the country on Saturday. The incidents happened just a day after three people were beaten by a mob in Thakurgaon. Incidents of mob beating have increased even after the Bridges ...

International »

Abe on course to retain majority in upper house election

AFP, Tokyo :Japanese voters cast ballots Sunday in an upper house election, with Shinzo Abe's ruling bloc looking to protect its majority and keep on track plans to amend the country's pacifist constitution.The 64-year-old Abe, who is on course to become Japan's longest-serving prime minister, is also hoping to shore ...

Entertainment »

Mehazabien, Tawsif, Sabila Nur’s Eid drama Better half

Entertainment Report :Few days ago, a drama titled Swapno Dekhi Abaro, directed by Mahmudur Rahman Himi, was made with theme given by popular TV actress Mehazabien Chowdhury. Mehazabien also acted in this play against Shamol Mawla which will be telecasted in upcoming Eid. This time Imraul Rafat has made an ...

Editorial »

Administrative control over ACC only to happy the corrupts

ANTI-GRAFT campaigner Transparency International Bangladesh (TIB) has expressed deep concern and extreme disappointment over the government's decision for making Deputy Commissioners as authorised officers to oversee the Anti-Corruption Commission's work in the districts. The move will undoubtedly restrict the ACC's ability to fight graft and proper investigation into allegations of ...

Sports »

Penny drops for Canada's teen swim queen Oleksiak

Canada's Penny Oleksiak insists she has finally left the "weirdness" of capturing Olympic swimming gold at the tender age of 16 after finally recovering from a lengthy Rio hangover. Oleksiak, who is preparing for the world championships which begin in South Korea this weekend, stunned the sport when she dead-heated ...

International »

Thousands rally in support of Hong Kong police

AP, Hong Kong :Tens of thousands of people rallied in support of Hong Kong's police and pro-Beijing leadership on Saturday, a vivid illustration of the polarisation coursing through the city after weeks of anti-government demonstrations.Hong Kong has been rocked by more than a month of huge and largely peaceful protests-as ...

International »

US offers $7m to find Hezbollah agent as Pompeo visits Argentina

AFP, Buenos Aires :The United States on Friday offered a $7 million reward to find a Hezbollah operative accused of masterminding a deadly 1994 attack on a Jewish center in Buenos Aires, as Secretary of State Mike Pompeo sought to unite Latin American nations against the militants.Pompeo visited to mark ...

Entertainment »

Shilpa Shetty to return to the big screen after twelve years

Shilpa Shetty is all set to make a comeback on the big screen after a gap of twelve years. The actress was last seen in Dharmendra, Sunny and Bobby Deol starrer Apne (2007). Before jetting off on a holiday with family, Shilpa has green lit filmmaker Aziz Mirza's son Haroon ...

Editorial »

Corruption in WASA crosses all limits

THE Anti Corruption Commission has identified eight projects and three areas in Dhaka WASA where corruption takes place. The State enterprise keeps extending deadlines and increasing the costs of its projects to create room for corruption. In many cases, WASA did not carry out its work as per project designs ...

International »

UN reaches agreement with Yemen rebels to resume food deliveries

AFP, United Nations :The World Food Program has reached an agreement in principle with Yemen's Huthi rebels to resume food aid to areas they control, the agency's chief said on Thursday.Malnutrition is widespread in Yemen after four years of civil war, but the UN suspended deliveries of food aid to ...

Entertainment »

Shabnam Parvin’s Hurmoti film to be released after Eid

Entertainment Report :Viewers’ choice popular actress Shabnam Parvin has made a movie titled Hurmoti which is based on her own written story. Shabnam Parvin herself played the title role in the movie. Al Monjur wrote dialogue while script was also written by Shabnam Parvin herself. Shabnam Parvin informed that against ...

Editorial »

China funded projects: Delay would create problems

A JOINT working group has been formed to probe the slow progress of the 27 projects involving around $20 billion that China had agreed to provide during President Xi Jinping's Dhaka visit in October 2016. China has so far disbursed only $981.36 million -- less than 5 percent of the ...

Football »

Infantino reacts to Blatter criticism over Africa cleanup

AP, Cairo :FIFA president Gianni Infantino hit back at Sepp Blatter's criticism of the world soccer body's cleanup operation in Africa as a modern-day form of "colonialism."Infantino response on Thursday was: "I have to laugh about it."Blatter, the former head of FIFA who is serving a six-year ban from soccer, ...

City »

A vital portion of highway in Uttara near Armed Police Office is in dilapidated condition where big potholes and cracks following incessant rains for the last few days and works relating to metro-rail project, other development works. This photo was taken on Thursday.

International »

US against any country purchasing Russia's S-400 defence system: Pentagon

PTI, Washington :The US is keen to make its defence partnership with India stronger, the Pentagon has said, but made it clear that it is against any country purchasing military equipment, including the S-400 missile defence system from Russia, that is designed to counter America's sophisticated fifth-generation aircraft.The remarks by ...

Items that you save may be read at any time on your computer, iPad, iPhone or Android devices.
Are you new to our website? Do you have already an account at our website?
Create An Account Log in here
Email this news to a friend or like someone
Write a comment to this news