Home Today's Paper Most Popular Video Gallery Photo Gallery
Subscription Blog Signin Register
Thursday, February 20, 2020 10:29:54 AM
Follow Us On: Facebook Twitter Twitter Twitter Twitter

Measuring Poverty Impacts

More Difficult Than Simply Using Score Cards

  • Twitter
  • Google+
  • Save
  • E-mail
  • Print
Share your thought
Post a comment »
Read all () »

Utz Pape :
Ending poverty is not only one of the twin goals of the World Bank, but also one of the Sustainable Development Goals. To design and optimise projects for poverty reduction, we need to measure their impact on poverty. This is quite difficult because changes in the poverty rate might take some time, and it is usually hard to attribute the impact to a particular project, especially without conducting a randomized controlled trial (RCT). But even if we manage to overcome these challenges, we need to measure poverty before the start of the project - as a baseline and to understand whether the project adequately targets the poor - and at the end of the project to assess its impact. And that is also not easy.
Poverty measures are derived from indicators that are captured at the household level (which comes with its own problems). Usually, we administer household questionnaires asking how much of which items the household members consumed in the past week(s) or month(s). As such, an interview usually takes several hours, which is often not feasible for assessing the impact of a project. Alternative methods have therefore been developed using just a handful of questions to estimate poverty. The Poverty Probability Index (PPI) invented by Grameen and taken forward by Innovations for Poverty Action (IPA) is a good example.
Based on a statistical model (calibrated with data from the last consumption survey), a score is assigned to each question. Once the scores from all questions are summed up, a predefined table is used to look up the probability of a specific household to be poor. While this sounds easy and is promised to be very cost-efficient, the scorecard suffers from several short-comings that will critically bias the results, even after the scorecard is tested and optimized. Here, I will focus on two of them.
The first problem is that the answers to some of those questions usually depend more on the location of the household or the time of the interview than on whether the household is actually poor. Simply put:  it is hard to come up with a short list of proxy poverty indicators that work well everywhere in a country at any time of the year. Let us look at question 6 which asks whether the household either purchased, consumed or acquired any ripe bananas in the past 7 days. Consumption of this item varies considerably within Kenya. For example, almost 75 percent of households in Mombasa compared to only less than 40 percent in Narok consume ripe bananas even though both counties have a comparable poverty rate of about 17 percent.
Based on the scoring system, households consuming ripe bananas will have a reduced probability of being identified as poor. Thus, the PPI-estimated poverty rate does not always fit the real poverty rate (measured with a representative household consumption survey). The population in Narok consumes less ripe bananas than is expected for households at a poverty rate of 17 percent. Therefore, the PPI-estimated poverty rate over-states the real or official poverty rate by almost 10 percentage points at 27 percent. Another example is Busia where the official poverty rate of 60 percent is underestimated by 15 percentage points at 45 percent. To put this into relation, Kenya needed 10 years to reduce its poverty rate by 7 percentage points. Thus, such a strong bias will make it impossible to measure any realistic changes in poverty.
These are conservative examples because, in addition, the scorecard system increases or reduces the score of households by a certain amount according to their location or county of interview. Thus, the PPI could have - theoretically - been calibrated to perfectly reproduce poverty estimates at the county level (but for statistical reasons related to overfitting this is not necessarily desirable). While I use the county-level as an example here, the problem with the system is more general: There will always be subpopulations for which the poverty estimate is going to be biased - with potentially critical consequences from excluding groups of people or locations from programs.
However, the scorecard (and other methods based on this principle) suffer from an even more fundamental problem, especially if used to evaluate the impact of a program on poverty. It is based on a so-called structural model, which relates responses to the questionnaire with poverty based on observed linkages - for example, between ripe bananas and poverty - at the time of the last household consumption survey. These relationships, however, can change over time, especially if the population is subject to shocks or beneficiaries of projects.
Kenya exports a good proportion of its bananas. If South Africa, for example, suffers a drought reducing its own banana production, it can compensate for this shock by importing more bananas from Kenya. This will increase the price of bananas in Kenya. In turn, producers of bananas will make higher profits, while consumers might substitute bananas in their diet for another fruit or product. This will reduce consumption of ripe bananas in Kenya. If - as an extreme example - no more bananas were to be consumed, the PPI would estimate an increase in poverty by up to 13 percentage points. On average, the estimated increase would be 8 percentage points which is more than the 10-year progress in poverty observed between 2005/6 and 2015/16. However, it's unlikely that such a positive economic shock would actually increase poverty at all.
Here is another example: Imagine we are using the PPI to estimate the impact of an agricultural project. Assume the project works well and improves agricultural productivity for more desirable staple foods than ripe bananas. Therefore, prices of other staple foods will drop, and households would substitute ripe bananas with the now affordable and more desirable staple foods. Thus, consumption of bananas will drop such that the PPI will estimate an increase in poverty as in the previous example, while in reality poverty is likely to have dropped due to the higher incomes of farmers and the decrease in prices.
This is not a specific characteristic of the question on bananas. One can see similar biases for almost all other questions. A project distributing towels to households will lead to a PPI-estimated poverty rate that is lower by up to 14 percentage points (on average: 9 percentage points), even though the real reduction in poverty - if any - is surely less impressive. Similarly, a project that trains beneficiaries to become tailors while distributing sewing machines will increase towels in an area, but probably with a much lower reduction in poverty than estimated by the PPI.
Of course, the PPI scorecard can be adjusted for specific groups or locations, as well as for specific projects to ensure that it is less susceptible to such spurious effects. Given the appeal of the general scorecard to non-technical users, however, many users will not know about the caveats and, thus, may not bother to adjust the card. Even if adapted though, the system will always be subject to biases, which often cannot be foreseen, especially if a project is evaluated over a longer time. Instead of a scoring card-like methodology, new consumption measurement approaches (e.g. the rapid consumption methodology) should be considered as they produce more accurate estimates, so that we can trust the measured poverty impact of a project, and correctly decide, for example, if it should be scaled up.

(Utz Pape, Economist).

Add Rate

News Archive

Inside The New Nation

Editorial »

We need a caring govt: Mere court's directions cannot go far

THE High Court Division on Tuesday directed the government to ensure setting up breastfeeding and baby care corners in the country's all the mills and factories. Most of the working women have to resign from jobs or take an attempt due to unavailability of baby care facilities at workplaces. When ...

Cricket »

Host Australia target fifth title at women's T20 World Cup

Mighty Australia go into their home Twenty20 World Cup this week as overwhelming favourites as they look to cement their superiority in women's cricket and draw a world-record crowd in the process.Meg Lanning's defending champions, and four-time winners, were rarely tested through the second half of 2019 when they whitewashed ...

Entertainment »

Baaghi 3’s new song Bhankas is surely the wedding song

After wowing the audience with the action packed trailer and the groovy number Dus Bahane 2.0, the makers of Baaghi 3 have released the latest song from the movie titled Bhankas. The new track, Bhankas is a remake of Bappi Lahiri’s original song and once again is set to break ...

International »

Sanders hopes early strength will prove he can beat Trump

AP, Las Vegas :Terry Reece has long been skeptical that voters would back Bernie Sanders, a 78-year-old self-described democratic socialist who is just months removed from a heart attack. Then the Vermont senator essentially tied for first place in the Democratic Party's Iowa caucuses and won its New Hampshire primary.That ...

International »

Britain unveils points-based immigration plan

Reuters, London  :Britain will prioritise access for high-skilled workers from around the world in its post-Brexit, points-based immigration system, the government said on Tuesday, setting out its plans to put an end to a reliance on "cheap labour from Europe".Concern over the impact of high levels of immigration from the ...

Editorial »

Food Safety Authority should be more active to root out prime causes of making foods toxic

BANGLADESH Food Safety Authority has found heavy metal presence in 63 samples of pesticide out of 67 tested recently. Some of the pesticides contained one milligram of heavy metal or even more per kilogram or per litre.  Some samples contained all of the three heavy metals: cadmium, chromium and lead. ...

Business & Economy »

Ziaul Hasan Siddique, Chairman of Sonali Bank Limited, presiding over its opening ceremony of a foundation course for newly appinted Senior Officer/Officer at the bank's Staff College in the city recently. Begum Masuma Akter, Principal of the college while DGM, AGM and other senior officials of the bank were also present.

City »

Eminent writer Emdadul Haque Milon giving autograph to children at the Ekushey Book Fair in the city's Suhrawardy Udyan on Tuesday.

City »

Army Chief General Aziz Ahmed speaking at the Regimental Colour awarding ceremony held at the 19 Infantry Division in Ghatail Cantonment on Tuesday.

Entertainment »

Guilty trailer: Sneak peek of Kiara Advani's Netflix film is bleh

The trailer of Netflix film Guilty is out, and by the looks of it, the movie lacks the punch of a thriller. The characters also lack the intrigue which is needed for a movie like this.Kiara Advani is Nanki - a rebellious, silver-haired songwriter who is part of a popular ...

Entertainment »

Tapas Pal passes away

The veteran actor in West Bengal Tapas Paul has passed away of cardiac arrest early Tuesday. He was 61.Recently, he had gone to Mumbai to visit his daughter. During his return to Kolkata, he complained of chest pain at the Mumbai airport and was rushed to a hospital in Juhu ...

International »

Iran sentences alleged US spies to 10 years in prison

AP, Tehran :Iran sentenced eight environmental activists, including an Iranian who reportedly also has British and American citizenship, to prison sentences ranging from four to 10 years on charges of spying for the United States and acting against Iran's national security, the judiciary said Tuesday.According to the judiciary spokesman, Gholamhossein ...

International »

UK Govt adviser quits over race comments

An adviser in British Prime Minister Boris Johnson's office resigned on Monday after online comments resurfaced where he linked intellect to race and seemed to advocate a eugenics policy.Andrew Sabisky once suggested that black Americans had a lower average intelligence than white Americans.He also said in a 2014 web post ...

Sports »

Virat Kohli becomes first Indian with 50 million Instagram followers

LANS :Virat Kohli has become the first person from India to have 50 million followers on Instagram.The captain of the Indian men's cricket team is regarded as one of the best batsmen in the current generation. He has so far 930 posts on the picture-sharing website and is following 480 ...

Football »

Gary Neville expects Manchester City to win appeal against 'hopeless' UEFA

Gary Neville has backed Manchester City to win an appeal against a two-season ban from European competition imposed by a "hopeless" UEFA.European football's governing body announced on Friday that City has been banned from continental competition for two seasons for what UEFA said were "serious" financial fair-play breaches between 2012 ...

Items that you save may be read at any time on your computer, iPad, iPhone or Android devices.
Are you new to our website? Do you have already an account at our website?
Create An Account Log in here
Email this news to a friend or like someone
Write a comment to this news