The GiveWell Blog

Response to concerns about GiveWell’s spillovers analysis

Last week, we published an updated analysis on “spillover” effects of GiveDirectly‘s cash transfer program: i.e., effects that cash transfers may have on people who don’t receive cash transfers but who live nearby those who do receive cash transfers.((For more context on this topic, see our May 2018 blog post.)) We concluded: “[O]ur best guess is that negative or positive spillover effects of cash are minimal on net.” (More)

Economist Berk Özler posted a series of tweets expressing concern over GiveWell’s research process for this report. We understood his major questions to be:

  1. Why did GiveWell publish its analysis on spillover effects before a key study it relied on was public? Is this consistent with GiveWell’s commitment to transparency? Has GiveWell done this in other cases?
  2. Why did GiveWell place little weight on some papers in its analysis of spillover effects?
  3. Why did GiveWell’s analysis of spillovers focus on effects on consumption? Does this imply that GiveWell does not value effects on other outcomes?

These questions apply to GiveWell’s research process generally, not just our spillovers analysis, so the discussion below addresses topics such as:

  • When do our recommendations rely on private information, and why?
  • How do we decide on which evidence to review in our analyses of charities’ impact?
  • How do we decide which outcomes to include in our cost-effectiveness analyses?

Finally, this feedback led us to realize a communication mistake we made: our initial report did not communicate as clearly as it should have that we were specifically estimating spillovers of GiveDirectly’s current program, not commenting on spillovers of cash transfers in general. We will now revise the report to clarify this.

Note: It may be difficult to follow some of the details of this post without having read our report on the spillover effects of GiveDirectly’s cash transfers.

Read More

New research on cash transfers

Summary

  • There has been a good deal of discussion recently about new research on the effects of cash transfers, beginning with a post by economist Berk Özler on the World Bank’s Development Impact blog. We have not yet fully reviewed the new research, but wanted to provide a preliminary update for our followers about our plans for reviewing this research and how it might affect our views of cash transfers, a program implemented by one of our top charities, GiveDirectly.
  • In brief, the new research suggests that cash transfers may be less effective than we previously believed in two ways. First, cash transfers may have substantial negative effects on non-recipients who live near recipients (“negative spillovers”). Second, the benefits of cash transfers may fade quickly.
  • We plan to reassess the cash transfer evidence base and provide our updated conclusions in the next several months (by November 2018 at the latest). One reason that we do not plan to provide a comprehensive update sooner is that we expect upcoming midline results from GiveDirectly’s “general equilibrium” study, a large and high-quality study explicitly designed to estimate spillover effects, will play a major role in our conclusions. Results from this study are expected to be released in the next few months.
  • Our best guess is that we will reduce our estimate of the cost-effectiveness of cash transfers to some extent, but will likely continue to recommend GiveDirectly. However, major updates to our current views, either in the negative or positive direction, seem possible.

More detail below.

Read More

Cash transfers vs. microloans

We’ve written that people in the developing world can get very high returns – in excess of 20% annually (and sometimes much more) – on cash transfers. We’ve previously argued that this is both plausible and empirically supported. However, it raises the question: “If people in the developing world can get such good returns on…

Read More

The case for cash

Our choice to name GiveDirectly as our #2 charity has drawn some surprise and criticism. GiveDirectly seeks to deliver 90c directly into the hands of the very poor (no strings attached) for every $1 of total organizational expenses. There are many people who consider this intervention “unproven” (since there is not research linking cash transfers…

Read More

Cost-effectiveness of nets vs. deworming vs. cash transfers

Update 12/5/2014: we update our cost-effectiveness models annually. The most up-to-date versions can be found here.  This post discusses how we see the relative “bang-for-the-buck” – good accomplished per dollar spent – of three interventions: Distribution of insecticide-treated nets to fight malaria, the intervention carried out by our #1 charity (the Against Malaria Foundation). Unconditional direct…

Read More

Evidence of impact for long-term benefits

We’ve recently published our updated review on the evidence on cash transfers. It elaborates on a claim we’ve made previously – that there is evidence for long-term benefits from cash transfers at high average rates of return. Some people have expressed skepticism of this evidence, pointing to several limitations: there are not many studies, some…

Read More