The GiveWell Blog

Update on how to help Japan: No room for more funding. We recommend giving to Doctors Without Borders to promote better disaster relief in general

The situation in Japan is tragic and worrying, and our hearts continue to go out to those affected and responding.

On Friday, we recommended that donors wait to see how the situation unfolds before giving. At this point we are ready to make a recommendation, though of course this is subject to change as the situation changes.

We believe that

  • Those affected have requested very little, limited aid. Aid being offered far exceeds aid being requested. (Details below.)
  • Charities are aggressively soliciting donations, often in ways we feel are misleading (more on this in future posts).
  • Any donation you make will probably be used (a) by the charity you give it to, for activities in a different country; (b) for non-disaster-relief-and-recovery efforts in Japan.
  • If you’re looking to pursue (a) and help people in need all over the world, we recommend giving to the best charity you can, rather than basing your giving on who is appealing to you most aggressively with images and language regarding Japan.
  • If you prefer (b), a gift to the Japanese Red Cross seems reasonable.

Overall, though, a gift to Doctors Without Borders seems to us like the best way to effectively “respond to this disaster”. We feel they are a leader in transparency, honesty and integrity in relief organizations, and the fact that they’re not soliciting funds for Japan is a testament to this. Rewarding Doctors Without Borders is a move toward improving incentives and improving disaster relief in general.

Donate to Doctors Without Borders
Below, we give the evidence we’ve found that the relief/recovery effort does not have room for more funding.

Because the situation is changing rapidly, we often include archived versions of the pages we link to (these archives will retain their content even if the pages themselves are changed).

Determining room for more funding in a disaster
As argued previously, we think it’s an open question whether a given disaster has room for more funding. Our basic (evolving) process for assessing the needs in a disaster situation is:

  1. First see whether a significant gap exists between requested and pledged/committed aid. Requests for money are, in our view, a necessary (though not sufficient) indicator that there is room for more funding.
  2. Next, collect whatever information is available about the progress of the relief effort, and look for signs that money is or isn’t a primary bottleneck to a better effort. In the case of Haiti, we’ve found signs that non-monetary issues have been primary obstacles to progress.
  3. If it seems that more money is both requested and needed, look at what is being spent, and on how many people, and make an assessment of how this giving compares to everyday relief for the world’s poor. In the case of Haiti and the Asian tsunami, we concluded that relief appeared less cost-effective than everyday international aid. The story might be very different in less-publicized disasters that have more trouble attracting funding.

At this stage, we don’t believe that this crisis passes the first test above. It looks to us like more aid is being offered than requested.

Info from OCHA and ReliefWeb
One of the first places we look in a situation like this is to U.N. Office for the Coordination of Humanitarian Affairs (OCHA), which is “the arm of the UN Secretariat that is responsible for bringing together humanitarian actors to ensure coherent response to emergencies,” as well as its affiliated site ReliefWeb. ReliefWeb is especially useful because in addition to consolidating official updates on an unfolding crisis, it consolidates official appeals for funding. Here’s what we observe from these sources:

Japanese Red Cross
The latest official update from any Red Cross appears to be a March 12 information bulletin from the Japanese Red Cross (archived). This bulletin opens with the following:

This bulletin is being issued for information only, and reflects the current situation and details available at this time. The Japanese Red Cross Society, with the support of the International Federation of Red Cross and Red Crescent Societies, has determined that external assistance is not required, and is therefore not seeking funding or other assistance from donors at this time.

I’m not exactly sure how to square this with the donate page for the Japanese Red Cross (archived), which states:

If you wish your fund to be distributed directly among the affected population of the earthquake and tsunami, please direct your fund to the following bank account. If you need the receipt of your fund, please state so clearly in the comment section of the bank transfer order. All the fund received under this account will be transferred to the Distribution Committee, which is formed around the local government of the disaster-affected prefecture and to administer the distribution of fund.

One possible interpretation is that funds will be given directly to those affected by the earthquake, but funds are not needed for the relief effort itself.

Japanese government
This quote from Reuters (archived) is consistent with the above picture:

Japan’s government has received offers for assistance from 91 countries, and has accepted assistance from about 15 based on assessed needs, mostly for specialized international urban search and rescue (USAR) teams and medical teams.

Charities
Charities seem to be sending a very different message from the above sources. By and large, they seem to be aggressively soliciting donations, and we feel that many are implying these donations will be used in the relief/recovery effort. (Details in a future post.)

However, a close look at the language they’re using reveals that their actual involvement in relief/recovery may be very limited and they are seeking donations for other activities. Gizmodo’s Mark Wilson did a good early analysis of this phenomenon, and a look at the up-to-date descriptions of activities from the Chronicle of Philanthropy (archived) and InterAction (archived) still appears to me to indicate limited involvement, and to be full of language that raises questions about whether involvement is forthcoming. A few examples:

  • “Catholic Relief Services: The organization said Friday it has personnel standing by throughout the pacific, waiting for requests for help from Caritas Japan.”
  • “Oxfam America: The organization’s Web site this morning displayed the headline “Worst Quake in Japan on Record” and asked visitors to donate to its Saving Lives 24/7 Fund.” The Saving Lives 24/7 fund (archived) appears global in focus.
  • “Save the Children: The charity said Friday it is mobilizing people and supplies to respond to the earthquake. The organization has worked in Japan for 25 years. On Saturday, it announced it had partnered with online game company Zynga to add calls to donate in the company’s games. On Sunday, the charity said it has sent an emergency team to assess needs in the worst-affected areas.”
  • ” World Vision: The charity this morning reported that its offices in Indonesia, Papua New Guinea, the Philippines, and the Solomon Islands are on alert to assist in tsunami response. A team is also on standby for possible deployment.”

One notable exception is Doctors Without Borders, which has been completely explicit that it is not seeking funding for Japan relief. Its note on funding for Japan (archived) states

At this point, we are drawing on unrestricted donations given to MSF to fund our efforts, and we are not accepting donations specifically earmarked for recovery efforts in Japan. We greatly appreciate your generosity and encourage your support of our work. We will continue to post updates on our homepage, Facebook, and Twitter as new information becomes available.

Many other organizations may also be soliciting donations only for global efforts, but Doctors Without Borders has the most clear and explicit note that we’ve seen.

On Friday, we stated that “we prefer Doctors Without Borders … because of its past decision to stop accepting donations for Haiti relief; this greatly reduces the risk in our eyes that it will over-solicit, a very important concern in this case.” It appears that Doctors Without Borders has, in fact, not over-solicited.

This may cause Doctors Without Borders to raise less money in this disaster, but we’re hoping at least some donors will reward it.

The bottom line
I wouldn’t want anyone to take this post as an argument that (a) the situation in Japan is anything other than extremely tragic and extremely challenging; (b) you shouldn’t give to charity.

My interpretation, rather, is that

  • the people and government of Japan are extraordinarily well-prepared, as well as competent and well-resourced, and do not need significant external assistance in order to mount a maximally effective relief and recovery effort.
  • Therefore, you as a donor do not have the power to improve the relief and recovery effort in Japan. If you do give, your gift will probably be used (a) by the charity you give it to, for activities in a different country; (b) for non-disaster-relief-and-recovery efforts in Japan.
  • Of the above two possibilities, I find (a) more appealing, because Japan is a wealthy country and everyday needs are greater elsewhere. But if you’re looking to pursue (a) and help people in need all over the world, I’d highly recommend giving to the best charity you can, rather than basing your giving on who is appealing to you most aggressively with images and language regarding Japan.
  • If you prefer (b), a gift to the Japanese Red Cross seems reasonable.

Overall, though, a gift to Doctors Without Borders seems to me like the best way to effectively “respond to this disaster”. We feel they are a leader in transparency, honesty and integrity in relief organizations, and the fact that they’re not soliciting funds for Japan is a testament to this. Rewarding Doctors Without Borders is a move toward improving incentives and improving disaster relief in general.

Others with similar sentiments

Japan earthquake/tsunami relief donations

Japan has been hit by a devastating earthquake and tsunami, and our hearts go out to those affected and responding.

Charities have been quick to solicit funding for the relief/recovery effort. Here we present our recommendations to donors, both in terms of which charities should be preferred and in terms of whether giving to this relief effort is a good opportunity overall.

At this point we strongly recommend holding off on giving to this relief/recovery effort. We believe that money isn’t a cure-all, and that there can be such a thing as an “overfunded” relief effort even in a devastating disaster. We don’t know yet whether that is the case with Japan, but we believe that the next few days will bring valuable information about it (and we will be providing updates in this space). We also believe that waiting a few days will not diminish the impact of your donations.

Where should you give? Lessons from Haiti

Over the last year, we’ve been examining the responses of major relief organizations to the 2010 Haiti earthquake. Our report grades these organizations on their transparency; the ones that stand out most are Direct Relief International, Doctors Without Borders and Partners in Health. Of these three, the first two appear to be responding to the Japan events (see these links for Doctors Without Borders and Direct Relief International).

Therefore, for donors determined to give to Japan relief/recovery, our top recommendation goes to Doctors Without Borders, followed by Direct Relief International. The reason we prefer Doctors Without Borders is because of its past decision to stop accepting donations for Haiti relief; this greatly reduces the risk in our eyes that it will over-solicit, a very important concern in this case (see immediately below).

We have also done substantial work assessing the overall spending and progress of the Haiti relief/recovery effort, and we feel that it provides an illustration of the fact that

Why Japan is different

This disaster is very different from other recent headline-making disasters. The 2005 Asian tsunami and 2010 Haiti earthquake took place in very poor countries; by contrast, Japan is a very wealthy country, with the 2nd- or 3rd-biggest economy in the world and per-person income in the same ballpark as that of the U.S.

This matters for several reasons.

  • Much better infrastructure and fewer logistical challenges. The The New York Times reports that

    Over the years, Japan has spent billions of dollars developing the most advanced technology against earthquakes and tsunamis. The Japanese, who regularly experience smaller earthquakes and have lived through major ones, know how to react to quakes and tsunamis because of regular drills — unlike Southeast Asians, many of whom died in the 2004 Indian Ocean tsunami because they lingered near the coast despite clear warnings to flee.

    This factor could cut both ways for donors. Facing fewer challenges could mean needing less money to respond and rebuild; however, it could also mean that there’s more of what we call room for more funding. (In the case of Haiti, logistical hurdles appear to have created many non-monetary bottlenecks to relief and recovery, as discussed above.)

  • Relief agencies are unlikely to have a strong existing local presence, and we find a local presence less relevant in general. From what we’ve seen major relief organizations (including the ones we recommend) do not have substantial existing presences in Japan, as they focus on working in less wealthy countries. Due to the likely smaller logistical challenges, we don’t think this should be a major factor in donors’ decisions.

  • There may be some challenges that are quite different from those seen in less wealthy countries, such as keeping nuclear reactors under control.
  • Most importantly, this relief effort will probably be far better-funded than those in less wealthy countries. We expect to have more specifics about this in the coming weeks, possibly even days.

Our advice: hold off for now

We believe that the vast majority of disaster relief funding is spent well after the initial crisis (example: Haiti). We also believe that the coming weeks (possibly days) will bring better information about the size of the need and the funds available to meet it. We will be posting any updates on the situation here.

For more advice, see Good Intentions are Not Enough. We particularly agree with the recommendations to (a) refrain from showing up as a volunteer; (b) give cash, not goods.

Your dollars at work: Update on top-rated charity VillageReach

VillageReach is the first (hopefully not the last) charity for which (a) GiveWell has raised enough money to make a qualitative difference in VillageReach’s activities; (b) GiveWell has a clear enough picture of the room for more funding situation to be able to say with some confidence what that difference is.

We intend on providing periodic (aiming for quarterly) updates on VillageReach’s (a) progress in its Mozambique expansion, for which unrestricted funds have been sought; (b) revenue, projected expenses, and room for more funding.

We have posted the first such update to the Updates on VillageReach page. In a nutshell:

  • Currently, VillageReach is active in Cabo Delgado, Niassa and Maputo, and VillageReach has provided a 6-month assessment and baseline vaccination coverage survey for Cabo Delgado.
  • The overall expansion is substantially behind the schedule set out in July 2010 (on time in Cabo Delgado but 6-12 months behind for other provinces) for funding-related reasons (though revenue in 2010 closed the entire “stretch funding gap” for the year, the vast majority of that revenue was not received or anticipated until December).
  • In Cabo Delgado, data collection appears to have improved, but there are not yet other signs of improvement in the health system’s performance. This is consistent with the expected trajectory of VillageReach’s 3-year involvement in a province, and we do not find it to be a major cause for concern.
  • There has been a global supply disruption in a key vaccine that is expected to be resolved by the third quarter of 2011.
  • VillageReach had a total of about $2 million in unrestricted revenue in 2010, of which a little over $1 million can be attributed to GiveWell’s recommendation.
  • We believe that this $1 million has been key to VillageReach’s being able to plan to expand its program into the provinces of Gaza and Inhambane.
  • We believe that VillageReach has a total funding gap of about $3.6 million remaining for this project. Taking into account expected revenue from non-GiveWell-related sources leaves about $1.4 million in room for more funding. These funds would allow it to proceed as quickly as possible with its full 8-province expansion plan.

The news is not all good. The global supply disruption is a major concern for us, and a reminder of how any attempt to help can be held up by circumstances beyond one’s control. VillageReach’s reports also reveal a problem with the flow of funds between a funder and the government, and make it quite clear that there has not yet been any noticeable improvement in health system efficiency (though there has been an improvement in data collection, and this is arguably what should be expected at this stage in the project).

Overall, though, we feel better about VillageReach than we did 3 months ago because we feel we continue to have a window into the true – not stylized – impact that GiveWell-related funds are having. In our view, one of the most problematic things about charity is that people purchase something but never get to fully understand what they purchased, so the feedback loops that lead to continuous improvement in most markets are broken. This is the first case we know of where individual donors can expect to get full and frequent updates on the impact of their donations (not just how their donations were spent), and is thus a first step toward improving those feedback loops.

Evaluating GiveWell by finding the best charity

One of the challenges of GiveWell is evaluating the quality of our own research. There are no accepted standards of what charity recommendations should be or how they should be assessed.

Over the last year, we’ve been developing a method for self-evaluation based on structured writeups from people external to GiveWell (i.e., people who are not donors, Board or staff). Some of these people are early-stage volunteers with GiveWell; asking them to review us in this way gives us both valuable feedback and a window into how they think. Other reviewers have been recruited by us because their opinions seem particularly relevant due to their backgrounds (for example, Laura Freschi of Aid Watch). The goal here isn’t to produce a quantitative “score” for our research, but rather to provide some in-depth and credible outside perspectives that our audience (and we) can react to as we choose.

In most cases, the reviewer is asked to answer a very specific set of questions about a specific subset of our content: our overview of a particular issue such as developing-world education or HIV/AIDS, our heuristics for identifying promising charities, the fairness of how we’ve applied these heuristics, or our writeups on particular charities. Put these four areas together and you have our entire process for recommending charities.

However, we’ve also been experimenting with a broader approach that asks the reviewer to evaluate the whole of GiveWell’s value at once: finding the best charity to donate to within a set period of time, with no requirement that they use GiveWell to do so. We provide the reviewer with a list of all online resources we know of, including but not limited to GiveWell, and encourage the reviewer to do whatever it takes to get the best answer (including searching independently for information and calling charities directly).

We’ve run this “Finding the Best Charity” project a couple of times with volunteers, but the most recent posting is particularly interesting for a couple of reasons:

  • The reviewer was Tobias Pfutze, an Assistant Professor of Economics who co-authored a paper rating official aid agencies with William Easterly.
  • We took the project out of the hypothetical and into the real by offering a $2,500 donation to the charity of Prof. Pfutze’s choice, in exchange for the time (about 10 hours) he spent on the review. This donation was funded by Dario Amodei. Thus, this project literally represented Prof. Pfutze’s best attempt at allocating $2,500 to accomplish good.
  • Prof. Pfutze chose a charity, Living Goods, that GiveWell does not recommend – though he did find this charity through GiveWell’s website.

Prof. Pfutze’s submission is available here. It includes a paraphrased transcript of a follow up conversation we had with him, exploring our areas of agreement and disagreement.

Overall we found this project very interesting and valuable. On one hand, Prof. Pfutze was clear that he “found Givewell to be by far the most helpful website,” that he agreed with the bulk of our criteria and conclusions, and that he found our recommended charities to have strong cases behind them. On the other, he came to a substantially different conclusion from us.

It appears that he placed a substantially higher weight on the “upside” of the donation – what the project would accomplish if it went as well as possible – and in particular, on the project’s model for achieving sustainability. He found Living Goods promising because it both (a) is aiming for a highly sustainable, lasting impact; (b) gains some credibility from its ongoing evaluation in partnership with Poverty Action Lab.

We remain in disagreement with this conclusion, but think his position is defensible, well-argued and thought-provoking.

We encourage interested readers to check out his full submission including the follow-up dialogue with GiveWell. We’ve found this “Finding the Best Charity” assignment to be valuable and interesting, and we are hoping to use this same format to get more feedback in the future.

GiveWell’s plan for 2011: Specifics of research

This is the fifth post (of five) focused on our self-evaluation and future plans.

A previous post outlined our top-level priorities for 2011. The most important priority is finding more top charities. This post lists our potential tactics for finding top charities; we are particularly interested in feedback on this topic.

These tactics are listed in order from “closest to our existing methodology; most likely to succeed” to “furthest departure from our existing methodology; most likely to take a lot of time before we can identify outstanding organizations.”

Tactic 1: deep investigations of charities with distinction.

We have a list of charities that have some form of distinction. This includes

We haven’t found sufficient information on these charities’ websites to recommend them, and based on past experience, this makes us pessimistic. However, we have begun the process of prioritizing how promising the different charities are; we will be contacting the most promising ones, interviewing staff, and thinking about the minimum information we would need to confidently recommend them. More so than in the past, we can now point to significant impact of our recommendations on donations, so we expect better access to these charities than in the past.

Tactic 2: investigating “low burden of proof” sub-causes in international aid

In the past, we’ve looked for direct evidence of charities’ impact on improving lives. As we’ve gotten more context and experience with international aid, however, a couple of causes have stood out to us as particularly recommended/promising, to the point where we may be able to be confident in a charity without the sort of impact assessment we’ve sought in the past.

  • Orphans and vulnerable children: some charities provide homes, shelters, and other basic services for children who otherwise might be homeless, sleeping on the street, or even taken in by those who exploit them. By speaking with the right people, we may gain an understanding of where and when there are needs for these sorts of organizations to expand, resulting in more children having safe homes/shelters who would not otherwise.
  • Water: if we found a charity that was demonstrably improving access to clean water, in a way that (a) benefited communities with very poor previous access to water (b) lasted over time (we are very concerned about wells being put in and falling into disrepair), we might recommend such an organization without direct evidence of improved health outcomes.

Tactic 3: investigating other promising causes

As mentioned previously, we’re experimenting with a method for quickly getting a high-level picture of a charitable cause and how likely it seems that we could find top charities in this area. By investigating particularly promising causes, such as disease research funding and catastrophic risk mitigation (including but not limited to global warming), we might be able to find more outstanding opportunities for donors.

We will certainly be pursuing this tactic, but feel it is less likely to generate top charities in 2011 than the tactics above.

Tactic 4: project funding.

We have always aimed to find great organizations and recommend unrestricted donations to them, rather than funding particular projects. This is partly because we think traditional donation restricting is unreliable; partly because we think project-based funding adds harmful complications (particularly the fact that the donor’s and charity’s goals aren’t fully aligned); and partly because, in the past, we have had so little sense of how much money (if any) our top-rated charities could expect to raise.

But if we can’t find more charities that focus – at the overall organizational level – on proven, cost-effective, scalable programs, we will open the doors to large organizations offering promising projects, and potentially recommend that donors give to these organizations with specific designations (“Use this donation for project X”).

If we go down this path, it will become essential to have concrete expectations for what will be implemented – and what will be measured and reported – at different levels of funding. (Projects also ought to be based, to the maximum extent possible, on programs that have worked in the past.) The fact that we now have a track record of moving money to top-rated charities makes this option more feasible than it was before.

We’d like to avoid project-based funding, and even if we do implement it, we’ll be keeping an eye out for organizations that we can recommend for unrestricted funding. The latter will always take precedence.

We think this tactic is promising in the long run, but unlikely to generate “gold medal” opportunities in the short run because of the difficulties we’ve had (and expect to have) communicating with grantwriters.

GiveWell’s plan for 2011: Top-level priorities

This is the fourth post (of five) we’re planning to make focused on our self-evaluation and future plans.

In previous posts, we discussed the progress we’ve made, where we stand, and how we can improve in core areas. This post focuses on the latter, and lays out our top-level strategic choices for the next year.

Broadly, we see the key aspects of GiveWell – the areas in which we can improve – as

  • Research vetting: subjecting our existing research to strong, critical scrutiny from people with substantial relevant experience and credentials.
  • Research maintenance and systemization: keeping our research up-to-date and high-quality, while training junior staff to maintain it.
  • Research expansion: actively seeking more charities to recommend.
  • Marketing: increasing our “customers” reached and money moved.
  • Fundraising/operating: maintaining the organization.

(These are broadly similar to last year’s areas for improvement.)

Our top priorities for this year are:

  1. Research expansion. As discussed previously, we have an urgent need to find more top charities so that we can productively move more money. It would be a major problem for GiveWell if we essentially had more demand for our research (i.e., donors interested in following our recommendations) than supply (i.e., charities able to absorb this funding effectively).We aim to find at least $3 million in room for more money moved, i.e., gold-medal charities that can collectively absorb at least $3 million very effectively. Finding more top charities could be very challenging and require large allocations of time from both junior and senior staff.
  2. Fundraising – as discussed in the overview of our financial situation, we have expanded our staff while seeing a couple of large sources of revenue fall off. Raising more money in 2011 will be necessary in order to maintain our operations at optimal size.We aim to raise our annual revenue from around $200,000 to around $400,000 (if we do not make it all the way to $400,000 we will cut some staff going into 2012, as outlined in our overview of our financial situation). I (Holden Karnofsky) will be taking primary responsibility for this task, and expect it to take a fair amount of time.

Other key priorities are:

  1. Research maintenance and systemization – all our research will need to be updated this year (as it is every year). We expect this work to be done primarily by junior staff.
  2. Research vetting – we believe there is substantial room for improvement in our testimonials and external reviews of our research. We expect to make improvements with relatively little investment of our time, since our process for getting testimonials and reviews is already in place.
  3. Marketing – we expect to pursue most of the ideas we listed previously for expanding our reach, with moderate time cost.
  4. High-level research of new causes – we’re experimenting with a method for getting a high-level picture of a charitable cause, without getting to the most time-consuming step of evaluating specific charities. The idea is to take a given cause – for example, global warming mitigation – and get a basic sense of what information is available, what cost-effectiveness estimates say about what can be accomplished for how much, what the key questions are for organizations, and how likely it seems that we could find top charities in this area. We hope to do high-level research on a few particularly promising causes, laying the groundwork to find more top charities in the future.