The GiveWell Blog

Flow-through effects

As mentioned previously, we believe that further economic development, and general human empowerment, is likely to be substantially net positive, and that it is likely to lead to improvement on many dimensions in unexpected ways. This post elaborates on the reasons we hold this view and the implications of it.

We haven’t done nearly as much empirical research on whether this view is appropriate as we would ideally like to, and in the future we may approach it with a more concerted research effort. For now, we’d point to the following as broad defenses of this view:

  • Since the Industrial Revolution, it appears that quality of life has improved in nearly every measurable way. A simple illustration of this idea comes from a brief recent post we made showing broadly rising per-capita income and falling infant mortality in the developing world. A more thorough discussion is available in chapter 2 of From Poverty to Prosperity by Arnold Kling and Nick Schultz, from which we’ve excerpted the key tables. (Note that this chapter isn’t our “primary source” for this claim; we have picked up various perspectives on this question from GapMinder, general discussions, etc. and point to this chapter merely as a relatively accessible summary.) The Better Angels of Our Nature, a relatively recent book by Steven Pinker, provides a deeper and narrower investigation of the effect of these changes on violence.
  • The developed world appears to be better off than the developing world on nearly every metric we can think of, such as life expectancy and reported happiness, nutritional status (particularly for children), civil rights and human rights, and education (including for women and girls in particular).
  • In the past, there have been many concerns about new technology making the world worse in some way, but these generally don’t seem to have panned out. For example, sulfur dioxide emissions, which cause acid rain, spiked during the mid 20th century in the U.S. but now are at much lower levels, along with most other pollutants in the U.S. Persistent worries about the mass unemployment effects of automation also appear not to have panned out, though they continue to be raised.

    We don’t believe that avoidance of modernity-related problems can be taken for granted. In many cases it may take place because of concerted efforts to improve regulation and societal norms, and such concerted efforts may be needed to deal with various issues today. However, we also think it’s worth noting that concerted efforts to make the world a broadly better place seem to have become more common and more viable as economic development has progressed. Environmentalism, multiple civil rights movements, and large-scale foreign aid are examples of positive social changes that have emerged in the last two centuries and appear stronger in the developed world than in the developing world today. We’d guess that increased wealth and improved technology often improves people’s ability to coordinate around, and concentrate on, movements whose effects go beyond their personal lives.

  • One of the most compelling cases for a way in which development and technology can cause harm revolves around “global catastrophic risks” such as climate change and nuclear war. However, from where we sit today, improved technology and economic development seem at least as likely to play a major role in mitigating these risks (via e.g. cleaner energy sources and more efficient overall economic activity to mitigate climate change, and greater economic interdependence and more effective security to mitigate military threats) as to worsen them. We will write further on this point in the future. It may be true that we would be safer from global catastrophic risks if we had never had any economic/technological development, but a faster rate seems safer than a slower rate from here.

We wish to note that we do not embrace the explanations for improvement sometimes associated with observations such as the ones above, explanations that often focus on the role of free markets to the exclusion of other institutions. We believe much of the improvement we describe may be attributable to the actions of governments, activist movements, and voluntary altruism (including philanthropy) as well as economic exchange. We believe that the exact dynamics by which the world has improved aren’t fully clear. My own take is that the concept of broad market efficiency is important here: as people become wealthier, better informed about each others’ activities, and generally gain more abilities and options, they become more empowered and motivated to tackle problems that they previously wouldn’t have been able to work on (or would have viewed as less pressing than other problems). To give a simple example, whatever good GiveWell does will be creditable partly to the huge number of other world improvements that have (a) given us the wealth and security to start a new venture; (b) given us education and tools to do our investigations; (c) addressed other problems that might have occupied our attention instead; (d) produced technology to run our lives and organization efficiently and find our audience (who themselves have similarly benefited).

If our overall view on this topic is broadly correct, it has some important implications.

First, it implies that a substantial part of the good that one does may be indirect: the people that one helps directly (by e.g. funding distribution of bednets) become more empowered to contribute to society, and this in turn may empower others, etc. If one believes that, on average, people tend to accomplish good when they become more empowered, it’s conceivable that the indirect benefits of one’s giving swamp the first-order effects.

If true, this is yet another source of noise (beyond the many we’ve identified) in formal cost-effectiveness estimates, and another reason not to take these estimates literally. It also implies that helping people who are well-positioned to contribute to society and/or help others is particularly valuable, relative to e.g. simple reduction of suffering for people who are not well-positioned to help others.

Second, it implies that helping to address any problem is a possible path to addressing many other problems. For example, if one’s only goal is to improve women’s education, it’s conceivable that the best option for doing so is to fund distribution of bednets (and if one’s only goal is malaria control, it’s conceivable that the best option is to fund women’s education).

Thus, even if one is convinced that a particular issue is the “most important” one to work on, this doesn’t by itself establish that one should directly fund or work directly on this issue. The nature of one’s practical opportunities matters greatly. If issue X appears to be of paramount importance, but issue Y has far more appealing giving opportunities for reasons related to room for more funding, one should consider donating toward issue Y.

Of course, a strong project aimed at the “right” problem is likely to have more impact than a strong project aimed at the “wrong” problem, but this isn’t always the choice that a donor faces (particularly a low-information individual donor). The details of what opportunities one has on each front are crucial.

So far, GiveWell has focused on the “easiest” interventions to have confidence in, figuring that being confident of accomplishing some substantial good is better than giving in an uninformed way, even if the latter is aiming at a cause that seems more important than global health. Going forward, we expect to be able to assess other ways of giving, from funding political advocacy to funding scientific research. But we expect to continue to put a substantial weight not just on the importance of an issue but on its tractability and its room for more funding.

Update on GiveWell’s web traffic / money moved: Q1 2013

In addition to evaluations of other charities, GiveWell publishes substantial evaluation on itself, from the quality of its research to its impact on donations. We publish quarterly updates regarding two key metrics: (a) donations to top charities and (b) web traffic.

The table and chart below present basic information about our growth in money moved and web traffic in the first quarter of 2013 (note 1).

Summary statistics: Q1

Growth is at a slower pace than in 2012 (note 2). This may largely be a function of the fact that we are now growing from a larger base from which we can no longer expect percentage increases of the scale we’ve had in the past. Another possibility is that we’re reaching a “saturation point” and growth will now slow significantly. Our arithmetic growth has slowed slightly over the past year, though it is roughly consistent with what it was at this point last year; this is especially true when we consider changes in our ability to measure donations each year.

We believe that some of the apparent slowing in money moved growth is due to better measurement in 2012 than in either 2011 or 2013. We are able to most completely and quickly track donations that (a) go to GiveWell for the support of our top charities; or (b) go directly to AMF (AMF asks donors at the time of donation whether they gave due to GiveWell and immediately makes that information available to us). In early 2011, the majority of donations went directly to VillageReach. In early 2012, the majority of donations went to AMF and to GiveWell for the support of SCI; we were able to track all of these donations when they were given. In early 2013, we had a third charity, GiveDirectly, receiving (we believe) a significant portion of donations directly.

A caveat to all of the above is that this is based solely on small donors. While in the past we’ve seen that growth in small donors earlier in the year provides an indication of overall growth at the end of the year, because a significant proportion of our money moved comes from a relatively small set of large donors, we don’t place significant weight on this projection.

Website traffic tends to peak in December of each year (circled in the chart below). Growth in web traffic has generally remained strong in 2013.


Note 1: Since our 2012 annual metrics report we have shifted to a reporting year that starts on February 1, rather than January 1, in order to better capture year-on-year growth in the peak giving months of December and January. Therefore metrics for the first quarter of 2013 reported below are for February through April.

Note 2: The majority of the funds GiveWell moves come from a relatively small number donors giving larger gifts. These larger donors tend to give in December, and we have found that, in past years, growth in donations from smaller donors throughout the year has provided a reasonable estimate of the growth from the larger donors by the end of the year.

In total, GiveWell donors have directed $604,862 to our top charities this year, compared with $555,749 at this point in 2012. For the reason described, we don’t find this number to be particularly meaningful at this time of year.

Unorthodox Prize

A couple of years ago, an anonymous family foundation launched a call for “extraordinary and unorthodox” philanthropic opportunities. We wrote critically about this at the time, but the winner of the contest turned out to be GiveDirectly (currently our #2 charity), which received its initial funding from the contest. We’ve since had some interactions with the funder, and we’ve been impressed with its thinking and with its broad interest in doing as much good as possible. (The funder has also been supportive of GiveWell in terms of contacts and has expressed potential interest in funding us directly, though no direct funding has occurred to date.)

The funder is now holding another contest with a similar aim to the previous one: to “identify and support one new great idea” that “can improve the lives of the world’s most disadvantaged people.”

We’ve played with the idea of a similar contest ourselves, with the hope of unearthing giving opportunities that fall outside “traditional” causes. To date we haven’t felt that holding such a contest would be the best use of our capacity, but we’d like to do what we can to support such a contest when another organization is holding it. Therefore, we’re publicizing this contest via our blog.

If you have – or know someone who has – an extraordinary and unorthodox idea for improving the lives of the world’s most disadvantaged people, please consider submitting it to the Extraordinary and Unorthodox Prize (and contacting us with it as well).

Broad market efficiency

It’s common to debate how “efficient” financial markets are. Broadly speaking, an “efficient” market is one in which the participants are quick to spot profit-making opportunities, so that prices quickly adjust to reflect available information and it’s very difficult for an outsider to “beat the market,” i.e., consistently earn outsized returns. (If one is interested in more details, I recommend searching for discussions of the “efficient-market hypothesis.”)

Not all opportunities to accomplish good are opportunities to make money. Yet I believe that it’s useful to use a similar concept in the world of philanthropy – to speak of a “broad market” in which people are rewarded (though not always financially) for accomplishing good, and in which we therefore have some reason to expect that (a) the “easiest” opportunities for accomplishing good will get funded and carried out without our help; (b) finding opportunities to do good that aren’t already funded will be challenging.

The question of how efficient the broad market is (and how its efficiency varies from domain to domain) seems to me like a crucial one, and it is a question that we are constantly debating and looking for new information on. It’s equivalent to the question of how effective the world as it exists today is at “scooping up opportunities to do good,” and thus how difficult we should expect it to be to find outstanding such opportunities. When we started GiveWell, the seemingly low quality of dialogue around giving led me to expect extremely low efficiency; over the years, I’ve substantially (though not overwhelmingly) raised our estimate of how much “efficiency” already exists.

The remainder of this post will:

  • Discuss why I’ve raised my estimate of “broad market efficiency” and what my current working view is.
  • Elaborate on why one’s estimate of “broad market efficiency” is important.

First, a point of clarification. I generally view “market efficiency” as a spectrum: the more efficient a particular market is, the higher the level of intensity and intelligence around finding good opportunities, and therefore the more intelligent and dedicated one will need to be in order to consistently “beat the market.” The most efficient markets can be consistently beaten only by the most talented/dedicated players, while the least efficient ones can be beaten with fairly little in the way of talent and dedication. This way of discussing market efficiency contrasts with the “Are markets efficient, yes or no?” approach that some others take to the question.

How efficient is the “broad market?”
When we started GiveWell, my basic picture of the world was that

  • For-profit markets are relatively efficient. Therefore, if there’s an opportunity to do good that’s also an opportunity to make money, it’s very likely that someone will seize on this opportunity relatively quickly.
  • Nonprofits accomplish good as well, but in the nonprofit world, funding almost exclusively chases “good stories” rather than good ideas. Therefore, there ought to be many opportunities to accomplish enormous amounts of good via nonprofit activities with a strong analytical case but no competitively compelling emotional pitch.

I still hold both these views to a degree, but several observations have complicated the picture for me.

  • As we recently wrote, it appears that the most proven cost-effective interventions are often able to attract funding from major funders. While I do believe we’ve found some places in which more money is needed to deliver more proven cost-effective interventions, doing so has been far more difficult than I expected.And while I believe there exist good opportunities to fund more research and strengthen health systems (which could lead to more opportunities to fund delivery of proven cost-effective interventions), I also have not seen a large amount of obvious low-hanging fruit (outstanding, unfunded giving opportunities) in these areas. In particular, many of the interventions whose effects are easiest to study are the ones that have already been fairly well studied; to create good research on other interventions could be much more difficult. I believe there are exceptions to this pattern, but that it does hold as a general pattern.
  • In 2012, we developed an interest in meta-research that grew out of our experiences reviewing evidence, and we noted at the time that we couldn’t identify any major foundations working in this area (based on our review of major foundations). We saw this as a promising but potentially ignored area. However, the more we investigated it and got involved in it, the more we saw that there are already many movements afoot that can be categorized as “meta-research” – and several major funders that are interested specifically in this area. Furthermore, it often appears to be the case that “meta-research projects” get funded by funders who don’t explicitly focus on “meta-research,” but instead focus on the field in question. (A future update will give more details on this.)The other funders focused on meta-research are roughly as new to the area as we are; we have uncovered some ideas that may qualify as “promising and un-funded”; and I still have the intuition that this is an extremely promising and under-resourced area. But it’s instructive that our best guess for a “promising but ignored” area turned out to have a non-negligible amount of interest from funders, once we looked more closely.
  • We’ve also seen various “global catastrophic risks” highlighted to us as causes that are highly likely to be neglected, because the scenarios in question are highly “farfetched” and low-probability, and philanthropic investments are unlikely to pay off in any tangible way. Thus, it seems that funding these causes might require a highly analytical and genuinely altruistic bent. We’ve done some light investigation of global catastrophic risks, and have found some substantial activity on some of the more “farfetched” ones. For example, on asteroid impacts, tens of millions of dollars are being spent on asteroid detection and the expected lives lost due to such impacts has reached a fairly low level. On threats from epidemics, bioterrorism and other biological threats, the Alfred P. Sloan Foundation ran a program (archived link) for several years in this area, and reports having closed the program after seeing substantial increases in government funding (as a side note, we don’t find its causal attribution compelling): 
      “Sloan’s Biosecurity Program has been very successful in bringing attention to the issues and challenges posed by biological threats. When our program began in 2000, the US government funding for strictly biodefense was approximately $50 million. The FY2010 budget is $1.09 billion.”

     

     

  • We’ve generally struggled to find proposals for projects that are fully fleshed out and immediately compelling, yet un-funded. We believe this is largely because of the dynamics of the philanthropic sector in which proposals tend to be written only after there is strong interest from a funder, but in a less efficient “broad market” we’d have expected to find some strong, exhaustively argued yet un-funded proposals by now.
  • In general, in interacting with major foundations (such as the Bill and Melinda Gates Foundation, Hewlett Foundation, CIFF and Open Society Foundations), we’ve encountered many program officers whom we perceive as well-informed, genuinely altruistic, and relatively analytical in their approach. It’s difficult to evaluate the quality of these people’s work, but they certainly don’t fit the stereotype of the “story-oriented donor.”

In general, it seems nearly impossible to find a promising area or idea that is completely ignored (though many may be underfunded relative to other areas and ideas).

It seems to me that there is a real sense in which people are “rewarded” nonfinancially for working on something with high altruistic value – whether through recognition from others, through pride in doing well at the job they’ve been hired for, or of course through altruism – as well as a real sense in which people are drawn toward areas that they perceive as neglected (foundation staff have cited the latter factor to us in many discussions). Even without any particular person taking a bird’s-eye view of the philanthropic world and making analytical, strategic calculations to find the most under-explored causes, an ecosystem with a large number of people who have various drives toward altruism and toward working on what’s neglected can be expected to produce some degree of “broad market efficiency” – a tendency to find and execute on the most outstanding and neglected ideas.

I am not saying that “all the good giving opportunities are taken” or that “philanthropic capital is allocated as well as it could be” – I very much don’t believe that. I believe that a great deal of giving is done with very little thought and goes to causes that are far inferior to the best ones out there; I believe that strategic cause selection is itself a neglected approach, and that it will lead to far more impact than we could achieve otherwise. Even if (as isn’t necessarily the case) the best $10 million worth of funding opportunities for a given cause are already funded, funding the next $10 million down in the most promising causes (as opposed to causes chosen with little reflection) could have enormous value. In addition, I believe that looking at existing giving opportunities doesn’t tell you the full story about a cause’s potential (as discussed previously), and raising the profile of the more important causes could generate outstanding giving opportunities that haven’t yet been surfaced.

What I no longer believe is that there’s any easy way to tell which areas are under-funded. All it takes is one or two idiosyncratic major funders to turn a cause area from under-funded to over-funded or appropriately funded. Thus, the mere fact that a cause is “wonky” (strong from an analytical perspective, but not from a storytelling perspective) or “wacky” (controversial, farfetched or otherwise unappealing to conventionally minded people) doesn’t guarantee that it will be neglected. When it comes to assessing what areas are neglected, there’s no substitute for doing the legwork of figuring out who’s working on them.

Why one’s view of “broad market efficiency” matters
In theory, it would be ideal to examine all possible giving opportunities and compare the “expected good accomplished” for each. In practice, it’s important to have good rules for prioritizing which areas and projects to investigate further. And having a view on “broad market efficiency” is important for such prioritization. Our view on “broad market efficiency” affects (a) how easy we expect it to be to find good giving opportunities in a given cause (and thus how much effort we expect to put in before having a good idea of what’s available); (b) what sort of claims about giving opportunities we consider highly plausible vs. which will immediately raise our skepticism that a piece of the picture is missing; (c) what sorts of giving opportunities are outstanding enough, in the scheme of things, for us to prioritize them.

If we expected extremely minimal “broad market efficiency,” we might be looking for projects that fit just about all the criteria one could ask for – strong track record, strong upside, strong people, etc. – and we’d deprioritize causes in which these projects didn’t quickly emerge. If we expected extremely strong “broad market efficiency,” we might place high emphasis on our personal interests and experiences, reasoning that these would be the areas in which we’d be most likely to “beat the market.” Our current view is in between the two extremes. Our intuition is that some causes are extremely under-funded relative to others, and we expect strategic cause selection to have major payoffs. (Note that while we have raised our estimate of “broad market efficiency” we’ve also become more confident that strategic cause selection is extremely rare, perhaps even nonexistent, in the philanthropic world.) On the other hand, we expect exploring a given cause to take a good deal of legwork and learning, and we’re inherently suspicious of projects that look “too good to be true.”

Another reason one’s view of “broad market efficiency” matters is it represents one mechanism for what I sometimes term the “fungibility of good” – the idea that making progress on one problem often leads to progress on other problems. For example, reducing the burden of malaria may make it more likely (depending on the degree of broad market efficiency) that other philanthropists shift from addressing malaria to addressing other problems. Thus, even if cause X is more important than cause Y, making progress on cause Y may cause other philanthropists to reallocate their giving away from cause Y and toward cause X, and may thus have some value for cause X.

The “fungibility of good” is one possible contributor to “regression to the mean” in philanthropic opportunities, and one possible justification for placing weight on tractability (what one can accomplish within a cause) and not just importance (the value of progress on a cause).

Ways to follow GiveWell

This is just a reminder of the various ways you can stay updated on GiveWell’s work.

If you’re reading this, you’re following our blog, which is a great way to stay updated on major research progress. In addition to following on the web, you can follow the blog via RSS or email.

Other ways to follow GiveWell:

  • We send out a ~monthly email with highlights from the month’s blog posts and other news about GiveWell (e.g., new hires, mentions in major media). Sign up for email updates here.
  • We announce the publication of each new report on our website and each time we publish notes from a conversation with a charity representative or other expert. You can follow these announcements via our “new content feed.” You can join the feed by subscribing to its emails (sign up here or send an email to this address) or by following on RSS.
  • You can follow us on Facebook (includes links to new blog posts) and Twitter (includes links to new blog posts and links to new content).

GiveWell Labs update

[Added August 27, 2014: GiveWell Labs is now known as the Open Philanthropy Project.]

While we haven’t spent as much time as hoped on GiveWell Labs, we have made some progress. This post summarizes how we’ve spent our time, what we’ve learned, and what we’re planning next.

We’ve put substantial time into each of the following:

  • Partnering with Good Ventures on “co-funding” with major foundations. Good Ventures has spoken with multiple major foundations (some conversations off the record, some on the record), asking for recommendations for particularly strong projects that Good Ventures might join in funding. It has committed $1 million to a project with the Gates Foundation and is in the process of considering other possible projects. We have sat in on most of the relevant conversations, advised Good Ventures, and published notes when possible to our website. We had hoped this experience would give us an opportunity to “learn from the pros” – to understand how established foundations go about sourcing and evaluating giving opportunities. To some extent, it has; for example, we’ve learned about the importance and pervasiveness of active funding among major foundations, and we’ve gotten a sense for what program officers do to find giving opportunities (it seems that the most common core activity is networking intensively with people in the field, while emphasizing their own strategic priorities). At the same time, we’ve found the giving opportunities themselves difficult to evaluate, both before and after execution. As discussed previously, the information that is easily available is often not in-depth enough for us to gain high confidence regarding the merit of the project without substantial further investigation (the case for these gifts relies largely on the fact that the partner foundation finds them worthwhile, as well as the learning opportunities they present to us).
  • Top-level investigation of the history and current state of philanthropy. We wrote about our understanding of philanthropy’s success stories, and collected data on philanthropy’s current funding allocations. Since then, we’ve continued to look for more information about the history of philanthropy – we think it’s important to understand what the major success stories have been and how they came about – but we have found little. We are now exploring the possibility of recommending funding to produce more such history.
  • Meta-research. Last year we expressed an interest in meta-research, or “improving the incentives in the academic world, to bring them more in line with producing work of maximal benefit to society.” We ended up spending much of our GiveWell-Labs-related time on this cause because we not only found it promising (and had significant starting context on it due to our direct experiences as consumers of research), but also found it to be a fairly nascent field. Thus, we had opportunities to explore opportunities and participate in meetings that would have been difficult with our level of experience in other areas.
    • We were originally interested in meta-research for the field of development economics, the field most directly relevant to our work. We joined a major funder in having preliminary exploratory conversations with relevant researchers (some were off the record, but some have notes posted to the “social sciences” section of this link) and I attended an April 2012 meeting at the William and Flora Hewlett Foundation regarding preregistration.
    • We recommended a quick grant to the U.S. Cochrane Center, and in the process of investigating it we turned up some evidence that medical meta-research is a promising (largely because neglected) area. We are now finishing a more thorough investigation of that cause.
    • We also put a small amount of time into exploring the idea of meta-research for the “harder” sciences (biology, computer science, etc.) We advised a volunteer, Paul Christiano, who has had multiple conversations (notes forthcoming) in the field of computer science, and I attended the first meeting (notes) of Vannevar, a group started by Dario Amodei to explore ways to make scientific research more efficient, collaborative and productive. Dario and I also had a preliminary conversation about the world of biomedical research.
  • We advised Good Ventures on its investigation of the cause of drug policy reform, seeing it as an opportunity to start learning about politics without a major commitment. Two consultants were retained to look into this area, and we aim to publish a public version of their report in the next month. I’ve also had many informal conversations about the world of political advocacy, and am starting to form a plan for understanding it better.

Our major takeaways to date from these investigations:

  • Due partly to the potential importance of active funding, it appears helpful to think of a “cause” or “sector” – rather than a “project” – as the most relevant unit of inquiry. We now plan on investigating a large number of potentially promising causes at very low depth, and investigating a smaller number at a higher level of depth.
  • Most of philanthropy seems to use some combination of (a) direct service delivery; (b) funding of research; (c) political advocacy. We feel that we have done substantial research on, and attained substantial understanding of, (a), while we understand very little about how (b) and (c) work in general. It is a priority for us to learn more, generally, about how the world of scientific research works (which involves understanding the incentives and evaluation mechanisms for academics) and about how the world of political advocacy works (which involves understanding the basic tools that are used in advocacy and how one might expect their effectiveness to vary with different issues).
  • It is very difficult to get a sense of what has worked, and failed, in philanthropy’s past. Our value of transparency is hopefully a step in the right direction for the future, but for our own learning we may find it necessary to do substantially more investigation of history.

Accordingly, for the next few months we expect to prioritize the activities of

  • Investigating a relatively large number of causes at relatively low depth, and investigating a smaller number at high depth. (We are currently finishing a higher-depth investigation of medical meta-research.)
  • Forming plans for improving our general understanding of scientific research and political advocacy.
  • Exploring the possibility of funding journalists and/or historians to produce better data on what has worked and failed in philanthropy in the past. (More)