The GiveWell Blog

How Do You Value Information?

There’s a common piece of dating advice: before you commit, go on a big trip together. Hopefully the trip itself will be fun, but that’s (almost) beside the point: the real goal is to figure out how smoothly you solve problems together. When it starts raining at 10pm on a Friday and you’re caught outdoors because of a misread-map incident (if we’re being honest: entirely your fault), you’re going to learn a lot about whether your partner reacts to difficulties in a way you’d like to be around for the rest of your life.

The value of what you learn from the trip (a concept called “value of information,” or VOI) can far exceed the direct costs and benefits, because the trip is just for a week and the rest of your life is, well, the rest of your life. If there’s a 10% chance that the trip will show you that you’re not truly compatible, the expected value of that information is higher than any plausible level of (un)happiness you might experience on the trip itself.

Sometimes, the value of information makes the trip worth taking when it wouldn’t have been otherwise—your partner has already scheduled a trip during their time off and it’s very inconvenient for you to join them, but the value of information makes the trip worth it. Other times, you can make choices about the trip in order to increase the value of information you’ll receive: perhaps an all-inclusive beach resort would be more enjoyable today, but a road trip where you camp at different spots each night has a higher value of information and so is ultimately more valuable.

Read More

GiveWell as Moneyball

If there’s one group of people who are as obsessed as we are with rigorously analyzing a complicated domain and figuring out where to prioritize scarce resources, it’s Major League Baseball front offices. With that in mind, we wanted to write this guide comparing some baseball statistics with the metrics we take into consideration when evaluating programs to save and improve lives.

Batting Average: Batting average is simple to calculate and easy to explain, and it was historically considered one of the most important ways of evaluating how good a player was. It remains one of the primary baseball stats you’ll find in the newspaper.

But as a measure of a player’s value, batting average isn’t actually all that helpful—and at times can be actively misleading. One of the two primary shortcomings of batting average is that it ignores plate appearances that end in a walk. But walks are really valuable! The Little League wisdom that “a walk is as good as a hit” is an oversimplification, but it also points us toward a statistic that’s more valuable than batting average. It turns out that on-base percentage, which considers walks (as well as the less common hit-by-pitch method of reaching base) as a successful outcome, is a better predictor of a player’s offensive value.

As an example, Juan Pierre and Adam Dunn, who both played in about 2,000 games over their careers, had lifetime batting averages of .295 and .237 respectively. At first glance this might give the impression that Pierre was the more productive hitter. Looking at on-base percentage though, we see that Dunn actually reached base more frequently than Pierre (.364 versus .343), which, combined with his propensity for hitting home runs (another indicator of offensive value that batting average ignores), made him the much more valuable career hitter. (Dunn’s negative defensive contributions are another story.)

Read More

Raffles, Deworming, and Statistics

Sometimes statistics can help when it’s hard to decide what to do.

You’re at a local art fair, and they’re raffling off a car worth $10,000. Five hundred tickets are being sold, each for $10. Does it make financial sense to buy a ticket? (For the moment, let’s set aside other questions about raffles and just focus on the benefit for you, the potential ticket-buyer.)

You can use a statistical concept called “expected value” to help you decide. Expected value is calculated by multiplying the probability of each potential outcome by its value, then adding these results together to get the average result of an action.

Let’s figure this out—a car is on the line. First, we multiply the probability of each potential outcome by its value.

Read More

What If We Have Extra?

What do you do if you’re in the very fortunate position of having more money than you need to meet your own immediate needs? You might find new things to buy. You might stockpile it for a rainy day. You might donate it to cost-effective global health programs. Or you might do some combination of the three.

GiveWell thinks about that same question.

First, a bit of context: All donations made to GiveWell’s Top Charities Fund, All Grants Fund, and recommended organizations go to the programs we recommend. (We do not take a percentage of donations made to recommended organizations through GiveWell’s website, nor do we receive any fees from organizations for being featured on our site.)

Our own organizational needs are met by donors who choose to direct funding to GiveWell’s operations (by giving to our Unrestricted Fund). In other words, we are supported only by donors who explicitly choose to support GiveWell itself through unrestricted donations.

But what happens when we receive more unrestricted donations than we need? We could choose to spend the funds on something new for the organization. We could squirrel those funds away, building an endowment to cover future needs. Or, like you, we could donate to cost-effective global health programs.

Read More

Why we’re excited to fund charities’ work a few years in the future

We recently spoke with someone who wanted to donate to a GiveWell top charity. They were interested in getting the funding “out the door” and to program participants as quickly as possible.

But our top choice for funding today is Malaria Consortium’s seasonal malaria chemoprevention program—for work it expects to complete in 2022.[1] The potential donor was puzzled. Shouldn’t we prioritize an organization that needs the money sooner?

We often recommend donations today that support programs a few years from now. This probably diverges from many people’s intuitions about getting funding out the door as soon as possible.

Read More

How GiveWell’s research is evolving

To date, most of GiveWell’s research capacity has focused on finding the most impactful programs among those whose results can be rigorously measured. This work has led us to recommend, and direct several hundred million dollars to, charities improving health, saving lives, and increasing income in low-income countries.

One of the most important reasons we have focused on programs where robust measurement is possible is because this approach largely does not rely on subject-matter expertise. When Holden and I started GiveWell, neither of us had any experience in philanthropy, so we looked for charities that we could evaluate through data and evidence that we could analyze, to make recommendations that we could fully explain. This led us to focus on organizations that had impacts that were relatively easy to measure.

The output of this process is reflected in our current top charities and the programs they run, which are analyzed in our intervention reports.

GiveWell has now been doing research to find the best giving opportunities in global health and development for 11 years, and we plan to increase the scope of giving opportunities we consider. We plan to expand our research team and scope in order to determine whether there are giving opportunities in global health and development that are more cost-effective than those we have identified to date.

We expect this expansion of our work to take us in a number of new directions, some of which we have begun to explore over the past few years. We have considered, in a few cases, the impact our top and standout charities have through providing technical assistance (for example, Deworm the World and Project Healthy Children), supported work to change government policies through our Incubation Grants program (for example, grants to the Centre for Pesticide Suicide Prevention and Innovation in Government Initiative), and begun to explore areas like tobacco policy and lead paint elimination.

Over the next several years, we plan to consider everything that we believe could be among the most cost-effective (broadly defined) giving opportunities in global health and development. This includes more comprehensively reviewing direct interventions in sectors where impacts are more difficult to measure, investigating opportunities to influence government policy, as well as other areas.

Making progress in areas where it is harder to determine causality will be challenging. In my opinion, we are excellent evaluators of empirical research, but we have yet to demonstrate the ability to make good judgments about giving opportunities when less empirical information is available. Our values, intellectual framework, culture, and the quality of our staff make me optimistic about our chances, but all of us at GiveWell recognize the difficulty of the project we are embarking on.

Our staff does not currently have the capacity or the capabilities to make enough progress in this direction, so we are planning to significantly increase the size of our staff. We have a research team of ten people, and we are planning to more than double in size over the next three years. We are planning to add some junior staff but are primarily aiming to hire people with relevant experience who can contribute as researchers and/or managers on our team.

GiveWell’s top charities list is not going to change dramatically in the near future, and it may always include the charities we recommend today. Our top charities achieve outstanding, cost-effective results, and we believe they are some of the best giving opportunities in global health and development. We expect to conclude that many of the opportunities we consider in areas that are new for us are less cost-effective than those we currently recommend, but we also think it is possible that we will identify some opportunities that are much more cost-effective. We believe it is worth a major effort to find out.

Read More