The GiveWell Blog

Significant life change

If you could accomplish any of the following for the same cost, which would you choose?

(1) Prevent 100 deaths-in-infancy, knowing that in all likelihood these 100 people will grow up to have consistently low income and poor health for their ~40-year-long lives.

(2) Provide consistent, full nutrition and health care to 100 people, such that instead of growing up malnourished (leading to lower height, lower weight, lower intelligence, and other symptoms) they spend their lives relatively healthy. (For simplicity, though not accuracy, assume this doesn’t affect their actual lifespan – they still live about 40 years.)

(3) Prevent one case of relatively mild non-fatal malaria (say, a fever that lasts a few days) for each of 10,000 people, without having a significant impact on the rest of their lives.

For me, the answer is definitely #2. I am very excited by the idea of changing someone’s life in a lasting and significant way (2); I’m much less excited by the idea of a temporary, less significant life change (3), and I don’t think that the quality of a life equals the sum of the quality of the days in it. (1) excites me the least – I just don’t put that much value in “potential lives” (I think the death of a 20-year-old is more tragic than the death of an infant), and I especially don’t put much value in saving “potential lives” riddled with health problems.

I’m not interested in having a long philosophical argument about the validity of my views. I believe that different donors likely have fundamentally different values that you can’t change by throwing any number of thought experiments or philosophical abstractions at them. Our research will aim to serve as many different sorts of donors as possible, rather than holding up one philosophical value set as the “rational” one. But I am interested in what others think, and whether my attitude is common or rare.

To give a quick sense of the practical relevance of this question: programs targeted directly at under-5 mortality (including some vaccination programs and some micronutrient programs) are much more likely to get you (1)-type results; programs that distribute bednets or other health materials en masse are more likely to get you (3)-type results; an economic empowerment program (particularly focused on improved farming techniques) may aspire to (2)-type results, but I believe that these types of results are the most difficult and expensive to bring about.

Malnutrition and income

Over the last few days I have been wondering just how severe and how fixable developing-world malnutrition may be. For a striking illustration, see “Grandmothers and Granddaughters: Old Age Pension and Intra-household Allocation in South Africa” by Esther Duflo.

This paper analyzes a survey of 9000 families in the early 1990s in South Africa, when a public pension program was broadened significantly, and tries to look at how the program (significant cash transfers to low-income, elderly people) affected child nutrition. Its key argument is that cash transfers to women significantly improved the nutrition of female children (but that cash transfers to men had no discernible effect on child nutrition).

I’m not convinced that the data support this argument (my chief concern is Figure 1, which makes it look like the children of eligible women got healthier before but not more than other children, and that the observed effect is an artifact of the time period studied). However, the argument reflects three key themes that, from the paper’s references and a few other things I’ve seen, seem to have significant research supporting them:

1. Malnutrition is widespread and severe among the very poor. Table 3 shows that prior to the program’s expansion, these low-income South African children were far shorter (for their age) than American children: their height-for-age averaged around -1.5 standard deviations (under standard assumptions, this would put the average South African child around the 7th percentile of American children). Height-for-age is strongly linked to nutrition in early childhood, as Duflo explains (with references) starting on Page 13.

2. Curbing malnutrition is not necessarily a thorny problem. Regardless of whether Duflo’s hypothesis about female vs. male recipients is correct, there is no question that the height gap described above fell sharply (down to 0.5 standard deviations, which corresponds to the 30th rather than 7th percentile of the general population) after the introduction of the pension program. Bear in mind that the program was no elaborate health intervention, but merely a cash transfer to families.

3. In the developing world, not all household income is equivalent. Duflo argues that income that comes to women is more likely to improve children’s health. This is the most questionable claim in the paper for me (for reasons outlined above), but the general idea is also argued in this study of Cote d’Ivoire, and possibly in other literature as well; this would give some explanation of why so many microfinance programs explicitly focus on women.

Research plan: A fresh start

We completed our first year of research a few weeks ago, and are now starting up our second. (Our annual review and plan discuss what we’ve learned from our first year, and the many ways in which we’re changing our approach for year 2.)

We found some strong organizations the first time around, but our “bottom-up” approach (counting on our applicants to tell us about their activities) left us with a very partial picture of things. At this point we’re basically starting over, and trying to answer the following questions:

1. What are all the obstacles faced by people in different parts of the developing world?

I want to know as much as possible about the groups of people we’re helping (not just the diseases we’re fighting), because this helps us to (a) form better guesses about the most important problems to focus on; (b) focus on areas where a little aid goes a long way; (c) paint a picture for donors of what sort of difference a good program can make, beyond the usual idealized anecdotes or “cost per life/DALY saved” figures. (For example, when you save a life from malaria, what sort of a life is it? When you help improve someone’s income, what does that mean for what they’re able to buy?)

Ideally, we would know the following about as many different parts of the developing world as possible:

  • Full details of the prevalence and severity of different health problems, including diseases (HIV/AIDS, tuberculosis, malaria, diarrhea, pneumonia, and NTDs), malnutrition (vitamin A deficiency, anemia, low weight-for-height and height-for-age), vision problems (including cataracts), and deformities (including cleft palate and obstetric fistula)
  • Availability, and cost, of basic quality-of-life goods and services including health care, water, sanitation, electricity, financial services (savings, loans, insurance), and basic entertainment (televisions, radios, festivals).
  • Availability, quality, and content of schooling.
  • Common occupations, along with necessary skills/qualifications for each. I’m particularly interested in what it would take for someone to improve their occupation and income (are there plenty of opportunities if only they had basic help, along the lines of nutrition assistance or financial services? Or is the set of possible jobs highly limited?)
  • What people most want to change about their lives, and what they most want help with.

I’ve been reading academic papers that answer some of these questions for certain areas using survey data; I’ve also talked to a couple of people who’ve spent significant time in the developing world, just to get a basic picture. I’ll share what I’ve learned so far in a future post.

2. What impact do different health problems generally have?

There are some diseases, such as AIDS, that we have a fairly good picture of in terms of their impact on quality/length of life. There are others – particularly the NTDs – that we know very little about. We need to examine enough medical literature to have a good sense of what possible symptoms are associated with different diseases, as well as a basic idea of how different health problems interrelate (for example, the extent to which malaria increases susceptibility to HIV/AIDS).

3. What are the most promising interventions and charities?

Answering #1 and #2, at least for some parts of the world, should have a major effect on how we think about #3, so we are focusing on #1 and #2 for now. The goal is to start with people and places, rather than programs. However, we want to make sure we’re checking out any particularly highly recommended, or otherwise promising, programs we come across (for example, recently we took a look at the Fred Hollows Foundation on several people’s recommendation).

We don’t expect to get anywhere close to “answering” all of the above questions, but that’s our framework for learning as much as we can to frame our investigations of charities. We have a lot of work to do. We’ll be sharing our findings as we go.

The GiveWell Pledge

The goal of GiveWell is to help a large chunk of individual giving to become more effective (i.e., to help people more). As such, the two most important questions about our project are:

1. Can we produce useful, actionable research for donors?
2. Will donors use it?

Our first year was focused on #1. We raised money only from people who knew us, because we had no track record and no existing research to point to. We told our donors that if they funded our startup, we would produce a first set of useful, actionable reports for donors. We’ve now done that.

Now the big question is whether our research can move a lot of donations. The bottom line about GiveWell is that if our research ends up influencing a lot of people’s giving, the project will work: sharing information will be worth charities’ time, and doing research will be worth our time and expense. If we can’t influence donors, then our research isn’t worth doing, and we’ll rightly go out of business. We’re not going to answer this question fully in the coming year, but we’re hoping to get a start on it.

That’s why we’re introducing the GiveWell Pledge, which aims to demonstrably increase our influence while preserving donor choice. A GiveWell Pledge is a formal, advance commitment to give to one or more of the charities we recommend after an additional year of research. The donor gets the final choice of charity, and pays no fee to us, but we get the benefit of being able to (a) show exactly how much money we’re moving; (b) show our direct donors, the ones who pay our operating expenses, whether we’re succeeding in our mission; and (c) show the charities we’re asking for information what’s in it for them.

This is different from the model used by philanthropic advisors (in which donors pay extra for research) and from the model used by independent evaluators (which have no “carrot” to get detailed information from charities). We’re hoping it will maximize our chances of doing research that is both thorough and sustainable. For more, see our official plan for the coming year.

New material

We’ve been releasing a lot of new material over the last few weeks, and I want to make sure that our blog readers are aware of it. GiveWell.net now includes:

Preventing blindness

Several people have recommended that we look at the Fred Hollows Foundation. We have been shown calculations implying that they are preventing or curing a person’s blindness for every $20-60 they spend. As we continue our research on developing-world aid, we checked them out a bit ourselves.

The Fred Hollows Foundation’s programs include surgeries to cure blindness caused by cataracts and trachoma. These surgeries are relatively straightforward and can therefore be performed relatively inexpensively (at less than $10 per trachoma surgery, according to the Diseases Control Priorities Project). But the cost per surgery doesn’t tell the whole story – for example, we also want to know:

  • How bad would patients’ vision be without surgery? While improving someone’s sight is always valuable, “curing blindness” means something very different to me from helping someone who previously had vision in one eye, or slightly impaired vision in both.
  • How old the people are who receive the surgeries? Again, curing blindness always has some value, but it means more to me when it means giving someone a full life of healthy vision (or when it helps someone to care for their dependents).

The Fred Hollows Foundation conducted a 65-person post-operative survey in Cambodia that sheds light on the above questions. (You can see the full report here; this is the only survey of its kind that I found on their website.)

  • 44% of those who received surgeries had been able to work before undergoing surgery, as they were “usually only blind in one eye or had some vision in both eyes” (Pg 11).
  • 77% of those who received surgeries were over the age of 60 and another 21% were over the age of 41 (pg 10).

I’m excited by the idea of vision correction surgery; it’s cheap and tangible, even considering the above. But these sorts of details about who is being helped significantly change my idea of what you get for your donation with this kind of program, and I’m far from convinced that it ultimately represents a better “value” than our current top health-related charities.