The GiveWell Blog

DALYs and disagreement

Elie thinks that fistula is worse than death. jsalvati disagrees.

I’d rather bring someone to full health than save an infant’s life. Ryan agrees, but Basti does not and Ron Noble emphatically does not.

It’s possible that we would all agree if we knew more about the lives of people in the developing world, or if we just had a long enough to argue about our values. It’s also possible that we wouldn’t. And as long as we disagree, we’ll have different opinions on what the most “cost-effective” interventions are. For example, if it’s true that fistulas can be repaired for $450 each, is this a better or worse use of donations than preventing children’s deaths for $200 each through vaccinations? My answer would be “It depends on the donor.”

Converting disease burdens and intervention benefits into DALYs doesn’t resolve questions like this. Rather, it obfuscates them, by converting the two interventions into the same terms using a single set of philosophical values. If the numbers above ($200/death averted for vaccinations, $450/surgery for fistula) are accurate, they allow different donors to make their own judgment calls, while being informed about their options. But these aren’t the numbers you’ll find in the Disease Control Priorities Project’s summary tables; instead, you’ll see only that surgical services cost an average of $136 per DALY averted (Jamison et al. 2006, Pg 75) and that the vaccinations interventions costs an average of $7 per DALY averted (Jamison et al. 2006, Pg 77).

Some simplification and information loss is necessary in order to compare different options, but reducing everything to a single unit means being able to serve only a single kind of donor. I’d prefer to estimate the effect of different interventions on a variety of “life outcomes” that different donors might value differently. We will discuss this variety more in a future post, but here’s a quick list:

  • Total life-years saved.
  • Adult lives saved (as it is common to value adult lives more than children’s lives).
  • Cases of extreme misery, such as fistula or perhaps severe elephantiasis, averted.
  • People brought to a “normal” level of health, i.e., without any debilitating nutritional or other conditions.

All of these things need to be separately estimated to produce DALY estimates. The DCP report did so with admirable thoroughness and far more people than we have (Jamison et al. 2006, Pgs xxiii-xxxiv). Yet because they published only their DALY estimates (not, with some exceptions, the estimates of different health problems that went into them), they buried a great deal of this work, and produce cost-effective estimates that are useful only if you’re completely on board with all of their values (from how bad each disability is to how to value different years of life). We’re currently trying to get in touch with the authors so we can get access to more of the details; if we don’t, we’ll have to repeat much of their work (with less capacity to do so).

Sources

Previously in series:

Donors don’t have to pay for their own philanthropic advice

Tactical Philanthropy:

Sooner or later, donors are going to start being willing to pay for advice on how to give. This will transform philanthropy.

I agree that donors should be willing to pay for advice on how to give. I certainly would have done so back when I was in the for-profit sector, if I could have found an advisor I had confidence in for a price I could afford.

But it’s conceivable that donors – especially small donors – will never have to pay for philanthropic advice, because someone else will pay to give them that advice. To give a simplified example: say that you care passionately about the cause of K-12 education, but know little about it. Now say that for $1,000, you can fund a philanthropic researcher to produce a report for other donors whose gifts to K-12 education charities will total $10,000. That means you have the choice of giving $1,000 directly to a K-12 charity (though you don’t have much to go on in picking one), or spending that $1,000 to “redirect” $10,000 of uninformed giving to the charities recommended by researchers.

The latter can be a pretty good deal. Unlike in investing, in philanthropy it makes perfect sense to pay for the privilege of redirecting other people’s money. (In fact, this practice is already widespread – large donors often fund fundraising campaigns, with the aim of raising money from others, and lots of people are happy to fund advocacy charities that are ultimately aiming to redirect government funding.)

Picture a world where some donors use philanthropic research for free, and other donors pay for that research with the knowledge that it’s redirecting the first group’s money. This isn’t the only, or necessarily the most aesthetically appealing, way for philanthropic research to get funded. But it’s a perfectly good deal for all parties involved (the donors that get the free research and the donors that pay to improve others’ giving). It’s a model that couldn’t work in for-profit investing, but when it comes to philanthropy where donors are seeking to create public goods rather than add to their own wealth, I see nothing unsustainable about this setup.

That’s the basic arrangement we’re currently pursuing. We are seeking GiveWell Pledges from donors who might be happy to use our research, but don’t necessarily want to pay for it. Meanwhile, a different set of donors pays our operating expenses, in the hopes that we’ll be able to move money from the first group.

Fistula

Coming across the current feature on the DCPP’s home page reminds me of how much I care about the issue of obstetric fistula.

The following are highlights from the article linked above (emphasis mine):

For countless women in developing countries, going into labor is the painful beginning of a lifetime of unremitting shame and misery as a despised social outcast—destitute, childless, and abandoned by family and friends.

These women have a condition called obstetric fistula. A fistula, the Latin word for “pipe,” is an “abnormal passage” between organs — in this case, between the vagina and the bladder, the rectum, or both. The hole makes the woman uncontrollably incontinent of urine or feces or both and transforms a healthy person into someone viewed as a leaking, reeking, “moving latrine,” in the words of Veronica Yakobe, a Malawian woman who endured 23 years of indignity before an operation at Nkhoma Hospital in her country’s central region closed the fistula.

  • 2 million to 3.5 million women worldwide currently [live] with obstetric fistula.
  • Statistics from Ethiopia, Nigeria, India, Pakistan, and elsewhere show that the majority of fistula sufferers are abandoned by their families, divorced by their husbands, and forced to fend for themselves, often by begging. Some, like a group of Somali women who leapt from a pier chained to one another, end their lives in despair.
  • Studies of patients undergoing fistula surgery find the majority in their early twenties or younger. In one Nigerian study, 72 percent were between the ages of 10 and 20, 82 percent having married between 10 and 15.
  • A number of facilities, most prominently the renowned Addis Ababa Fistula Hospital, in Ethiopia, repair thousands of fistulas each year at a cost of about $450 for each operation and related care.

The disability weight used for fistula in DALY calculations is .430 (Pg 121 of the Global Burden of Disease report (PDF)). For context, the disability weight for blindness is .600 (Pg 120). To me, fistula seems much worse. Not only does a person undergo severe physical trauma, but she also often suffers severe social consequences such as communal ostracization and abandonment by her family.

In fact, it’s hard for me to imagine a cause I’d rather attack. I’d much rather prevent a fistula than save a life. The fate described above seems worse than death.

We’re planning to look into fistula carefully, and I hope we’ll find donors a great option for helping those afflicted.

Health education is tricky

In theory, you can fight HIV/AIDS by teaching safe sexual behavior; fight diarrhea by promoting hygienic practices; reduce child mortality by educating mothers; etc. However:

  • Research on the effectiveness of these sorts of programs is thin; and programs that combine documented effectiveness with clear replication models are, so far as we can tell, rare to nonexistent.
  • Changing people’s behavior isn’t straightforward. For an example, consider the finding – regarding hygiene education – that “The interventions promoting the single hygiene practice of washing one’s hands with soap tended to achieve greater reductions in disease than those that promoted several different behaviors … numerous messages dilute each other in the minds of the target audience” (see DCP pg 785 – references given there).

If it’s true that education works best when it’s focused, that means that planning an education program right means not just identifying behaviors that need changing, but analyzing which changes would be most beneficial. That’s a complex undertaking, and so is changing how people from another culture live their daily lives.

I’m generally not very optimistic about this category of intervention given what we know about it. Handwashing programs appear to be pretty well-documented and are a possible exception.

Direct food aid?

Both the Disease Control Priorities report (DCP) and Copenhagen Consensus (CC) acknowledge malnutrition as an extremely widespread and damaging problem, and both discuss a variety of interventions including breastfeeding promotion, vitamin supplementation, and fortification.

Yet both give hardly any space to the idea of direct food aid, i.e., providing healthy food (or the money necessary to purchase it) directly to people in poverty. CC states that such interventions are “cost-effective but more costly [than other interventions],” and that “because of the emphasis on costs and cost-effectiveness levels we focus on [other interventions such as supplementation] only” (Pg 6). DCP’s chapter on malnutrition (551-565) mentions direct aid only in one paragraph, in the context of comprehensive child nutrition programs, and states that “No consensus exists on when or how to include supplemental food to reduce undernutrition, and inefficient targeting is frequently a key constraint to effectiveness” (556).

Direct food aid seems to me to deserve much more attention, specifically because it is a potential solution to several of the most difficult types of malnutrition to address:

  • Iron deficiency, which can cause anemia and impair cognitive development (DCP 553-4), is extremely difficult to address through supplementation or fortification because of how frequently iron needs to be ingested (DCP 558). Might frequent consumption of meat be an easier sell than frequent consumption of supplements?
  • Protein-energy malnutrition can result in emaciation and stunted height (30-50% of under-5 children sub-Saharan Africa and South Asia suffer from these problems – see DCP Pg 552). As this condition results from insufficient calorie consumption, it does not appear to be treatable through vitamin supplements. Breastfeeding may ensure adequate calories for infants, but what about afterward?
  • There is also always the possibility that our understanding of nutrition isn’t sufficient to name all of the necessary nutrients, and that the best way to give someone a diet that works as well as ours is to give them similar food (rather than simply identifying what seem to be the essential nutrients and providing those).

Direct food aid programs have come under fire due to the practice of obtaining the food from the developed world, which may cause economic distortion and problems for developing-world farmers. But this problem doesn’t seem inherent to direct food aid, only to programs that insist on using developed-world surplus food; a program that bought what it could from nearby farmers, and provided the rest from overseas, would not obviously cause more distortion than other aid programs.

Direct food aid programs may be costly and complex, but they may also be the only way to ensure truly adequate nutrition in some parts of the world. Why aren’t they getting more attention from otherwise thorough analyses?

Vaccinations

According to the Disease Control Priorities Project, expanding vaccination is an excellent fit for donors who want proven, cost-effective, scalable ways of helping people. According to this table (more detailed version on page 401 of the full report), both South Asia and sub-Saharan Africa have relatively low levels of existing coverage (50-58%), and vaccinating more children could save lives for about $200 each. If saving lives is in fact your priority (and we know it isn’t for all donors), that’s hard to beat.

The most promising nonprofit I know for implementation is the GAVI Alliance, which we have yet to thoroughly evaluate.