The GiveWell Blog

Why we wish charities ran LESS like businesses

GiveWell started in the hedge fund world (as a collaboration between coworkers), and our staff and board is heavy on for-profit experience. When we talk about metrics and dashboards, a lot of people assume we’re applying business concepts, and that we want to see charities run more like businesses. That isn’t true.

Do businesses conduct academic-style studies employing randomization and statistical significance tests to figure out how they’re doing? If any do, I doubt they’re very good ones. If you’re running a chain of pizza joints, you don’t need to know anything about statistics, and you can get by without much of a dashboard too. That’s because the single most important thing you need to measure – profit – is hitting you in the face every day. And most of the other things you need to measure take care of themselves too. It’s easy to know how much you’re paying delivery boys and how that impacts your bottom line – and if they slack off, you’ll be hearing about it from your consumers. No followup surveys necessary.

The more complicated things get, and the more difficult-to-observe things you have that might affect you in long-term and difficult-to-notice (but still important) ways, the more you need to audit. That’s why companies do it. But there’s no business whose operations are as difficult to understand – and whose outcomes are as difficult to measure – as even the simplest charity trying to fight poverty.

If a charity doesn’t follow up with its clients, it will never know whether its efforts are very successful, moderately successful, or entirely worthless. It will have no way of figuring out when the plan that made sense in its director’s head is falling short in reality. It could keep doing things that make logical sense, but don’t work at all, for hundreds of years – and never find out. None of that is true of any business.

Reading fundraisers’ arguments for why their charities are good, I keep hearing things like “We’re very experienced,” “We’ve been around for a long time,” “We’re well recognized/well respected/well established.” These are all points that make perfect sense as praises for a for-profit business, and no sense as praises for a charity. Charities are mission-driven, not self-gain-driven. Continued existence is not evidence of success; fundraising excellence isn’t either. The fact is that without evaluation, a charity’s success is something no one can see.

Believe me, I know about the inherent limitations of measurement, and I know how expensive and annoying it is too. I don’t like to fill out a survey every time I blow my nose; if I were running a business, I wouldn’t want to be spending half our budget on figuring out whether our pizza really was the cause of improved customer happiness, or whether selection bias were involved. But if I were running a charity, I wouldn’t see a choice. It’s tough but true: unlike a business, a charity needs all that annoying stuff – or it’s working in the pitch dark.

Comments

  • Rodobago on August 27, 2007 at 8:36 am said:

    Academic style studies form the cornerstone of brand management, pricing theory, and franchise strategies for pizza joint chains and every other major consumer retail endeavor. I don’t think Correct me if I’m wrong, but I have to believe that Starbucks, Walmart choose the location of their stores using a rigorous model they have developed.

  • Holden on August 27, 2007 at 9:43 pm said:

    I’d also guess that Starbucks and Wal-Mart are choosing new locations with a fair amount of research and rigor, since a new location is a big commitment that relies on a pretty confident view of the future. (I’d be a little surprised if they are choosing new locations the way most of the large charities we’ve spoken to do: by choosing between purely qualitative proposals from their people in the field.)

    I’m a lot less convinced of the impact of academic studies on brand management and pricing. Regardless, the larger point of the post is that charities have far more need of formal measurement than companies do. That companies often do quite a bit is a testament to how important auditing can be … but I want to see charities do even more, consistent with their greater challenges, rather than gauging their success from financials, years of existence, etc. as businesses do.

  • Stephen on January 2, 2008 at 11:00 am said:

    This post is being featured on the front page of The Issue (www.TheIssue.com) in the issue of the day section. Check it out if you get a chance and let me know (Stephen@theissue.com) if you have any questions

Comments are closed.