<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: GiveWell&#8217;s plan for 2011: specifics of research</title>
	<atom:link href="http://blog.givewell.org/2011/02/21/givewells-plan-for-2011-specifics-of-research/feed/" rel="self" type="application/rss+xml" />
	<link>http://blog.givewell.org/2011/02/21/givewells-plan-for-2011-specifics-of-research/</link>
	<description>Exploring how to get real change for your dollar.</description>
	<lastBuildDate>Fri, 17 May 2013 22:52:07 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.5.1</generator>
	<item>
		<title>By: Holden</title>
		<link>http://blog.givewell.org/2011/02/21/givewells-plan-for-2011-specifics-of-research/comment-page-1/#comment-199133</link>
		<dc:creator>Holden</dc:creator>
		<pubDate>Fri, 25 Feb 2011 15:26:48 +0000</pubDate>
		<guid isPermaLink="false">http://blog.givewell.org/2011/02/21/givewells-plan-for-2011-specifics-of-research/#comment-199133</guid>
		<description><![CDATA[&lt;strong&gt;Ian&lt;/strong&gt;: &quot;low burden of proof&quot; does not mean that little information is needed overall; it means that once the cause and context are well understood, there may be little information needed from individual charities.

Investigating the cause of orphans and vulnerable children would mean trying to understand (perhaps from, for example, speaking with government agencies that refer them to nonprofits) when and where there are orphans and vulnerable children who lack appropriate support services, and thus trying to understand where more orphanages or support services are needed. This is not easy or necessarily feasible, but if we could come to this understanding, we wouldn&#039;t need much information from orphanages themselves, and that&#039;s important because it&#039;s usually at the stage of getting information directly from charities that things become most difficult.

&lt;strong&gt;Jonah&lt;/strong&gt;: I think all the factors you name are relevant, including the raising of our bar.&lt;ul&gt;
&lt;li&gt;We&#039;re always going to compare charities against the best we&#039;ve found. So it isn&#039;t that we&#039;ve set a certain bar and only VillageReach cleared it; it&#039;s that the gap between our #1 and the rest happens to be large.
&lt;li&gt;VillageReach is unusual in a lot of ways, in terms of timing as well as in terms of activities/evaluation. It is a small organization that has had one well-demonstrated success but hasn&#039;t yet scaled it up. That&#039;s arguably a &quot;sweet spot&quot; for casual donors, because there is neither the uncertainty that comes with an entirely new project nor the uncertainty that comes with the size and bureaucracy of a scaled-up organization. And it&#039;s my view that in charity, the effect of brand and peer pressure creates fast and uncontrolled jumps from &quot;new and unestablished&quot; to &quot;dramatically overfunded to the point of departing far from the original vision.&quot; So VillageReach is at a particular stage that most charities don&#039;t seem to stay at for long, and it may have stayed at this stage longer than most because of &lt;a href=&quot;http://blog.givewell.org/2010/12/06/the-best-charity-that-no-one-has-heard-of-how-would-you-tell-its-story/&quot; rel=&quot;nofollow&quot;&gt;struggles in storytelling&lt;/a&gt; - i.e., the unusual difficulty of fundraising for it may be a factor behind its unusually high appeal to us and our donors. Finally, it has an aptitude for meaningful evaluation and a commitment to transparency that we&#039;ve found rare.
&lt;li&gt;Since the beginning of the project, we&#039;ve preferred &quot;false negatives&quot; (failing to recommend good charities) to &quot;false positives&quot; (recommending weak charities), which has led us to err on the side of having overly strict and limited criteria. The more we learn, the more different ways we come up with to identify a charity as outstanding, and the more we can broaden. So the fact that there&#039;s only one charity we really feel good about is partly a statement about our own knowledge and experience (though it is also a statement about the sector).
&lt;/ul&gt;

Taking these considerations together, the fact that we&#039;ve only found one VillageReach to date doesn&#039;t seem particularly shocking or puzzling to me.

As for why VillageReach has had trouble getting funding from elsewhere, we&#039;ve speculated that it has to do with &lt;a href=&quot;http://blog.givewell.org/2010/12/20/the-best-charity-that-no-one-has-heard-of-response-roundup/&quot; rel=&quot;nofollow&quot;&gt;the difficulty of storytelling for this kind of work&lt;/a&gt; (relevant for all donors but especially individuals) and &lt;a href=&quot;http://blog.givewell.org/2010/11/17/after-extraordinary-and-unorthodox-comes-the-valley-of-death/&quot; rel=&quot;nofollow&quot;&gt;the fact that it&#039;s looking to scale up a project of its own&lt;/a&gt; (which makes it unattractive to most institutional funders). Note, however, that it does still receive funding from both Mulago and Skoll and that both of these organizations tend to keep their gifts to any particular organization within a pretty consistent range.]]></description>
		<content:encoded><![CDATA[<p><strong>Ian</strong>: &#8220;low burden of proof&#8221; does not mean that little information is needed overall; it means that once the cause and context are well understood, there may be little information needed from individual charities.</p>
<p>Investigating the cause of orphans and vulnerable children would mean trying to understand (perhaps from, for example, speaking with government agencies that refer them to nonprofits) when and where there are orphans and vulnerable children who lack appropriate support services, and thus trying to understand where more orphanages or support services are needed. This is not easy or necessarily feasible, but if we could come to this understanding, we wouldn&#8217;t need much information from orphanages themselves, and that&#8217;s important because it&#8217;s usually at the stage of getting information directly from charities that things become most difficult.</p>
<p><strong>Jonah</strong>: I think all the factors you name are relevant, including the raising of our bar.
<ul>
<li>We&#8217;re always going to compare charities against the best we&#8217;ve found. So it isn&#8217;t that we&#8217;ve set a certain bar and only VillageReach cleared it; it&#8217;s that the gap between our #1 and the rest happens to be large.
</li>
<li>VillageReach is unusual in a lot of ways, in terms of timing as well as in terms of activities/evaluation. It is a small organization that has had one well-demonstrated success but hasn&#8217;t yet scaled it up. That&#8217;s arguably a &#8220;sweet spot&#8221; for casual donors, because there is neither the uncertainty that comes with an entirely new project nor the uncertainty that comes with the size and bureaucracy of a scaled-up organization. And it&#8217;s my view that in charity, the effect of brand and peer pressure creates fast and uncontrolled jumps from &#8220;new and unestablished&#8221; to &#8220;dramatically overfunded to the point of departing far from the original vision.&#8221; So VillageReach is at a particular stage that most charities don&#8217;t seem to stay at for long, and it may have stayed at this stage longer than most because of <a href="http://blog.givewell.org/2010/12/06/the-best-charity-that-no-one-has-heard-of-how-would-you-tell-its-story/" rel="nofollow">struggles in storytelling</a> &#8211; i.e., the unusual difficulty of fundraising for it may be a factor behind its unusually high appeal to us and our donors. Finally, it has an aptitude for meaningful evaluation and a commitment to transparency that we&#8217;ve found rare.
</li>
<li>Since the beginning of the project, we&#8217;ve preferred &#8220;false negatives&#8221; (failing to recommend good charities) to &#8220;false positives&#8221; (recommending weak charities), which has led us to err on the side of having overly strict and limited criteria. The more we learn, the more different ways we come up with to identify a charity as outstanding, and the more we can broaden. So the fact that there&#8217;s only one charity we really feel good about is partly a statement about our own knowledge and experience (though it is also a statement about the sector).
</li>
</ul>
<p>Taking these considerations together, the fact that we&#8217;ve only found one VillageReach to date doesn&#8217;t seem particularly shocking or puzzling to me.</p>
<p>As for why VillageReach has had trouble getting funding from elsewhere, we&#8217;ve speculated that it has to do with <a href="http://blog.givewell.org/2010/12/20/the-best-charity-that-no-one-has-heard-of-response-roundup/" rel="nofollow">the difficulty of storytelling for this kind of work</a> (relevant for all donors but especially individuals) and <a href="http://blog.givewell.org/2010/11/17/after-extraordinary-and-unorthodox-comes-the-valley-of-death/" rel="nofollow">the fact that it&#8217;s looking to scale up a project of its own</a> (which makes it unattractive to most institutional funders). Note, however, that it does still receive funding from both Mulago and Skoll and that both of these organizations tend to keep their gifts to any particular organization within a pretty consistent range.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Chuck S'r</title>
		<link>http://blog.givewell.org/2011/02/21/givewells-plan-for-2011-specifics-of-research/comment-page-1/#comment-199061</link>
		<dc:creator>Chuck S'r</dc:creator>
		<pubDate>Fri, 25 Feb 2011 07:10:41 +0000</pubDate>
		<guid isPermaLink="false">http://blog.givewell.org/2011/02/21/givewells-plan-for-2011-specifics-of-research/#comment-199061</guid>
		<description><![CDATA[Your frustration with identifying top-rated or gold medal charities is palpable. I see your frustration as evidence of your integrity.]]></description>
		<content:encoded><![CDATA[<p>Your frustration with identifying top-rated or gold medal charities is palpable. I see your frustration as evidence of your integrity.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Jonah</title>
		<link>http://blog.givewell.org/2011/02/21/givewells-plan-for-2011-specifics-of-research/comment-page-1/#comment-198812</link>
		<dc:creator>Jonah</dc:creator>
		<pubDate>Wed, 23 Feb 2011 23:33:40 +0000</pubDate>
		<guid isPermaLink="false">http://blog.givewell.org/2011/02/21/givewells-plan-for-2011-specifics-of-research/#comment-198812</guid>
		<description><![CDATA[I&#039;m glad to see that GiveWell has several avenues to pursue for finding top charities in 2011.

One point that one of you raised in your &lt;a href=&quot;http://www.givewell.org/about/official-records/board-meeting-14&quot; rel=&quot;nofollow&quot;&gt; most recent board meeting&lt;/a&gt; is that there&#039;s a question of why GiveWell has found only one VillageReach.

I&#039;ve been wondering about this for the past few months. A priori it seems unlikely that there would be &lt;i&gt;exactly one&lt;/i&gt; charity meeting GiveWell&#039;s criteria - one would either expect zero charities meeting the criteria or multiple charities meeting the criteria.

One hypothetical narrative that could describe the situation here is that GiveWell is setting the bar for top rated charities based on the top charity that it sees. This is somewhat consistent with &lt;a href=&quot;http://blog.givewell.org/2010/11/24/new-content-new-research-report-new-ratings-system-diy-guide-and-self-evaluation&quot; rel=&quot;nofollow&quot;&gt; November 24th blog post:&lt;/a&gt;

&lt;blockquote&gt;Part of what’s going on here is a gradual raising of our bar, as we have capacity for more analysis and a substantially &lt;i&gt;higher&lt;/i&gt; opinion of our top-rated charity VillageReach than we had last year.&lt;/blockquote&gt;

But on the other hand there seems to be a pretty substantial gap between VillageReach and GiveWell&#039;s silver medal rated international charities - I say this both based on my own impression having read this review and with a quote from Holden&#039;s &lt;a href=&quot;http://blog.givewell.org/2011/02/04/givewells-annual-self-evaluation-and-plan-a-big-picture-change-in-priorities&quot; rel=&quot;nofollow&quot;&gt; February 4th blog post&lt;/a&gt;  

&lt;blockquote&gt;When the 2010 holiday season was approaching, and we started thinking about our strategy for outreach, we realized that we only had one charity we could personally feel really good about aggressively raising money for. While we think all our recommended charities stand well above other donors’ options, it was only VillageReach for which I felt I could sit down with someone face-to-face about and say, “Give as much as you can to this one.”

Why? Because not only does VillageReach have outstanding evidence of effectiveness; it has outstanding bang-for-the-buck (in absolute terms, not just relative terms) and most importantly, it has a concrete plan for additional funding.

We personally don’t like raising money for groups that we can’t say all these things about. We’re happy to provide our recommendations for someone looking for the best microfinance charity, but we can’t honestly say that we think dollars given to it are accomplishing as much good as possible.&lt;/blockquote&gt;

Several possible interpretations here:

1. VillageReach is a &quot;once in a blue moon&quot; type opportunity for casual donors to do good; it&#039;s unrealistic to expect comparable opportunities for casual donors on a regular basis.

2. GiveWell&#039;s criteria are overly rigid in ways not necessarily correlated opportunities for casual donors doing the most good. 

3. Thus far, venues where GiveWell has looked for quality charities are suboptimal; there are other places to look that would yield more fruitful results. 

I have a poor sense of the relevance of each of the above mentioned factors. The above post seems to focus on (3), but maybe it&#039;s worth considering (1) and (2) as well.

-------------

A question strongly related to that of why GiveWell has found only one VillageReach is the question of why VillageReach wasn&#039;t able to secure adequate funding without GiveWell&#039;s help. VillageReach&#039;s pilot project was funded &lt;a href=&quot;http://www.gatesfoundation.org/Grants-2004/Pages/VillageReach-OPP30874.aspx&quot; rel=&quot;nofollow&quot;&gt;by the Gates Foundation&lt;a&gt;. Why didn&#039;t the Gates Foundation continue to fully fund VillageReach after the pilot project was successful?

Also according to the linked websites for The Skoll Foundation and for The Mulago Foundation, both foundations funded VillageReach. Is the fact that they did not single-handedly bridge VillageReach&#039;s funding gap an indication that they deemed their other grantees to be offer roughly comparable expected return on investment? Is the overlap between the values of the above mentioned foundations and GiveWell&#039;s values sufficiently great so that a casual donor would do nearly as well to donate to one of the above mentioned foundations rather than to GiveWell&#039;s top recommended charities?

I have guesses of my own, and maybe one issue is that the foundations are not explicit about their reasons for funding the projects that they do; but it would be good to get a better picture of the reasons why VillageReach had difficulty bridging its funding gap in absence of GiveWell - it seems like thinking about this might point a way toward finding other opportunities to fund outstanding organizations with room for more funding.]]></description>
		<content:encoded><![CDATA[<p>I&#8217;m glad to see that GiveWell has several avenues to pursue for finding top charities in 2011.</p>
<p>One point that one of you raised in your <a href="http://www.givewell.org/about/official-records/board-meeting-14" rel="nofollow"> most recent board meeting</a> is that there&#8217;s a question of why GiveWell has found only one VillageReach.</p>
<p>I&#8217;ve been wondering about this for the past few months. A priori it seems unlikely that there would be <i>exactly one</i> charity meeting GiveWell&#8217;s criteria &#8211; one would either expect zero charities meeting the criteria or multiple charities meeting the criteria.</p>
<p>One hypothetical narrative that could describe the situation here is that GiveWell is setting the bar for top rated charities based on the top charity that it sees. This is somewhat consistent with <a href="http://blog.givewell.org/2010/11/24/new-content-new-research-report-new-ratings-system-diy-guide-and-self-evaluation" rel="nofollow"> November 24th blog post:</a></p>
<blockquote><p>Part of what’s going on here is a gradual raising of our bar, as we have capacity for more analysis and a substantially <i>higher</i> opinion of our top-rated charity VillageReach than we had last year.</p></blockquote>
<p>But on the other hand there seems to be a pretty substantial gap between VillageReach and GiveWell&#8217;s silver medal rated international charities &#8211; I say this both based on my own impression having read this review and with a quote from Holden&#8217;s <a href="http://blog.givewell.org/2011/02/04/givewells-annual-self-evaluation-and-plan-a-big-picture-change-in-priorities" rel="nofollow"> February 4th blog post</a>  </p>
<blockquote><p>When the 2010 holiday season was approaching, and we started thinking about our strategy for outreach, we realized that we only had one charity we could personally feel really good about aggressively raising money for. While we think all our recommended charities stand well above other donors’ options, it was only VillageReach for which I felt I could sit down with someone face-to-face about and say, “Give as much as you can to this one.”</p>
<p>Why? Because not only does VillageReach have outstanding evidence of effectiveness; it has outstanding bang-for-the-buck (in absolute terms, not just relative terms) and most importantly, it has a concrete plan for additional funding.</p>
<p>We personally don’t like raising money for groups that we can’t say all these things about. We’re happy to provide our recommendations for someone looking for the best microfinance charity, but we can’t honestly say that we think dollars given to it are accomplishing as much good as possible.</p></blockquote>
<p>Several possible interpretations here:</p>
<p>1. VillageReach is a &#8220;once in a blue moon&#8221; type opportunity for casual donors to do good; it&#8217;s unrealistic to expect comparable opportunities for casual donors on a regular basis.</p>
<p>2. GiveWell&#8217;s criteria are overly rigid in ways not necessarily correlated opportunities for casual donors doing the most good. </p>
<p>3. Thus far, venues where GiveWell has looked for quality charities are suboptimal; there are other places to look that would yield more fruitful results. </p>
<p>I have a poor sense of the relevance of each of the above mentioned factors. The above post seems to focus on (3), but maybe it&#8217;s worth considering (1) and (2) as well.</p>
<p>&#8212;&#8212;&#8212;&#8212;-</p>
<p>A question strongly related to that of why GiveWell has found only one VillageReach is the question of why VillageReach wasn&#8217;t able to secure adequate funding without GiveWell&#8217;s help. VillageReach&#8217;s pilot project was funded <a href="http://www.gatesfoundation.org/Grants-2004/Pages/VillageReach-OPP30874.aspx" rel="nofollow">by the Gates Foundation</a><a>. Why didn&#8217;t the Gates Foundation continue to fully fund VillageReach after the pilot project was successful?</p>
<p>Also according to the linked websites for The Skoll Foundation and for The Mulago Foundation, both foundations funded VillageReach. Is the fact that they did not single-handedly bridge VillageReach&#8217;s funding gap an indication that they deemed their other grantees to be offer roughly comparable expected return on investment? Is the overlap between the values of the above mentioned foundations and GiveWell&#8217;s values sufficiently great so that a casual donor would do nearly as well to donate to one of the above mentioned foundations rather than to GiveWell&#8217;s top recommended charities?</p>
<p>I have guesses of my own, and maybe one issue is that the foundations are not explicit about their reasons for funding the projects that they do; but it would be good to get a better picture of the reasons why VillageReach had difficulty bridging its funding gap in absence of GiveWell &#8211; it seems like thinking about this might point a way toward finding other opportunities to fund outstanding organizations with room for more funding.</a></p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Ian Turner</title>
		<link>http://blog.givewell.org/2011/02/21/givewells-plan-for-2011-specifics-of-research/comment-page-1/#comment-198755</link>
		<dc:creator>Ian Turner</dc:creator>
		<pubDate>Wed, 23 Feb 2011 17:38:17 +0000</pubDate>
		<guid isPermaLink="false">http://blog.givewell.org/2011/02/21/givewells-plan-for-2011-specifics-of-research/#comment-198755</guid>
		<description><![CDATA[I am extremely surprised to see you list &quot;Orphans and vulnerable children&quot; as a &quot;low burden of proof&quot; approach, given the number of well-publicized problems with orphanages, such as child trafficking, adoption profiteering, orphan tourism, and the possibility that creating (or funding) orphanages can move orphans from a home environment with an extended family member into an institution.

Saundra &lt;a href=&quot;http://goodintents.org/category/orphanages&quot; rel=&quot;nofollow&quot;&gt;has written extensively&lt;/a&gt; about orphanages; perhaps the most important of these posts is &quot;&lt;a href=&quot;http://goodintents.org/choosing-a-charity/does-funding-orphanages-create-orphans-2&quot; rel=&quot;nofollow&quot;&gt;Does funding orphanages create orphans?&lt;/a&gt;&quot;.]]></description>
		<content:encoded><![CDATA[<p>I am extremely surprised to see you list &#8220;Orphans and vulnerable children&#8221; as a &#8220;low burden of proof&#8221; approach, given the number of well-publicized problems with orphanages, such as child trafficking, adoption profiteering, orphan tourism, and the possibility that creating (or funding) orphanages can move orphans from a home environment with an extended family member into an institution.</p>
<p>Saundra <a href="http://goodintents.org/category/orphanages" rel="nofollow">has written extensively</a> about orphanages; perhaps the most important of these posts is &#8220;<a href="http://goodintents.org/choosing-a-charity/does-funding-orphanages-create-orphans-2" rel="nofollow">Does funding orphanages create orphans?</a>&#8220;.</p>
]]></content:encoded>
	</item>
</channel>
</rss>
