The GiveWell Blog

Making Predictions about Our Grants

From sports announcers to political pundits to friends gossipping about romantic interests, lots of people make probabilistic predictions about the future. But only some actually follow up to see how well their predictions performed. For instance, you may have heard that weather forecasters predicted that the 2024 hurricane season had an 85% chance of being more active than normal and there would be 17 to 25 named storms. But in September, they were surprised that so far, it had been unexpectedly quiet, with climate change likely affecting weather patterns in ways scientists don’t fully understand.

GiveWell researchers often make forecasts about activities, milestones, and outcomes of the programs and research studies we recommend funding for, as well as decisions that GiveWell will make in the future. For example, we might forecast whether we’ll fund more hospital programs to implement Kangaroo Mother Care programs by 2027, or whether data collected about how many people are using chlorinated water will align with our expectations.

As a way to solicit external feedback on some of our predictions, we just launched a page on Metaculus, an online forecasting platform. Periodically, we will post forecasts there about GiveWell’s research and grants for the public to make their own predictions. Metaculus and other contributors will award $2,250 in prizes to people who leave insightful comments on a select group of forecasting questions. The deadline for comments is December 1, 2024.

Read More

GiveWell’s Research Council

As GiveWell grows and matures as an organization, we’re excited to continue learning from others in our field. We believe that actively seeking feedback on our work enables us to do more good. In May 2023, we launched a Research Council, a small group of experts we can consult on research questions and grant investigations.

We aimed to create a Council whose collective experience includes:

  • Deep familiarity with specific areas GiveWell researches
  • Substantial time working and/or living in the geographic areas where we fund work (low- and middle-income countries, primarily in Africa and South Asia)
  • Conducting research, especially randomized controlled trials (RCTs), on global health and development programs
  • Taking effective programs from pilot to scale
  • Working in partnership with major funding institutions and with country governments, especially the governments of countries where we support programs

So far, we’ve held three meetings with this full group to share further details of our research process and how we set our cost-effectiveness threshold. During these meetings, Council members provided helpful feedback about ways we might improve our research.

Read More