Reposting this with permission from Toby Ord (the original author):
http://www.facebook.com/topic.php?uid=4 ... topic=3320
One of the most prominent causes in developed world charity is guide dogs for the blind. Guide dogs do indeed provide a large benefit to their owners, bringing them more mobility and independence. But what if for the same price, we could actually cure a person of blindness? That would be much better. It is much better to be able to see than to merely have a guide dog to help you. The curing charity would win hands down. Now what if you could cure 10 people for the same cost? That would be amazing. What if you could cure 100 people? Astounding! What if you could cure 1000 people? I've run out of appropriate adjectives, but it is *very much better*.
According to Charity Navigator, the world's 'premier' charity rating service, The Seeing Eye is a 4 star charity. That is the highest accolade and means:
'Exceeds industry standards and outperforms most charities in its Cause.'
The Seeing Eye estimate that it costs them US$50,000 to breed and train a guide dog and to train its recipient. This is not including the costs to the recipient in feeding it for the rest of its ten year working life.
In contrast, the Fred Hollows Foundation can completely cure someone of blindness for only US$22 (their estimate) or US$53 (our safe upper bound). Thus you can cure about 1,000 people of blindness for the price of providing one person a guide dog.
In what sense is The Seeing Eye an efficient charity, as Charity Navigator proclaim? They perform at less than a tenth of a percent of the efficiency of the Fred Hollows Foundation. Ninety percent I could understand, but a tenth of a percent?
I hope this illustrates the problem of the astounding variability in charity effectiveness. I did choose my charities somewhat carefully, but The Seeing Eye is hardly a fringe group: it is the world pioneer guide dog charity (its name is so famous that is often used to refer to any guide dog) and The Seeing Eye is rated with full marks by the world's most prominent charity analysis website. I could have found much more extreme examples if I were to pick a typical developed world charity rather than such a prominent one.
Something is seriously wrong here! You can see why we need better advice when donating. Charity Navigator determine all of their advice from rather meaningless financial details such as the percentage of income spent on administration (you've no doubt seen such figures prominently displayed elsewhere). Who cares if they spend 8% or 12% on administration when they could be doing work over one thousand times as effective elsewhere? Even if the Fred Hollows Foundation started spending 99% of its income on administration, they would still outperform The Seeing Eye. Given the startling lack of insight into effectiveness amongst charities, I think that more money spent on administration is probably better rather than worse. It really is best to completely ignore this percentage (and Charity Navigator for that matter) and focus on what the charities actually do with the money. This is what Giving What We Can's charity analysis arm does: producing robust estimates of a charity's efficiency based on their proven effects divided by their total earnings. This way money on administration is rewarded exactly when it improves the benefits per dollar.
Now what of developing world charities? What is the range of efficiency there? Surely it is smaller, as we are focusing on where we can do more good per dollar?
The range here should indeed typically be smaller, but it is still wide. Even amongst direct health interventions in the developing world (a field that is quite concrete and testable) there are still about 3 to 4 orders of magnitude difference. Health benefits are often measured in disability adjusted life years (DALYs). These respect that we can never 'save' lives but only extend them, and they also take into account improvements in morbidity as well as mortality. A disability adjusted life year is a year of life in perfect health, or two years lifting someone from half health to full health etc. There is obviously an issue in how to rate the burden of different disabilities, but they do a pretty good job of it through extensive surveys about how people with and without the disabilities actually judge their quality of life and how much life at the disabled level they would trade for a year at full health.
We can then see that there are health interventions provided in sub-Saharan Africa that cost as much as $12,000/DALY (eg Meningitis vaccine) and others that cost as little as $4/DALY (eg Measles vaccine). This is a factor of 3,000 or 3.5 orders of magnitude. Have a look at:
http://www.dcp2.org/page/main/BrowseInterventions.html
(click View Interventions)
Note that both of these estimates are rated at the highest level of accuracy as they are based on original approved research across multiple countries in sub-Saharan Africa.
Think of the interventions as a group of four buckets sitting side by side. If you put a dollar in the first bucket, it produces some reasonably sized benefit (a larger benefit than it would produce for yourself). If you put it in the second bucket it produces ten times this benefit. The third bucket is ten times that and the fourth bucket produces ten times the benefit of that.
Bucket 1: 1x (eg Meningitis vaccine to sub-Saharan Africa)
Bucket 2: 10x
Bucket 3: 100x
Bucket 4: 1,000x (eg Measles vaccine to sub-Saharan Africa)
When people typically give to charity, they put their money in one of the buckets at random. They aren't aware that there is such a large difference and never really think about it. Perhaps (and not unreasonably) they would expect to be told about it if the differences were more than a factor of two...
Few people ever do find out about these differences, but you are now one of them. Once we know about these differences, we have to make sure that all money goes into the final bucket — at least until such a time comes as we run out of interventions that effective. To change metaphors: we need to go after the low hanging fruit first.
Over the last few paragraphs, I have been talking about *interventions* and these are slightly different to *charities* because different charities may do the same intervention with different efficiency or do a spread of interventions. When we give, we give to a particular charity, not a particular intervention. Let's consider large and small NGOs separately.
In general NGOs aren't great at focusing on what is the best use of money. For example they feel obliged to keep up old projects even if they haven't worked so well. Large NGOs (like Oxfam etc) end up doing a spread of interventions of wildly varying efficiency. My guess is that Oxfam (which appears to be one of the best of them) will have the bulk of its projects spread over about 2 orders of magnitude in efficiency: money to Oxfam will mainly go into the top two buckets.
Small aid organizations are also quite poor at choosing the most effective interventions. I'd guess that very few of them even consider tables such as the one above before deciding what they will focus on. The founders probably just do what they are good at with little thought to their effectiveness. The big benefit of small organizations is that we can work out which are the good ones and support only those -- achieving the most good per dollar we give. That way every dollar we give goes into the top bucket instead of the top two. Even if our analysis isn't perfectly accurate and we are sometimes off by a factor of two, that is still accurate enough to show you where you can give your money so that it goes into the top bucket (though it will remain hard to get to the top part of the top bucket).
Giving What We Can is currently a very small (pre-launch) organization. We have been working on the final version of the website, on the exact nature of the organization and on finding a group of prominent initial members. We haven't been able to do all that much direct analysis of charities/NGOs so far, but much more will be coming over he next year (if you want to volunteer to help with this, then please do email me). It is very difficult to assess the large NGOs like Oxfam, but as the above analysis shows, our efforts seem better spent on finding the best smaller organizations. For now, I can't see anyone better to give to than the Fred Hollows Foundation.
There are many more points to raise in any discussion of efficiency, such as what to do about interventions that are hard to compare (eg Measles vaccine vs curing blindness vs lobbying for free trade). Rest assured that we are not ignoring such things, but merely don't have the space to talk about all of them at once. Hopefully this has sparked an interest in aid effectiveness and a realization of how silly the current allocation of donations is. Hopefully you will never again just give 'to charity' without thinking about the effectiveness of the gift. Don't just save a life. Save ten thousand.
http://www.facebook.com/topic.php?uid=4 ... topic=3320