Best of JesseLiberty.com: Bayesian Probability

This from 2009:

Yudkowsky poses the following canonical problem:

1% of women at age forty who participate in routine screening have breast cancer. 80% of women with breast cancer will get positive mammographies. 9.6% of women without breast cancer will also get positive mammographies.

A woman in this age group had a positive mammography in a routine screening. What is the probability that she actually has breast cancer?

The frightening thing is that only 15% of doctors get this right. And they’re off by a lot. That is, the average answer is in the range of 80% while the correct answer is 7.8%. Apparently, there is something about the way we think about the problem that makes 7.8% hard to accept, and Yudkowsky does a great job of walking you through the logic in painfully small steps.

Let’s try something similar here…

What Do We Know & What Does It Imply?
We have three pieces of information:

1% of sample are TRUE (that is, they have cancer)

80% of sample who are TRUE will test TRUE

9.6% of sample who are FALSE will test TRUE.

On the face of it, we should guess that the percentage of women who test TRUE who actually are TRUE (test positive and actually have cancer) is pretty small based on two facts provided: the actual percentage of women from the sample who are TRUE (regardless of testing) is only 1%, and the test has a false positive for 9.6% of those tested.

So, to solve this:

1) Assume we have a sample of 1000 women (I use 1000 to reduce the amount I have to talk about fractional people, but I don’t use 10,000 as I get lost in the zeros).

2) We know that the reality is that of the 1,000 women, 10 will have cancer (1%).

990 = no cancer
10 = cancer

3) Of the 10 who have cancer, 8 will test positive
8 out 1000 women tested will test True and are True

4) Of the 990 with no cancer 9.6% will also test positive = 990 * .096 = 95.04.
95.04 women out of 1,000 will test True but are False.

5) The total number testing true is 8 + 95.04 = 103.04.
Of these, 8 actually have Cancer.

6) So the value for tests positive (103.04) versus is positive (8) is 8/103.4 or 0.773 or 7.8%

Unknown's avatar

About Jesse Liberty

Jesse Liberty has three decades of experience writing and delivering software projects and is the author of 2 dozen books and a couple dozen online courses. His latest book, Building APIs with .NET, is now available wherever you buy your books. Liberty is a Senior SW Engineer for CNH and he was a Senior Technical Evangelist for Microsoft, a Distinguished Software Engineer for AT&T, a VP for Information Services for Citibank and a Software Architect for PBS. He is a Microsoft MVP.
This entry was posted in Essentials. Bookmark the permalink.

676 Responses to Best of JesseLiberty.com: Bayesian Probability

  1. I have not checked in here for a while because I thought it was getting boring, but the last several posts are great quality so I guess I’ll add you back to my everyday bloglist. You deserve it my friend 🙂

  2. Some times its a pain in the ass to read what blog owners wrote but this internet site is rattling user genial! .

  3. Wow! Thank you! I continually wanted to write on my website something like that. Can I implement a portion of your post to my blog?

  4. Hello my friend! I want to say that this article is awesome, nice written and include approximately all vital infos. I would like to see more posts like this .

  5. I’m still learning from you, as I’m trying to achieve my goals. I certainly liked reading everything that is written on your site.Keep the tips coming. I loved it!

  6. Well I definitely enjoyed studying it. This article provided by you is very practical for accurate planning.

  7. I will right away grab your rss feed as I can’t find your e-mail subscription link or newsletter service. Do you have any? Please let me know in order that I could subscribe. Thanks.

  8. layarkaca21's avatar layarkaca21 says:

    I’m commenting to let you know of the magnificent encounter my cousin’s princess obtained visiting your web site. She discovered a wide variety of things, including how it is like to have a wonderful helping nature to have the rest effortlessly have an understanding of selected grueling subject areas. You really did more than people’s desires. I appreciate you for presenting those important, dependable, explanatory and in addition easy tips about the topic to Ethel.

  9. Honey Trick's avatar Honey Trick says:

    Hello my friend! I wish to say that this article is awesome, nice written and include approximately all vital infos. I’d like to see more posts like this.

  10. sleeper sofa's avatar sleeper sofa says:

    Hiya, I’m really glad I have found this info. Nowadays bloggers publish only about gossips and web and this is actually annoying. A good blog with exciting content, this is what I need. Thanks for keeping this web-site, I will be visiting it. Do you do newsletters? Can’t find it.

  11. What i do not understood is actually how you are now not actually much more well-favored than you may be right now. You are so intelligent. You understand thus considerably in relation to this matter, produced me individually believe it from numerous numerous angles. Its like men and women aren’t fascinated except it’s something to do with Woman gaga! Your own stuffs great. All the time handle it up!

  12. olxtoto's avatar olxtoto says:

    Glad to be one of many visitors on this awful website : D.

  13. Excellent read, I just passed this onto a friend who was doing a little research on that. And he actually bought me lunch since I found it for him smile Therefore let me rephrase that: Thanks for lunch!

  14. Great tremendous things here. I?¦m very satisfied to look your post. Thanks a lot and i am taking a look forward to touch you. Will you please drop me a e-mail?

  15. You should participate in a contest for among the best blogs on the web. I will suggest this website!

  16. Hey very nice web site!! Guy .. Excellent .. Superb .. I’ll bookmark your blog and take the feeds additionally?KI’m happy to search out numerous helpful information here within the publish, we’d like develop extra techniques in this regard, thank you for sharing. . . . . .

  17. Someone necessarily help to make seriously posts I might state. This is the first time I frequented your website page and so far? I amazed with the research you made to make this particular publish extraordinary. Fantastic activity!

  18. F*ckin¦ awesome issues here. I¦m very satisfied to peer your article. Thanks so much and i’m having a look ahead to contact you. Will you please drop me a mail?

  19. Unquestionably believe that which you stated. Your favorite reason appeared to be on the net the easiest thing to be aware of. I say to you, I definitely get annoyed while people think about worries that they plainly don’t know about. You managed to hit the nail upon the top and defined out the whole thing without having side effect , people could take a signal. Will probably be back to get more. Thanks

  20. Thank you a lot for sharing this with all people you actually recognize what you’re speaking about! Bookmarked. Please also seek advice from my site =). We will have a link change agreement among us!

  21. Hi , I do believe this is an excellent blog. I stumbled upon it on Yahoo , i will come back once again. Money and freedom is the best way to change, may you be rich and help other people.

  22. Do you have a spam issue on this blog; I also am a blogger, and I was wanting to know your situation; many of us have created some nice procedures and we are looking to exchange methods with others, be sure to shoot me an email if interested.

  23. 312bet's avatar 312bet says:

    hi!,I like your writing very much! share we communicate more about your article on AOL? I require a specialist on this area to solve my problem. May be that’s you! Looking forward to see you.

  24. I believe this internet site holds very great indited articles articles.

  25. superb post.Never knew this, thanks for letting me know.

  26. You made some respectable points there. I appeared on the web for the problem and found most people will go together with along with your website.

Leave a Reply

Your email address will not be published. Required fields are marked *