Best of JesseLiberty.com: Bayesian Probability

This from 2009:

Yudkowsky poses the following canonical problem:

1% of women at age forty who participate in routine screening have breast cancer. 80% of women with breast cancer will get positive mammographies. 9.6% of women without breast cancer will also get positive mammographies.

A woman in this age group had a positive mammography in a routine screening. What is the probability that she actually has breast cancer?

The frightening thing is that only 15% of doctors get this right. And they’re off by a lot. That is, the average answer is in the range of 80% while the correct answer is 7.8%. Apparently, there is something about the way we think about the problem that makes 7.8% hard to accept, and Yudkowsky does a great job of walking you through the logic in painfully small steps.

Let’s try something similar here…

What Do We Know & What Does It Imply?
We have three pieces of information:

1% of sample are TRUE (that is, they have cancer)

80% of sample who are TRUE will test TRUE

9.6% of sample who are FALSE will test TRUE.

On the face of it, we should guess that the percentage of women who test TRUE who actually are TRUE (test positive and actually have cancer) is pretty small based on two facts provided: the actual percentage of women from the sample who are TRUE (regardless of testing) is only 1%, and the test has a false positive for 9.6% of those tested.

So, to solve this:

1) Assume we have a sample of 1000 women (I use 1000 to reduce the amount I have to talk about fractional people, but I don’t use 10,000 as I get lost in the zeros).

2) We know that the reality is that of the 1,000 women, 10 will have cancer (1%).

990 = no cancer
10 = cancer

3) Of the 10 who have cancer, 8 will test positive
8 out 1000 women tested will test True and are True

4) Of the 990 with no cancer 9.6% will also test positive = 990 * .096 = 95.04.
95.04 women out of 1,000 will test True but are False.

5) The total number testing true is 8 + 95.04 = 103.04.
Of these, 8 actually have Cancer.

6) So the value for tests positive (103.04) versus is positive (8) is 8/103.4 or 0.773 or 7.8%

Unknown's avatar

About Jesse Liberty

** Note ** Jesse is currently looking for a new position. You can learn more about him at https://jesseliberty.bio Thank you. Jesse Liberty has three decades of experience writing and delivering software projects and is the author of 2 dozen books and a couple dozen online courses. His latest book, Building APIs with .NET, is now available wherever you buy your books. Liberty was a Team Lead and Senior Software Engineer for various corporations, a Senior Technical Evangelist for Microsoft, a Distinguished Software Engineer for AT&T, a VP for Information Services for Citibank and a Software Architect for PBS. He is a 13 year Microsoft MVP.
This entry was posted in Essentials. Bookmark the permalink.

1,647 Responses to Best of JesseLiberty.com: Bayesian Probability

  1. At this time it seems like WordPress is the top blogging platform available right now. (from what I’ve read) Is that what you’re using on your blog?

  2. Hi there just wanted to give you a quick heads up and let you know a few of the pictures aren’t loading correctly. I’m not sure why but I think its a linking issue. I’ve tried it in two different web browsers and both show the same outcome.

  3. Hey I know this is off topic but I was wondering if you knew of any widgets I could add to my blog that automatically tweet my newest twitter updates. I’ve been looking for a plug-in like this for quite some time and was hoping maybe you would have some experience with something like this. Please let me know if you run into anything. I truly enjoy reading your blog and I look forward to your new updates.

  4. basket168's avatar basket168 says:

    You are a very smart individual!

  5. Hello there, just became aware of your weblog through Google, and located that it is truly informative. I’m gonna be careful for brussels. I will be grateful if you happen to proceed this in future. Many other people might be benefited from your writing. Cheers!

  6. At this time it seems like Drupal is the top blogging platform available right now. (from what I’ve read) Is that what you are using on your blog?

  7. Timsothybioli's avatar Timsothybioli says:

    This post presents the ideas with clarity and thoughtfully, creating a discussion that feels welcoming and easy for readers.

    kinghills

  8. Newton Nosel's avatar Newton Nosel says:

    Excellent post. Keep writing such kind of info on your page. Im really impressed by it.

  9. Hey I know this is off topic but I was wondering if you knew of any widgets I could add to my blog that automatically tweet my newest twitter updates. I’ve been looking for a plug-in like this for quite some time and was hoping maybe you would have some experience with something like this. Please let me know if you run into anything. I truly enjoy reading your blog and I look forward to your new updates.

  10. Very interesting details you have observed, regards for putting up.

  11. At this time it looks like WordPress is the top blogging platform available right now. (from what I’ve read) Is that what you are using on your blog?

  12. Heya i am for the primary time here. I found this board and I find It really useful & it helped me out a lot. I am hoping to offer something back and aid others like you aided me.

  13. steel power's avatar steel power says:

    I dugg some of you post as I cerebrated they were handy very useful

  14. Hey I know this is off topic but I was wondering if you knew of any widgets I could add to my blog that automatically tweet my newest twitter updates. I’ve been looking for a plug-in like this for quite some time and was hoping maybe you would have some experience with something like this. Please let me know if you run into anything. I truly enjoy reading your blog and I look forward to your new updates.

  15. I truly prize your work, Great post.

  16. Can I simply just say what a relief to find an individual who genuinely knows what they are discussing over the internet. You definitely know how to bring a problem to light and make it important. More and more people have to read this and understand this side of your story. It’s surprising you aren’t more popular because you most certainly possess the gift.

  17. Admiring the persistence you put into your site and in depth information you offer. It’s awesome to come across a blog every once in a while that isn’t the same old rehashed information. Excellent read! I’ve saved your site and I’m including your RSS feeds to my Google account.

  18. Right now it sounds like Drupal is the preferred blogging platform available right now. (from what I’ve read) Is that what you are using on your blog?

  19. Hi there, You’ve performed a fantastic job. I will definitely digg it and for my part recommend to my friends. I’m sure they will be benefited from this website.

  20. WONDERFUL Post.thanks for share..extra wait .. …

  21. Hello there, You have performed an excellent job. I will definitely digg it and individually recommend to my friends. I am sure they will be benefited from this web site.

  22. Wendi's avatar Wendi says:

    At this time it appears like BlogEngine is the best blogging platform out there right now. (from what I’ve read) Is that what you are using on your blog?

  23. Lezlie's avatar Lezlie says:

    Wow that was unusual. I just wrote an really long comment but after I clicked submit my comment didn’t appear. Grrrr… well I’m not writing all that over again. Anyway, just wanted to say excellent blog!

  24. Azucena's avatar Azucena says:

    Aw, this was an extremely nice post. Spending some time and actual effort to generate a top notch article… but what can I say… I hesitate a whole lot and don’t manage to get anything done.

  25. bos138's avatar bos138 says:

    I think this web site contains some real fantastic info for everyone :D. “The test of every religious, political, or educational system is the man that it forms.” by Henri Frdric Amiel.

  26. Deference to author, some wonderful selective information.

  27. Jaimie's avatar Jaimie says:

    Hey there, You have performed a great job. I’ll definitely digg it and in my view recommend to my friends. I’m sure they will be benefited from this web site.

  28. Great blog here! Additionally your site quite a bit up fast! What web host are you using? Can I am getting your affiliate hyperlink to your host? I want my site loaded up as fast as yours lol

  29. Antionette's avatar Antionette says:

    At this time it looks like Drupal is the top blogging platform out there right now. (from what I’ve read) Is that what you are using on your blog?

  30. Vanesa's avatar Vanesa says:

    Excellent article. Keep writing such kind of info on your blog. Im really impressed by it.

  31. Janie's avatar Janie says:

    Currently it sounds like WordPress is the top blogging platform available right now. (from what I’ve read) Is that what you’re using on your blog?

  32. Jazmine's avatar Jazmine says:

    May I simply say what a comfort to find somebody that truly understands what they’re discussing on the internet. You actually know how to bring an issue to light and make it important. More and more people really need to look at this and understand this side of the story. I can’t believe you’re not more popular because you most certainly possess the gift.

  33. you are really a good webmaster. The site loading speed is incredible. It seems that you are doing any unique trick. Also, The contents are masterpiece. you’ve done a excellent job on this topic!

  34. Nora's avatar Nora says:

    Hey there, You have done an incredible job. I will definitely digg it and personally recommend to my friends. I’m sure they will be benefited from this site.

  35. live score's avatar live score says:

    I really appreciate this post. I’ve been looking all over for this! Thank goodness I found it on Bing. You’ve made my day! Thanks again

  36. Hey There. I found your blog using msn. This is an extremely well written article. I will be sure to bookmark it and come back to read more of your useful info. Thanks for the post. I’ll certainly return.

  37. Today, I went to the beach front with my kids. I found a sea shell and gave it to my 4 year old daughter and said “You can hear the ocean if you put this to your ear.” She put the shell to her ear and screamed. There was a hermit crab inside and it pinched her ear. She never wants to go back! LoL I know this is completely off topic but I had to tell someone!

  38. moto rental's avatar moto rental says:

    Only wanna input on few general things, The website style and design is perfect, the content material is real fantastic : D.

  39. Hey I know this is off topic but I was wondering if you knew of any widgets I could add to my blog that automatically tweet my newest twitter updates. I’ve been looking for a plug-in like this for quite some time and was hoping maybe you would have some experience with something like this. Please let me know if you run into anything. I truly enjoy reading your blog and I look forward to your new updates.

  40. Excellent post. Keep writing such kind of info on your blog. Im really impressed by it.

  41. Excellent post. Keep posting such kind of information on your blog. Im really impressed by your site.

  42. Hello there, You have performed an excellent job. I will definitely digg it and in my opinion recommend to my friends. I am sure they will be benefited from this website.

  43. Hi, i think that i saw you visited my website so i came to “return the favor”.I am attempting to find things to enhance my web site!I suppose its ok to use a few of your ideas!!

  44. Wow that was strange. I just wrote an incredibly long comment but after I clicked submit my comment didn’t show up. Grrrr… well I’m not writing all that over again. Anyways, just wanted to say excellent blog!

  45. Hey there, You have performed a fantastic job. I’ll definitely digg it and for my part suggest to my friends. I am sure they will be benefited from this site.

  46. IM网站's avatar IM网站 says:

    Can I just say what a relief to find a person that really knows what they’re discussing online. You certainly realize how to bring a problem to light and make it important. A lot more people need to check this out and understand this side of your story. I can’t believe you are not more popular given that you definitely have the gift.

Leave a Reply

Your email address will not be published. Required fields are marked *