Best of JesseLiberty.com: Bayesian Probability

This from 2009:

Yudkowsky poses the following canonical problem:

1% of women at age forty who participate in routine screening have breast cancer. 80% of women with breast cancer will get positive mammographies. 9.6% of women without breast cancer will also get positive mammographies.

A woman in this age group had a positive mammography in a routine screening. What is the probability that she actually has breast cancer?

The frightening thing is that only 15% of doctors get this right. And they’re off by a lot. That is, the average answer is in the range of 80% while the correct answer is 7.8%. Apparently, there is something about the way we think about the problem that makes 7.8% hard to accept, and Yudkowsky does a great job of walking you through the logic in painfully small steps.

Let’s try something similar here…

What Do We Know & What Does It Imply?
We have three pieces of information:

1% of sample are TRUE (that is, they have cancer)

80% of sample who are TRUE will test TRUE

9.6% of sample who are FALSE will test TRUE.

On the face of it, we should guess that the percentage of women who test TRUE who actually are TRUE (test positive and actually have cancer) is pretty small based on two facts provided: the actual percentage of women from the sample who are TRUE (regardless of testing) is only 1%, and the test has a false positive for 9.6% of those tested.

So, to solve this:

1) Assume we have a sample of 1000 women (I use 1000 to reduce the amount I have to talk about fractional people, but I don’t use 10,000 as I get lost in the zeros).

2) We know that the reality is that of the 1,000 women, 10 will have cancer (1%).

990 = no cancer
10 = cancer

3) Of the 10 who have cancer, 8 will test positive
8 out 1000 women tested will test True and are True

4) Of the 990 with no cancer 9.6% will also test positive = 990 * .096 = 95.04.
95.04 women out of 1,000 will test True but are False.

5) The total number testing true is 8 + 95.04 = 103.04.
Of these, 8 actually have Cancer.

6) So the value for tests positive (103.04) versus is positive (8) is 8/103.4 or 0.773 or 7.8%

Unknown's avatar

About Jesse Liberty

Jesse Liberty has three decades of experience writing and delivering software projects and is the author of 2 dozen books and a couple dozen online courses. Liberty is a Senior AI Engineer at the University of Pittsburgh Medical Center, and was a Team Lead and Senior Software Engineer for various corporations, a Senior Technical Evangelist for Microsoft, a Distinguished Software Engineer for AT&T, a VP for Information Services for Citibank and a Software Architect for PBS. He is a 21 year Microsoft MVP.
This entry was posted in Essentials. Bookmark the permalink.

1,647 Responses to Best of JesseLiberty.com: Bayesian Probability

  1. It’s exhausting to seek out educated folks on this matter, however you sound like you recognize what you’re speaking about! Thanks

  2. I’m not that much of a internet reader to be honest but your blogs really nice, keep it up! I’ll go ahead and bookmark your site to come back later. Cheers

  3. Hello there! I know this is kinda off topic but I was wondering if you knew where I could get a captcha plugin for my comment form? I’m using the same blog platform as yours and I’m having difficulty finding one? Thanks a lot!

  4. Would love to always get updated great weblog! .

  5. slot pui68's avatar slot pui68 says:

    Oh my goodness! a tremendous article dude. Thanks Nevertheless I am experiencing subject with ur rss . Don’t know why Unable to subscribe to it. Is there anyone getting identical rss downside? Anybody who is aware of kindly respond. Thnkx

  6. Simply wanna state that this is very useful, Thanks for taking your time to write this.

  7. Nice read, I just passed this onto a colleague who was doing a little research on that. And he actually bought me lunch as I found it for him smile So let me rephrase that: Thanks for lunch!

  8. Wow! Thank you! I permanently wanted to write on my blog something like that. Can I implement a portion of your post to my blog?

  9. It’s appropriate time to make some plans for the future and it is time to be happy. I have read this post and if I could I desire to suggest you some interesting things or tips. Perhaps you could write next articles referring to this article. I want to read more things about it!

  10. Great post. I am facing a couple of these problems.

  11. Magnificent web site. Plenty of helpful information here. I’m sending it to several friends ans additionally sharing in delicious. And obviously, thanks to your effort!

  12. I think this site has got some really excellent info for everyone : D.

  13. I went over this web site and I believe you have a lot of wonderful info , saved to bookmarks (:.

  14. Hello my friend! I wish to say that this article is awesome, nice written and include almost all significant infos. I would like to see more posts like this.

  15. Rattling great info can be found on web blog. “I am not merry but I do beguile The thing I am, by seeming otherwise.” by William Shakespeare.

  16. I¦ve recently started a website, the information you provide on this site has helped me tremendously. Thank you for all of your time & work.

  17. What’s Taking place i am new to this, I stumbled upon this I have found It absolutely helpful and it has aided me out loads. I hope to give a contribution & assist other users like its aided me. Good job.

  18. M4markets's avatar M4markets says:

    엠포마켓과 함께하는 트레이딩의 이점을 알아보세요. 전 세계 수천 명의 트레이더가 왜 혁신적이고 신뢰할 수 있는 브로커로 엠포마켓을 선택하는지 확인하실 수 있습니다.

  19. Thank you for sharing excellent informations. Your website is very cool. I’m impressed by the details that you’ve on this site. It reveals how nicely you understand this subject. Bookmarked this website page, will come back for more articles. You, my pal, ROCK! I found simply the info I already searched all over the place and just could not come across. What a perfect web-site.

  20. Well I really enjoyed studying it. This article provided by you is very helpful for good planning.

  21. phtaya's avatar phtaya says:

    I think this is among the most significant info for me. And i’m glad reading your article. But wanna remark on some general things, The site style is ideal, the articles is really great : D. Good job, cheers

  22. I don’t even know how I ended up here, but I thought this post was great. I don’t know who you are but definitely you’re going to a famous blogger if you are not already 😉 Cheers!

  23. wps下载's avatar wps下载 says:

    Hi! Do you use Twitter? I’d like to follow you if that would be ok. I’m undoubtedly enjoying your blog and look forward to new updates.

  24. 166 bet 4's avatar 166 bet 4 says:

    Hi, i think that i saw you visited my site so i came to “return the favor”.I’m trying to find things to improve my website!I suppose its ok to use some of your ideas!!

  25. Hi, Neat post. There’s a problem with your web site in internet explorer, would test this… IE still is the market leader and a good portion of people will miss your excellent writing because of this problem.

  26. I savour, cause I found just what I used to be taking a look for. You have ended my four day long hunt! God Bless you man. Have a great day. Bye

  27. Have you ever thought about adding a little bit more than just your articles? I mean, what you say is fundamental and all. But just imagine if you added some great graphics or videos to give your posts more, “pop”! Your content is excellent but with images and videos, this website could certainly be one of the very best in its niche. Excellent blog!

  28. c333bet's avatar c333bet says:

    Thanks for the sensible critique. Me & my neighbor were just preparing to do some research on this. We got a grab a book from our local library but I think I learned more from this post. I’m very glad to see such great information being shared freely out there.

  29. Undeniably consider that which you stated. Your favorite reason appeared to be at the internet the easiest thing to consider of. I say to you, I definitely get annoyed at the same time as other folks think about concerns that they just don’t realize about. You controlled to hit the nail upon the highest and outlined out the whole thing without having side-effects , other folks can take a signal. Will probably be again to get more. Thank you

  30. Write more, thats all I have to say. Literally, it seems as though you relied on the video to make your point. You clearly know what youre talking about, why waste your intelligence on just posting videos to your site when you could be giving us something enlightening to read?

  31. Wow! Thank you! I continually needed to write on my blog something like that. Can I take a portion of your post to my site?

  32. student vps's avatar student vps says:

    Unquestionably believe that which you stated. Your favorite reason appeared to be on the internet the simplest thing to be aware of. I say to you, I certainly get irked while people consider worries that they just do not know about. You managed to hit the nail upon the top as well as defined out the whole thing without having side-effects , people can take a signal. Will likely be back to get more. Thanks

  33. Good web site! I truly love how it is easy on my eyes and the data are well written. I am wondering how I might be notified when a new post has been made. I have subscribed to your feed which must do the trick! Have a great day!

  34. Sweet blog! I found it while browsing on Yahoo News. Do you have any suggestions on how to get listed in Yahoo News? I’ve been trying for a while but I never seem to get there! Many thanks

  35. Saved as a favorite, I really like your blog!

  36. Write more, thats all I have to say. Literally, it seems as though you relied on the video to make your point. You obviously know what youre talking about, why throw away your intelligence on just posting videos to your weblog when you could be giving us something informative to read?

  37. magnificent submit, very informative. I wonder why the opposite specialists of this sector do not realize this. You must continue your writing. I am sure, you’ve a great readers’ base already!

  38. It is in point of fact a great and helpful piece of information. I am glad that you shared this helpful info with us. Please stay us informed like this. Thank you for sharing.

  39. When I initially commented I clicked the “Notify me when new comments are added” checkbox and now each time a comment is added I get several e-mails with the same comment. Is there any way you can remove me from that service? Appreciate it!

  40. bplwin's avatar bplwin says:

    What i do not realize is actually how you are not really much more well-liked than you may be now. You are so intelligent. You realize thus significantly relating to this subject, produced me personally consider it from so many varied angles. Its like men and women aren’t fascinated unless it’s one thing to accomplish with Lady gaga! Your own stuffs outstanding. Always maintain it up!

  41. Thank you for another fantastic article. The place else may anybody get that type of info in such a perfect way of writing? I have a presentation subsequent week, and I’m on the look for such info.

  42. I wanted to make a small message to be able to express gratitude to you for the awesome advice you are writing at this site. My particularly long internet investigation has at the end of the day been recognized with pleasant facts and strategies to go over with my family members. I ‘d tell you that we readers are rather blessed to dwell in a fabulous place with very many wonderful people with valuable basics. I feel really grateful to have come across your web page and look forward to plenty of more amazing times reading here. Thanks a lot again for all the details.

  43. I?¦ve learn several just right stuff here. Definitely worth bookmarking for revisiting. I surprise how so much effort you place to create this type of great informative web site.

  44. Hello my loved one! I wish to say that this article is awesome, nice written and come with almost all significant infos. I would like to look more posts like this .

  45. I think you have remarked some very interesting points, regards for the post.

  46. I conceive this website contains some real excellent info for everyone :D. “Morality, like art, means a drawing a line someplace.” by Oscar Wilde.

  47. I have read some good stuff here. Certainly price bookmarking for revisiting. I wonder how much effort you set to create this kind of great informative site.

  48. This is really interesting, You are an excessively professional blogger. I’ve joined your rss feed and look forward to in the hunt for extra of your wonderful post. Additionally, I’ve shared your site in my social networks!

  49. Just wanna input that you have a very nice site, I like the pattern it really stands out.

Comments are closed.