Best of JesseLiberty.com: Bayesian Probability

This from 2009:

Yudkowsky poses the following canonical problem:

1% of women at age forty who participate in routine screening have breast cancer. 80% of women with breast cancer will get positive mammographies. 9.6% of women without breast cancer will also get positive mammographies.

A woman in this age group had a positive mammography in a routine screening. What is the probability that she actually has breast cancer?

The frightening thing is that only 15% of doctors get this right. And they’re off by a lot. That is, the average answer is in the range of 80% while the correct answer is 7.8%. Apparently, there is something about the way we think about the problem that makes 7.8% hard to accept, and Yudkowsky does a great job of walking you through the logic in painfully small steps.

Let’s try something similar here…

What Do We Know & What Does It Imply?
We have three pieces of information:

1% of sample are TRUE (that is, they have cancer)

80% of sample who are TRUE will test TRUE

9.6% of sample who are FALSE will test TRUE.

On the face of it, we should guess that the percentage of women who test TRUE who actually are TRUE (test positive and actually have cancer) is pretty small based on two facts provided: the actual percentage of women from the sample who are TRUE (regardless of testing) is only 1%, and the test has a false positive for 9.6% of those tested.

So, to solve this:

1) Assume we have a sample of 1000 women (I use 1000 to reduce the amount I have to talk about fractional people, but I don’t use 10,000 as I get lost in the zeros).

2) We know that the reality is that of the 1,000 women, 10 will have cancer (1%).

990 = no cancer
10 = cancer

3) Of the 10 who have cancer, 8 will test positive
8 out 1000 women tested will test True and are True

4) Of the 990 with no cancer 9.6% will also test positive = 990 * .096 = 95.04.
95.04 women out of 1,000 will test True but are False.

5) The total number testing true is 8 + 95.04 = 103.04.
Of these, 8 actually have Cancer.

6) So the value for tests positive (103.04) versus is positive (8) is 8/103.4 or 0.773 or 7.8%

Unknown's avatar

About Jesse Liberty

Jesse Liberty has three decades of experience writing and delivering software projects and is the author of 2 dozen books and a couple dozen online courses. Liberty is a Senior AI Engineer at the University of Pittsburgh Medical Center, and was a Team Lead and Senior Software Engineer for various corporations, a Senior Technical Evangelist for Microsoft, a Distinguished Software Engineer for AT&T, a VP for Information Services for Citibank and a Software Architect for PBS. He is a 21 year Microsoft MVP.
This entry was posted in Essentials. Bookmark the permalink.

1,647 Responses to Best of JesseLiberty.com: Bayesian Probability

  1. olxtoto's avatar olxtoto says:

    Great line up. We will be linking to this great article on our site. Keep up the good writing.

  2. Outstanding post, I conceive website owners should acquire a lot from this blog its rattling user friendly.

  3. Hi, just required you to know I he added your site to my Google bookmarks due to your layout. But seriously, I believe your internet site has 1 in the freshest theme I??ve came across. It extremely helps make reading your blog significantly easier.

  4. olxtoto's avatar olxtoto says:

    A formidable share, I just given this onto a colleague who was doing somewhat analysis on this. And he in fact bought me breakfast as a result of I found it for him.. smile. So let me reword that: Thnx for the treat! But yeah Thnkx for spending the time to debate this, I feel strongly about it and love reading extra on this topic. If attainable, as you grow to be experience, would you thoughts updating your blog with more details? It is highly useful for me. Big thumb up for this weblog publish!

  5. I was just looking for this information for a while. After six hours of continuous Googleing, at last I got it in your web site. I wonder what is the lack of Google strategy that don’t rank this type of informative sites in top of the list. Usually the top web sites are full of garbage.

  6. Good blog! I really love how it is simple on my eyes and the data are well written. I am wondering how I could be notified when a new post has been made. I have subscribed to your RSS feed which must do the trick! Have a great day!

  7. I like what you guys are up also. Such clever work and reporting! Carry on the superb works guys I have incorporated you guys to my blogroll. I think it’ll improve the value of my site 🙂

  8. zoom's avatar zoom says:

    This design is incredible! You most certainly know how to keep a reader amused. Between your wit and your videos, I was almost moved to start my own blog (well, almost…HaHa!) Wonderful job. I really loved what you had to say, and more than that, how you presented it. Too cool!

  9. I will right away grab your rss feed as I can not find your email subscription link or e-newsletter service. Do you have any? Kindly let me know in order that I could subscribe. Thanks.

  10. F*ckin’ amazing things here. I’m very satisfied to look your post. Thanks so much and i am having a look forward to contact you. Will you please drop me a mail?

  11. togel 4d's avatar togel 4d says:

    It’s really a great and useful piece of information. I’m glad that you shared this helpful info with us. Please keep us up to date like this. Thank you for sharing.

  12. ughoki's avatar ughoki says:

    I like what you guys are up also. Such clever work and reporting! Carry on the excellent works guys I¦ve incorporated you guys to my blogroll. I think it’ll improve the value of my web site 🙂

  13. bandar togel's avatar bandar togel says:

    I really like your writing style, fantastic info, regards for putting up :D. “I hate mankind, for I think myself one of the best of them, and I know how bad I am.” by Joseph Baretti.

  14. ughoki's avatar ughoki says:

    My brother suggested I might like this website. He was entirely right. This post actually made my day. You cann’t imagine just how much time I had spent for this info! Thanks!

  15. mpo500's avatar mpo500 says:

    Very interesting points you have mentioned, appreciate it for posting.

  16. olxtoto's avatar olxtoto says:

    Its like you read my mind! You seem to know so much about this, like you wrote the book in it or something. I think that you can do with a few pics to drive the message home a little bit, but instead of that, this is great blog. A great read. I will definitely be back.

  17. I am impressed with this website , rattling I am a fan.

  18. Thank you, I’ve just been searching for info about this topic for ages and yours is the best I’ve discovered till now. But, what about the bottom line? Are you sure about the source?

  19. Do you have a spam issue on this blog; I also am a blogger, and I was curious about your situation; we have created some nice methods and we are looking to swap solutions with other folks, please shoot me an e-mail if interested.

  20. Lovely just what I was looking for.Thanks to the author for taking his time on this one.

  21. I like what you guys are up also. Such clever work and reporting! Keep up the excellent works guys I¦ve incorporated you guys to my blogroll. I think it will improve the value of my web site 🙂

  22. mpo800's avatar mpo800 says:

    What’s Taking place i’m new to this, I stumbled upon this I have discovered It positively useful and it has helped me out loads. I’m hoping to contribute & aid other users like its aided me. Good job.

  23. videochat's avatar videochat says:

    Utterly indited written content, Really enjoyed looking through.

  24. agen togel's avatar agen togel says:

    I consider something genuinely special in this web site.

  25. I conceive other website owners should take this website as an model, very clean and great user friendly layout.

  26. olxtoto's avatar olxtoto says:

    Hiya! I know this is kinda off topic however , I’d figured I’d ask. Would you be interested in trading links or maybe guest writing a blog post or vice-versa? My blog covers a lot of the same subjects as yours and I feel we could greatly benefit from each other. If you happen to be interested feel free to shoot me an e-mail. I look forward to hearing from you! Fantastic blog by the way!

  27. salju88's avatar salju88 says:

    I like the helpful info you provide in your articles. I’ll bookmark your blog and check again here frequently. I’m quite sure I’ll learn lots of new stuff right here! Good luck for the next!

  28. olxtoto's avatar olxtoto says:

    I do love the way you have framed this problem and it does supply me personally some fodder for thought. Nonetheless, because of just what I have seen, I only trust when the remarks pack on that people keep on point and not start upon a soap box associated with some other news du jour. All the same, thank you for this outstanding point and whilst I can not necessarily agree with it in totality, I value the perspective.

  29. This is the right blog for anyone who wants to find out about this topic. You realize so much its almost hard to argue with you (not that I actually would want…HaHa). You definitely put a new spin on a topic thats been written about for years. Great stuff, just great!

  30. Very good blog! Do you have any helpful hints for aspiring writers? I’m hoping to start my own website soon but I’m a little lost on everything. Would you recommend starting with a free platform like WordPress or go for a paid option? There are so many choices out there that I’m completely confused .. Any tips? Bless you!

  31. slot online's avatar slot online says:

    You have mentioned very interesting details! ps nice web site. “Sutton lost 13 games in a row without winning a ballgame.” by Ralph Kiner.

  32. situs toto's avatar situs toto says:

    Excellent blog! Do you have any hints for aspiring writers? I’m planning to start my own site soon but I’m a little lost on everything. Would you suggest starting with a free platform like WordPress or go for a paid option? There are so many options out there that I’m completely confused .. Any ideas? Thank you!

  33. kelinciapi's avatar kelinciapi says:

    naturally like your web site but you need to check the spelling on quite a few of your posts. A number of them are rife with spelling issues and I find it very troublesome to tell the reality then again I will surely come back again.

  34. Great post. I am facing a couple of these problems.

  35. Appreciate it for all your efforts that you have put in this. very interesting info .

  36. kelinciapi's avatar kelinciapi says:

    you have a great blog here! would you like to make some invite posts on my blog?

  37. It’s really a great and helpful piece of information. I am glad that you shared this useful information with us. Please keep us up to date like this. Thank you for sharing.

  38. There is noticeably a bundle to know about this. I assume you made certain nice points in features also.

  39. kelinciapi's avatar kelinciapi says:

    Thank you for sharing superb informations. Your web site is very cool. I am impressed by the details that you?¦ve on this site. It reveals how nicely you perceive this subject. Bookmarked this web page, will come back for more articles. You, my pal, ROCK! I found simply the info I already searched everywhere and just could not come across. What a perfect web-site.

  40. I really lucky to find this internet site on bing, just what I was searching for : D likewise saved to bookmarks.

  41. When I initially commented I clicked the “Notify me when new comments are added” checkbox and now each time a comment is added I get four emails with the same comment. Is there any way you can remove me from that service? Bless you!

  42. toto's avatar toto says:

    Lovely just what I was looking for.Thanks to the author for taking his clock time on this one.

  43. mpo500's avatar mpo500 says:

    A person necessarily lend a hand to make severely posts I might state. This is the first time I frequented your website page and so far? I surprised with the research you made to make this actual publish extraordinary. Wonderful activity!

  44. situs slot's avatar situs slot says:

    Nice read, I just passed this onto a colleague who was doing a little research on that. And he just bought me lunch because I found it for him smile So let me rephrase that: Thank you for lunch!

  45. It’s really a cool and helpful piece of info. I am glad that you shared this useful information with us. Please keep us informed like this. Thanks for sharing.

  46. Nice read, I just passed this onto a colleague who was doing some research on that. And he just bought me lunch as I found it for him smile So let me rephrase that: Thank you for lunch! “To be 70 years young is sometimes far more cheerful and hopeful than to be 40 years old.” by Oliver Wendell Holmes.

  47. mpo500's avatar mpo500 says:

    I’m still learning from you, while I’m making my way to the top as well. I absolutely love reading all that is posted on your site.Keep the tips coming. I loved it!

  48. crime's avatar crime says:

    Hi, I think your site might be having browser compatibility issues. When I look at your website in Safari, it looks fine but when opening in Internet Explorer, it has some overlapping. I just wanted to give you a quick heads up! Other then that, fantastic blog!

  49. poolplane's avatar poolplane says:

    You can certainly see your skills within the paintings you write. The sector hopes for even more passionate writers like you who are not afraid to say how they believe. At all times go after your heart. “In order to preserve your self-respect, it is sometimes necessary to lie and cheat.” by Robert Byrne.

  50. I needed to create you the very little word in order to say thanks as before on the pretty concepts you have featured above. This has been quite extremely open-handed of people like you in giving publicly precisely what a number of people would’ve sold as an electronic book to earn some profit for their own end, chiefly seeing that you might well have tried it in the event you considered necessary. Those inspiring ideas as well worked to become a easy way to be aware that other people online have the same dreams like mine to figure out somewhat more with regard to this problem. I am certain there are many more pleasurable instances up front for individuals that see your site.

Comments are closed.