Best of JesseLiberty.com: Bayesian Probability

This from 2009:

Yudkowsky poses the following canonical problem:

1% of women at age forty who participate in routine screening have breast cancer. 80% of women with breast cancer will get positive mammographies. 9.6% of women without breast cancer will also get positive mammographies.

A woman in this age group had a positive mammography in a routine screening. What is the probability that she actually has breast cancer?

The frightening thing is that only 15% of doctors get this right. And they’re off by a lot. That is, the average answer is in the range of 80% while the correct answer is 7.8%. Apparently, there is something about the way we think about the problem that makes 7.8% hard to accept, and Yudkowsky does a great job of walking you through the logic in painfully small steps.

Let’s try something similar here…

What Do We Know & What Does It Imply?
We have three pieces of information:

1% of sample are TRUE (that is, they have cancer)

80% of sample who are TRUE will test TRUE

9.6% of sample who are FALSE will test TRUE.

On the face of it, we should guess that the percentage of women who test TRUE who actually are TRUE (test positive and actually have cancer) is pretty small based on two facts provided: the actual percentage of women from the sample who are TRUE (regardless of testing) is only 1%, and the test has a false positive for 9.6% of those tested.

So, to solve this:

1) Assume we have a sample of 1000 women (I use 1000 to reduce the amount I have to talk about fractional people, but I don’t use 10,000 as I get lost in the zeros).

2) We know that the reality is that of the 1,000 women, 10 will have cancer (1%).

990 = no cancer
10 = cancer

3) Of the 10 who have cancer, 8 will test positive
8 out 1000 women tested will test True and are True

4) Of the 990 with no cancer 9.6% will also test positive = 990 * .096 = 95.04.
95.04 women out of 1,000 will test True but are False.

5) The total number testing true is 8 + 95.04 = 103.04.
Of these, 8 actually have Cancer.

6) So the value for tests positive (103.04) versus is positive (8) is 8/103.4 or 0.773 or 7.8%

Unknown's avatar

About Jesse Liberty

Jesse Liberty has three decades of experience writing and delivering software projects and is the author of 2 dozen books and a couple dozen online courses. Liberty is a Senior AI Engineer at the University of Pittsburgh Medical Center, and was a Team Lead and Senior Software Engineer for various corporations, a Senior Technical Evangelist for Microsoft, a Distinguished Software Engineer for AT&T, a VP for Information Services for Citibank and a Software Architect for PBS. He is a 21 year Microsoft MVP.
This entry was posted in Essentials. Bookmark the permalink.

1,647 Responses to Best of JesseLiberty.com: Bayesian Probability

  1. You are a very clever person!

  2. As soon as I discovered this site I went on reddit to share some of the love with them.

  3. I’d have to examine with you here. Which is not one thing I usually do! I take pleasure in reading a post that may make folks think. Additionally, thanks for permitting me to comment!

  4. Howdy! I’m at work browsing your blog from my new apple iphone! Just wanted to say I love reading through your blog and look forward to all your posts! Carry on the fantastic work!

  5. I’d have to examine with you here. Which isn’t something I normally do! I take pleasure in studying a put up that may make people think. Additionally, thanks for allowing me to remark!

  6. Good post. I be taught one thing more difficult on different blogs everyday. It is going to all the time be stimulating to read content from different writers and practice slightly one thing from their store. I’d want to make use of some with the content material on my weblog whether or not you don’t mind. Natually I’ll offer you a hyperlink in your web blog. Thanks for sharing.

  7. This internet site is my inhalation, real fantastic style and design and perfect content.

  8. Hello, you used to write fantastic, but the last several posts have been kinda boring… I miss your super writings. Past several posts are just a little bit out of track! come on!

  9. olxtoto's avatar olxtoto says:

    You have observed very interesting points! ps decent website . “I hate music, especially when it’s played.” by Jimmy Durante.

  10. The Pink Salt Trick is a minimalist but effective morning routine: Just drink a glass of lukewarm water mixed with a pinch of Himalayan pink salt as soo

  11. whoah this blog is fantastic i love reading your posts. Keep up the great work! You know, a lot of people are looking around for this information, you could help them greatly.

  12. I enjoy what you guys tend to be up too. This type of clever work and exposure! Keep up the very good works guys I’ve you guys to my personal blogroll.

  13. The Pink Salt Trick is a minimalist but effective morning routine: Just drink a glass of lukewarm water mixed with a pinch of Himalayan pink salt as soo

  14. Hey! I know this is kinda off topic however I’d figured I’d ask. Would you be interested in trading links or maybe guest authoring a blog post or vice-versa? My blog goes over a lot of the same subjects as yours and I think we could greatly benefit from each other. If you happen to be interested feel free to shoot me an email. I look forward to hearing from you! Fantastic blog by the way!

  15. The Pink Salt Trick is a minimalist but effective morning routine: Just drink a glass of lukewarm water mixed with a pinch of Himalayan pink salt as soo

  16. Lipovive's avatar Lipovive says:

    Would you be considering exchanging hyperlinks?

  17. The Pink Salt Trick is a minimalist but effective morning routine: Just drink a glass of lukewarm water mixed with a pinch of Himalayan pink salt as soo

  18. As a Newbie, I am continuously searching online for articles that can help me. Thank you

  19. The Pink Salt Trick is a minimalist but effective morning routine: Just drink a glass of lukewarm water mixed with a pinch of Himalayan pink salt as soo

  20. ampera88's avatar ampera88 says:

    What i do not understood is actually how you’re not actually much more well-liked than you might be now. You are so intelligent. You realize thus considerably relating to this subject, produced me personally consider it from numerous varied angles. Its like women and men aren’t fascinated unless it’s one thing to do with Lady gaga! Your own stuffs great. Always maintain it up!

  21. I was very pleased to find this web-site.I wanted to thanks for your time for this wonderful read!! I definitely enjoying every little bit of it and I have you bookmarked to check out new stuff you blog post.

  22. gagah4d's avatar gagah4d says:

    Outstanding post, you have pointed out some excellent details , I besides conceive this s a very fantastic website.

  23. kaki268's avatar kaki268 says:

    I like what you guys are usually up too. This sort of clever work and coverage! Keep up the wonderful works guys I’ve added you guys to our blogroll.

  24. I like this site very much, Its a very nice billet to read and obtain info .

  25. Some truly nice and utilitarian info on this internet site, too I conceive the design contains fantastic features.

  26. You can certainly see your enthusiasm in the work you write. The world hopes for even more passionate writers like you who are not afraid to say how they believe. Always go after your heart.

  27. lgopro99's avatar lgopro99 says:

    You could certainly see your expertise within the work you write. The sector hopes for even more passionate writers such as you who aren’t afraid to say how they believe. All the time follow your heart.

  28. me encantei com este site. Para saber mais detalhes acesse o site e descubra mais. Todas as informações contidas são conteúdos relevantes e exclusivas. Tudo que você precisa saber está ta lá.

  29. I enjoy your work, regards for all the great content.

  30. Lipovive's avatar Lipovive says:

    What i don’t understood is in truth how you are no longer really much more neatly-favored than you might be now. You’re so intelligent. You already know therefore considerably on the subject of this topic, produced me in my opinion imagine it from a lot of numerous angles. Its like women and men are not fascinated unless it is something to do with Girl gaga! Your personal stuffs great. All the time maintain it up!

  31. Pretty! This was a really wonderful post. Thank you for your provided information.

  32. Prodentim's avatar Prodentim says:

    You can certainly see your skills in the work you write. The world hopes for more passionate writers such as you who are not afraid to say how they believe. At all times follow your heart.

  33. fascinate este conteúdo. Gostei muito. Aproveitem e vejam este conteúdo. informações, novidades e muito mais. Não deixem de acessar para saber mais. Obrigado a todos e até a próxima. 🙂

  34. Hi! I know this is kinda off topic but I was wondering which blog platform are you using for this website? I’m getting fed up of WordPress because I’ve had problems with hackers and I’m looking at options for another platform. I would be fantastic if you could point me in the direction of a good platform.

  35. Whats Happening i’m new to this, I stumbled upon this I have found It absolutely useful and it has aided me out loads. I hope to give a contribution & help different users like its helped me. Good job.

  36. macanempire's avatar macanempire says:

    Thanks for the good writeup. It actually used to be a enjoyment account it. Glance advanced to more added agreeable from you! By the way, how could we keep up a correspondence?

  37. you are really a good webmaster. The site loading speed is incredible. It seems that you’re doing any unique trick. In addition, The contents are masterpiece. you’ve done a excellent job on this topic!

  38. osteopatia's avatar osteopatia says:

    Hello! I could have sworn I’ve been to this blog before but after browsing through some of the post I realized it’s new to me. Anyways, I’m definitely happy I found it and I’ll be book-marking and checking back frequently!

  39. My brother recommended I would possibly like this blog. He was totally right. This submit truly made my day. You cann’t consider simply how so much time I had spent for this info! Thank you!

  40. I conceive this website has got very good pent content blog posts.

  41. per's avatar per says:

    ทำให้ relx artisan เป็นตัวเลือกยอดนิยมในตลาด.เยว่เค่อ บุหรี่ไฟฟ้า

  42. relx artisan's avatar relx artisan says:

    เครื่องสูบบุหรี่ไฟฟ้า ของ RELX มีให้เลือกหลากหลาย ทั้งรุ่น Infinity,พอตไฟฟ้า relx

  43. tlover tonet's avatar tlover tonet says:

    In this great design of things you’ll receive an A+ for effort. Where exactly you confused us was on all the specifics. As it is said, the devil is in the details… And that couldn’t be much more accurate in this article. Having said that, let me say to you just what did deliver the results. The article (parts of it) is actually rather convincing and this is most likely why I am making the effort to opine. I do not make it a regular habit of doing that. 2nd, while I can certainly notice the leaps in reasoning you make, I am not necessarily certain of how you appear to connect your details which inturn make the actual conclusion. For now I shall yield to your issue but hope in the near future you link your dots much better.

  44. tlovertonet's avatar tlovertonet says:

    I was very pleased to find this web-site.I wanted to thanks for your time for this wonderful read!! I definitely enjoying every little bit of it and I have you bookmarked to check out new stuff you blog post.

  45. This is really interesting, You’re a very skilled blogger.
    I’ve joined your rss feed and look forward to seeking more of your excellent post.
    Also, I have shared your website in my social networks!

    Also visit my webpage: himalayan pink salt trick for weight loss reviews

  46. gogogocheck's avatar gogogocheck says:

    I’m excited to discover this page. I wanted to thank you for your time for this particularly fantastic read!!
    I definitely loved every little bit of it and i also have you book marked to check out new information on your web site.

  47. Some really interesting points you have written.Helped me a lot, just what I was searching for : D.

  48. he blog was how do i say it… relevant, finally something that helped me. Thanks

Comments are closed.