tag:blogger.com,1999:blog-9959776.post113929189815557617..comments2024-02-15T04:42:41.606+00:00Comments on James' Empty Blog: Last Chance SaloonJames Annanhttp://www.blogger.com/profile/04318741813895533700noreply@blogger.comBlogger19125tag:blogger.com,1999:blog-9959776.post-62070242662684397642010-01-13T01:14:53.168+00:002010-01-13T01:14:53.168+00:00Anything by Jaynes is good, and best of all, a lot...Anything by Jaynes is good, and best of all, a lot of it is freely available through the intertubes - Google really is your friend.James Annanhttps://www.blogger.com/profile/04318741813895533700noreply@blogger.comtag:blogger.com,1999:blog-9959776.post-62000555162165557852010-01-12T17:43:04.450+00:002010-01-12T17:43:04.450+00:00Hee, hee!
But seriously, folks.
The cognitive gulf...Hee, hee!<br />But seriously, folks.<br />The cognitive gulf between Bayesians and frequentists is either a crack in the sidewalk or the Grand Canyon, depending on how it's approached -- suggesting to me that there are some other issues motivating the discussion.<br />And I won't even try to add value to that discussion until I have read all of E.T. Jaynes' <i>Probability Theory: The Logic of Science.</i>jrehttps://www.blogger.com/profile/09970581038792305659noreply@blogger.comtag:blogger.com,1999:blog-9959776.post-27209162441214356232010-01-12T11:26:12.964+00:002010-01-12T11:26:12.964+00:00vi!vi!James Annanhttps://www.blogger.com/profile/04318741813895533700noreply@blogger.comtag:blogger.com,1999:blog-9959776.post-40564809883495042632010-01-11T21:00:51.131+00:002010-01-11T21:00:51.131+00:00Is it too late for me to point out what all right-...Is it too late for me to point out what all right-thinking people know to be true?<br /><br />emacs.<br /><br />There. That's better.<br />Or am I on the wrong thread?jrehttps://www.blogger.com/profile/09970581038792305659noreply@blogger.comtag:blogger.com,1999:blog-9959776.post-1139448534755810022006-02-09T01:28:00.000+00:002006-02-09T01:28:00.000+00:00Wolfgang,Where did they get their set of 10 initia...Wolfgang,<BR/><BR/>Where did they get their set of 10 initial states?<BR/><BR/>From a <I>Bayesian</I> prior (also informed by observations, of course).<BR/><BR/>Lumo put it very clearly in his last post, although I obviously disagree with what he considers to be doing your job "right":<BR/><BR/><I>Bayesian probabilities are always number that differ from 0 or 100 percent because you did not do your job right. Whenever you do these things right, all of your numbers will go either to 0 or 100 percent</I><BR/><BR/>It is unarguable that the uncertainty in a weather forecast is epistemic: if we knew the initial conditions better, and knew the behaviour of the atmosphere better, there is in principle no limit to how accurately we could forecast. The occurrence of rain tomorrow is not a random variable, merely an unknown one. We have no option but to use a Bayesian interpretation of probability here, and whether or not we make up an ensemble of model simulations is entirely a matter of practicality (it is only recently that the use of ensembles has become widespread). I could make an ensemble of hypothetical apples too, and see how many are <100g. But I have to choose them from a prior which necessarily has a subjective element. Has it not occurred to you that if there was such a thing as an objective answer, then different weather forecasters would never disagree?<BR/><BR/>But since you have already had this explained to you in great detail, and have apparently been unable to either understand or accept it, at this point I conclude that you are too stupid or stubborn to learn anything about the subject. Please go away and don't come back. Maybe some others passers-by have learnt something.James Annanhttps://www.blogger.com/profile/04318741813895533700noreply@blogger.comtag:blogger.com,1999:blog-9959776.post-1139445843757158642006-02-09T00:44:00.000+00:002006-02-09T00:44:00.000+00:00>> In your example of the weather prediction> But ...>> In your example of the weather prediction<BR/>> But how did the "scientists" make the forecasts in the first place?<BR/><BR/>James, you really managed to come full circle 8-) Congratulations!<BR/><BR/>As we told you, a "probability of 70% chance of rain tomorrow" either means that the scientists ran different simulations and 7 out of 10 gave rain.<BR/>Or it means 70% of the area will experience rain tomorrow or it can mean: In previous cases (with the same or very similar initial conditions) it was raining in 7 cases out of 10 the next day.<BR/><BR/>You can just continue reading your previous posts and our comments.<BR/>You no longer need us to comment here 8-)<BR/><BR/>Best greetings,<BR/>Mr. Not-thinking-Wannabee-Acolyte<BR/><BR/>PS: acolyte is actually with one c only.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-9959776.post-1139438457168268802006-02-08T22:40:00.000+00:002006-02-08T22:40:00.000+00:00In your example of the weather prediction, most pe...<I>In your example of the weather prediction, most people are able to make decisions</I><BR/><BR/> But how did the "scientists" make the forecasts in the first place? According to Lubos, <I>science prohibits to make any conclusions in these situations, except for charlatans who can always make them</I>.<BR/><BR/>I think it's very sad that so many people have such a narrow view of science. IMO weather prediction is a shining example of science at its best, demonstrating huge benefits to society and tested on a daily basis. But to Lubos, a forecast that predicts a 70% chance of rain is merely a demonstration that the forecaster didn't do their job right:<BR/><BR/><I>Bayesian probabilities are always number that differ from 0 or 100 percent because you did not do your job right. Whenever you do these things right, all of your numbers will go either to 0 or 100 percent</I><BR/><BR/>WRT decision-making, I suppose if knowing the value of the unknown parameter in question has no possible implications for any future decisions, then there is no particular need to apply ideas such as bayesian probability. In fact there's no reason to even measure it in the first place. Most scientific research concerns things that matter to us, at least a bit.James Annanhttps://www.blogger.com/profile/04318741813895533700noreply@blogger.comtag:blogger.com,1999:blog-9959776.post-1139407040999832362006-02-08T13:57:00.000+00:002006-02-08T13:57:00.000+00:00James - If you think I'm a Lumo accolyte, your dec...James - If you think I'm a Lumo accolyte, your decision making procedures are based on some pretty faulty priors.CapitalistImperialistPighttps://www.blogger.com/profile/17523405806602731435noreply@blogger.comtag:blogger.com,1999:blog-9959776.post-1139403832400884832006-02-08T13:03:00.000+00:002006-02-08T13:03:00.000+00:00Dear James,I see that you shifted the discussion o...Dear James,<BR/><BR/>I see that you shifted the discussion once again. Now you want to know how to make desicions under uncertainty.<BR/>I will limit myself to this one comment.<BR/>In your example of the weather prediction, most people are able to make decisions, because they encountered the same or similar situation many times and they simply counted how many times the weather man was correct and how many times he was wrong. If most people are uncertain about the quality of weather predictions it is because they fail to count patiently and just make up some subjective uncertainty instead. <BR/><BR/>I see that you use the strategy of name calling quite frequently. I have seen this strategy several times before, usually when people were uncertain about their ideas.<BR/>But in my experience this strategy is not very effective and usually backfires.<BR/><BR/>Best,<BR/>Mr. AccolyteAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-9959776.post-1139401974285318282006-02-08T12:32:00.000+00:002006-02-08T12:32:00.000+00:00Lumo,When a scientist is looking for the right ans...Lumo,<BR/><BR/><I>When a scientist is looking for the right answers, she may be uncertain in the middle and design subjective strategies how to deal with the uncertainty, but as long as she is uncertain, her knowledge is not settled science.</I><BR/><BR/>Well that's a fine strawman you've built yourself there.<BR/><BR/>Who said anything about the estimate being "settled science"? Of course it is not "settled science" to say the apple has a 10% chance of weighing less than 100g. It is simply an up-front representation of our uncertainty about the weight of the apple. If the weight of the apple matters, then we either use such a partially-subjective estimate, or we just make an arbitrary decision that does not take account of all the information which we have. <BR/><BR/>I can't believe that you, or anyone else, would seriously suggest the second course of action as being preferrable on either practical or theoretical grounds. Indeed I am confident that you pay attention to the weather forecast at least occasionally, despite the prediction being "not settled science". Presumably you think the only properly scientific weather forecast is "I'll tell you tomorrow" :-)<BR/><BR/>I note with amusement that you are simultaneously more hard-line and more realistic than your accolytes, firstly in asserting that "science prohibits to make any conclusions in these situations" and secondly in clearly acknowledging that it is in fact reasonable for a scientist to "design subjective strategies how to deal with the uncertainty". It's sad that you have such a limited vision of valid scientific behaviour, but I can only imagine that string theory's loss is the rest of the world's gain.James Annanhttps://www.blogger.com/profile/04318741813895533700noreply@blogger.comtag:blogger.com,1999:blog-9959776.post-1139375090069323632006-02-08T05:04:00.000+00:002006-02-08T05:04:00.000+00:00Dear James,you are free to use your subjective Bay...Dear James,<BR/><BR/>you are free to use your subjective Bayesian tools not justified by any measurements or tested theories, but you can't expect that others will consider these subjective statements to be objective science.<BR/><BR/>As you say correctly, we can't make your reasoning without the Bayesian notions. The reason is that science prohibits to make any conclusions in these situations, except for charlatans who can always make them.<BR/><BR/>The strength of your belief in Muhammed or the weight of an Apple being below 100 grams are just subjective things about your brain. We can study your brain scientifically, much like when we do experiments with mice, and scientifically predict what you say if someone asks you what is the weight of an apple.<BR/><BR/>But in that case, we study your brain, not the apple itself. Of course, when we study your brain scientifically, we again use the frequentist notions only, as opposed to unjustifiable priors and other dogmas - especially dogmas that are guaranteed to be wrong.<BR/><BR/>When a scientist is looking for the right answers, she may be uncertain in the middle and design subjective strategies how to deal with the uncertainty, but as long as she is uncertain, her knowledge is not settled science.<BR/><BR/>The numbers only become scientifically meaningful after sufficient "frequentist" statistics has been accumulated to trust them within the accuracy that were measured. This is manifestly false for all of your Bayesian fairy-tales. Your Bayesian probabilities are always number that differ from 0 or 100 percent because you did not do your job right. Whenever you do these things right, all of your numbers will go either to 0 or 100 percent (e.g. the probability that the apple is below 100 grams), and any intermediate answer is rubbish.<BR/><BR/>The only way how intermediate probabilities may make sense is if they express the ratios of events in the frequentist counting.<BR/><BR/>Best<BR/>LubosLuboš Motlhttps://www.blogger.com/profile/17487263983247488359noreply@blogger.comtag:blogger.com,1999:blog-9959776.post-1139365864569882182006-02-08T02:31:00.000+00:002006-02-08T02:31:00.000+00:00If each apple has the same price, I might try a fe...If each apple has the same price, I might try a few on the scale before buying. Much more likely, I will pay and go, unless the apple looks rotten or something. I will never take into account the fact that the scale has a random error, partly because I know systematic errors are more likely, but mainly because I don't believe there is any plausible way I could improve my bargain by doing do. I will bet that a) you don't either, or b) you don't do the shopping, or 3) you are loco.CapitalistImperialistPighttps://www.blogger.com/profile/17523405806602731435noreply@blogger.comtag:blogger.com,1999:blog-9959776.post-1139365123206971072006-02-08T02:18:00.000+00:002006-02-08T02:18:00.000+00:00CIP,Amazingly enough, James, billions of people wh...CIP,<BR/><BR/><I>Amazingly enough, James, billions of people who never heard of Bayes or Bayesian statistics make these decisions every day</I><BR/><BR/>And if they want to make the decisions carefully, weighing up all the evidence, then Bayesian methods enable them to formalise the process that they are subconsciously approximating.<BR/><BR/>If they <I>don't</I> weigh up all the evidence carefully, do you think their decisions are likely to be better, or worse, than if they <I>do</I>? It is easy to find examples on the web where the careless and unthinking interpretation of data will lead to poor decision making, due to inadequate consideration of the prior.<BR/><BR/>I still don't think I've seen you suggest any method by which you would make a decision in the case described, or any like it. Don't be shy now. Don't just say "you can't do that". Tell me what you would actually do if you wanted to buy a >100g apple. Do you simply ignore the readout on the scales and just toss a coin instead?James Annanhttps://www.blogger.com/profile/04318741813895533700noreply@blogger.comtag:blogger.com,1999:blog-9959776.post-1139362281761636682006-02-08T01:31:00.000+00:002006-02-08T01:31:00.000+00:00Amazingly enough, James, billions of people who ne...Amazingly enough, James, billions of people who never heard of Bayes or Bayesian statistics make these decisions every day. I'm pretty sure I make decisions on apples just like the other 6.8 billion or so people. Frankly, I amazed that not all the Bayesians have starved to death.CapitalistImperialistPighttps://www.blogger.com/profile/17523405806602731435noreply@blogger.comtag:blogger.com,1999:blog-9959776.post-1139350391264006982006-02-07T22:13:00.000+00:002006-02-07T22:13:00.000+00:00Wolfgang,You need to have a theoryActually I need ...Wolfgang,<BR/><BR/><I>You need to have a theory</I><BR/><BR/>Actually I need to make a decision (is the apple big enough, my apple pie needs a 100g apple to taste nice). I don't have a theory, nor do I have perfect measurements. I still need to make a decision. There is no null decision, no middle way between accepting the apple and rejecting it. There are no more measurements available. How would you decide?James Annanhttps://www.blogger.com/profile/04318741813895533700noreply@blogger.comtag:blogger.com,1999:blog-9959776.post-1139349174484407202006-02-07T21:52:00.000+00:002006-02-07T21:52:00.000+00:00So, I assume from this continued rejection of baye...So, I assume from this continued rejection of bayesian ideas that if you had a recipe which called for a minimum of 100g of apple, you would simply have no idea how to estimate whether the apple was big enough, no matter how accurate your scales were. In fact, the whole question is ill-posed to you two, since we have no "theory".<BR/><BR/>I don't believe that you act like this in the real world. If you did, you would never be able to make any decisions at all.James Annanhttps://www.blogger.com/profile/04318741813895533700noreply@blogger.comtag:blogger.com,1999:blog-9959776.post-1139332832922936892006-02-07T17:20:00.000+00:002006-02-07T17:20:00.000+00:00And one last time:You need to have a theory, in yo...And one last time:<BR/><BR/>You need to have a theory, in your example a knowledge about apples, to establish a reasonable "prior".<BR/><BR/>But once you have a theory, the distinction between Bayesian and frequentist is trivial (as you wrote yourself on CIPs blog).<BR/><BR/>And if you do not have a theory (could apples weigh 5000kg ?) it would be a mistake to just assume a "prior", just so that you can continue with your analysis.<BR/><BR/>PS: No more comment(s) from me about this. Enough is enough.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-9959776.post-1139321264272183752006-02-07T14:07:00.000+00:002006-02-07T14:07:00.000+00:00James, I would also like to point out that all you...James, I would also like to point out that all your "priors" were distributions, which have an intrinsic frequentist (or measure) interpretation. They would be theories, except for the fact that you permit yourself the freedom to make them up as you go along, seemingly arbitrarily.CapitalistImperialistPighttps://www.blogger.com/profile/17523405806602731435noreply@blogger.comtag:blogger.com,1999:blog-9959776.post-1139320826463433762006-02-07T14:00:00.000+00:002006-02-07T14:00:00.000+00:00I'd like to be there when you try out your Bayesia...I'd like to be there when you try out your Bayesian reasoning on the grocer.CapitalistImperialistPighttps://www.blogger.com/profile/17523405806602731435noreply@blogger.com