http://strata.oreilly.com/2012/08/analyzing-health-care-data-to-empower-patients.html
-Max
Introduction to the "omitted variable fraud" critique, continued
For the 1750-2010 period examined, two variables correlate strongly with the observed warming (and hence with each other). Solar magnetic activity and atmospheric CO2 were both trending upwards over the period, and both stepped up to much higher levels over the second half of the 20th century. These two correlations with temperature change give rise to the two main competing theories of 20th century warming. Was it driven by rapidly increasing human release of CO2, or by the 80 year "grand maximum" of solar activity that began in the early 1920′s? ("Grand minima and maxima of solar activity: new observational constraints," Usoskin et al. 2007.)
The empirical evidence in favor of the solar explanation is overwhelming. Dozens of peer-reviewed studies have found a very high degree of correlation (.5 to .8) between solar-magnetic activity and global temperature going back many thousands of years (Bond 2001, Neff 2001, Shaviv 2003, Usoskin 2005, and many others listed below). In other words, solar activity "explains," in the statistical sense, 50 to 80% of past temperature change.
Such a high degree of correlation over such long time periods implies causality, which can only go one way. Global temperature cannot be driving solar activity, so there must be some mechanism by which solar activity is driving or modulating global temperature change. The high degree of correlation also suggests that solar activity is the primarydriver of global temperature on every time scale studied (which is pretty much every time scale but the Milankovitch cycle).
In contrast, records of CO2 and temperature reveal no discernable warming effect of CO2. There is a correlation between atmospheric CO2 and temperature, but with CO2 changes following temperature changes by an average of about 800 years (Caillon 2003), indicating that it is temperature change that is driving atmospheric CO2 change (as it should, since warming oceans are able to hold less CO2). This does not rule out the possibility that CO2 also drives temperature, and in theory a doubling of CO2 should cause about a 1 degree increase in temperature before any feedback effects are accounted, but feedbacks could be negative (dampening rather than amplifying temperature forcings), so there no reason, just from what we know about the greenhouse mechanism, that CO2 has to be a significant player. The one thing we can say is that whatever the warming effect of CO2, it is not detectable in the raw CO2 vs. temperature data.
This is in glaring contrast to solar activity, which lights up like a neon sign in the raw data. Literally dozens of studies finding .5 to .8 degrees of correlation with temperature.
Psalms 82:1-8 God standeth in the congregation of the mighty; he judgeth among the gods. How long will ye judge unjustly, and accept the persons of the wicked? Selah. Defend the poor and fatherless: do justice to the afflicted and needy. Deliver the poor and needy: rid them out of the hand of the wicked. They know not, neither will they understand; they walk on in darkness: all the foundations of the earth are out of course. I have said, Ye are gods; and all of you are children of the most High. But ye shall die like men, and fall like one of the princes. Arise, O God, judge the earth: for thou shalt inherit all nations. [emphasis added] [BTW, I'm not sure what Selah means, but I think it's a musical term of some sort.]
John 10:23-39 And Jesus walked in the temple in Solomon's porch. Then came the Jews round about him, and said unto him, How long dost thou make us to doubt? If thou be the Christ, tell us plainly. Jesus answered them, I told you, and ye believed not: the works that I do in my Father's name, they bear witness of me. But ye believe not, because ye are not of my sheep, as I said unto you. My sheep hear my voice, and I know them, and they follow me: And I give unto them eternal life; and they shall never perish, neither shall any man pluck them out of my hand. My Father, which gave them me, is greater than all; and noman is able to pluck them out of my Father's hand. 30 I and my Father are one. Then the Jews took up stones again to stone him. Jesus answered them, Many good works have I shewed you from my Father; for which of those works do ye stone me? The Jews answered him, saying, For a good work we stone thee not; but for blasphemy; and because that thou, being a man, makest thyself God. Jesus answered them, Is it not written in your law, I said, Ye are gods? If he called them gods, unto whom the word of God came, and the scripture cannot be broken; Say ye of him, whom the Father hath sanctified, and sent into the world, Thou blasphemest; because I said, I am the Son of God? If I do not the works of my Father, believe me not. But if I do, though ye believe not me, believe the works: that ye may know, and believe, that the Father is in me, and I in him. Therefore they sought again to take him: but he escaped out of their hand,
2.) There's a variant of the Gambler's Fallacy that mostly applies to sports and other action games. The Hot-Hand fallacy is so called because in the sport of Basketball fans started getting this idea that if a player made two or three baskets in a row, they were "running hot" and more likely to score additional baskets and not miss. (We even see this in sports games like NBA Jam, where becoming "on fire" is actually a mechanic that gives the player a speed and accuracy advantage… and some cool effects like making the basket explode in a nuclear fireball.)
When probability theorists looked at this, their first reaction was that each shot is an independent event, like rolling dice, so there's no reason why previous baskets should influence future ones at all. They expected that a player would be exactly as likely to make a basket,regardless of what happened in the players' previous attempts.
Not so fast, said Basketball fans. Who says they're completely independent events? Psychology plays a role in sports performance. Maybe the player has more confidence after making a few successful shots, and that causes them to play better. Maybe the fans cheering them on gives them a little extra mental energy. Maybe the previous baskets are a sign that the player is hyper-focused on the game and in a really solid flow state, making it more likely they'll continue to perform well. Who knows?
Fair enough, said the probability theorists, so they looked at actual statistics from a bunch of games to see if previous baskets carried any predictive value for future performance.
As it turned out, both the theorists and sports fans were wrong. If a player made several baskets in a row, it slightly increased their chance of missing next time – the longer the streak, the greater the chance of a miss (relative to what would be expected by random chance). Why? I don't think we know for sure, but presumably there is some kind of negative psychological effect. Maybe the player got tired. Maybe the other team felt that player was more of a threat, and played a more aggressive defense when that player had the ball. Maybe the crowd's cheering broke the player's flow state, or maybe the player gets overconfident and starts taking more unnecessary risks.