Showing posts with label climate-change. Show all posts
Showing posts with label climate-change. Show all posts

Tuesday, November 24, 2009

On "tricks" and science

Are people really claiming that the word "trick", when used by climate scientists to describe a data analysis technique via a mailing list for other climate scientists, indicates some nefarious conspiracy of deception? Why yes, they are, and Acephalous has the rebuttal:

Global warming skeptics are attacking climate scientist Phil Jones for encouraging trickery in an email recently stolen off the webmail server at the University of East Anglia in which he wrote:

I've just completed Mike's Nature trick of adding in the real temps to each series for the last 20 years (ie from 1981 onwards) amd from 1961 for Keith's to hide the decline.

Over at RealClimate, the skeptical response to the word "trick" is to treat it as a colloquial:

Trick:
“a cunning or deceitful action or device; “he played a trick on me”; “he pulled a fast one and got away with it”
“Something designed to fool or swindle; ”
“flim-flam: deceive somebody; “We tricked the teacher into thinking that class would be cancelled next week”

. . .

Schmidt obliges:

. . . It's mostly used in mathematics, for instance in decomposing partial fractions, or deciding whether a number is divisible by 9 etc.etc.etc.

The skeptics rejoinder:

This is nonsense. Both are examples of teaching or explaining concepts to lay people. The first intentionally places “tricks” in quotations marks to emphasize its non-technical use.

The problem with nonspecialists reading the private correspondence of experts is that their ignorance transforms all the technical points into nefarious inkblots. To continue with the example above, skeptical nonspecialists encounter the word "trick" and ask for clarification. Schmidt provides evidence that the word is innocuous, but because nonspecialists can interpret neither the context of the original nor that of the further examples, they redouble their efforts: now the rhetorical situation in which the word "trick" is uttered matters; now the appearance of quotation marks matters, etc. They are convincing themselves that those black blobs represent what they insist they represent, and when experts inform them that those are not Rorschach blots to be subjectively interpreted—that they are, in fact, statements written in a language that skeptics simply do not understand—the nonspecialists look over them again and declare that it could be a butterfly, or maybe a bat.

For the programmers out there, this is a little like finding a comment in some random piece of program source code

// Hack: just disassemble the whole tree for now

and concluding that the author of the software is attempting to "hack" your password.

The word "trick", like the word "hack", is a term of art with an esoteric meaning different from its lay meaning. And no, "trick" does not denote either a deception or a way of "teaching concepts to lay people". See, for example, the tricks on Terence Tao's blog. Can anybody seriously believe that this amplification trick is "a way of explaining math to laypeople"? Well, I guess they can, if they're shooting their mouths off without having the least fucking clue what they're talking about.

So, OK, what does trick mean? Well, C. Shalizi's review of Tao's book gives a reasonable definition:

Tao’s third theme is tricks: patterns of establishing results that replicate across many situations, but in which any one result is too small to be a theorem in its own right, while the general pattern is too vague. These are an important part of how math actually gets done, but by their nature they tend not to have a recognized place in the curriculum, getting passed down by oral tradition, or by being absorbed by those who are lucky enough not only to run across a paper using the trick, but also to guess that it will generalize. There are numerous tricks throughout the book, and one of the nicest chapters, 1.9, expounds a family of tricks for improving inequalities, which Tao calls amplification.

Although, to be more precise, the climate scientists in question do not seem to be using the word "trick" in its narrowest mathematical sense, but rather in the more general sense of a useful technique — however, again, usually one too small to be publishable on its own [0] [1].


Incidentally, this sort of irresponsible misreading shows how little most climate change "skeptics" on the Internet know about math or science. Why the heck would I lend credence to people who don't know jack about scientific practice, and cannot be bothered to learn, and still feel comfortable dismissing thousands of working scientists as frauds? And especially why would I believe them over scientific professionals who have dedicated their lives to studying the data?

I mean, yesterday I got a comment on my previous post on climate change denialism saying:

Models that can exhibit large errors tend to exhibit them in the direction that the modellers would prefer. That's why real sciences use double-blind testing.

Anyone who doesn't know what results climate "scientists" are looking for isn't paying attention.

"Real" sciences use "double-blind testing"? O RLY? No wai! Blind testing, of either the single- or double- variety, is irrelevant to most experiments in the natural sciences. I would like to know what "double-blind" even means for a microarray assay; are we not informing the microscopic dots of DNA whether we've hybridized them or not? Are we getting them to sign little microscopic release forms and giving them little microscopic placebo pills?

If most researchers in the natural sciences even had to single-blind every experiment they do, they'd never get anything done. Natural science labwork is often incredibly laborious and grad students do not have time to, like, close their eyes and spin a little roulette wheel of test tubes every time they pipette a drop of reagent. The usual way to weed out observer bias is by (1) designing experimental methods which are relatively robust to observer influence; (2) repeating your experiments; and (3) describing a procedure in sufficient detail for other sufficiently trained people to reproduce the result. Blind experimentation is reserved for certain types of experiments where observer or subject bias is especially dangerous or probable.

As for the email the commenter links to, I find it hard to see anything suspicious about it. Here's an excerpt:

The Soon & Baliunas paper couldn't have cleared a 'legitimate' peer review process anywhere. That leaves only one possibility--that the peer-review process at Climate Research has been hijacked by a few skeptics on the editorial board.

. . .

[In quoted reply:] I looked briefly at the paper last night and it is appalling - worst word I can think of today without the mood pepper appearing on the email ! . . . The phrasing of the questions at the start of the paper determine the answer they get. They have no idea what multiproxy averaging does. By their logic, I could argue 1998 wasn't the warmest year globally, because it wasn't the warmest everywhere. With their LIA being 1300-1900 and their MWP 800-1300, there appears (at my quick first reading) no discussion of synchroneity of the cool/warm periods. Even with the instrumental record, the early and late 20th century warming periods are only significant locally at between 10-20% of grid boxes.

I'll freely admit that I don't know what the jargon means, but "they have no idea what X does" is not a phrasing I'd ever have wanted to read in a review of a paper of mine. This is not prima facie evidence of anything but that some journal published a bad paper.

And subversion of publication venues by cranks is actually an everpresent danger in the sciences. Do climate change denialists really believe that concern over a journal's publishing trash is evidence of a groupthink conspiracy? No doubt they'll be taking up the heroic cause of M. S. El Naschie next.


[0] The notion of "trick" seems loosely related to what the C.S. community calls a "pearl", except that pearls are perhaps more rigidly described, and computer scientists publish them in some venues regardless (e.g. ICFP). Truthfully the "unpublishability" of tricks and other semi-formal knowledge seems like a flaw in scientific publishing, albeit one that blogs and other Internet-based venues may be correcting.

[1] It's not even unheard-of for laypeople to use the word "trick" in roughly this sense. See: Clemenza's recipe from The Godfather. I look forward to climate skeptics' exegesis of the diabolical agenda behind Clemenza's spaghetti sauce.

Thursday, October 08, 2009

Why are so many IT workers climate change denialists?

Maybe it's just my imagination, but it seems that climate change denialism is even more common among programmer and sysadmin types than among engineers and applied scientists more generally. Without diving into climate science*, here are a few brief hypotheses.

  • Computers teach you to think in logic. Climate change modeling relies on the synthesis of a large number of statistical correlations rather than crisp rules of inference. Although logic and statistics are related (probability strictly generalizes logic, in a precise mathematical sense), a mind too narrowly conditioned to thinking in syllogisms may find it hard to reason statistically.
  • Computing workers spend a lot of time on the Internet, and are disproportionately likely to be white, male, and libertarian. Climate change denialism is seen as not only respectable but intellectually heroic by (a significant faction of) the tribe of white, male, libertarian Internet users. (Arguably this merely begs the question, however, as the direction of causality may go the other way.)
  • Computing workers are more socially isolated than people belonging to the same socioeconomic class. Because they spend less time around an intelligent, well-educated peer group, they are less socialized to defer to the knowledge of others.
  • Computing workers spend all their time around intricate machines which (a) they understand better than the general public, and (b) the general public has become heavily reliant upon. This breeds arrogance, and arrogance breeds disrespect for expertise in general. Disrespect for climatologists is simply a special case of this phenomenon. This, however, is true of almost any profession involving specialized knowledge, from plumbing to physical therapy to nursing; so this factor might not prove decisive, except for the next bullet...
  • Computing workers are, on average, more "autistic" and less "empathetic" on the autism/empathy spectrum. That is, they are unusually incompetent at modeling the mental and emotional states of other people. As a result, they fail to place themselves in the shoes of professional climatologists. That is, they do not imagine that most professional climatologists have worked hard to become experts in an esoteric and demanding (which is to say nerdy) intellectual discipline; might be driven by passion and curiosity and a desire to get it right; might along the way have been exposed to vast volumes of knowledge with which the lay observer is not familiar. In short, it is much easier to view literally thousands of scientists worldwide as a species of fools, liars, and conspirators when one assumes that they are nothing like oneself. (I strongly suspect that fewer IT workers would be climate change denialists if they realized that climate scientists are natural science geeks like them, whereas the primary beneficiaries of climate change denialism are corporate suits who were probably shoving geeks into lockers in high school.)

*About which, er, you can say whatever you like, but I'm going to listen to this guy.