Stupidest Headline of the Day
I was having trouble with my email, so I went over to the RoadRunner site to get some help. There I was confronted by a headline of truly epic stupidity:
Big Comeback for McCain?
No. Really. That's what it said. Stupid picture of McCain blearily giving a thumbs-up. Click on it and it links to a CNN story about the "tightening" of the race.
Now, I must admit I've found it remarkable how much more likely CNN polls are to find a race "close" or "tightening" or "neck and neck" or "closing back up" than other polls and I've even fired off the occaisional snide comment. However, I was only half serious until I read the thoughts of someone much smarter than I am about these things, specifically, the words of Sam Wang at the Princeton Electoral Consortium.
Uncertainties such as the margin of error can be reduced by taking more samples. An individual pollster can halve the margin of error by surveying 4 times as many people. It's a square-root relationship: N samples lead to a sqrt(N)-fold reduction in uncertainty. The same is true for combining polls, with the added advantage of reducing the effects of methodological variation. Thus the value of poll-aggregation sites like this one. Meta-Analysis worked extremely well in 2004 and 2006, and is likely to do so again this year.
So why don't more pollsters or media organizations aggregate polls? The CNN Poll of Polls is a start, but it's an exception. Two forces encourage bad horserace reporting:
Competition among pollsters. It's not in the interest of individual pollsters to say "average my results with the others." It's also not advantageous to collect a larger sample once the margin of error meets industry standards.
The hungry media beast. With news budgets on the decline, it's costly to report real news. Why pay for investigative reporting when you can buy a poll and report the horserace? Within the area of poll reporting, market forces discourage high accuracy. For example, commissioning a survey of 4 times as many people would reduce uncertainty by a factor of two. But why pay 4 times as much for data that generate a lower likelihood of an apparent - and reportable - swing?
Dr. Wang was responding, specifically, to that Gallup poll that showed the race within two points that McPow was selectively gloating about on Fox yesterday. But his point also applies to CNN polls. And it's the point of what both Wang and Nate Silver do at their websites (even if Wang does tend to sniff a bit at Pablano's methodology).
They're both good places to go if you want to see what the polls really tell us about the race. Wang's site tells us how many electoral votes Obama would get if the election were held today, providing an upper and lower range, along with the best guess about where it would really land. Last time, Wang's prediction the day before the election was dead-on balls accurate (or it would have been had he not introduced an erroneous assumption about undecided voters into his math at the last minute.). Fivethirtyeight purports to make a prediction of how many electoral votes the candidates will win on election day based upon a far more complicated, and thus far untested, methodology, but its far more entertaining than Wang's site and its got better commentary.
They're both smart guys. I'm smart enough to more or less understand what they're doing, but nowhere near smart enough to do it myself. I check them both every day. Today, Fivethirtyeight predicts Obama will get 344 electoral votes. Wang projects that if the election were held today, Obama would get 364 electoral votes and, within the range of the aggregated confidence intervals says it would come in at a minimum of 330.
Is the race tightening up a bit? Quite possibly. Obama predicts it and Silver seems to believe its happening, but until the electoral vote projection of either of these guys drops below, say, 300, I'm not getting dressed for the Chicken Dance.
By the way, totally off-topic, but if you want to see my nominee for the iconic campaign photo of Campaign 2008, here it is, an AP photo from yesterday's rally in Fatalburg, er, Fayetteville that was plastered across the front page of our local rag this morning.





I'm sure you've got loads of time on your hands, and won't find the following request too burdensome, at all: could you please do a "Stupidest headline of the day" every other day or so before the election?
I mean, it's not like you have any other responsibilities, right?
Seriously, it would be a public service for all of us trying to jam our chicken little outfits into the trash compactor, but not really succeeding.
October 21, 2008 11:26 AM | Reply | Permalink
CT. Cats and chickens are not a good combination.
Poll cats are often off putting for many with very little margin of error. Jake Taper is not reporting enough movement in Wyoming to get you any less anxious. Try Halloween shopping on QVC.
October 21, 2008 12:28 PM | Reply | Permalink
Worth a rec'd - just for the photo!
October 21, 2008 12:18 PM | Reply | Permalink
Worth a rec'd - just for the photo!
October 21, 2008 12:19 PM | Reply | Permalink
This system drives me nuts!
October 21, 2008 12:20 PM | Reply | Permalink
Steve, plese edit that headline for spelling.
Otherwise, nice points.
October 21, 2008 12:50 PM | Reply | Permalink
One particularly embarrassing misspelling, down the Memory Hole.
October 21, 2008 3:20 PM | Reply | Permalink
Great photo!
October 21, 2008 1:19 PM | Reply | Permalink
It is a good photo! I could have done without the poll commentary -- all that stuff goes simultaneously over my head and in one eye and out the other.
When it comes to mathematics, count me out.
October 21, 2008 1:34 PM | Reply | Permalink
I am completely in love with fivethirtyeight.com. It is the first website I check every morning. Nate Silver is a pretty interesting dude--I can't wait to see the final tally on this election to see how well his program worked.
The race may be tightening in the tracking polls, but they're notoriously erratic. Nate actually posted a piece on the tracking polls and how credible he finds them as well as how they come up with their numbers--a pretty good read if you're as fascinated as I am. Though I'm likely in the minority on this!
What you honestly have to look at is the Electoral Map (Viva Chuck Todd!) which is resoundingly blue right now. As Steve noted, Nate has Barack at 344 right now--landslide city. Rec'd up, Steve! Good work! Love the Get Fuzzy av as well!
October 21, 2008 4:01 PM | Reply | Permalink
Right now, CNN on its home page is going with"CNN poll: Presidential race tighter" while on its Politics home page, it's running "Obama widens lead in national poll." Both articles are talking about the same poll.
Something for everybody.
October 21, 2008 4:04 PM | Reply | Permalink
Proving once again that news and information are not necessarily the same thing in the 21st Century.
October 21, 2008 5:22 PM | Reply | Permalink
Don't tell me that a large company like CNN doesn't have somebody actively looking out for continuity errors?
Ridiculous--Steve's right, news and information are moving to opposite ends of the spectrum.
October 21, 2008 6:28 PM | Reply | Permalink