TPMCafe
« Socialist Rhetoric | Home | Chutzpah: West Bank Settlers Complain That Checkpoints Make Them Late For Work »

"What Does It Mean To Be "Undecided" OR "Haven't Made Up Your Mind" ?

user-pic

polls
Live from Cincinnati: It's Tuesday afternoon! Is that quick and bloggy enough for the TPM Café? Well, here's my not so bloggy beginning, with a thought to loosening up later in the week once I get my first, coherent two cents on the cyber-table.

Yes, the standard vote-choice question developed by Gallup and imitated by countless other pollsters certainly does minimize the "undecideds", especially during the earlier time periods preceding the election, such as the summer. So David's post and critique of the standard practice in the field (elaborated in his book, which I just finished reading last week) is largely on target, but I don't think David goes quite far enough in digging into a even bigger issue: the meaning of saying you're "undecided" or that you "haven't made up your mind" or "could change your mind before Election Day".

Mark's right: "A preference is often not a final decision." preference is often not a final decision." And yes, Nancy, question wording may just be the tip of the iceberg for all the reasons you have enumerated, particularly the likely voter screens and turnout models, a lot of which appears to be proprietary and therefore unavailable for us un-insiders to scrutinize.

But I'm thinking of a deeper iceberg: What exactly does it mean when someone says they're "undecided", that they "might change their mind", or that they "lean" this way or that way? And do these response categories mean the same thing in late October or early November, when voters' preferences are presumably firmer, as they do in June, July, August or September? I would wager that an in-depth cognitive interview probing the meaning of these response categories would turn up a lot of apples, oranges, and pears sitting underneath the exact same response category chosen by different respondents, and that this would vary over the campaign period as well. This issue strikes me as reminiscent of the problem with middle response and don't know/not sure categories in survey questions. If a respondent says he or she is "undecided", for example, it might mean they're genuinely ambivalent and torn between the candidates; or they want to avoid committing himself or herself publicly to an interviewer asking about their vote preferences; so the safe option is "undecided" or "might change my mind". Or perhaps they're consciously concealing their vote preference and just don't want to tell us who they're voting for (a place for the "Bradley Effect" or "Reverse Bradley Effect" to hide?). Or maybe they just haven't thought aboutthe election that much yet, so in this case, saying you're "undecided" represents another form of a "don't know" or indifferent response, especially during the summer or spring months preceding the election.

So David's suggestion for a new vote question, along with Nancy's and Mark's ideas, will certainly help us get a better handle on how the uncertainty of voters' preferences fluctuate across the course of the campaign and how we can go about getting better info on what the pollsters actually do in the dark, proprietary recesses of their operations--fuggettabout getting at the "truth"! But I don't think we have a very good grasp, if any, short of some well-designed cognitive interviews, at what it actually means to be uncertain about who to vote for, now, and how that differs from being uncertain last summer, winter or spring? There's lots of ambiguity sitting in the standard question and in David's new question too. So we have lots and lots to think about before we sleep...more later.

George Bishop is a professor of Political Science at the University of Cincinnati.


3 Comments

| Leave a comment
user-pic

This TPM Cafe discussion on polling methods has so far left out an important consideration about all opinion polls. You touched on it tangentially, when mentioning the Bradley effect.

There are many possible reasons for a person to answer surveys dishonestly. The "Bradley" related reasons are germane. Persons who are irritated by a pollster's unsolicited telephone at an inopportune moment may very well answer untruthfully out of spite. Some responders may believe that their mendacious answers serve a higher good by moving policy makers in a direction they desire.

I am a real SOB, and simply derive great amusement from intentionally fuzzing survey data. If at the beginning of the survey, I'm asked if I will respond honestly, and respond in the affirmative, I will keep my word. That question is exceedingly unlikely though. It just wouldn't do to give the "population" any ideas now, would it?

Just a few days ago, I told a phone pollster that I was going to vote for Baldwin, and there is not a chance in hell I'd ever do that. Constitution Party members possess a high conspiracy theory paranoia factor. Maybe I can help to intensify it by skewing the pre-election polling data away from the actual returns. I loathe theocrats, and their Original Intent fictions spun out with non-contextual quoting of the Nation's Founders.

The farther statistics drift away from hard-fact, the farther it walks away from real scientific methodologies. The closer a survey's questions delve into the underlying articles of faith that all humans use as inner anchor points, the larger the margin for error in the data collected (See: 'Sex, Lies, and Social Science': An Exchange, The New York Review of Books, Volume 42, Number 9 · May 25, 1995).

In voter polls, I believe most people answer as honestly as the questions will allow, yet there is still a large room for error, when the person being polled has intense secretly held positions, which they seldom allow to see the light of day. There are no proper methods for correcting this in the data.

user-pic

Obama a BMW, McCain a Ford?

http://www.brandweek.com/bw/content_display/special-reports/features/e3ic7f8e4e0a6055a533bc156487cf4842e

....The results were telling. While Democratic nominee Barack Obama was compared to Google, his Republican competitor John McCain was likened to AOL. Obama was also associated with BMW and Target, while McCain was linked with Ford and Wal-Mart.

The 2008 Presidential ImagePower survey, released today, polled a cross-section of 1,002 registered voters between Oct. 1-6.

When asked what fictional spy they would compare the candidates to, Obama was likened to James Bond, while McCain was compared to Jack Bauer.....

user-pic

I, nor my wife, EVER participate in polls. I'm certain that poll results do effect political strategies, but we aren't prepared to devote our valuable time responding to a multitude of questions that enable manipulators of the electorate to enable or weaken a candidate or party. What we cannot understand is how ANYONE can be "undecided" this close to the election (or even four years ago!) Be the voter Dem or Republican, the contrast is so glaring that undecided is indicative, to me, of an individual with little or no convictions...a sheep. I can understand why a pro-lifer will vote for McCain. Even if he\she has been financially decimated by the GOP. Why a black person will probably favor a black president. Even if that black has made a zillion bucks with off-shore tax loop-holes. I would not want to find myself in a fox hole with a person with such fragile convictions.

Leave a comment

Advertisement
Please disable your adblocker!
Ads are how we pay the bills!

Subscribe

The Coffee House
TPMCafe's regulars

House Brew
From Your Cafe Editor

Special Guests
Big names and big brains

Special Features
Pressing topics and trends

Table for One
An expert's week-long talk.

All Reader Posts
TPM readers discuss.

Recent Reader Posts

All Reader Posts »





Masthead

Editor-in-Chief
Josh Marshall

Site Editor
Lila Shapiro

Intern
Kyle Krahel-Frolander



Subscribe to TPMCafe's feed.
Subscribe to TPMCafe's reader blog feed.

Advertise Liberally
Share
Close Social Web Email

"To" Email Address

Your Name

Your Email Address