« Clinton versus McCain | Main | "The Face of Seung-Hui Cho" »

My Biases

10 Jan 2008 12:45 pm

bias.png

I remember having been very interested in the Implicit Association Test I took a few years ago on racial bias, but then kind of forgot about the whole thing for a while. Eve Fairbanks mentioned taking one on gender in a blog post, so I thought I'd check it out. But en route to discovering what kind of a sexist I am, I was waylaid by a test that examines your biases about the presidential candidates.

I took it and discovered the results you see at left. This is a question of relative bias. They explain that "a committed Republican might have negative associations with all of these candidates, but in this display, the ones that are least negative would appear toward the top and the ones that are most negative would appear toward the bottom." All four candidates cluster in the middle third of the spectrum, so I don't have any really extreme implicit associations with the candidates, but as we can see there's a distinct pro-Obama leaning.

That jibes with what I learned about myself the night of the Iowa caucuses. Thinking and writing about it beforehand, I'd definitely found Obama to be a praiseworthy figure but never really committed myself super-strongly in his favor, and in the couple of weeks leading up to the caucus felt increasingly persuaded by arguments made on John Edwards' behalf. But when it was announced the he won I was thrilled even though my official view continues to be that the differences between the candidates in the field are non-enormous.

Meanwhile, demographically speaking I'm in Obama's wheelhouse -- young, male, college educated -- and I had pre-existing pro-Obama views on the issues. I'd be interested to see what kind of results you can from people whose views are more at odds with their demographics.

Share This

Comments (58)

"Meanwhile, demographically speaking I'm in Obama's wheelhouse -- young, male, college educated"

Don't forget urban and moneyed to boot.

My testing came out pretty much exactly where I expected. Edwards at the very top of the scale, Richardson at the very bottom of the scale, and Obama and Clinton bunched in the middle, with Obama a bit above Clinton.

It's nice to know the test works.

I just tried this.... Wow! I got a similar spaced spread as yours, but with Rich. and Edwards at middle and HRC down, down, down.
Reflecting on how this testing works, I realized that I made my quickest taps when just the word "clinton" came up. This reflects, for me, how I have changed since Bill Clinton. I was a SO in college in 92, and for a while became an apologist for Clinton with my parents (who loved him at first).
But after 8 yrs, in which Bush/Rove took advantage of the "sell them products and they will acquiesce" Clinton plays, I am getting angrier each day at their (Clinton/Carville) presumed inheritance. [interj.- Why the f*** do I know the man's pol. advisor's name, anyway? In The War Room they were scrappy, but what change was there, really, except not bombing Iraq? and Stefanopoulis? Oh, man... ]

So just seeing the name-as-brand "CLINTON" is reflexively the easiest for me to reject.

That test clarified for me something that I already vaguely was aware of.

I strongly dislike Clinton intellectually because she's running for President and I think she'd be a disaster as leader of the Party. But emotionally, I don't have a real problem with her.

This nomination race has convinced me that Bill Richardson is interchangeable with Satan.

My results:

Obama

Edwards

Clinton

Richardson

No matter how much I concentrated, I repeatedly hit the wrong button on Richardson.

My results: Edwards way, way up at the top (something that even I became aware of as I was taking the test); then a large gap followed by Obama; then another gap, followed by Richardson; and then another gap, with Clinton at the bottom. I'm shocked, as I strongly prefer Clinton to Richardson.

My demographics: early 40s, white Protestant male with a graduate degree, married with children.

I blame these results on the subliminal and corrosive influence of Andrew Sullivan.

"I'd be interested to see what kind of results you can (get) from people whose views are more at odds with their demographics."

I'm an Obamabot demographically. But my brain is wired to think ideologically and partisanly.

Matt, have you had a corrupt friend offer to give you a special deal on real estate yet, just like Obama?

You may have to wait till your running for office for that to happen. Will you accept it? Obama did.

So don't jump to the conclusion you share his values until you are tempted by corruption as well and get to see what you are really like, when it really matters.

My results looked like Matt's except that Obama was lower, just above the Clinton-Edwards row. I'm surprised the results were so tightly clustered.

Cool and interesting. I like Hillary more than I thought I did, which I sort of found out at 8:30 Tuesday evening for the first time in 17 years or so.

"No matter how much I concentrated, I repeatedly hit the wrong button on Richardson."

If you've been following the Presidential race closely, how could you not? Dude really is interchangeable with Satan.

I'm partially convinced that he was intentionally putting up a Chewbacca defense for Clinton during the debates. No one could really be as stupid and rambling as he appeared, right?

I had Obama way up, then Clinton, Richardson, and Edwards in that order, but basically right next to each other. I also flirted with Edwards for a while but came home for Obama at the end.

I took the Republican version, and got

Huckabee (very positive)


Romney Guiliani (all negative)
McCain

I strongly question the validity of this test method. Did anyone besides me find the speed and accuracy strongly affected by the ordering of the choices. Obviously test takers get accustomed to hitting "e" or "i" based on which images and words are shown first for "good" and "bad". Once that changes, it's hard to break out of the ingrained motor response.

Hmm. Apparently I like Clinton and Obama about the same - not what you'd expect from an Obama volunteer with roughly Matt's demographics. Also, I really seem to hate Edwards' guts for some reason.

My results:

Obama

Clinton Edwards


Richardson

Wow, I didn't realize how much I dislike Richardson. Also, I thought I likee Hillary more than Edwards. Some of the confusion may be because I repeatedly associated the name "Bill" with Hillary.

My results looked just like Matt's, but Richardson and Edwards were reversed.

I used to really dislike Edwards, but have been warming up to him over time. Now he is just a step below the experience crew.

Obama


Edwards
Clinton
Richardson

I'm in Obama's wheelhouse as well. Only surprise here was that Clinton finished a little above Richardson, as I had always regarded Clinton as my least favorite candidate.

It came out about as I expected, with Obama and Edwards at the top, with a big gap between them and Clinton and Richardson at the bottom. Actually the placement for Richardson was surprising, even below Clinton. That doesn't sound right, I don't have anything against him.

Mine came out with all four candidates at an equal level. Exactly, as far as I can tell.
I now volunteer my services to be a Moderator in a Debate, Chair of the National Convention, or at least, Chair of the Credentials Committee, and to all bloggers and pundits as a typical, middle of the road Democrat unswayed by personal animosity.
I should have column somewhere, as soon as my test scores are validated by the Daily Howler.

Hmm... mine was similar to Matt's, except with Clinton at the bottom & Richardson alongside Edwards. FWIW, I'm a decade older & female, and my degree's from a state school.

A couple of observations that may or may not be relevant since I never studied anything like this... In demographic terms, I should probably like HRC better than I do, especially as a self-identified lifelong feminist. I also wonder how much the visual appearance of certain words affect responses-- I'm sure that the font differences were meant to mitigate that, but I'd still say that the rounded letters in 'Barack' are more visually appealing than the straight lines & short vowels in 'Hillary.' Also, I was getting a lot of incorrect answers until I turned my music off.


I took both the GOP and DEM tests. Apparently, I like Obama and McCain, feel fairly neutral towards Clinton, Richardson, Giuliani and Romney, and dislike Edwards and Huckabee.

Which is mostly right, I guess; I was a McCainiac in 2000, and who can have negative associations with Mr. Congeniality?

I wonder about the impact of familiarity on the results, though. I'm a New Yorker, and my associations with the Giuliani years are basically positive. But I am not supporting him for President; in that contest specifically, my feelings are much less positive. How can the test capture *that* aspect?

On the other hand, I have paid essentially no attention to Bill Richardson, so I doubt I have any strong positive or negative associations. I suspect that in a different test I would have scored him above Clinton, not because I particularly like him, but because I associate the word "Bill" with the word "Clinton" and not "Richardson", and this surely caused me to hesitate whenever the word "Bill" appeared on the screen, which probably pushed him down relative to where he would otherwise have been in the rankings.

Also: I wonder why they used pictures for the Republicans but names for the Democrats. It can't be that Republicans are illiterate, or they wouldn't be able to find the happy words. I specifically wonder whether John McCain and Hillary Clinton do better when you don't see their pictures; neither of them photograph especially well, and both specifically have creepy smiles. It would make more sense to use a mix of names and pictures for all candidates.

In any event, the whole test makes me feel very superficial.

"In any event, the whole test makes me feel very superficial."

The test is designed to measure superficial feelings. That's its whole value.

I'm a die hard Edwards fan, and as expected he came out on top for me.

What was surprising was that Clinton came out in the middle and Obama at the bottom, with Richardson just below.

Consciously I like Obama far more than Hillary. Not sure what to make of that, I guess it could be a woman thing...

"Consciously I like Obama far more than Hillary. Not sure what to make of that, I guess it could be a woman thing..."

I think a lot of Dems have warm emotional feelings towards Hillary, even if they don't like her politically. L'affair Lewinsky has helped ensure that.

And the entire Clinton for President campaign is designed to take advantage of those warm emotional feelings. She's felt free to run to the right specifically because she knows she has a wellspring of emotional support from Dem partisans.

Having just recently come over to Edwards after initially liking Obama (the first few days of his celebrity and before any policy came out), I wasn't surprised to find Edwards pretty high up the 'More Positive' side. What surprised me was that the other three were all even and just below the midline, meaning I showed a slight negative attitude toward them in equal measure. I really thought Obama would be second, Hillary third, and Richardson last.

It is an interesting test and from what I can gather it basically reveals what your 'gut' says. If you go too slow then the reaction times don't register because your must be using multiple connections in your brain rather than making a 'knee-jerk' reaction. Too many errors would suggest you are going too fast and aren't paying attention to the task. I made more errors on Richardson than anyone else and I figured it would show that those errors were based on a deeper-seated dislike of him over the others, but I guess the errors looked like attentional issues, perhaps I made most of them in one of the blocks, and were discarded.

I think I'll go try the Repubs now.

I think my results on this were messed up because I kept associating "bill" with hillary clinton.

My results:

Edwards


Clinton

Obama

Richardson

I'm surprised Hillary beat out Obama as if given a choice between the two, I'd definitely go with Barak. I also found that I noticed I was getting Edwards right most of the time while taking it. (I also kept on getting "Bill" and "Clinton" confused.)

My results surprised me so I retook the test -

Obama

Clinton
Richardson


Edwards

Much more in line with what I figured, but I wonder if that was because I was paying more attention.

Don't know if it's "scientific", but it's sure fun! I had Obama in the top 1/4, with Hillary just a little behind him (right below, but not overlapping), Edwards in the middle, and Richardson near the bottom. This is probably where I *really* stand, when I'm not on some anti-Hillary tear.

i'm a 56 year old woman.

despite what i thought was a preference for edwards, obama was noticably :more positive." edwards and hillary were together midway & richardson was about as far down as obama was up.

maybe my 22 year old son's enthusiasm for obama and/or my growing desire to believe that he is really more radical than he is letting on have gotten to me more than i was aware.

"Bias" seems to be going the way of "disinterested": a useful word with a specific meaning is becoming a synonym for another common word or phrase, shrinking the language. "Bias" used to mean "improperly motivated judgement"; now it seems to mean "already formed judgement." "Disinterested" has become a synonym for "uninterested."

Interestingly, the old definition of bias and the old definition of disinterested are linked: a disinterested party is one without bias.

After trying the racial bias test MY mentioned, I've got to say the testing seemed, well, biased! One incorrect response in the whole test led to a 27% preference for white Europeans over African Americans!? Please -- especially when you consider that all the "AA/bad" pairing took place later in the test, after they'd already locked you into the other mode, thereby skewing the results; this placement bias is amplified when one considers the timed element of the testing -- as one progresses through a confusing test, they'll undoubtedly slow in their responses. However, I'm sure their erroneous methodology served their preconceptions quite well.

I got:

Edwards
Obama

Clinton Richardson

Also: I wonder why they used pictures for the Republicans but names for the Democrats.

I got photos for the Democrats. Haven't done the Republicans. I was confused by all the talk above about the shapes of words and reactions to "Bill" and "Clinton", since I didn't see any of that. Must be more than one version of the test.

Everybody was bunched toward the middle for me, but it went:

Obama
Edwards Clinton
Richardson

So, similar to Matt, but less of a gap after Obama. My demographics are 34, male, urban, California (L.A.), Master's degree (urban planning), professional, Democrat, married, no kids, Catholic, white, renter.

Oh, also, the results more or less match my pre-existing preferences. I like Obama best, and would support the others if they got the nomination.

I strongly question the validity of this test method. Did anyone besides me find the speed and accuracy strongly affected by the ordering of the choices. Obviously test takers get accustomed to hitting "e" or "i" based on which images and words are shown first for "good" and "bad". Once that changes, it's hard to break out of the ingrained motor response.

Diff'rnt test, same as the rest. That website is whack.

Well, I was floored. I got:

Clinton


Obama

Edwards Richardson

I've been supporting John Edwards, very positive towards Obama, and I've been angrily vocal about HRC's candidacy, regarding it as a violation, an abuse of power, because of the legacy issue.

The test works based on how long it takes you to press the i or e key, (reaction time) not accuracy, iirc--it takes more time to process inconsistent pairs than consistent pairs because it takes mental energy to sort out the inconsistency.

Thus, when you are confronted with a pair that lines up with your unconscious, implicit, attitude, you will be quicker to respond and when a pair is inconsistent, you will be slower to respond (so, for me, I was quicker answering "Hillary-good" pairs and slower to respond to "Hillary-bad" pair.) Some people saw photographs, some saw just words. The order in which you saw them, I suspect, was random.

I should mention, in terms of demographics, that I am most like Hillary Clinton--I could be her kid sister. So that may be why I implicitly like her. Her face. good. My face. good.

I got

Obama


Clinton
Edwards


Richardson


Which surprised me, I expected Edwards above Clinton. I think one thing that may have skewed it was the test that has Edwards and Richardson's faces, gotta pay a little more attention there so it sometimes took longer to make a choice, where with Hillary and Obama you can tell really quickly that it is their picture or not.

Middle-aged, single mother by choice, MBA from state university, IT-industry. I was surprised since I thought I favored Edwards, and didn't realize that I didn't care for Richardson. I had the same words (happy, angry, enemy, friend,can't remember any other) and 4 different photos of each - some smiling, some not. I don't doubt emotionally that I connect with Hillary - being a single mom by choice via artificial insemination at 40 (my family was APPALLED until my son appeared and was so perfect!), you have to be pretty strong so I imagine that is what I "feel" in Hillary.

In the end, I will happily vote for anyone who doesn't go totally negative.

Clinton (nearly at the top)

Edwards, Obama

Richardson (slightly below middle, so I must like them all)

Me again, just took the Republican one. Looks like I don't feel that Guiliani sucks as much as I think he does.

McCain (just above middle)
Huckabee


Guiliani


Romney (almost at very bottom)

Hmmmmm....

Rudy

McCain
Romney

Huckabee

Something wrong with that test. I ended up preferring Hillary! But not by much, Obama was right under her. Edwards was a bit further down, and Richardson way down.

It was damn hard to remember who I was dealing with in each of the very repetitive tests, which I assume is part of the design, forcing the subconscious to take over more of the task than the conscious mind.

I have to agree that it was easier to distinguish Obama's and Clinton's faces than Richardson and Edwards (I actually had no clue as to how Richardson even looked before taking this test, that's how low on the scale he is.)

I did rank Obama higher on "leadership" than Clinton, but not by much (a 6). Most of my responses to the questionnaire part were "neutral". Note that there's no ability to say "anarchist" to this one, either - you're either "conservative" or "liberal".

Maybe my subconscious (and even my conscious) mind wants to bang Hillary, so I made more mistakes on the others.

Gender bias could seriously screw this test, I think. It would interesting to see how females ranked the candidates overall compared to males. Would females be more likely to choose Hillary or one of the male candidates - and would Edward or Obama win that one? Would males tend to pick another male or Hillary?

If you substituted a younger female for Hillary, would that affect the overall picks for males or females?

I take such tests with a large grain of salt.

Everyone is having a ton of fun with this "test" as though it were a cute gimmick -- but there is something more ominous to think about: I listened to a researcher from the University of Washington on our local NPR station in Seattle a few weeks ago stating that this test PROVES peoples unconscious preferences. She said she wasn't using the test to justify racism or to support a particular candidate. Then she blithely went on to say that both black and white voters preferred HILLARY to Obama whether they consciously admit it to themselves or not. The interviewer did not even question the researcher about the methodology or possible bias of the study, who made the decision to conduct it in the first place or why they chose to use current candidates in an on-going election. Did she even consider whether or not reporting on the findings would have any influence on the outcome? I cringed just hoping this creepy thing would never find its way in the MSM. But HELL NO -- I heard this same head-up-her-ass researcher last night on All Things Considered. She was brought on to support the notion that Obama was a victim of the Bradley effect. Again -- the interviewer dropped the ball and didn't bother to question how this information might be used to create a self-fulling prophesy. IS IT JUST TOO PARANOID TO THINK THAT PERHAPS THEY DO KNOW EXACTLY WHAT THEY ARE DOING? After all the slurs that keep oozing out of the Clinton campaign the thought does cross my mind.

Al's results are very close to my picture of Al's politics.

"IS IT JUST TOO PARANOID TO THINK THAT PERHAPS THEY DO KNOW EXACTLY WHAT THEY ARE DOING? After all the slurs that keep oozing out of the Clinton campaign the thought does cross my mind."

You are being too paranoid in this particular case, but you're not wrong to be paranoid about the Clinton campaign tactics in general.

They've got many evil geniuses on their squad.

Matt,

Just what are those pro-obama views? Would you mind listing them out so that we can find out which of his policies sway you most and why?

"I listened to a researcher from the University of Washington on our local NPR station in Seattle a few weeks ago stating that this test PROVES peoples unconscious preferences."

Of course, this is likely extending the test beyond the evidence. I suspect, as I indicated in my previous post, that this test could be skewed any number of ways.

It also says nothing about WHAT unconscious preferences might be influencing the outcomes, and more importantly, whether those unconscious influences necessarily imply an outcome in the real world that agrees with them.

Without an analysis of the methodology of the test or the theory and experimental evidence behind it, there's no reason to believe it's any better than any other.

The best way to prove this test has some value would be to let people "hack" it in various ways, and see what the variables actually are.

Psychologists and researchers always assume that some test they've come up with really deals with ALL the variables in a given situation. I suspect this is almost never true except in really limited situations.

Jeeeezuuuus,

We can't even manage a straight-up vote in this country and we're taking stuff like this seriously?

Who stuck me on this ship of fools...I want off.

I get:

Clinton Obama Richardson
Edwards

All in a neat row a little below neutral. I like to think I'm biased against them all equally, especially Edwards.

For those wondering about the methodology, there's a bunch of programs here:

http://video.google.com/videosearch?q=Mahzarin+Banaji

Where the head of the program Mahzarin Banaji explains herself somewhat. I first saw it in a presentation where she walks Richard Dawkins and his ilk through it, but the video for that seems to be down. A shame, it was better than Alan Alda's.

I got:

Pretty high up: Obama

Edwards Richardson

Clinton

For the Republicans:

About 35% of the way down: McCain


Huckabee Romney

Giuliani

I wonder if people who took the test and got pictures for the Democrats (like I did) tended to put Richardson higher than people who got names (Bill).

"After trying the racial bias test MY mentioned, I've got to say the testing seemed, well, biased! One incorrect response in the whole test led to a 27% preference for white Europeans over African Americans!? Please -- especially when you consider that all the "AA/bad" pairing took place later in the test, after they'd already locked you into the other mode, thereby skewing the results; this placement bias is amplified when one considers the timed element of the testing -- as one progresses through a confusing test, they'll undoubtedly slow in their responses. However, I'm sure their erroneous methodology served their preconceptions quite well."

It's not the incorrect responses, it's the timing of the responses that determines your score. It's literally measuring how quickly you are willing to make certain kinds of associations.

Scratch the "willing". I mean able.


Comments closed January 24, 2008.

Copyright © 2008 by The Atlantic Monthly Group. All rights reserved.