The Corner

Science & Tech

Another Replication Failure: ‘Stereotype Threat’ Is Probably Empty

(Rick Wilking/REUTERS)

Back in the 1990s, academics decided that “stereotype threat” depresses the performance of groups for whom society has lower expectations. For example, in experimental settings in which girls are reminded that boys tend to do better on math tests, those girls will then perform worse on a math test than girls who receive no reminder. The upshot is that education aimed at countering stereotypes could boost girls’ performance.

You may be thinking, “Gee, stereotype threat sounds like a simplistic and awfully convenient result that just happens to validate the left-wing conception of gender differences as socialized. Isn’t there some sort of ‘replication crisis’ going on right now that has overturned a lot of these types of findings?” If you’re thinking that, good for you. You have healthy instincts.

In 2014, Dutch academics Paulette Flore and Jelte Wicherts performed a meta-analysis of the stereotype threat literature as it applies to gender differences in math. They found a significant negative effect overall, but they also found evidence of “publication bias” — null results less likely to be published than significant results — and wondered whether stereotype effect has been overstated. “We propose a large replication study to provide a less biased effect size estimate,” the authors stated.

Now their large replication study has been released, and the conclusion should not surprise followers of the replication crisis: There was no evidence of stereotype threat. Boys did perform better than girls on the math test, as expected. However, the gender gap was not significantly different when girls were told that gender differences exist on the test compared to when they were told there were no gender differences.

This experiment has several advantages over the prior studies. First, it was one of the largest to date, with 2,064 students involved. Second, it was “pre-registered,” meaning the authors announced their methods before conducting the experiment. Pre-registration discourages researchers from torturing their data every which way before finding something they want to report. It also helps prevent publication bias, since pre-registered studies are expected to be written up regardless of the results.

This replication failure applies only to gender differences in math, not to the many other instances of stereotype threat that academics claim to have found. It should give everyone pause, however, to learn that such an oft-cited and long-accepted part of the literature is likely wrong. It’s another reminder that “I’ll wait for the replication” is a healthy reaction to any new study from the world of social psychology.

Jason Richwine — Jason Richwine is a public-policy analyst and a contributor to National Review Online.

Most Popular

PC Culture

Hate-Crime Hoaxes Reflect America’s Sickness

On January 29, tabloid news site TMZ broke the shocking story that Jussie Smollett, a gay black entertainer and progressive activist, had been viciously attacked in Chicago. Two racist white men had fractured his rib, poured bleach on him, and tied a noose around his neck. As they were leaving, they shouted ... Read More

White Progressives Are Polarizing America

To understand how far left (and how quickly) the Democratic party has moved, let’s cycle back a very short 20 years. If 1998 Bill Clinton ran in the Democratic primary today, he’d be instantaneously labeled a far-right bigot. His support for the Religious Freedom Restoration Act, the Defense of Marriage Act, ... Read More
Politics & Policy

The Strange Paradoxes of Our Age

Modern prophets often say one thing and do another. Worse, they often advocate in the abstract as a way of justifying their doing the opposite in the concrete. The result is that contemporary culture abounds with the inexplicable — mostly because modern progressivism makes all sorts of race, class, and ... Read More

One Last Grift for Bernie Sanders

Bernie Sanders, the antique Brooklyn socialist who represents Vermont in the Senate, is not quite ready to retire to his lakeside dacha and so once again is running for the presidential nomination of a party to which he does not belong with an agenda about which he cannot be quite entirely ... Read More
PC Culture

Fake Newspeople

This week, the story of the Jussie Smollett hoax gripped the national media. The story, for those who missed it, went something like this: The Empire actor, who is both black and gay, stated that on a freezing January night in Chicago, in the middle of the polar vortex, he went to a local Subway store to buy a ... Read More
Film & TV

A Sublime Christian Masterpiece of a Film

‘There are two ways through life -- the way of nature and the way of grace,” remarks the saintly mother at the outset of The Tree of Life, one of the most awe-inspiring films of the 21st century. She continues: Grace doesn’t try please itself. It accepts being slighted, forgotten, disliked, accepts insults ... Read More