I think this is basically a fair point, from a reader:

one thing that irks me is that if this had been a former Bush admin. guy, all the news shows would be saying, “Former Bush Cabinent member said women are too stupid to do math!”
Patricia Ireland on Scarborough last night was trying to tie Summer’s comments to Harvard’s dwindiling tenure rate for women profs. I just know if this had been a Republican, she would have been talking about the entire Republican party as being anti women.