I suspect it won’t be Romney, but the camp that is doing the whispering, who will be hurt.