“I think [Madison’s] lack of physical dash may have made his brilliance easier for people to accept. They were not so threatened by the fact that he had fifty I.Q. points on them because he was short and small. So he was able to insinuate at some times, rather than simply overpowering,” says Richard Brookhiser, author of James Madison.