Another friend of Madison directs our attention to his letter to Frederick Beasley, November 10, 1825. Read the whole thing online in the James Madison Papers. Money graf:

What may safely be said seems to be, that the infinity of time & space forces itself on our conception, a limitation of either being inconceivable; that the mind prefers at once the idea of a self-existing cause to that of an infinite series of cause & effect, which augments, instead of avoiding the difficulty; and that it finds more facility in assenting to the self-existence of an invisible cause possessing infinite power, wisdom & goodness, than to the self-existence of the universe, visibly destitute of those attributes, and which may be the effect of them.