From my former research assistant Lyle:

Glad to see the Rorty posts, Jonah. I remember reading that exact excerpt from “Consequences of Pragmatism” a few years back. In any case, I enjoyed this (long) Neuhaus piece: The key point: “Recognizing the contingency of all vocabularies, one may find in an existing vocabulary such compelling intimations of the good, the beautiful, and, yes, the true that one has no higher desire than to be part of the continuation of that final vocabulary. We may all well live in the house of words, but some houses have words that claim to tell us what really is “out there” and “deep down within,” and we have no way of knowing — not with undoubtable certitude, not yet—whether those words are true. Neither does anyone know whether they are false. And, one adds, neither does anyone, including Mr. Rorty, know beyond the possibility of doubt whether speaking of truth and falsehood in this way does or does not have any bearing on how the universe really is. For many of us, Christianity is such a final vocabulary.” (Neuhaus happens to be arguing on behalf of Christianity, but pretty
much any faith pertains.)
As I see it, Rorty was correct in attacking analytic philosophy –
and, along with it, the metaphysical project in general — as
floorless, circular, in a word, impossible. Hume and others had
already done this. Where he went astray was in assuming just because
all belief is unprovable by any coherent logical standard — that is,
every belief leaves room for justified doubt — there is no such thing
as true or false beliefs. As the Continental, particularly the German,
tradition has it, all there “is” is will (an obvious performative
contradiction).
What really unnerved me about Rorty, though, is how this broader
Nietzschian theme of his overshadowed a more reasonable thrust of his
work — the idea that searching for metaphysical proof of this or that
value/belief is simply a waste of time. I agree with him there. Force
yourself to spend a day at a library reading nothing but analytic
philosophy and you’ll know what I mean. Of course, this far more
modest claim leaves little room for political application, which is
probably why Rorty felt the urge to venture beyond.

Me: Also worth reading: Roger Scruton’s piece in City Journal from a while back.