A shocking number of readers have offered this insight:

Dear Jonah:
In all the back-and-forth on this topic I’m surprised I haven’t seen a reference to the instance on Star Trek where that phrase was used. The episode was the classic “A Piece of the Action” — Iotian society modeled entirely on book about 1920’s Chicago mob rule. Vic Tayback (“Mel” from the 70’s show “Alice”) is Jojo Krako, the second-most powerful boss in the territory (behind Bella Oxmyx). Krako is transported, against his wishes, to the Enterprise, where he’s met by Scotty. Krako is furious over being detained. “I got rights!” He demands. “You got nothing.” Scotty replies.

Me: Other pop culture references I missed were various lines from Dirty Harry as well as the “diplomatic immunity” declaration at the end of Lethal Weapon II.