I’ve taken to deadpan saying, “I can’t tell if you’re joking or not.”

Doesn’t work well with strangers, but it works with people who know me and have some level of understanding of the whole thing.