This is the same principle as behind the social contract of tolerance - intolerance is permitted, but only as a response to intolerance which isn’t being used to defend the tolerant.