I have some that is for sensitive skin without any additives. I just scrub my armpits really well for a bit longer under running water.

But now that you mention it, I got a new brand of antiperspirant recently that I’ve had issues with, so I might just need to use soap for that.