Fascists and right wingers too?

Probably. Certainly republicans, so fascism isn’t a deal-breaker for them.

the conspiracies tend to be different

Plenty of union members believe in the “jewish deep state”, e.g., so I don’t think the conspiracies are that different.

I agree that freedoms can be abused. And, they can certainly be used for right-wing purposes. I also agree that there are plenty of fallacious arguments for freedom, some of which are based on conspiratorial thinking. But, fighting for freedoms of the people and restrictions on the state is always a left-wing activity.

That said, I don’t know where the balance is or should be between solidarity and rejecting intolerance. At the moment, I’m more in favor of protecting marginalized persons by aggressively excluding intolerant people, particularly if their intolerant behavior is well-documented and they still refuse to reject and remediate it. So, I do see the fascists in open source as a problem.