many white families also couldn’t afford to move to the suburbs, but that was a downside the rich white racists were willing to accept

I think this was a feature, not a downside. (I agree with the rest of your post tho)