The major difference is money. We should be banding together against the rich, but instead we distract ourselves with what we look like, what we sound like, where we come from, what team (sports, town, city, state, country, …) we support, which sex we have, and a bunch of other things that divide us.
There aren’t only two sides to every issue. Thinking like that is limiting.