Why is today's world a confusing place when you are difference?

As a black man, I always wondered why most black people seem to have a lack of understanding towards others who seem to be different mentally and physically. In addition, I feel I am judge more harshly by the same ethic group based on my physical features other than my personality. For instance, I remember when I was in high school, I would be teased and pick on because my clothes didn't have a popular name brand, or I had no hair. Furthermore, I finished high school a couple of years ago and now attending a post secondary institution, but I still notice that they have a tendency to gossip about me, or approach me with false allegations, just to aggravate me!! Remember, this is a recollection of what I experienced in the past and present; however, I am not looking sympathy. Please provide a intelligent answer.