I don't mean for people who don't really mean it to call me brother

from Joell Ortiz – Same Love (Remix) Lyrics on Rap Genius

Meaning

African-Americans stereo-typically refer to each other as brothers even if they barely know each other, a stereo-type that is frequently used in American movies.
Joell is addressing this stereo-type and showing that he thinks it can be stupid because people will call him brother just because of his ethnicity.

It also shows that Joell thinks that the way people of different backgrounds are segregated isn’t right and doesn’t think he should be called brother by other people who share his ethnicity just because they are segregated from people of different ethnicities.

To help improve the meaning of these lyrics, visit “Same Love (Remix)” by Joell Ortiz Lyrics and leave a comment on the lyrics box