All because they noticed the top with the box logo
Tyler always wears caps (top), and they are usually Supreme (box logo). This makes it easier for him to be spotted by fans.
He could also be referring to the plain Supreme box logo shirt (also a top) with the white background that he usually wears.
To help improve the meaning of these lyrics, visit "Colossus" by Tyler The Creator Lyrics and leave a comment on the lyrics box