And eventually answers to the call of Autumn
Autumn is commonly used in poetry as a metaphor to refer to the decline of something. i.e. the cooling after a summer.
In this line Kanye refers to the decline, or fall, of those folks marked (branded) by race or class taking risks with jail time (penitentiary chances) in the hopes of shinin' (for the love of ballin') as their continued risks eventually fail to pay off and they end up incarcerated.
To help improve the meaning of these lyrics, visit "Gorgeous" by Kanye West (Ft. Kid Cudi & Raekwon) Lyrics and leave a comment on the lyrics box