Heard you like to take the love
That’s why I.. came to town..
With only my brain
Before he went to Hollywood he heard that she (Holly) likes to take the love from people, she take their hearts…in other words she appeals to their emotions (which as he’ll refer to further in the song drives them crazy)…so he came with just his Brain meaning that he’ll be smart!
To help improve the meaning of these lyrics, visit "Holly Baby" by Frank Ocean Lyrics and leave a comment on the lyrics box