You knew me before the fame, don't lose me the more I change
Even though the fame is changing his persona, she, (the music), isn’t loosing him, as music is adaptable and it is still able to let Cole release his true feelings.
This line could also tie back with how he was talking about Tiffany, the first girl who died in his life. She knew him before he was famous, maybe her spirits still lives with him and he’s asking her not to lose him the more he changes in the world.
To help improve the meaning of these lyrics, visit "Born Sinner" by J. Cole Lyrics and leave a comment on the lyrics box