When he feel that he's broken up his nest
When a father has broken up his family/home. I think he is saying sorry to Erykah Badu here, who he had a child named Seven with. But he didn’t settle down with them as a family. In the lines prior to this he explains his guilt for leaving them behind and how he wished a wiser man would’ve informed him of the consequent guilt that would come of leaving Erykah and Seven.
To help improve the meaning of these lyrics, visit "Sorry" by T.I. (Ft. Andre 3000 & Stacy Barthe) Lyrics and leave a comment on the lyrics box