Losing you, daddy, it hurt more than any physical pain
The realisation of never seeing his father again and accepting the fact that he had died hurt R.A. more than getting beaten up could since he has to harbour that pain with him everywhere he goes. This line is most likely referring to how physical pain is temporary and doesn’t last long, whereas the weight of losing your father hurts more than that and will last with you forever.
To help improve the meaning of these lyrics, visit "Legends Never Die (Daddy's Halo)" by R.A. The Rugged Man Lyrics and leave a comment on the lyrics box