Doin' it by myself didn't turn out that good
Trying to beat his substance abuse problems by himself (without help) did not work out that well, as evidenced by his relapse. This line is paired with the preceding line; he’s saying when he was first getting sober he did so without God and The Bible (the book), and it didn’t work. 12-step program and AA usually involve the acceptance of a higher power.
To help improve the meaning of these lyrics, visit “Starting Over” by Macklemore and Ryan Lewis (Ft. Ben Bridwell of Band of Horses & Macklemore) Lyrics and leave a comment on the lyrics box