I'm only trying to build what they attempt to destroy
He is saying that in other rappers' attempt to make good music are actually in fact destroying it.
Now some are intentionally destroying it by being in the Game without the determination to make it for the people instead of making it exclusively for the money.
Instead of coming up with some bullshit that will sell, he is bringing intellectual thinking and hard work to the rap industry.
To help improve the meaning of these lyrics, visit "No Idea" by Joe Budden Lyrics and leave a comment on the lyrics box