Opening a disagreement with "not to be rude, but" or "no offense" doesn't erase the offense that follows, linguists who study these softening phrases have found they signal the speaker already knows what's coming next isn't going to land well.
When you say "no offense," you're admitting you're about to give some.