Removing wall mount

How do I remove the wall mount without completing destroying my walls? Trying to pull the covers off the wall results in either the adhesive ripping off huge chunks of drywall or separating from the cover and staying on the wall.