...and they leave a giant hole when they are removed.

I just finished patching those holes with wood filler and covering it up with spackle.
Regular old plastic anchors work fine if you can use two of them. If you can get at least one screw into a stud, all the better.