I'd definitely go with LPs. Wouldn't you rather have shorter playing times, less bass, decreasing sound quality from the inner to outer portion of the disc, mechanical wear, relatively expensive playback systems that vary more in quality, and the need for extra analog gain stages that introduce additional noise and distortion, in addition to the intrinsic distortion of the media which is about 30db higher than a CD's.
(I'm sorry, 3db, I couldn't resist.)
Of course, LPs and turntables are a hell of a lot more fun than CD players, because there are measurable, audible, qualitative differences between the equipment. Probably not so anymore with most CD players. Many turntables and tonearms are made like jewelry, and good ones make most modern CD players look like cheap junk. Just keeping LPs clean is a ritual. And shopping for LPs is can be adventure, with numerous specialty stores. The local CD stores are what, Walmart and Target?
So what are you really interested in? The best sound or the most fun? Based on your post I suspect you really want LPs.