That's right! There's more to vinyl than the sound. I inherited a turntable from my father recently, and while not normally a hoarder of "things", it's probably one thing that I will never part with.
And, while the sound of CDs is arguably more "accurate," I don't think it's reasonable to say or imply that vinyl sucks. Indeed, I find it to have a rather pleasing sound. I also very much enjoy my digital collection, both on CD and PC (lossless).
It is possible to enjoy both.
smaidimaita, to answer your original question, I think you should check out Music Hall and Rega. I believe these guys are both offering very fine products in your price range.
I'm sure it's also possible to find used turntables if you're careful. I inherited the Thorens TD-150 Mk II like
this one. I replaced the original cartridge (or whatever was on it) with a
Shure M97xE that I bought on Amazon. None of this stuff is top-of-the-line, but it works quite well together.
The connections for the replacement cartridge was simple in my case (and remember that my TT was probably manufactured in the mid-60s in Europe, Germany I believe). There are four leads that go to the back of the cartridge, and they are color-coded as to their signal path (L+, L Ground, R+, R Ground). Two screws hold the cartridge in place, and that's it. I did have to find shorter screws than the originals, but that was the only hitch.
Good luck, and enjoy!