Craigslist is a good option if you have more time than money.
Generally any mainstream home audio CD player will be a good option, just be sure to test it before you buy. also listen to the mechanism. Some get pretty noisy (just like the ones on your desktop/laptop can).
I returned a Samsung DVD player because of teh noise it made spinning up and indexing between "chapters".
On paper it was a great deal, but having a player that calls so much attention to itself is not something I could live with.
I agree. You could also try Thrift stores in your area. Just make sure you test the player by putting a CD in it and making sure it plays. Ebay is another option, though you might want to restrict your searches for units that are near you and allow for local pickup instead of shipping (shipping costs you more, and can endanger the unit, if someone packs it improperly).
I am currently using a used Integra CDC-3.1 in my main 2-channel system. I probably paid about $50 for it a few years ago. Other mainstream brands are fine, and which is most suitable depends in part on what features you like.
Oh yeah, and it sounds good. I listen to it through these speakers:
http://web.archive.org/web/20150910160459fw_/http://www.apogeespeakers.com/stage.htm
I do not use it simply because it was cheap. I use it because it is good and has features I like.
And your idea of yard sales is also a good one. Again, just make sure you test it by playing a CD in it before you buy it.