For the best sound quality which is the best connection a digital one or an analogue?
You understand that in your system, there will be some digital/analog conversion going on regardless of what you do? Your source is digital. Your speakers only take analog. Your receiver processes digital.
If you use the analog pre-outs on your CD player, here's what happens:
> CD provided digital
> CD player converts digital to analog for preouts
> AVR converts incoming analog to digital for processing
> AVR converts finished digital to analog for output to speakers
So if you take analog from your CD player, and do anything but amplify it, (like YPAO, various theater modes, etc), you're double dipping in the conversion bowl.
Now, the suggestion to try both is still good. It will demonstrate how little difference, (if any), the A/D D/A conversions make to your ears.