I can't since I don't know all the details. What desktop (windows or mac, preferably with a model or motherboard model), I assume
this is your usb-spdif converter, what dac are you using?
Not as critical, are the rest of audio path, pre-amp, amp and speaker could give a hint