Well, that could be the problem. You need to attach the ground, to, well, ground.
Your amp/preamp/receiver may have a ground lug on the back of it to attach it to.
Also, if you volume is very very low, are you using the Phono input? If you don't have a phono input, then chances are you do not have a phono pre-amp and will need to purchase one.