Yes, you are right. If you put your cable next to an electrical line, you would have problems. The thing is, your IC's can pick up a bunch more RF and EMI interference without shielding. Then that garbage is amplified. Your speaker cables aren't going to have any garbage they pick up amplified.
At least, that's MY take on the situation.