Mark has it right, Martin Colloms guessed right back in 1994, and your instincts are right. Save some money, and pass on paying more for balanced connections.
Balanced connections are commonly used for live audio and in recording studios, especially for microphones with long cables. Long cables (30 feet or more) carrying weak microphone signals, (~1-3 mV) can pick up noise induced by electromagnetic interference (EMI) or radio frequency interference (RFI). Balanced connections along with the differential circuits required on the electronic gear can cancel out this noise. Pro audio chose to standardize on one type of signal cable, mainly to avoid confusion.
Balanced connections do seem to be fashionable in home audio for preamp-to-amp connections, and many higher priced examples feature these as a sought-after and expensive feature. The voltage levels between preamps and amps (in the range of 0.1 to 5.0 volts) are much higher than at the microphone level. So it is likely that interconnects at this level are much less prone to EMI induced noise, especially if they are less than 30 feet long. Unless you have an unusually noisy environment with high levels of EMI, there are no benefits from using balanced connections over standard RCA interconnects.
To be fair, if the entire electronic signal chain has full differential circuits and is connected with balanced cables on all devices in the chain, it could provide an additional 3 dB in dynamic range. This would include all devices from a sound source like a CD player (or DAC) through preamp and amp. For stereo sound, it would require a 4-channel DAC, a 4-channel preamp and a 4-channel amp to maintain balanced operation from input to output, summing the signal at the speakers. In theory, this would cancel all common mode distortion in the electrical path, and achieve as much as 3 dB extra headroom depending on how much distortion there originally was to cancel. While not insignificant, this would cost a premium.
Providing balanced connections only between a preamp and amp will not accomplish this.