The effect of psycho-acoustics is amazing. I bought a new expensive cartridge for my turntable recently. I was loving the sound so sat listening to records all evening. Eventually I put a record on I hadn't played before (it was on my house-mate's pile of used records she'd bought but never played). Suddenly I heard a strange thudding sound every second or so. There was a "speed bump" on the record that was causing the needle to pretty much leave the surface of the vinyl and then land again. I was so convinced this had ruined my new cartridge and needle that everything after that sounded thin and not like before. I just couldn't enjoy listening anymore for the rest of the evening, thinking I'd have to replace it.
I eventually compared the sound to some high quality vinyl recordings of the same tracks. They sounded practically identical, no problem at all - certainly nothing lacking at the bottom end like I thought it was. I also posted to a vinyl forum and they said it was extremely unlikely it would have caused any problem. When I calmed down I also could see the "speed-bump" in the record was very small, but I won't be playing it again!
In a past life I used to do live sound engineering. Quiet often I'd get a fairly bogus request from the stage to reduce a certain frequency band. I turned the DFA knob so they could see me doing it until I got an eventual thumbs up. DFA stands for "does f*** all"... The funny thing is I could also confuse myself. Sometimes I would turn the EQ knob on the fully parametric equalizer, changing the frequency range and level, and be convinced it was making a small difference only to discover the EQ bypass for that channel was engaged.
Similarly, I was also into studio recording. Numerous times when tweaking the EQ on cubase I would be convinced it was making a subtle difference, only to again find I had that particular plug-in bypassed, but because I was activity changing a setting that I thought was making a difference, I thought I could hear a difference.
This to me proves that without a blind test, any test is completely invalid. How our minds affect what we are hearing is incredible, but I guess it makes sense since our minds are the squishy organic things that are converting the vibrations to what we perceive as sound.
Also I've stumbled across articles in the past that say a single blind test is often also invalid because of unconscious signals given off by the person doing the testing. They do say that most communication between humans is non-verbal, so I can see how that makes sense.
We also have extremely short "acoustic memory". I'm fairly convinced that unless an A/B test (in double blind conditions) is done so the switching is *immediate*, that you can't possibly be sure of the differences unless they really are obvious (due to faulty equipment or bad tone-matching). So any talk of switching wires or connectors manually rather than via a switch box completely invalidates a test in my eyes at least; it just takes too long - the switch has to be instantaneous and without any "clicking" sound of the switching.
I'm not going to say if I think amps sound different or not as I've never done a double blind test for such a thing. If there is any I suspect the difference is small between well designed amps (when not being over-driven), but that is just pure speculation on my part. If the difference is not small, then how can both amps be well designed since the purpose of an amp is to make the signal coming in bigger than the signal coming out? I suppose the question then would be: which has an output signal closest to the input signal (baring the obvious difference in amplitude) ? If the waveform is faithfully reproduced then it perhaps just comes down to the distortion characteristics as other posts have alluded to.
I'd be interested to see the difference between amps given the same speakers - can't we use a measuring device on the speaker to compare the produced waveforms?
I also found this which I thought was interesting:
Testing audiophile claims and myths
I started investigating this topic (hence I found this thread) when trying to decide in what way to upgrade my A/V receiver. I'm becoming more and more convinced that I just would not notice any meaningful difference between a well priced Yamaha, Denon or Sony, or an outrageously priced Arcam or NAD. I currently have an old NAD 752 that has served me well for 10 years and still sounds good. I'm mainly thinking of upgrading it for functionality reasons rather than sound (i.e. I cannot plug my HDMI cables into the NAD).