NewYorkJosh - I agree with your assessments of this problem and I would take the argument a large step further. Why would anybody concerned enough about HiFi to monitor this forum argue that all amplifiers sound the same? This position is utterly ludicrous, at least for anybody that knows anything about anything.
This statement requires acceptance of all the following: 1) Cables (all) make no difference; 2) Capacitors, resistors, power supplies and other functional internals are of no sonic consequence; 3) Internal topology is meaningless, solid state, tube, or otherwise (I have a digital-switching amplifier); 4) Construction quality, including soldering, case, and internal wiring, are esoterica; 5) Speaker/amplifier matching is an audiophile justification; and 6) Radio Shack produces the same ultimate product as Krell.
There are doubtless more implicit assumptions not listed above. C'mon, people! Why are you in this hobby if this is what you believ?. Your ears don't hear a spectrum graph. Measurements aren't everything. The CD player in my garage is 15 years old and basically produces a flat signal from top to bottom. Does it sound the same as the heavily modified player in my main system? Not even close!
I defy any of the "Don't tell me what you hear without backup data" people to even explain what measurements they might attribute to the sense of ease, dimension, and clarity of any fine component.
Setting up a true DBT for anything is exceptionally difficult. Equalizing the variables, especially without degrading the signal path, is critical but nearly impossible. HOWEVER:
One of biggest problem in DBT testing and one that keeps the professionals wary is one of the human mind: Aural memory is exceedingly short. The brain adapts quickly to incoming signals from the ears. As the professionals acknowledge, differences between, say, two interconnects are slight. Their comparisons never are between a Sony receiver and a Mark Levinson amp because, like I said, c'mon.
Regardless of what component is under discussion, they're all made of the same basic parts. If it's true for amps, your other components should be subject to your same theory. Amps, CD players, preamps, what's the difference? I guess speaker selection must be the only thing that makes any difference in any system.
Those of you who say there is no difference between amplifiers should proceed like this: Buy a pair of speakers you like, find the cheapest integrated amplifier you can find with sufficient power for your liking, buy the cheapest source components available and plug it all together with the RCA's and power cables that come with those new gems. Get a 400' spool of lamp cord to use for speaker cable. Can you believe people pay for wires?! What a scam.
Then, hang it up. Quit thinking about your system. You have everything you'll ever need, because upgrading is just an immeasurable figment of other people's imaginations.
Me? Can't wait to upgrade my interconnects to silver.