For the record, I used to hear lots of differences between amplifiers, and I've owned a few... But a couple of years ago when I was looking for a pair of monitors, my view on this changed when I bought a pair of Harbeths. Alan Shaw, the owner/head designer of Harbeth, has a user group forum, where I was able to get lots of great info. But what surprised me, was his stance on cables and amplifiers - he doesn't recommend esoteric gear/accessories. I was surprised because his speakers are expensive, usually when I see expensive speakers, expensive cables and amplifiers are hooked up to them (and endorsed by the speaker company).
He makes a great effort on his site to give good examples as to why amplifiers and cables sound the same (unless they're doing something wrong). Below is a thread that may answer a few questions on how our senses work. It's a long thread (sorry), but Alan comes up with some great little tests (both visual, and audible) that will shed some light. Take the time to go through it - you can probably just focus mostly on his posts, to save some time...
Working with the human ear: the proper evaluation of audio equipment incl. amplifiers