I think the point of contention over blind testing is a simple matter of semantics.
In the literal sense blind means without sight.
However, when doing research involving people, a blind test is one where the subject has no way to know which condition they are experiencing. By this definition and with Gene's statement above, this would be a blind test.
A DBT (double blind test) requires that the person administering the test also be "blind" to which condition is which. This is the standard for good testing of subjective perceptions. It has been established that a blind test and a double blind test often have different results; while DBT's are repeatable. If the person who administers the test knows which condition is which he will unintentionally give off subtle cues which are subconsciously picked up by the subjects in the test.
In the case of testing one amp against another, there is no reason for the test administrator to be in the room with the subject (assuming the subject can be trusted to not investigate the wiring), so it would be easier to do an "Indirect DBT". I would propose the test administrator wire up an A/B switch and leave the room. The subject then would enter the room and establish which amp, A or B, was preferred and write it on a pad. The subject would then leave the room before the administrator saw the result. Some type if bell or simply a single knock on the wall could communicate when one party had completed their task. Repeat this 10 times. If the score was then 10 to 0 for one amp vs the other, it is done. Anything else, repeat the ten trials a second time.
Understand that I am no expert at this type of testing. There is probably a better protocol. I wanted to get specific to make the concepts clear and to throw out a discussion document for refinement (if that is a place this thread wants to go).
In case someone doesn't fully understand the need for the double blind test, simply consider that if the test administrator receives the info from the third trial and it is consistent with the result from the first two (a score of 3 to 0). He might (without awareness) raise an eyebrow or betray some subtle hint of congratulation or respect to the subject.
The next question is what does a 9 out of 10 score mean? 8 out of 10?
I don't think either would be conclusive, but repeating the entire test and scoring 9 out of 10 for the same amp as the first round would make for a significant result.