One interesting (to me) issue of the hearing-tasting sense comparison is that of the flavor of the food/music. Let's look at the flavoring of foods. I'm particularly fond of savory and highly spiced foods. My wife prefers lighter and sweeter faire. In hearing, the listener's brain, for whatever reason, also has a preference for audio/sound/music "flavoring". I like rock and roll...my wife prefers pop or classical. Furthermore, some speakers are better suited to those styles of music. I wouldn't hesitate to put a dynamic JBL or Cerwin-Vega into a rock setting. But they wouldn't do much for me on quiet jazz.
Now I haven't read those articles listed by Andrew, so I'm not familiar with Toole's testing methodology. But I'd guess that the "flavor" of the music/sounds used by Toole
et al was not controlled for listener preference. (Andrew or someone please verify this.) As an example of possible result skewing...if I was in the controlled study, was asked to listen to loudspeakers presenting rock music...speakers that played well with rock, I'd probably like them. If they were quite reserved speakers more appropriate for that breathy Diana Krall stuff, I may not like them at all on the rock music. OTOH, I may prefer the more laid-back ones with a Krall style of music.
Does this make any sense to anyone? Probably not. I'm just blowin' old guy smoke here.