Oh sure, huge bumps and/or dips should raise red flags, but certain aspects such as the ability to resolve inner detail, stage depth, imaging, etc. depends on far more elements than the mere frequency response would suggest.
"Audiophool"--I love that term...assuming it wasn't directed at me! :D