While I understand your concerns, its important understand the bigger picture which I hope to outline below:
- Manufacturers don't like negative reviews. Blasting a product will usually ensure you NEVER get a review sample from that manufacturer again.
- Most consumers don't like negative reviews. They feel offended if you're too hard on a product that they bought and convinced themselves it was a good product for their needs.
- Most of the press will gush over anything new. Just look at all the gushing for the Atmos-reflection speakers when they first came out. Most of the press (except us) were regurgitating Dolby press material. We took a more critical view and were slammed by fanboys at AVS. It wasn't until Dr. Floyd Toole saw all the nonsensical claims about those speakers that he kindly helped to support my arguments with scientific facts. This still didn't win us any points with Atmos fanboys but I digress.
- Most of the press don't know how to critically analyze a product. They don't understand the basic engineering mechanics, how to measure what matters, and even if they can measure, usually not interpret meaningful info from the measurements.
- We tend to choose products we know will review well to avoid the drama of reviewing a bad product.
Forget negative reviews for a moment. Many manufacturers can't handle the slightest critical comments in reviews. I can give examples that quite frankly you wouldn't believe. I've been told by a particular manufacturer that they make the best speakers in the world regardless of price and at worst case they will be "similarly good" to a more expensive product in a blind comparison. So any criticism, including measurements we would show otherwise would automatically be invalidated based on their logic. To avoid this type of drama going forward, we are very selective of the companies we choose to do reviews for. Companies like SVS, Klipsch, Yamaha, RBH, (to name a few), are far less fussy of critical review comments. These are the type of companies that stand behind their products and are a pleasure to work with.
With all of these points considered, the consumer should also NOT be lazy. They should do their own research and use the reviews as a guideline, not a biblical source. Outside of Audio, I do just that when buying a car. I read the reviews to see how the car tests on a track. I look at the reliability ratings, maintenance costs, etc. But in the end, I don't buy a car unless I can test drive it and/or see it in person to make sure it's what I really want REGARDLESS of what the reviews claim. Fortunately it's an even easier proposition with audio since most ID companies offer generous return policies so you can try at home and send back what you don't like.
If a consumer can't make up their mind based on the data at hand and the ability to try at home, then they probably wouldn't appreciate the differences in the products they are comparing to begin with.
As for taking apart and analyzing products, we personally do that with ALMOST all products we review. When I started Audioholics I dissected everything I reviewed. It's what made us stand out from the rest of the industry that basically used stock photos and massaged press releases to describe the products and prompted this very article from a late industry insider:
http://www.audioholics.com/editorials/reviewing-home-theater-reviews
I will also remind you that while the rest of the press was gushing over the LexiCon Blu-ray player, we actually took one apart, measured and compared and revealed it was an Oppo in a fancy box. We took A LOT of heat for this from reviewers of competitor sites that tried to discredit our analysis and the audio industry in general. To this day Harman hasn't ponied up a single cent of advertising on Audioholics despite we have good working relations with all of their tech people and admire their non lexicon-oppo products and have also given MOST of their products favorable reviews.
I challenge you to find another AV publication (online or in print) that would do a full expose like this on a product or a technology like Atmos-enabled speakers. Not trying to toot my own horn but just stating a truth that Audioholics generally digs much deeper into product analysis and audio stories than the rest of the press. As a result this does NOT make us rich, but it does build a loyal readership and trust among our community of readers.
Are we perfect? Definitely not. Do we make mistakes? Hell yes! But, we do our best to learn and grow our knowledge of audio to improve the quality of our content to help our readers make more educated buying decisions. However at the end of the day, it's up to you to chose what product is right for your needs. We are happy to be here as a guideline and resource and hope others find what we report as useful.