Do any audio reviewers have a "Best of" type of critical review?

[AirMail]

Wondering if there's any publication (online ofc) that publishes any critical reviews that boil down to the "best" of each type of speaker / component by price bracket. Thinking along the lines of what Toms Hardware and Anandtech provide for computing products (e.g., buying guides for CPUs, video cards, etc.). Those "best" brackets would be updated as new products are introduced and knock down previous winners.

I just find that audio reviews are generally very non-commital and manufacturer-friendly on the side of reviewers. Lots of "This product makes me feel X Y Z emotions and is very good". Even sites that put a rating scale on their reviews seem to hesitate to directly pit products against each other. I understand the business drivers (manufacturers might hesitate to send out units to critical reviewers), but I think this is a major deficiency in the industry and a gap that holds back progress. Without a standard benchmark to measure against, hard to know if newer products are really any better, or who is really pushing the boundaries of what is possible.

Interested to hear your thoughts on this, and why it's not a more common approach, or any references to reviewers that have this practice.

 

[ryanosaur]

If there are, I never found them! I researched about 100 speakers last year, from July to November when I finally started auditioning. Your best bet IMO is to read reviews, cross reference reviews for the comparison speakers, and cross reference those again. Then go and listen and compare. Its the only way I know to define in your own ear-mind what sound you like.
Not the answer you want.
Why is it not common? All those reviews are subjective. How to you compile a comparitive sampling when the people comparing have their own subjective preferences?

 

[Phase 2]

Wondering if there's any publication (online ofc) that publishes any critical reviews that boil down to the "best" of each type of speaker / component by price bracket. Thinking along the lines of what Toms Hardware and Anandtech provide for computing products (e.g., buying guides for CPUs, video cards, etc.). Those "best" brackets would be updated as new products are introduced and knock down previous winners.

I just find that audio reviews are generally very non-commital and manufacturer-friendly on the side of reviewers. Lots of "This product makes me feel X Y Z emotions and is very good". Even sites that put a rating scale on their reviews seem to hesitate to directly pit products against each other. I understand the business drivers (manufacturers might hesitate to send out units to critical reviewers), but I think this is a major deficiency in the industry and a gap that holds back progress. Without a standard benchmark to measure against, hard to know if newer products are really any better, or who is really pushing the boundaries of what is possible.

Interested to hear your thoughts on this, and why it's not a more common approach, or any references to reviewers that have this practice.

You can bet your last buck, when Gene and his staff has reviewed and tested speakers you can bet and take it to the bank.

 

[ryanosaur]

You can bet your last buck, when Gene and his staff has reviewed and tested speakers you can bet and take it to the bank.

I generally agree with this. If you see any testing results... not just spec regurgitation... but real testing, that is a review to lend a bit more credibility towards!

 

[Phase 2]

I generally agree with this. If you see any testing results... not just spec regurgitation... but real testing, that is a review to lend a bit more credibility towards!

So true, nice post! with all the testing Gene does alone with his staff is why I come here first! I read a post where Gene was clearing out a storage building he has with cables and whatnots from all the testing he has done in the past. Sure Gene and his staff has to make a living, if it's BS they will call it out. Some of the members on here have had and still have some of the best speakers money can buy. They are always willing to help out. Give solid advice great tips. Gene's Audioholics site should be at the top of anyone's list as a, go-to website for unbiased straightforward , advice test results and reviews of audio speakers and gear. Thing is it's free!

 

[everettT]

It boils down to manufacturers not reviewers. The cost is on them and when it comes to an objective review, most will pass.

 

[shadyJ]

There are sites that have 'best of' audio product reviews, but its a nonsensical way to evaluate certain audio products. Let's take speakers for example, well speaker can have strengths in one category and weaknesses in others. You can't just assign a simple number or metric to them since they are application dependent. They are more like cars than PC components, and you have to look at which one is a good fit for your particular needs. While there are some speakers that really are bad, many others are a mixed bag that might excel for your situation.

 

[GrimSurfer]

... you have to look at which one is a good fit for your particular needs.

This is very true.

The best favor an audiophile can do for themselves before shopping is to take the time to define their needs. Then order these needs from top (essential) to middle (desirable) to bottom (optional) for each component.

Then look for components whose general specifications best meet needs, followed by reading reviews and getting friends' input. This will lead to the development of a reasonable list from which to audition gear.

 

[BMXTRIX]

One of the things that is very difficult is often things start at 'good' or 'very good' and run UP from there. Do B&W ceiling speakers sound better than Monoprice ceiling speakers? Likely, yes. Do they sound $400 a pair (or more) better? WELL - That is VERY subjective isn't it?

I find this to be the case with projectors all the time. When people ask what I consider the best to get for an entry level theater, I think of the JVC RS440. It's now discontinued, but just a 2018 model. So, if you can find it, for around $3,000, it's great. But, for some people $3K isn't entry level. $1,000 is. So, then you have the BenQ HT2050a, the Optoma HDR27, the Epson 3100/3700. They are ALL very good models with decent black levels and decent noise levels. They all do slightly different things slightly better than others do. I can tell you my favorite, and I can back it up. But, I can honestly say, that in a given situation, I have recommended different models at different times because of the circumstances of the installation itself.

A/V receivers are often the same way. It's possible to get measurement data, and it may be possible to spend ten times as much to get 10% greater performance, but then you aren't even talking to the right people 99% of the time. You also get into the voodoo of audiophile which isn't a place most here want to dwell.

I can say, honestly, that things in the A/V world are murky at best and it is part of the reason why A/V forums are so popular compared to some other forums out there. You can often ask a simple question, then get 10 people asking you for details about your room, your space, your budget, your goals, your setup, and once you answer them, you can start getting some recommendations and options. Some options will not fit your goals, but most likely will be credible options you can choose from. Then you can further ask questions. It becomes a two-way discussion about what will work best for your specific scenario.

 

[ryanosaur]

I can say, honestly, that things in the A/V world are murky at best and it is part of the reason why A/V forums are so popular compared to some other forums out there. You can often ask a simple question, then get 10 people asking you for details about your room, your space, your budget, your goals, your setup, and once you answer them, you can start getting some recommendations and options. Some options will not fit your goals, but most likely will be credible options you can choose from. Then you can further ask questions. It becomes a two-way discussion about what will work best for your specific scenario.

And in the process of getting advice, also learn more about the why of it!!! Especially for things like AVRs, Amps, and Subwoofers.

 

[GrimSurfer]

One of the things that is very difficult is often things start at 'good' or 'very good' and run UP from there. Do B&W ceiling speakers sound better than Monoprice ceiling speakers? Likely, yes. Do they sound $400 a pair (or more) better? WELL - That is VERY subjective isn't it?

I find this to be the case with projectors all the time. When people ask what I consider the best to get for an entry level theater, I think of the JVC RS440. It's now discontinued, but just a 2018 model. So, if you can find it, for around $3,000, it's great. But, for some people $3K isn't entry level. $1,000 is. So, then you have the BenQ HT2050a, the Optoma HDR27, the Epson 3100/3700. They are ALL very good models with decent black levels and decent noise levels. They all do slightly different things slightly better than others do. I can tell you my favorite, and I can back it up. But, I can honestly say, that in a given situation, I have recommended different models at different times because of the circumstances of the installation itself.

A/V receivers are often the same way. It's possible to get measurement data, and it may be possible to spend ten times as much to get 10% greater performance, but then you aren't even talking to the right people 99% of the time. You also get into the voodoo of audiophile which isn't a place most here want to dwell.

I can say, honestly, that things in the A/V world are murky at best and it is part of the reason why A/V forums are so popular compared to some other forums out there. You can often ask a simple question, then get 10 people asking you for details about your room, your space, your budget, your goals, your setup, and once you answer them, you can start getting some recommendations and options. Some options will not fit your goals, but most likely will be credible options you can choose from. Then you can further ask questions. It becomes a two-way discussion about what will work best for your specific scenario.

I take your point -- there's a certain point where the price/performance curve flattens. Not sure where that is exactly, but I suspect that it's somewhere after Monoprice.

It's not just performance but longevity too. Cheap components for the crossover will show after several years when the electrolytics dry out (good ones will last longer, polyester caps longer still).

The same thing applies to suspensions. Foam suspensions are cheap but disintegrate. Different grades of rubber will last a generation.

Some cone materials will warp, particularly in humid climates. Others won't.

 

[panteragstk]

Speakers are like food, wine, beer, or whiskey. One person's preference may not be another's. Motherboards and CPUs are different because it's easy to measure what makes them better. Nobody's going to have a preference for a CPU that handles computing tasks a bit slower than another because of the how good the finish on the CPU is. Motherboards, maybe if you're one of those that likes windows in your case so people can see your stuff, but even then, performance, features, and lots of other things will make your decision over whether it has pretty lights on it...at least I hope so.

 

[davidscott]

Speakers are like food, wine, beer, or whiskey. One person's preference may not be another's. Motherboards and CPUs are different because it's easy to measure what makes them better. Nobody's going to have a preference for a CPU that handles computing tasks a bit slower than another because of the how good the finish on the CPU is. Motherboards, maybe if you're one of those that likes windows in your case so people can see your stuff, but even then, performance, features, and lots of other things will make your decision over whether it has pretty lights on it...at least I hope so.

Agreed with the speaker analogy. The same can also be attributed to headphones and phono cartridges. Its always nice to be able to listen to these devices before buying if at all possible.